WO2005112446A1 - 画像処理装置 - Google Patents
画像処理装置 Download PDFInfo
- Publication number
- WO2005112446A1 WO2005112446A1 PCT/JP2005/007750 JP2005007750W WO2005112446A1 WO 2005112446 A1 WO2005112446 A1 WO 2005112446A1 JP 2005007750 W JP2005007750 W JP 2005007750W WO 2005112446 A1 WO2005112446 A1 WO 2005112446A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- axis direction
- time axis
- image data
- screens
- decoding
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/7921—Processing of colour television signals in connection with recording for more than one processing mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/114—Adapting the group of pictures [GOP] structure, e.g. number of B-frames between two anchor frames
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/146—Data rate or code amount at the encoder output
- H04N19/15—Data rate or code amount at the encoder output by monitoring actual compressed data size at the memory before deciding storage at the transmission buffer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/177—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a group of pictures [GOP]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/765—Interface circuits between an apparatus for recording and another apparatus
- H04N5/77—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
- H04N5/772—Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/79—Processing of colour television signals in connection with recording
- H04N9/80—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
- H04N9/804—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components
- H04N9/8042—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction
- H04N9/8047—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback involving pulse code modulation of the colour picture signal components involving data reduction using transform coding
Definitions
- the present invention relates to an image processing apparatus, and more particularly, to an image processing apparatus that processes image data of a plurality of screens including, for example, an intra-coded screen and an inter-coded screen.
- the MPEG video decoder decodes the re-encoded data sequence thus generated in the reverse direction, and outputs the decoded image data to the display circuit. Thereby, smooth reverse reproduction is realized.
- the circuit scale is increased because two MPEG decoders need to be prepared.
- a main object of the present invention is to provide a novel image processing device.
- Another object of the present invention is to reduce the circuit scale, and to provide image data of a plurality of screens which have been subjected to intra-encoding and in-encoding along the first time axis direction as the first time axis direction.
- the object of the present invention is to provide an image processing apparatus capable of reproducing in the second time axis direction in the reverse direction.
- the image processing device comprises: a first time axis; A plurality of blocks each containing image data of multiple screens in which the first screen is subjected to intra coding and the screen following the first screen in the first time axis direction is inter-coded.
- Designation means for sequentially designating along the second time axis direction; first decoding means for sequentially decoding image data of a plurality of screens included in the block designated by the designation means along the first time axis direction; (1) an encoding means for performing the intra-encoding along the first time axis direction on each of the image data of a plurality of screens decoded by the decoding means; and the plurality of screens coded by the coding means.
- Second decoding means for sequentially decoding the image data in the second time axis direction.
- Each of the plurality of blocks is composed of a plurality of screens in which the first screen in the first time axis direction has been subjected to the encoder coding and the screen subsequent to the first screen in the first time axis direction has been subjected to the inter-coding.
- the specifying means sequentially specifies the plurality of blocks along a second time axis direction opposite to the first time axis direction.
- the first decoding means decodes the image data of a plurality of screens included in the specified block in order along the first time axis direction, and the encoding means decodes each of the decoded image data of the plurality of screens. Intra coding is performed along the first time axis direction.
- the encoded image data of a plurality of screens is sequentially decoded by the second decoding means along the second time axis direction.
- the image data decoded in the first time axis direction by the first encoding means is subjected to the encoder encoding in the first time axis direction by the encoding means.
- the image data that has been subjected to the intra coding is thereafter decoded in the second time axis direction by the second decoding means.
- the image processing device further comprises a determining means for determining whether or not the number of screens subjected to intra coding is equal to or greater than a threshold value, and the second decoding means includes a determining means. When the determination result is affirmative, the decoding process is performed.
- the intra-coding process of the image data is executed along the first time axis direction, while the decoding process of the intra-coded image data is executed along the second time axis direction. Therefore, in claim 2, it is determined whether or not the number of screens subjected to intra-encoding exceeds a threshold value, and the decoding process is executed when the determination result is positive. In this way, processing failure is avoided. According to claim 3 depending on claim 1 or 2, the processing of the encoding means and the processing of the second decoding means follow the JPEG method.
- the image processing program executed by the processor of the image processing device comprises: the first screen in the first time axis direction is intra-coded and the first screen in the first time axis direction; A designation step of sequentially designating a plurality of blocks each including image data of a plurality of screens in which a screen subsequent to the screen is subjected to the inter-encoding along a second time axis direction opposite to the first time axis direction; A first decoding step of sequentially decoding the image data of a plurality of screens included in the block specified by the specifying step along the first time axis direction; a multi-screen image data decoded by the first decoding step; A coding step of performing the intra coding along the first time axis direction; and decoding the image data of a plurality of screens coded by the coding step in order along the second time axis direction Second decryption step.
- the image data decoded in the first time axis direction by the first decoding step is subjected to the intra coding in the first time axis direction by the encoding step.
- the image data that has been intra-coded is then decoded in the second time axis direction in a second decoding step.
- the image processing device comprises: the first screen in the first time axis direction is subjected to the intra coding, and the screen following the first screen in the first time axis direction is subjected to the inter coding.
- a processor that sequentially specifies a plurality of blocks each including the image data of a plurality of screens along a second time axis direction opposite to the first time axis direction; a plurality of blocks included in a block specified by the processor.
- a decoder for sequentially decoding the image data of the screen along the first time axis direction; and a decoder for decoding the image data of the plurality of screens decoded by the decoder along the first time axis direction. Cotec that decodes image data of multiple screens that have been subjected to intra coding in order along the second time axis direction.
- Each of the plurality of blocks has the first screen in the first time axis direction subjected to intra coding.
- the screen following the first screen in the first time axis direction includes image data of a plurality of screens that have been subjected to inter-coding.
- the processor sequentially designates the plurality of blocks along a second time axis direction opposite to the first time axis direction.
- the decoder sequentially decodes image data of a plurality of screens included in the specified block along the first time axis direction.
- the codec performs intra-encoding on each of the decoded image data of the plurality of screens along the first time axis direction, and converts the encoded image data of the plurality of screens along the second time axis direction. Decode in order.
- the image data can be reproduced in the second time axis direction while suppressing the circuit scale.
- the processor instructs the codec to perform the encoding process and the decoding process alternately, and the codec executes the process according to the command from the processor.
- FIG. 1 is a block diagram showing a configuration of one embodiment of the present invention
- FIG. 2 is an illustrative view showing one example of a mapping state of the SDRAM applied to the embodiment of FIG. 1;
- FIG. 3 is an illustrative view showing a part of the operation of the embodiment in FIG. 1;
- FIG. 4 is an illustrative view showing another portion of the operation of the FIG. 1 embodiment
- FIG. 5A is an illustrative view showing another portion of the operation of the embodiment in FIG. 1;
- FIG. 5 (B) is an illustrative view showing another part of the operation of the FIG. 1 embodiment
- FIG. 5 (C) is an illustrative view showing still another part of the operation of the FIG. 1 embodiment
- 5 (D) is an illustrative view showing another portion of the operation of the embodiment in FIG. 1;
- FIG. 6 is a flowchart showing a part of the operation of the CPU applied to the embodiment of FIG. 1;
- FIG. 7 is a flowchart showing another part of the operation of the CPU applied to the embodiment of FIG.
- FIG. 8 is a front view showing another part of the operation of the CPU applied to the embodiment of FIG. And;
- FIG. 9 is a front view showing still another part of the operation of the CPU applied to the embodiment of FIG. 1;
- FIG. 10 is a flowchart showing another part of the operation of the CPU applied to the embodiment of FIG. 1;
- FIG. 11 is a flowchart showing another part of the operation of the CPU applied to the embodiment of FIG. 1;
- FIG. 12 is a flowchart showing yet another portion of the operation of the CPU applied to the embodiment in FIG. BEST MODE FOR CARRYING OUT THE INVENTION
- a digital video camera 10 of this embodiment includes an optical lens 12.
- the optical image of the object scene is applied to the image plane of the image sensor 14 through the optical lens 12.
- a charge corresponding to an optical image of the object scene, that is, a raw image signal is generated by photoelectric conversion.
- the CPU 36 instructs the driver 16 to repeat pre-exposure and thinning-out reading.
- the driver 16 repeatedly executes the pre-exposure of the image sensor 14 and the thinning-out reading of the raw image signal generated thereby.
- the pre-exposure and the thinning-out reading are executed in response to the vertical synchronization signal Vsync 1 output from the frequency divider 34 based on the clock CLK1.
- the vertical sync signal V sync 1 is generated once every 130 seconds, and the low-resolution raw image signal corresponding to the optical image of the object scene is output from the image sensor 14 at a frame rate of 30 fps. .
- the output raw image signal of each frame is subjected to a series of processes of noise removal, level adjustment, and AZD conversion by the circuit 18 and is a digital signal.
- the raw image data is obtained
- the signal processing circuit 20 adds white balance adjustment, color separation, and white balance to the raw image data output from the CDS AGCZAD circuit 18. Performs processing such as YUV conversion to generate image data in YUV format.
- the generated image data of each frame is written into the SDRAM 26 by the memory control circuit 24.
- the video encoder 28 requests the memory control circuit 24 to read image data in response to the vertical synchronizing signal Vsync2 output from the frequency divider 32 based on the clock CLK2.
- the vertical synchronizing signal Vsync2 is also generated once every 30 seconds, and the image data is transferred from the SDRAM 26 to the video encoder 28 at a frame rate of 30 fps.
- the video encoder 28 converts the transferred image data into a composite video signal according to the NTSC format, and supplies the converted composite video signal to the LCD monitor 30. As a result, a through image of the object scene is displayed on the monitor screen. Although description is omitted as appropriate below, access to the SDRAM 26 is always performed through the memory control circuit 24.
- the CPU 36 instructs the driver 16 to perform one main exposure and one readout of all pixels.
- the driver 16 executes the main exposure of the image sensor 14 and the reading of all the pixels of the raw image signal generated by the main exposure once.
- a high-resolution raw image signal corresponding to the optical image of the object scene is output from the image sensor 14.
- the output raw image signal is converted into a YUV format still image data by the same processing as described above, and the converted still image data is written to the SDRAM 26.
- the CPU 36 also issues a compression instruction to the JPEG codec 40.
- the JPEG codec 40 reads still image data from the SDRAM 26, performs JPEG compression on the read still image data, and writes the compressed still image data, that is, JPEG data, to the SDRAM 26. Thereafter, the CPU 36 reads the JPEG data from the SDRA M26, and records the JPEG file including the read JPEG data on the recording medium 44 through the IZF 42.
- the recording medium 44 is a detachable semiconductor memory, and can be accessed by the IZF 42 when the recording medium 44 is mounted in a slot (not shown).
- the CPU 36 When the through image is displayed on the LCD monitor 30, When operated, the CPU 36 activates the MPEG4 codec 34.
- the MPEG-4 codec 34 reads the image data of each frame from the SDRAM 26 every time the vertical synchronization signal Vsync 1 is generated, and performs a compression process on the read image data in accordance with the MPEG 4 format simple profile. Apply. In the image data, intra coding is applied approximately once every 15 frames, and inter coding is applied to the remaining frames.
- the generated compressed moving image data that is, MPEG data, is written to the SDRAM 26.
- Intra-coded frames are defined as "I-frames", and inter-coded frames are defined as "P-frames".
- a lump composed of an I frame and a plurality of P frames following it is defined as a "GOP (Group Of Pictures)”. Then, the MPEG data has the data structure shown in FIG. Each GOP is assigned an identification number starting with "0".
- the CPU 40 periodically reads out the MPEG data stored in the SDRAM 26 and records the read MPEG data on the recording medium 44 through the I / F 42.
- the CPU 36 disables the MPEG4 codec 38 and records the MPEG data remaining in the SDRAM 26 on the recording medium 44.
- an MPEG file including a plurality of frames of MPEG data is created.
- the CPU 36 stores the JPEG data stored in the JPEG file in the recording medium 44.
- the JPEG decoder 40 reads the JPEG data from the SDRAM 26, decompresses the read JPEG data, and writes the decompressed image data to the SDRAM 26.
- the video encoder 28 reads the image data from the SDRAM 26 every time the vertical synchronization signal Vsync 2 is generated, converts the read image data into an NTSC C format composite video signal, and converts the converted composite video signal. Signal to the LCD monitor 30.
- the reproduction processing of this MPEG file is executed.
- the CPU 36 transfers the MPEG data of the first frame stored in the MPEG file from the recording medium 44 to the SDRAM 26, and gives a decompression instruction to the MPEG4 codec 38.
- the MPEG codec 38 reads the MPEG data of the first frame from the SDRAM 26, decompresses the read MPEG data, and writes the decompressed image data to the SDRAM 26.
- the video encoder 28 performs the same processing as described above. As a result, the still image of the first frame is displayed on the LCD monitor 30.
- the CPU 36 transfers the MPEG data stored in the desired MPEG file to the SDRAM 26 by 1 GOP at a cycle corresponding to 1 GOP, and responds to the vertical synchronization signal Vsync 1 to the MPEG4 codec 38 To the decompression instruction.
- the MPEG4 codec 38 performs the same processing as described above in response to the vertical synchronization signal Vsync1.
- the video encoder 28 reads image data from the SDRAM 26 every time the vertical sync signal Vsync 2 is generated, converts the read image data into an NTSC C-format composite video signal, and converts the image data.
- the supplied composite video signal is supplied to the LCD monitor 30. As a result, the moving image following the first frame is displayed on the LCD monitor 30.
- the CPU 36 executes the MPEG decompression task shown in FIGS. 6 and 7, the JPEG compression task shown in FIGS. 8 to 10, the JPEG decompression task shown in FIG. 11, and the display task shown in FIG. 12 in parallel. .
- the CPU 36 executes the tasks shown in FIGS. 6 to 12 under the control of a multitask OS such as ITRON.
- a control program corresponding to such a task is stored in the flash memory 22.
- the SDRAM 26 is mapped as shown in FIG. Bank 26a Bank 0), Bank 26b (Bank 1) and Bank 26c (Bank 2)
- Each is an area for storing one frame of decompressed image data.
- the JPEG data area 26c is an area for storing JPEG data of each frame.
- the J PEG index area 26e is an area for storing the start address value of the J PEG data of each frame stored in the J PEG data overnight area 26d, and includes 45 columns JPEG—index [0] to JPEG—. It is formed by index [44].
- the MPEG 4 data area 26f is an area for storing the MPEG data read from the recording medium 44.
- the transfer of MPEG data from the recording medium 44 to the MPEG4 data area 26f is periodically executed by a task (not shown).
- step S1 various variables are initialized. Specifically, set the GO P number gop—mmi to “#”, set the number of frames vop_num to “*”, set the column number K to “vop—mini—1”, and set the address value jenc— Set adr to "JPG —START".
- the flags mdec—end, jenc_flg, jdec—flg and disp fig are set to 0, the frame numbers mdec_num, jenc num, and jdec—nrn are set to “0”, and the bank number is set.
- Set mbank, jbank and dbank to "0".
- the GOP number gop_num is the identification number of the G ⁇ P of interest
- “#” indicates the identification number of the GOP to which the frame that was being played back when the reverse moving image playback was instructed belongs.
- the number of frames vop—num is the number of frames to be played from the GOP of interest
- “*” is “1” for the number of the frame that was playing when the reverse video playback was instructed. Indicates the added value.
- Column number K is the identification number of the column formed in JPEG index area 26e shown in FIG.
- the address value jenc-adr is the address value at which writing of the JPEG data is started
- "JPG-START" is the start address value of the JPEG data area 26d.
- the flag mdec end indicates that the playback frame reaches the first frame of the MPEG file. This is a flag for identifying whether or not the operation has been performed. "0" means not reached, “1” means reached.
- the flag jenc1 fig is a flag for identifying whether or not to permit the JPEG codec 40 compression processing. "0” means forbidden, “1” means allowed.
- the flag jdec-fig is a flag for identifying whether or not to permit the decompression processing of the JPEG codec 40. "0” means forbidden and “1” means allowed.
- the flag disp-flg is a flag for identifying whether or not the encoding process of the video encoder 28 is permitted. "0” means prohibition, "1" means permission.
- the frame number mdec-num is an identification number of a frame to be expanded by the MPEG4 codec 38.
- the frame number jenc-num is an identification number of a frame to be compressed by the JPEG codec 40.
- the frame number jdec-num is the identification number of the frame to be expanded by the JPEG codec 40.
- the bank number mbank is an identification number of a bank in which one frame of image data expanded by the MPEG4 codec 38 is to be stored.
- the bank number jbank is used to identify a bank in which one frame of image data to be compressed by the JPEG codec 40 or a bank in which one frame of image data decompressed by the JPEG codec 40 is to be stored.
- the bank number dbank is the identification number of the bank in which one frame of image data to be displayed on the LCD module 30 is stored.
- the flag mdec-end is set to "1" in step S37 described later when the playback frame reaches the first frame of the MPEG file.
- Step S7 is a step for setting the flag; jdec-flg to "1" in place of step S69 described later after JPEG compression of the first frame of the MPEG file is completed.
- the frame number mdec_num is set to the frame number jenc_num.
- the number of frames vop—num is set to the number of frames] 'vop_nmn
- the GOP number gop—num is set to the GOP number jgop—num
- step S15 the bank number mbank is the bank number; Set to jbank.
- Frame number mdec num, frame number vo _ num, GP 3 ⁇ 4> go— _ num and bank number mbank are referenced in the MPEG decompression task, and frame number jenc— num, frame number jvop _ num, and GOP number j go _ num.
- the jbank number is also referred to in the JPEG compression task.
- a one-frame decompression instruction is issued to the MPEG4 codec 38.
- the issued decompression instruction includes a GOP number gop-num, a frame number mdec-num, and a puncture number mbank.
- the MPEG4 codec 38 reads and reads one frame of MPEG data specified by the GOP number gop—nrnn and the frame number mdec—num from the MPEG4 data area 26 # shown in FIG.
- the expanded MPEG data is expanded, and the expanded image data is written to the bank corresponding to the bank number mbank among the banks 0 to 2 shown in FIG.
- YES is determined in step S19, and the flag jenc-fig is set to "1" in step S21.
- step S23 the bank number mbank is updated according to Equation 1. According to Equation 1, the remainder obtained by dividing "mbank + l" by "3" is set as the bank number mbank.
- step S25 the frame number mdec-num is incremented, and in step S27, it is determined whether or not the incremented frame number mdec-num matches the frame number vop-num. If NO here, it is considered that MPEG expansion of the frame to be reproduced from the GOP of interest has not been completed yet, and the direct step S Return to 3.
- step S27 the GOP number gop—nuni is decremented in step S29 to change the GOP of interest.
- step S31 it is determined whether or not the decremented G P number gop_num is less than "0".
- step S33 the flow advances to step S33 to set the number of frames vop-num to the number of GOP frames corresponding to the G0P number gop-nvrai. After that, in step S35, the frame number mdec-num is set to "0", and the process returns to step S3. On the other hand, if the GOP number gop-num is less than "0", the flag mdec-end is set to "1" in step S37 to end the MPEG extension processing. Upon completion of the process in the step S37, the process returns to the step S3.
- step S41 it is determined whether or not flag jenc-flg indicates "1". If YES, the process proceeds to step S43. As described above, the flag jenc-fig is updated to "1" in step S21 when the first MPEG expansion is completed. Therefore, the processing after step S43 is started when one frame of image data is secured in the bank corresponding to the bank number mbank.
- a compression instruction is issued to the JPEG codec 40.
- the J PEG codec 40 reads one frame of image data from the bank corresponding to bank number] 'bank among banks 0 to 2 shown in FIG. 4, performs J PEG compression on the read image data, Then, the generated JPEG data is written after the address corresponding to the address value jenc-adr of the JPEG data area 26 d shown in FIG.
- step S45 When J PEG compression is completed, YES is determined in step S45, and step S47 Writes the address value jenc-adr to the column JPEG-index [K] in the JPEG index area 26 e shown in Fig. 2.
- step S49 the address value jenc-adr is updated according to equation 2, and in step S51 it is determined whether the condition of equation 3 is satisfied.
- jenc— adr jenc one adr + flt
- the “compressed size” shown in Expressions 2 and 3 is the size of the JPEG data created by the process in the immediately preceding step S43.
- “JPEG-END” is the end address value of the JPEG data area 26 d shown in FIG. 2, and “HI” is the margin.
- step S55 the column number K is decremented, and in subsequent step S57, it is determined whether or not the column number K is less than "0". If the column number K is "0" or more, go directly to step S61. On the other hand, if the column number is less than "0", the column number K is set to "MAX-J-IDX-1" in step S59, and then the process proceeds to step S61.
- “MAX—J—IDX” is the total number of columns formed in the JPEG index area 26 d. As can be seen from FIG. 2, "MAX-J-IDX” indicates "45" in this embodiment.
- step S61 it is determined whether or not the frame number jenc-num matches "jvop-num-1". That is, it is determined whether or not the frame subjected to JPEG compression is the last frame to be reproduced from the focused GOP. If NO here, it is determined in step S63 whether or not the GOP number jgop_nmn is equal to or more than "# -2", and the address value written in the column JPEG__indextjdec—mmi] exceeds "0" It is determined in step S65 whether or not this is the case.
- step S63 a sufficient number of frames of JPEG data are This is a step for determining whether or not the data is stored in the file 26d.
- Step S65 is a step for determining whether or not a valid address value is set in the column JPEG-indexlj'dec-num].
- step S69 If one of steps S63 and S65 is determined to be N ⁇ , the process directly proceeds to step S69. If YES is determined in both steps S65 and S67, the flag jdec-fig is set to "1" in step S67, and the process proceeds to step S69. By the processing of step S67, the processing of step S93 and thereafter shown in FIG. 11 is started. In step S69, a flag is set to prohibit the JPEG compression processing;
- the column number K is updated to “K + jvop_num” in a step S71, and in a step S73, the updated column number K is equal to or more than “MAX—J-IDX”. Determine whether or not. If “NO” here, the process directly proceeds to the step S77. If “YES”, the variable K is updated to “K—MAX—J—IDX” in a step S75, and then the process proceeds to a step S77. As a result, the columns formed in the JPEG index area 26e are designated cyclically. -In step S77, the GOP number jgop-nrnn is decremented.
- step S81 it is determined whether or not the updated GOP number jgop-nrnn is "0". If YES is determined here, the flag jenc-fig is set to "0" in a step S79, and the process returns to the step S41.
- step S77 the processes in and after the step S81 are executed.
- step S81 the number of frames of the GOP corresponding to the GOP number jgop-nrnn is added to the column number K, and the column number K is updated with the added value obtained thereby.
- step S83 it is determined whether or not the updated column number K is equal to or greater than "MAX-J-IDX". If NO, the process directly proceeds to step S63. If YES, the column number K is updated to “K—MAX__J—IDX” in step S85, and then the process proceeds to step S63.
- JPEG compression image data of each frame decompressed in the forward direction from each GOP specified in the reverse direction is subjected to JPEG compression in the forward direction.
- the JPEG data of each frame obtained in this way is stored in the JPEG data area 26 d Is written to.
- the start address value of the JPEG data of each frame is written to the JPEG index area 26e in the manner shown in FIGS. 5 (A) to 5 (D).
- the three start address values for the three frames of GOP (n + 1) are stored in columns JPEG—index [2] to JPEG—index [0] as shown in FIG. ] Respectively.
- the 15 start address values for the 15 frames of GOP (n) are written to columns JPEG-index [17] to JPEG-index [3], respectively, as shown in Fig. 5 (B).
- step S63 When JPEG compression for GOP (n-1) is started, YES is determined in step S63 (and S65), and the flag; jdec-fig is set to "1" in step S67. That is, decompression processing of JPEG data is permitted.
- the start address value stored in the JPEG index area 26e is read by the JPEG decompression task described later in the manner shown in FIGS. 5C and 5D.
- the first 3 start address values are written to JPEG-index [2] to JPEG-index [0], respectively, and the remaining 12
- the first address values are written in JPEG-index [44] to JPEG-index [32], respectively (see Fig. 5 (D)).
- step S91 it is determined whether or not flag jdec-fig indicates "1". If YES, a one-frame decompression instruction is given to JPEG codec 40 in step S93.
- the decompression instruction includes the address value written in the column; jpeg—indextjdec—num] and the bank number; jbank.
- the JPEG codec 40 reads one frame of JPEG data from the JPEG data area 26e according to the address value included in the decompression instruction, decompresses the read JPEG data, and decompresses the decompressed image data. Bank number; Write to the bank corresponding to jbank.
- step S95 When the JPEG decompression process is completed, YES is determined in step S95, the flag disp-flg is set to "1" in step S97, and the column number jdec-mim is incremented in step S99.
- step S101 it is determined whether or not the updated column number; jdec-nmn is greater than or equal to "MAX-J-IDX”. If NO here, go directly to step S105, but if YES, step S1 In column 03, the column number jdec—num is set to “0”, and the process proceeds to step S105.
- step S105 the flag; jdec-fig is set to "0", and the process returns to step S91.
- the start address value of the JPEG data of each frame is read from the JPEG index area 26d in the manner shown in FIGS. 5 (A) to 5 (D).
- step S111 it is determined whether or not flag disp_fig is "1". If “YES” here, the generation of the vertical synchronization signal Vsync 2 is waited for in step S113, and then the puncture number dbank is updated in accordance with equation 4 in step S115. According to Equation 4, the remainder obtained by dividing "; jbank + 2" by "3" is set as the bank number dbank.
- step S117 the updated bank number dbank is set in the video encoder 28, and the process returns to step S111.
- the banks 0 to 2 shown in FIG. 2 are cyclically designated by the powerful display task, and a moving image moving in the opposite direction is displayed on the LCD monitor 30.
- each of the plurality of GOPs is an image of a plurality of frames in which the first frame in the forward direction is subjected to the intra coding and the frame following the first frame in the forward direction is subjected to the inter coding.
- the CPU 36 sequentially specifies the plurality of GOP blocks in the reverse direction (S29).
- the MP EG 4 codec 38 forwardly decodes the image data of a plurality of frames included in the specified GOP, and the JP EG codec 40 forwardly decodes each of the decoded image data of the plurality of frames.
- Intra coding is performed.
- the CPU 36 determines whether or not the number of frames subjected to the intra code is equal to or larger than a threshold (S63). When the determination result of the CPU 36 is affirmative, the J PEG codec 40 decodes the image data of a plurality of frames that have been intra-coded in the reverse direction.
- the image data decoded in the forward direction by the MPEG4 codec 38 is intra-coded in the forward direction by the JPEG codec 40.
- Intra The encoded image data is then decoded in the reverse direction by the JPEG codec 40.
- the JPEG system is adopted for the intra coding of the image data of each frame.
- the JPEG2000 system may be adopted instead of the JPEG system.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
Description
Claims
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/596,673 US20080008453A1 (en) | 2004-05-17 | 2005-04-18 | Image Processing Apparatus |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2004-146162 | 2004-05-17 | ||
JP2004146162A JP4190458B2 (ja) | 2004-05-17 | 2004-05-17 | 画像処理装置 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2005112446A1 true WO2005112446A1 (ja) | 2005-11-24 |
Family
ID=35394526
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2005/007750 WO2005112446A1 (ja) | 2004-05-17 | 2005-04-18 | 画像処理装置 |
Country Status (4)
Country | Link |
---|---|
US (1) | US20080008453A1 (ja) |
JP (1) | JP4190458B2 (ja) |
CN (1) | CN100563321C (ja) |
WO (1) | WO2005112446A1 (ja) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102723986A (zh) * | 2012-06-28 | 2012-10-10 | 无锡莱吉特信息科技有限公司 | 基于usb接口的水下led通信系统 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07162805A (ja) * | 1993-12-08 | 1995-06-23 | Toshiba Corp | 圧縮画像用特殊再生装置 |
JPH1032787A (ja) * | 1996-07-16 | 1998-02-03 | Fujitsu Ltd | リアルタイム逆方向再生用動画像符号化方式 |
JPH11252507A (ja) * | 1998-02-27 | 1999-09-17 | Sony Corp | 映像信号再生装置及びその方法並びに映像信号記録再生装置及びその方法 |
JP2001333384A (ja) * | 1999-12-15 | 2001-11-30 | Sanyo Electric Co Ltd | 画像処理方法とこの方法を利用可能な画像処理装置およびテレビジョン受像機 |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7706445B2 (en) * | 2001-05-31 | 2010-04-27 | Sanyo Electric Co., Ltd. | Image processing employing picture type conversion |
US7245821B2 (en) * | 2001-05-31 | 2007-07-17 | Sanyo Electric Co., Ltd. | Image processing using shared frame memory |
US7940844B2 (en) * | 2002-06-18 | 2011-05-10 | Qualcomm Incorporated | Video encoding and decoding techniques |
-
2004
- 2004-05-17 JP JP2004146162A patent/JP4190458B2/ja not_active Expired - Fee Related
-
2005
- 2005-04-18 US US11/596,673 patent/US20080008453A1/en not_active Abandoned
- 2005-04-18 CN CNB2005800095335A patent/CN100563321C/zh not_active Expired - Fee Related
- 2005-04-18 WO PCT/JP2005/007750 patent/WO2005112446A1/ja active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH07162805A (ja) * | 1993-12-08 | 1995-06-23 | Toshiba Corp | 圧縮画像用特殊再生装置 |
JPH1032787A (ja) * | 1996-07-16 | 1998-02-03 | Fujitsu Ltd | リアルタイム逆方向再生用動画像符号化方式 |
JPH11252507A (ja) * | 1998-02-27 | 1999-09-17 | Sony Corp | 映像信号再生装置及びその方法並びに映像信号記録再生装置及びその方法 |
JP2001333384A (ja) * | 1999-12-15 | 2001-11-30 | Sanyo Electric Co Ltd | 画像処理方法とこの方法を利用可能な画像処理装置およびテレビジョン受像機 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102723986A (zh) * | 2012-06-28 | 2012-10-10 | 无锡莱吉特信息科技有限公司 | 基于usb接口的水下led通信系统 |
Also Published As
Publication number | Publication date |
---|---|
US20080008453A1 (en) | 2008-01-10 |
CN100563321C (zh) | 2009-11-25 |
JP2005328432A (ja) | 2005-11-24 |
CN1934859A (zh) | 2007-03-21 |
JP4190458B2 (ja) | 2008-12-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
KR101015737B1 (ko) | 기록 방법, 기록 장치, 기록 매체, 촬상 장치, 및 촬상 방법 | |
JP4682102B2 (ja) | 画像符号化装置及び画像符号化方法 | |
JP2010074241A (ja) | 動画再生装置、動画再生方法、プログラム及び記録媒体 | |
US20090153677A1 (en) | Recording and reproduction apparatus and methods, and a recording medium storing a computer program for executing the methods | |
JP2004015580A (ja) | 記録装置 | |
JP2005039792A (ja) | 記録装置及び再生装置 | |
WO2005112446A1 (ja) | 画像処理装置 | |
US7991265B2 (en) | Content recording apparatus capable of recording long content output | |
JP2004193695A (ja) | 記録再生装置及び方法 | |
JP2009272921A (ja) | 動画像記録装置、動画像再生装置、動画像記録方法、動画像再生方法および半導体集積回路 | |
WO2005081521A1 (ja) | ファイルアクセス装置 | |
JP2000287162A (ja) | ディジタルカメラおよび動画像再生装置 | |
JP2004140630A (ja) | フレーム間引き処理を行うための画像圧縮方法及び装置 | |
JP2008097727A (ja) | 動画再生装置 | |
JP4446669B2 (ja) | 動画データの記録方法及びその再生方法並びに動画データの記録装置及びその再生装置 | |
JP2007324663A (ja) | ビデオカメラ | |
JP2005300943A (ja) | 情報表示位置制御方法及び装置 | |
JP4420778B2 (ja) | 動画像再生装置 | |
JP2005348258A (ja) | 撮影装置及び方法、並びにプログラム及び記憶媒体 | |
JP2005229553A (ja) | 画像処理装置 | |
JP2013058853A (ja) | 動画再生装置、動画再生方法及びプログラム | |
JP4298583B2 (ja) | 撮像装置および携帯電話 | |
KR101332299B1 (ko) | 영상기록장치 및 방법 | |
JP4164696B2 (ja) | 撮像装置および撮像方法 | |
JP2007081463A (ja) | 画像処理装置及び方法 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 200580009533.5 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 11596673 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWW | Wipo information: withdrawn in national office |
Country of ref document: DE |
|
122 | Ep: pct application non-entry in european phase | ||
WWP | Wipo information: published in national office |
Ref document number: 11596673 Country of ref document: US |