CN1964460A - Recording and playback apparatus and recording and playback method, recording apparatus and recording method, playback apparatus and playback method, and program - Google Patents

Recording and playback apparatus and recording and playback method, recording apparatus and recording method, playback apparatus and playback method, and program Download PDF

Info

Publication number
CN1964460A
CN1964460A CNA2006101439793A CN200610143979A CN1964460A CN 1964460 A CN1964460 A CN 1964460A CN A2006101439793 A CNA2006101439793 A CN A2006101439793A CN 200610143979 A CN200610143979 A CN 200610143979A CN 1964460 A CN1964460 A CN 1964460A
Authority
CN
China
Prior art keywords
image
recording medium
kinematic parameter
kinematic
parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2006101439793A
Other languages
Chinese (zh)
Other versions
CN100592778C (en
Inventor
平井纯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Corp filed Critical Sony Corp
Publication of CN1964460A publication Critical patent/CN1964460A/en
Application granted granted Critical
Publication of CN100592778C publication Critical patent/CN100592778C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • H04N5/77Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera
    • H04N5/772Interface circuits between an apparatus for recording and another apparatus between a recording apparatus and a television camera the recording apparatus and the television camera being placed in the same enclosure
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/20Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding
    • H04N19/29Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video object coding involving scalability at the object level, e.g. video object layer [VOL]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor
    • H04N5/92Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/20Analysis of motion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/50Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
    • H04N19/503Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
    • H04N19/51Motion estimation or motion compensation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/14Picture signal circuitry for video frequency region
    • H04N5/144Movement detection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/91Television signal processing therefor
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/01Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/765Interface circuits between an apparatus for recording and another apparatus
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording
    • H04N5/78Television signal recording using magnetic recording
    • H04N5/781Television signal recording using magnetic recording on disks or drums

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Television Signal Processing For Recording (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Television Systems (AREA)
  • Studio Devices (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention refers to a recording and playback apparatus and a recording and playback method, a recording apparatus and a recording method, a playback apparatus and a playback method, and a program. A recording and playback apparatus includes a first obtaining unit configured to obtain one or more moving parameters regarding motion from a first image; a converter configured to convert the first image into a second image composed of a lesser amount of data than the first image; a recording controller configured to record moving parameter information and the second image on a recording medium, the moving parameter information relating to the moving parameters of the first image; a reading controller configured to read the moving parameter information and the second image from the recording medium; and an image processor configured to execute image processing on the second image read from the recording medium using the moving parameters of the first image, the moving parameters of the first image being obtained from the moving parameter information read from the recording medium.

Description

Record and reproducing device and method, recording equipment and method, reproducing device and method and program
The cross reference of intersecting application
The present invention comprises the relevant theme of submitting in Japan Patent office with on November 7th, 2005 of Japanese patent application JP2005-322405, and its full content is incorporated herein for your guidance.
Technical field
The present invention relates to record and reproducing device and record and playback method, recording equipment and recording method, reproducing device and playback method and program.More particularly, the present invention relates to for example write down and reproducing device and record and playback method, recording equipment and recording method, reproducing device and playback method and program, by them, obtain the high precision kinematic parameter in advance so that kinematic parameter can be used for various image processing.
Background technology
At record and reproducing device, such as DVR, write down the image that image for example and broadcast are recorded, in some cases, on image to be recorded, carry out and handle so that save the recording capacity of hard disk.
More particularly, for example, the pixel of each frame by extraction picture frame to be recorded or abstract image reduces the data volume of image.When playing image, the image of being made up of the data volume that reduces obtains sports kinematic parameter, and such as motion vector, and this kinematic parameter is used for image processing, reduces such as noise.
In Japanese Unexamined Patent Application publication number No.8-149480 for example, the method that obtains as the motion vector of the kinematic parameter of image has been described.
Summary of the invention
When the image be made up of the data of relatively small amount obtains kinematic parameter, compare with the situation that obtains kinematic parameter from the image of forming by relative mass data, reduce the precision of kinematic parameter, so that in successive image is handled, suppress suitably processing.
Expectation high-precision motion parameter can be used for image processing.
According to the first embodiment of the present invention, a kind of record and reproducing device are provided, be used for image is recorded in recording medium, and from the recording medium playing image.This record and reproducing device comprise: first obtains device, is used for obtaining sports one or more kinematic parameter from first image; Conversion equipment is used for first image transitions is become second image of being made up of the data volume of lacking than first image; Recording control apparatus is used for the moving parameter information and second image are recorded in recording medium, and moving parameter information is relevant with the kinematic parameter of first image; Read control device is used for reading the moving parameter information and second image from recording medium; And image processing apparatus, being used to use the kinematic parameter of first image, carries out image processing on second image that reads from recording medium obtains the kinematic parameter of first image from the moving parameter information that is read by recording medium.
The kinematic parameter that obtains by the first acquisition device can comprise that the frequency band of the change of rank of the intensity of variation in motion vector, expression brightness or the color signal, the zoom ratio that degree is amplified or dwindled in expression, the specific rotation of representing swing, expression frequency band intensity of variation changes, and the one or more parameters in the focal variation of the intensity of variation of expression focus.
Conversion equipment can be by extracting the frame of first image, or extract the pixel of each frame of first image, first image transitions become second image of being made up of data volume still less.
Image processing apparatus can be with the one or more image processing that are implemented as in frame interpolation, up conversion, Y/C separation, noise reduction, object extraction and I/P (interlaced/progressive) conversion.
Record and reproducing device according to first embodiment may further include the second acquisition device, are used for obtaining one or more kinematic parameters from second image; Difference information obtains device, is used to obtain the difference information about the one or more differences between the kinematic parameter of the kinematic parameter of first image and second image; And reconfiguration device, be used for the kinematic parameter of reconstruct first image.In this case, recording control apparatus can be recorded in difference information on the recording medium, as moving parameter information; And reconfiguration device can be by the kinematic parameter of the difference information and second image, the kinematic parameter of reconstruct first image, read difference information as moving parameter information from recording medium, and the kinematic parameter that obtains second image from second image that reads by recording medium.
When on second image that the image processing apparatus that is used in the reproducing device carries out image processing of playing image is reading from recording medium during carries out image processing, difference information obtains device and can obtain in the kinematic parameter of first image, only with the relevant difference information of one or more kinematic parameters that is used for by the image processing of image processing apparatus execution.
Record and reproducing device according to first embodiment may further include compression set, are used to use the kinematic parameter that is obtained by the second acquisition device, and second image compression is become packed data; And decompressing device, be used for packed data is de-compressed into second image.In this case, recording control apparatus can be recorded in the packed data and the difference information of second image on the recording medium, and recording control apparatus can read packed data and difference information from recording medium.
Simultaneously, may further include compression set, be used to use by first obtain the kinematic parameter that device obtains, second image compression is become packed data according to record and the reproducing device of first embodiment; Decompressing device is used for packed data is de-compressed into second image; And the 3rd obtain device, is used for second image that decompresses from by decompressing device, obtains one or more kinematic parameters.In this case, recording control apparatus can be recorded in the packed data and the difference information of second image on the recording medium, and recording control apparatus can read packed data and difference information from recording medium; And the kinematic parameter of the reconfiguration device use difference information and second image, the kinematic parameter of reconstruct first image, the kinematic parameter of second image obtain device by the 3rd and obtain.
Simultaneously, according to the first embodiment of the present invention, the record and the playback method of a kind of record and reproducing device are provided, be used for image is recorded in recording medium, and from the recording medium playing image, and a kind of program that allows the computer executive logging and reset and handle, be used for image is recorded in recording medium, and from the recording medium playing image.This record and playback method or program comprise step: obtain sports one or more kinematic parameter from first image; First image transitions is become second image of forming by the data volume of lacking than first image; The moving parameter information and second image are recorded on the recording medium, and moving parameter information is relevant with the kinematic parameter of first image; Read the moving parameter information and second image from recording medium; And the kinematic parameter that uses first image, carries out image processing on second image that reads from recording medium obtains the kinematic parameter of first image from the moving parameter information that is read by recording medium.
Record and reproducing device, record and playback method or program by basis first embodiment as above, obtain sports one or more kinematic parameter from first image, first image transitions is become second image of forming by the data volume of lacking than first image; The moving parameter information and second image are recorded on the recording medium, and moving parameter information is relevant with the kinematic parameter of first image.Therefore, read the moving parameter information and second image from recording medium, use the kinematic parameter of first image, carries out image processing on second image that reads from recording medium obtains the kinematic parameter of first image from the moving parameter information that is read by recording medium.
According to a second embodiment of the present invention, provide a kind of recording equipment, be used for image is recorded in recording medium.Recording equipment comprises that first obtains device, is used for obtaining sports one or more kinematic parameter from first image; Conversion equipment is used for first image transitions is become second image of being made up of the data volume of lacking than first image; Recording control apparatus is used for the moving parameter information and second image are recorded in recording medium, and moving parameter information is relevant with the kinematic parameter of first image.
Recording equipment according to second embodiment may further include transmission control unit, and the moving parameter information and second image that are used for writing down on recording medium are sent to another equipment that is used for playing image.
The kinematic parameter that is obtained by the first acquisition device can comprise that the frequency band of the change of rank of the intensity of variation in motion vector, expression brightness or the color signal, the zoom ratio that degree is amplified or dwindled in expression, the specific rotation of representing swing, expression frequency band intensity of variation changes, and the one or more parameters in the focal variation of the intensity of variation of expression focus.
Conversion equipment can be by extracting the frame of first image, or extract the pixel of each frame of first image, first image transitions become second image of being made up of data volume still less.
Recording equipment according to second embodiment may further include the second acquisition device, is used for obtaining one or more kinematic parameters from second image; And difference information obtains device, is used to obtain the difference information about the one or more differences between the kinematic parameter of the kinematic parameter of first image and second image.In this case, recording control apparatus can be recorded in difference information on the recording medium, as moving parameter information.
When on second image that the image processing apparatus of the reproducing device carries out image processing that is used for being used for playing image is reading from recording medium during carries out image processing, difference information obtains device and can obtain in the kinematic parameter of first image, only with the relevant difference information of one or more kinematic parameters that is used for the image processing that image processing apparatus carries out.
Recording equipment according to second embodiment may further include compression set, is used to use the kinematic parameter that is obtained by the second acquisition device, and second image compression is become packed data.In this case, recording control apparatus is recorded in the packed data and the difference information of second image on the recording medium.
Simultaneously, may further include compression set, be used to use by first obtain the kinematic parameter that device obtains, second image compression is become packed data according to the recording equipment of second embodiment.In this case, recording control apparatus is recorded in the packed data and the difference information of second image on the recording medium.
Simultaneously, according to a second embodiment of the present invention, a kind of recording method of recording equipment is provided, be used for image is recorded in recording medium, or a kind ofly being used to allow computer to carry out the program that is used for image is recorded in the recording processing on the recording medium, this recording method or program comprise step: obtain sports one or more kinematic parameter from first image; First image transitions is become second image of forming by the data volume of lacking than first image; And the moving parameter information and second image be recorded on the recording medium, moving parameter information is relevant with the kinematic parameter of first image.
Recording equipment, recording method or program by basis second embodiment as above obtain sports one or more kinematic parameter from first image; First image transitions is become second image of forming by the data volume of lacking than first image.Then, and the moving parameter information and second image be recorded on the recording medium, moving parameter information is relevant with the kinematic parameter of first image.
A third embodiment in accordance with the invention provides a kind of reproducing device, is used for playing image.Reproducing device comprises read control device, be used for having write down from it the moving parameter information and the second record images medium, read the moving parameter information and second image, moving parameter information is relevant with one or more kinematic parameters of first image, and, obtain second image by reducing the data volume of first image; And image processing apparatus, being used to use the kinematic parameter of first image, carries out image processing on second image that reads from recording medium obtains the kinematic parameter of first image from the moving parameter information that is read by recording medium.
Reproducing device according to the 3rd embodiment may further include receiving control device, is used to receive the moving parameter information and second image that transmits from another equipment.In this case, can be recorded on the recording medium by the moving parameter information and second image that receiving control device receives.
Image processing apparatus can be with the one or more image processing that are implemented as in frame interpolation, up conversion, Y/C separation, noise reduction, object extraction and the I/P conversion.
Reproducing device according to the 3rd embodiment may further include reconfiguration device, is used for the kinematic parameter of reconstruct first image.In this case, when the difference information about the one or more differences between one or more kinematic parameters of the kinematic parameter of first image and second image is recorded on the recording medium, during as moving parameter information, reconfiguration device can be by the kinematic parameter of the difference information and second image, the kinematic parameter of reconstruct first image, read difference information from recording medium, as moving parameter information, and the kinematic parameter of second image obtains from second image that is read by recording medium.
Reproducing device according to the 3rd embodiment may further include decompressing device, be used for the packed data of second image is de-compressed into second image,, compress second image by using the kinematic parameter of second image, obtain the packed data of second image, and it is recorded on the recording medium.
Reproducing device according to the 3rd embodiment may further include decompressing device, be used for the packed data of second image is de-compressed into second image, by using the kinematic parameter of first image, compress second image and obtain packed data and it is recorded on the recording medium; And the acquisition device, be used for obtaining one or more kinematic parameters from second image by the decompressing device decompression.In this case, reconfiguration device can use the kinematic parameter of the difference information and second image, and the kinematic parameter of reconstruct first image by obtaining device, obtains the kinematic parameter of second image.
Simultaneously, a third embodiment in accordance with the invention, a kind of playback method of reproducing device of playing image is provided, and a kind of program that allows the computer execution to be used for the playback processing of playing image, this playback method or program comprise step: the recording medium that has write down second image and moving parameter information from it, read second image and moving parameter information, moving parameter information is relevant with one or more kinematic parameters of first image, and, obtain second image by reducing the data volume of first image; And the kinematic parameter that uses first image, carries out image processing on second image that reads from recording medium obtains the kinematic parameter of first image from the moving parameter information that is read by recording medium.
By according to as above reproducing device, playback method or the program of the 3rd embodiment, write down the recording medium of second image and moving parameter information from it, read second image and moving parameter information, moving parameter information is relevant with one or more kinematic parameters of first image, and, obtain second image by reducing the data volume of first image.Therefore, use the kinematic parameter of first image, carries out image processing on second image that reads from recording medium obtains the kinematic parameter of first image from the moving parameter information that is read by recording medium.
According to these embodiment of the present invention, may use high-precision kinematic parameter to be used for image processing.
Description of drawings
Fig. 1 is the block diagram of representing to write down according to an embodiment of the invention with the exemplary configurations of playback system;
Fig. 2 is the block diagram of the exemplary configurations of expression recording controller shown in Figure 1;
Fig. 3 is the flow chart that is illustrated in the processing of carrying out in the recording controller shown in Figure 2;
Fig. 4 is the block diagram of the exemplary configurations of expression playback controller shown in Figure 1;
Fig. 5 is the flow chart that is illustrated in the processing of carrying out in the playback controller shown in Figure 4;
Fig. 6 is the block diagram of another exemplary configurations of expression recording controller shown in Figure 1;
Fig. 7 is used for illustrating first figure that obtains the example of the processing carried out the unit in MPd difference information shown in Figure 6;
Fig. 8 is used for illustrating second figure that obtains the example of the processing carried out the unit in MPd difference information shown in Figure 6;
Fig. 9 is used for illustrating the 3rd figure of example of processing that obtains the execution of unit in MPd difference information shown in Figure 6;
Figure 10 is the flow chart that is illustrated in the processing of carrying out in the recording controller shown in Figure 6;
Figure 11 is the block diagram of another exemplary configurations of the playback controller shown in the presentation graphs 1;
Figure 12 is the flow chart that is illustrated in the processing of carrying out in the playback controller shown in Figure 11;
Figure 13 is the block diagram of another exemplary configurations of the recording controller shown in the presentation graphs 1;
Figure 14 is used for illustrating the figure that obtains the example of the processing carried out the unit in MPd difference information shown in Figure 13;
Figure 15 is the flow chart that is illustrated in the processing of carrying out in the recording controller shown in Figure 13;
Figure 16 is the block diagram of another exemplary configurations of the playback controller shown in the presentation graphs 1;
Figure 17 is the flow chart that is illustrated in the processing of carrying out in the playback controller shown in Figure 16;
Figure 18 be represent according to another embodiment of the present invention record and the block diagram of the exemplary configurations of playback system; And
Figure 19 represents the figure of the exemplary configurations of computer according to an embodiment of the invention.
Embodiment
Now, embodiment of the present invention will be described.The present invention and described in this specification or the corresponding relation between the feature of the embodiment shown in the figure as follows.This specification is used for guaranteeing describing or illustrating in the drawings the support embodiments of the invention in this specification.Therefore, though described in this specification or the embodiment shown in the figure do not describe or be shown corresponding to some feature of the present invention at this, but do not represent that this embodiment does not correspond to those features.On the contrary, even embodiment in this description or be shown corresponding to some feature, does not represent that this embodiment does not correspond to other features.
According to the record of the first embodiment of the present invention and reproducing device (for example record shown in Fig. 1 and reproducing device 11) is to be used for going up document image and from the record and the reproducing device of this recording medium playing image at recording medium (HDD14 for example shown in Figure 1).Record and reproducing device comprise that first obtains device (MP1 for example shown in Figure 2 obtains unit 22), are used for obtaining sports one or more kinematic parameter from first image; Conversion equipment (withdrawal device 23 for example shown in Figure 2) is used for first image transitions is converted to by than first image second image formed of data volume still less; Recording control apparatus (for example, input/output interface 21 shown in Figure 2) is used for the record moving parameter information and second image on recording medium, and moving parameter information is relevant with the kinematic parameter of first image; Read control device (input/output interface 41 for example shown in Figure 4) is used for reading the moving parameter information and second image from recording medium; And image processing apparatus (image processor 43 for example shown in Figure 4), be used to use the kinematic parameter of first image, carries out image processing on second image that reads from recording medium obtains the kinematic parameter of first image from the moving parameter information that is read by recording medium.
Record and reproducing device according to the first embodiment of the present invention may further include the second acquisition device (MP2 for example shown in Figure 13 obtains unit 103), are used for obtaining one or more kinematic parameters from second image; Difference information obtains device (MPd difference information for example shown in Figure 13 obtains unit 104), is used to obtain the difference information about the one or more differences between the kinematic parameter of the kinematic parameter of first image and second image; And reconfiguration device (MP1 reconstructor 125 for example shown in Figure 16), be used for the kinematic parameter of reconstruct first image.In this case, recording control apparatus can write down difference information on recording medium, as moving parameter information, and reconfiguration device can be by the kinematic parameter of the difference information and second image, the kinematic parameter of reconstruct first image, read difference information from recording medium, as moving parameter information, and the kinematic parameter that obtains second image from second image that recording medium reads.
Record and reproducing device according to first embodiment may further include compression set (compressor reducer 55 for example shown in Figure 6), are used to use the kinematic parameter that is obtained by the second acquisition device, and second image compression is become packed data; And decompressing device (decompressor 83 for example shown in Figure 11), be used for packed data is de-compressed into second image.In this case, recording control apparatus can be recorded in the packed data and the difference information of second image on the recording medium, and read control device can read packed data and difference information from recording medium.
Simultaneously, may further include compression set (compressor reducer 105 for example shown in Figure 13), be used to use by first obtain the kinematic parameter that device obtains, second image compression is become packed data according to record and the reproducing device of first embodiment; Decompressing device (decompressor 123 for example shown in Figure 16) is used for packed data is de-compressed into second image; And the 3rd obtain device (MP2 for example shown in Figure 16 obtains unit 124), is used for second image that decompresses from by decompressing device, obtains one or more kinematic parameters.In this case, recording control apparatus can write down the packed data and the difference information of second image on recording medium, recording control apparatus can read packed data and difference information from recording medium, and reconfiguration device can use the kinematic parameter of the difference information and second image, the kinematic parameter of reconstruct first image obtains the kinematic parameter that device obtains second image by the 3rd.
According to the record of the first embodiment of the present invention and playback method or program is to be used for being recorded in image on the recording medium and from the record of recording medium playing image and the record and the playback method of reproducing device, or is used to allow computer to carry out and is used for being recorded in image on the recording medium and from the record of recording medium playing image and the program of resetting and handling.Record and playback method or program comprise step: obtain sports one or more kinematic parameter (step S11 for example shown in Figure 3) from first image; First image transitions is become second image of forming by the data volume of lacking than first image (step S12 for example shown in Figure 3); The moving parameter information and second image are recorded on the recording medium moving parameter information relevant with the kinematic parameter of first image (step S14 for example shown in Figure 3); Read moving parameter information and second image (step S21 for example shown in Figure 5) from recording medium, and the kinematic parameter that uses first image, carries out image processing on second image that reads from recording medium, the kinematic parameter that reads from recording medium obtains the kinematic parameter (step S23 for example shown in Figure 5) of first image.
Recording equipment according to a second embodiment of the present invention (recording equipment 141 for example shown in Figure 180) is to be used for image is recorded in recording equipment on the recording medium (HDD144 for example shown in Figure 180).Recording equipment comprises that first obtains device (MP1 for example shown in Figure 2 obtains unit 22), is used for obtaining sports one or more kinematic parameter from first image; Conversion equipment (withdrawal device 23 for example shown in Figure 2) is used for first image transitions is become second image of being made up of the data volume of lacking than first image; And recording control apparatus (input/output interface 21 for example shown in Figure 2), being used for the moving parameter information and second image are recorded in recording medium, moving parameter information is relevant with the kinematic parameter of first image.
Recording equipment according to second embodiment (for example may further include transmission control unit, transmission control unit (TCU) 145 shown in Figure 180), the moving parameter information and second image that are used for writing down on recording medium are sent to another equipment (reproducing device 151 for example shown in Figure 180), are used for playing image.
Recording equipment according to a second embodiment of the present invention may further include second and obtains device (for example, MP2 shown in Figure 13 obtains unit 103), is used for obtaining one or more kinematic parameters from second image; And difference information obtains device (MPd difference information for example shown in Figure 13 obtains unit 104), is used to obtain the difference information about the one or more differences between the kinematic parameter of the kinematic parameter of first image and second image.In this case, recording control apparatus can be recorded in difference information on the recording medium, as moving parameter information.
Recording equipment according to a second embodiment of the present invention may further include compression set (compressor reducer 55 for example shown in Figure 6), is used to use the kinematic parameter that is obtained by the second acquisition device, and second image compression is become packed data.In this case, recording control apparatus can be recorded in the packed data and the difference information of second image on the recording medium.
Simultaneously, recording equipment according to a second embodiment of the present invention may further include compression set (compressor reducer 105 for example shown in Figure 13), is used to use the kinematic parameter that is obtained by the first acquisition device, and second image compression is become packed data.In this case, recording control apparatus can be recorded in the packed data and the difference information of second image on the recording medium.
Recording method according to a second embodiment of the present invention or program are the recording methods that is used for image is recorded in the recording equipment on the recording medium, or are used to allow computer to carry out the program that image is recorded in the recording processing on the recording medium.Recording method or program comprise step: obtain sports one or more kinematic parameter (step S11 for example shown in Figure 3) from first image; First image transitions is become second image of forming by the data volume of lacking than first image (step S12 for example shown in Figure 3); And the moving parameter information and second image be recorded on the recording medium moving parameter information relevant with the kinematic parameter of first image (step S14 for example shown in Figure 3).
The reproducing device of a third embodiment in accordance with the invention (reproducing device 151 for example shown in Figure 180) is the reproducing device that is used for playing image.This reproducing device comprises read control device (input/output interface 41 for example shown in Figure 4), be used for having write down from it moving parameter information and the second record images medium (HDD153 for example shown in Figure 180), read the moving parameter information and second image, moving parameter information is relevant with one or more kinematic parameters of first image, and by reducing the data volume of first image, obtain second image, and image processing apparatus (image processor 43 for example shown in Figure 4), be used to use the kinematic parameter of first image, carries out image processing on second image that reads from recording medium, the moving parameter information that reads from recording medium obtains the kinematic parameter of first image.
The reproducing device of a third embodiment in accordance with the invention may further include receiving control device (reception controller 152 for example shown in Figure 180), is used for receiving the moving parameter information and second image that transmits from another equipment (recording equipment 141 for example shown in Figure 180).In this case, the moving parameter information and second image that is received by receiving control device can be recorded on the recording medium.
The reproducing device of a third embodiment in accordance with the invention may further include reconfiguration device (MP1 reconstructor 84 for example shown in Figure 11), is used for the kinematic parameter of reconstruct first image.In this case, when the difference information about the one or more differences between one or more kinematic parameters of the kinematic parameter of first image and second image is recorded on the recording medium, during as moving parameter information, reconfiguration device can be by the kinematic parameter of the difference information and second image, the kinematic parameter of reconstruct first image, read difference information from recording medium, as moving parameter information, and the kinematic parameter that obtains second image from second image that recording medium reads.
The reproducing device of a third embodiment in accordance with the invention may further include decompressing device (decompressor 83 for example shown in Figure 11), be used for the packed data of second image is de-compressed into second image, by using the kinematic parameter of second image, compress the packed data that second image obtains second image, and it is recorded on the recording medium.
Reproducing device according to the 3rd embodiment may further include decompressing device (decompressor 123 for example shown in Figure 16), be used for the packed data of second image is de-compressed into second image, by using the kinematic parameter of first image, compress second image, obtain packed data, and it is recorded on the recording medium; And obtain device (MP2 for example shown in Figure 16 obtains unit 124), be used for obtaining one or more kinematic parameters from second image by the decompressing device decompression.In this case, reconfiguration device can use the kinematic parameter of the difference information and second image, and the kinematic parameter of reconstruct first image is by obtaining the kinematic parameter that device obtains second image.
The playback method of a third embodiment in accordance with the invention or program are the playback methods that is used for the reproducing device of playing image, or be used to allow the computer execution to be used for the program of the playback processing of playing image, playback method or program comprise step: from writing down the recording medium of second image and moving parameter information thereon, read second image and moving parameter information, moving parameter information is relevant with one or more kinematic parameters of first image, and, obtain second image (step S21 for example shown in Figure 5) by reducing the data volume of first image; And the kinematic parameter that uses first image, carries out image processing on second image that reads from recording medium from the moving parameter information that is read by recording medium, obtains the kinematic parameter (step S23 for example shown in Figure 5) of first image.
Now, will be with reference to the accompanying drawings, embodiments of the invention are described.
Fig. 1 is the block diagram of representing to write down according to an embodiment of the invention with the exemplary configurations of playback system.
Record and playback system comprise record and reproducing device 11, HDTV (high definition television) video camera 12 and monitor 16.Record and reproducing device 11 comprise recording controller 13, HDD (hard drive) 14 and playback controller 15.Record and reproducing device 11 can be applied to DVR, be connected to file server of so-called local network or the like.
HDTV video camera 12 is caught HD (high definition) image of being made up of the HDTV signal, and the HD image is offered recording controller 13.
Recording controller 13 will offer HDD14 from the HD image that HD video camera 12 provides, so that the HD image is recorded on the HDD14.Simultaneously, recording controller 13 reads in HDD14 and goes up the HD image of record and carry out processing so that obtain the kinematic parameter of the motion in the relevant HD image, and the HD image transitions is become the image of being made up of the data volume of lacking than the HD image.Then, recording controller 13 offers HDD14 with the image of being made up of the moving parameter information of data volume and relevant kinematic parameter still less, so that image and moving parameter information are recorded on the HDD14.
As kinematic parameter, for example can use the one or more parameters in the motion vector, the frequency band of the zoom ratio of the change of rank of expression brightness or color signal change degree, expression amplification or degree of dwindling, the specific rotation of expression swing, expression frequency band change degree changes, and the focal variation of expression focal variation degree.
In addition, recording controller 13 can be provided by the HD image that is used for from being provided by HDTV video camera 12, directly obtain the processing of moving parameter information, and will temporarily not be stored on the HDD14 from the HD image that HDTV video camera 12 provides, then, the HD image transitions that will provide from HDTV video camera 12 becomes by than the HD image image formed of data volume still less, and will be recorded on the HDD14 by image and the moving parameter information that data volume is still less formed.
HDD14 will be recorded on the internal hard drive from image and the moving parameter information be made up of low volume data that recording controller 13 provides.As being used to write down the image formed by few images and the recording medium of moving parameter information, in addition, can use disk record medium except that hard disk, semiconductor memory or the like.
Playback controller 15 reads image and the moving parameter information of being made up of low volume data from HDD14, and is using the kinematic parameter that obtains from moving parameter information, carries out image processing on the image of being made up of low volume data.In addition, playback controller 15 will offer monitor 16 by the image that image processing obtains.
Can only be used for a kind of image processing from one or more parameters that moving parameter information obtains or be common to several image processing.For example, as the motion vector of the kinematic parameter that obtains from moving parameter information, brightness variation of expression brightness change degree or the like can be common to image processing, such as noise reduction and up conversion.
Use the example of the image processing of kinematic parameter execution to comprise frame interpolation, up conversion, Y/C separation, noise reduction, object extraction and I/P (interlaced/progressive) conversion.
The image that is provided by playback controller 15 is provided monitor 16.
Fig. 2 is the block diagram of the exemplary configurations of expression recording controller 13 shown in Figure 1.
The HD image that provides from HDTV video camera 12 is provided input/output interface 21, and the HD image is offered MP (kinematic parameter) 1 acquisition unit 22 or HDD14.Simultaneously.Input/output interface 21 reads the HD image from HDD14, and the HD image is offered MP1 acquisition unit 22.In addition, image and the moving parameter information that provides from multiplexer 24 is provided input/output interface 21, and this image and moving parameter information are offered HDD14, so that image and moving parameter information are recorded on the HDD14.
For obtaining the high-precision motion parameter, MP1 obtains unit 22 from 21 that provide from HDD144 through input/output interface, as to have high frame frequency and high definition HD image detection (calculating), and obtain kinematic parameter MP1 thus, such as motion vector, and kinematic parameter MP1 offered multiplexer 24.Because MP1 obtains unit 22 and use the HD image that has write down on HDD14, detects kinematic parameter MP1, therefore can use for example a large amount of frames, obtain high-precision motion parameter MP1.
More particularly, for example relevant with the motion vector among the kinematic parameter MP1, under situation,, carry out and handle by using two or three frames based on the image processing of MPEG (Motion Picture Experts Group) standard, detect motion vector.In contrast, because MP1 obtains unit 22 by the HD image detection motion vector that has write down on HDD14, compare with the situation of real-time detection motion vector, the enough time can be used.Therefore, can use four or above frame, detect motion vector.This is used for predicted motion trend more accurately, thereby obtains high accuracy motion vectors.
Remove as mentioned above, through input/output interface 21, the HD image that provides from HDD14 obtains outside the kinematic parameter MP1, and MP1 obtains unit 22 the HD image is offered withdrawal device 23.
The frame of the HD image that provides from MP1 acquisition unit 22 is provided withdrawal device 23, or the pixel of each frame, the HD image transitions is become the abstract image of being made up of low volume data, and abstract image is offered multiplexer 24.
More particularly, for example, withdrawal device 23 is carried out and is extracted so that the n of an every HD image successive frame, and deletion N-1 frame, N be more than or equal to two, thereby HD image transitions one-tenth is had than the HD image abstract image of low frame rate more.In addition, for example, withdrawal device 23 is carried out and is extracted so that N neighbor of each frame in the successive frame of HD image reduced to a pixel, and M is more than or equal to 2, thereby HD image transitions one-tenth is had than the HD image abstract image of low resolution more.
In addition, withdrawal device 23 can extract the frame of HD image, and the pixel that extracts each frame, thereby the HD image transitions is become the abstract image of being made up of low volume data.
Multiplexer 24 multiplexing by MP1 obtain the unit 22 that provide, as the kinematic parameter MP1 of moving parameter information and the abstract image that provides by withdrawal device 23, and final multiplex data offered input/output interface 21.
Input/output interface 21 will offer HDD14 by the multiplex data that multiplexing moving parameter information and abstract image in multiplexer 24 obtain, so that multiplex data is recorded on the HDD14.
MP1 obtains unit 22 and can carry out and be used for directly from through input/output interface 21, and the HD image that provides from HDTV video camera 12 (rather than be recorded on the HDD14 HD image) obtains the processing of kinematic parameter MP1.
Multiplexer 24 can with obtain from MP1 the unit 22 that provide, as the kinematic parameter MP1 of moving parameter information, and directly offer input/output interface 21 from the abstract image that withdrawal device 23 provides.
In this case, for example, input/output interface 21 is non-multiplexing moving parameter information and the abstract image that is provided by multiplexer 24, as independent file storage at HDD14.
Then, will performed processing in the recording controller 13 shown in Figure 2 be described with reference to flow chart shown in Figure 3.
When the HD image has been offered recording controller 13, recording controller 13 receives the HD image and the HD image is offered HDD14, so that the HD image is recorded on the HDD14.Then, recording controller 13 is according to flow chart shown in Figure 3, carry out and handle, for example, when the user on the operating unit (not shown) during executable operations or when there is not pending processing in (in fact).
More particularly, input/output interface 21 reads the HD image and this HD image is offered MP1 from HDD14 and obtains unit 22.In step S11, the HD image of unit 22 from being provided by input/output interface 21 is provided MP1, obtains kinematic parameter MP1, and this kinematic parameter MP1 is offered multiplexer 24.Simultaneously, MP1 obtains unit 22 and will offer withdrawal device 23 from the HD image that input/output interface 21 provides.Then, processing enters step S12.
At step S12, the frame of the HD image that is provided by MP1 acquisition unit 22 or the pixel of its each frame are provided withdrawal device 23, thereby the HD image transitions is become the abstract image of being made up of low volume data, and this abstract image is offered multiplexer 24.Then, processing enters step S13.
At step S13, it is multiplexing that multiplexer 24 will obtain unit abstract image 22 that provide, that provide as the kinematic parameter MP1 of moving parameter information and from withdrawal device 23 from MP1, and final multiplex data is offered input/output interface 21.Then, processing enters step S14.
At step S14, input/output interface 21 will offer HDD14 from the multiplex data that multiplexer 24 provides.Then, finish this processing.
Fig. 4 is the block diagram of the exemplary configurations of expression playback controller 15 shown in Figure 1.
The playback instructions that input/output interface 41 response has for example been sent during executable operations on the operating unit (not shown) as the user reads multiplex data from HDD14, and this multiplex data is offered demodulation multiplexer 42.
The multiplex data demultiplexing that demodulation multiplexer 42 will provide from input/output interface 41 is abstract image and moving parameter information, and this abstract image and moving parameter information are offered image processor 43.
Image processor 43 uses the kinematic parameter MP1 of HD images, i.e. the moving parameter information that provides from demodulation multiplexer 42, and carries out image processing on the abstract image that provides by demodulation multiplexer 42, and will offer monitor 16 by the image that image processing obtains.Image processor 43 can be carried out appropriate image processing by high-precision motion parameter MP1 is used for image processing on abstract image, obtain kinematic parameter MP1 from high-quality (high frame frequency and high definition) HD image.
More particularly, for example, image processor 43 comprises denoiser 44 and interpolater 45.To each frame of abstract image, denoiser 44 uses high-precision motion parameter MP1, determines that two field picture has momental moving image or (basically) the nonmotile rest image more than or equal to a certain amount.In addition, when two field picture had been defined as moving image, denoiser 44 only used the image in this frame, carried out noise reduction.On the other hand, when the image with frame had been defined as rest image, denoiser 44 used comprise the theme frame a plurality of preceding and at the image of back frame, carries out noise reduction.In addition, denoiser 44 offers interpolater 45 with the abstract image behind the noise reduction.The brightness that denoiser 44 uses motion vector among the kinematic parameter MP1 for example or expression brightness to change changes, and determines that each two field picture is moving image or rest image.
Interpolater 45 uses for example motion vector from the high-precision motion parameter MP1 that demodulation multiplexer 42 provides, on the abstract image that provides from denoiser 44, in each frame, carry out frame interpolation or pixel interpolating, thereby abstract image is changed high-quality HD image, and this HD image is offered monitor 16.
Then, will the processing of carrying out in the playback controller 15 shown in Figure 4 be described with reference to flow chart shown in Figure 5.
When the image replaying instruction is sent to input/output interface 41, for example, when the user has sent during executable operations on the operating unit (not shown), in step S21, HDD14 reads multiplex data and multiplex data is offered demodulation multiplexer 42 from HDD14.Then, processing enters step S22.
At step S22, demodulation multiplexer 42 will demultiplex into abstract image and kinematic parameter MP1 from the multiplex data that input/output interface 41 provides, and abstract image and kinematic parameter MP1 are offered image processor 43.Then, processing enters step S23.
At step S23, use high-precision motion parameter MP1, i.e. the kinematic parameter that also provides from demodulation multiplexer 42, image processor 43 is carries out image processing on the abstract image that provides from demodulation multiplexer 42, and final image is offered monitor 16.Finish this processing then.
More particularly, in image processor 43, denoiser 44 uses kinematic parameter MP1, carries out noise reduction on abstract image, and will finally reduce image and offer interpolater 45.Use kinematic parameter MP1, interpolater 45 is carried out interpolation, thereby is converted abstract image to the HD image, and the HD image is offered monitor 16 on the abstract image that provides from denoiser 44.The HD image that is provided by this interpolater 45 (image processor 43) is provided monitor 16.
Fig. 6 is the block diagram of another exemplary configurations of expression recording controller 13 shown in Figure 1.
In Fig. 6, corresponding to parts shown in Figure 2 by identical numeral, and will suitably the descriptions thereof are omitted.
Recording controller 13 shown in Figure 6 comprises frame withdrawal device 52, rather than withdrawal device 23, and comprises that newly MP2 obtains unit 53, the MPd difference information obtains unit 54 and compressor reducer 55.Other structures of recording controller 13 shown in Figure 6 are identical with Fig. 2.
Frame withdrawal device 52 obtains unit 22 from MP1 and receives the HD image.The frame of the HD image that provides from MP1 acquisition unit 22 is provided frame withdrawal device 52, thereby the HD image transitions is become the abstract image of being made up of low volume data, and abstract image is offered MP2 acquisition unit 53.
The abstract image of unit 53 from being provided by frame withdrawal device 52 is provided MP2, detect (calculatings), thereby and obtain sports kinematic parameter MP2, such as the motion vector of abstract image, and this kinematic parameter MP2 offered MPd difference information acquisition unit 54.In addition, MP2 obtains unit 53 abstract image and kinematic parameter MP2 is offered compressor reducer 55.
The MPd difference information obtains unit 54 and obtains unit 22 reception kinematic parameter MP1 from MP1, and also obtains unit 53 reception kinematic parameter MP2 from MP2.The MPd difference information obtains unit 54 and detects (calculating), thereby and obtain, and difference information MPd is offered multiplexer 24 with the kinematic parameter MP1 that provides from MP1 acquisition unit and from the relevant difference information MPd of one or more differences between the kinematic parameter MP2 of MP2 acquisition unit 53 acquisitions.
When the parameter of same type is included among kinematic parameter MP1 and the kinematic parameter MP2, if the difference between could calculating parameter, could be with the difference information MPd of the difference between parameter as relevant moving parameter information.When a certain parameter is present among the kinematic parameter MP1 but relevant parameters when not being present among the kinematic parameter MP2, be present in parameter among the kinematic parameter MP1 can be directly as the difference information MPd of relevant moving parameter information.That is, the difference information of relevant kinematic parameter can be arbitrary information, as long as use the difference information MPd of relevant moving parameter information and kinematic parameter MP2, and can reconstitution movement parameter MP1.
As mentioned above, when difference information MPd as moving parameter information, can use the difference between the parameter among kinematic parameter MP1 and the kinematic parameter MP2, or kinematic parameter MP1 itself.Usually, the difference between kinematic parameter MP1 and kinematic parameter MP2 has the data volume still less than kinematic parameter MP1 itself.Therefore, the difference when between kinematic parameter MP1 and kinematic parameter MP2 is recorded on the HDD14, during as moving parameter information, upward compares as the situation of moving parameter information with kinematic parameter itself being recorded in HDD14, saves the memory capacity of HDD14.In addition, can shorten translatory movement parameter information institute's time spent.
In addition, when being used as from the difference of kinematic parameter MP2 the kinematic parameter MP1, only be used in image processor shown in Figure 11 43 in the relevant moving parameter information of one or more kinematic parameter MP1 the time, can further shorten translatory movement parameter information institute's time spent, and the memory capacity that can further save HDD14.
Compressor reducer 55 uses also and obtains the kinematic parameter MP2 that unit 53 provides from MP2, and for example according to the MPEG scheme, compression obtains the abstract image that unit 53 provides from MP2, and final packed data is offered multiplexer 24.
In Fig. 6, the difference information MPd that multiplexer 24 will provide from MPd difference information acquisition unit 54 regards moving parameter information as, the packed data of the multiplexing abstract image that provides as the difference information MPd and the compressor reducer 55 of moving parameter information offers input/output interface 21 with final multiplex data.
Then, will be described in the processing that MPd difference information shown in Figure 6 obtains execution in the unit 54 with reference to figure 7.
For example, suppose by carrying out 1/2 and extract that withdrawal device 52 becomes abstract image with the HD image transitions so that two successive frame frames of HD image are reduced to a frame, and with motion vector as kinematic parameter MP1 and MP2.
In addition, the n frame of the HD image of Ji Suaning will be expressed as the n frame from the outset, and from the n frame to the n ' frame (n '>n) motion vector will be expressed as motion vector mv (n, n ').
With reference now to Fig. 7,, three successive frames, i.e. n frame, (n+1) frames of relevant HD image, and (n+2) frame, suppose that deletion (n+1) frame is so to this HD image by the HD image transitions being become the extraction of abstract image, detect motion vector mv (n, n+1) and mv (n+1, n+2), and to abstract image, detect motion vector mv (n, n+2).
Motion vector mv (n based on abstract image, n+2), 1/2 of MPd difference information computing unit 54 compute vectors, i.e. 1/2 * mv (n, n+2) as the motion vector mv of HD image (n, predicted value mv ' n+1) (n, n+1) and the motion vector mv (n+1 of HD image, predicted value mv ' n+2) (n+1, n+2).In addition, the MPd difference information obtains unit 54 calculating kinematical vector mv (n, n+1) and predicted value mv ' (n, n+1) the difference mv between (n, n+1)-mv ' (n, n+1), and with difference mv (n, n+1)-(n n+1) is set to motion vector mv (n to mv ', difference information MPd n+1) (n, n+1).Simultaneously, the MPd difference information obtains unit 54 calculating kinematical vector mv (n+1, n+2) and its predictor motion vector mv ' (n+1, n+2) the difference mv between (n+1, n+2)-mv ' (n+1, n+2), and with difference mv (n+1, n+2)-(n+1 n+2) is arranged to motion vector mv (n+1 to mv ', difference information MPd n+2) (n+1, n+2).
Motion vector mv (n by abstract image, n+2), can calculate motion vector mv (n, predicted value mv ' (n n+1) of HD image, n+1), and can (n be n+1) with as difference information MPd (n, difference mv (n n+1) by its predicted value mv ', n+1)-mv ' (n, n+1), and the motion vector mv of calculating HD image (n, n+1).That is, by with the motion vector mv of abstract image (n, n+2) with as difference information MPd (n, difference mv n+1) (n, n+1)-mv ' (n n+1) adds together, motion vector mv that can reconstruct (calculating) HD image (n, n+1).
Similarly, can use abstract image motion vector mv (n, n+2) and as difference information MPd (n+1, difference mv n+2) (n+1, n+2)-mv ' (n+1, n+2), can reconstruct the HD image motion vector mv (n+1, n+2).
MP1 reconstructor 84 shown in Figure 11 as mentioned below is in aforesaid mode, the motion vector mv of reconstruct HD image (n, n+1) and motion vector mv (n+1, n+2).
In Fig. 7, in theory, satisfy equation mv (n, n+1)+mv (n+1, n+2)=mv (n, n+2).In this case, remove abstract image motion vector mv (n, n+2) outside, when two motion vector mv of HD image (n, n+1) and motion vector mv (n+1, but one of n+2) time spent can calculate another motion vector.
Therefore, even as difference information MPd (n, n+1) and difference information MPd (n+1, when n+2) all unavailable, a but time spent in these difference information, can use the motion vector mv (n of this difference information and abstract image, n+2), the motion vector of the HD image that reconstruct is relevant with difference information, and use the motion vector of the HD image relevant and the motion vector mv (n of abstract image with difference information, n+2), the further motion vector of the reconstruct HD image relevant with another difference information.
According to as mentioned above, the MPd difference information obtains unit 54 not necessarily must be with motion vector mv (n, n+1) difference information MPd (n, n+1) and motion vector mv (n+1, n+2) difference information MPd (n+1, n+2), and one of these difference information be enough to as moving parameter information all as moving parameter information.
In this case, with (n, n+1) (n+1 n+2) all compares as the situation of moving parameter information, reduces the data volume of moving parameter information with difference information MPd with difference information MPd.Therefore, can further reduce translatory movement parameter information institute's time spent, and the memory capacity that can further save HDD14.
Then, will further describe in MPd difference information shown in Figure 6 and obtain performed processing in the unit 54 with reference to figure 8 and 9.
In Fig. 8 and 9, similar simultaneously with Fig. 7, only motion vector is regarded as kinematic parameter MP1 and kinematic parameter MP2.In addition, suppose that the HD image is made up of 11 frames, and extract so that the even frame (hereinafter, being called even frame) of deletion HD image that frame withdrawal device 52 becomes abstract image with the HD image transitions by carrying out.In addition, suppose the detection motion vector, relevant first frame to the, six frames from the HD image move up and from the 6th frame to the 11 frames of HD image with the constant speed of a pixel of every frame, the motion object that moves down with the constant speed of two pixels of every frame.
Fig. 8 represents the position with respect to the motion object in first frame, the position of motion object (being called the HD picture position hereinafter) in each frame of HD image, based on predicted position (the prediction interpolation position that is called abstract image hereinafter) at the motion object of former frame to each even frame two odd-numbered frame (being called odd-numbered frame hereinafter) at the HD image of the motion-vector prediction of back one frame from two odd-numbered frame, and the interpolated error of the error between the prediction interpolation position of expression HD picture position and abstract image.
More particularly, in Fig. 8, represent the HD picture position, represent the prediction interpolation position of abstract image, and represent interpolated error by black triangular marker with the black square mark by black circle mark.Although the prediction interpolation position of abstract image exists only in the even frame, in Fig. 8, for simplicity,, also represent the prediction interpolation position of abstract image to odd-numbered frame.
As the prediction interpolation position of the abstract image that is used for even frame, the mean value of the position of the motion object in the odd-numbered frame before and after the use even frame.As the prediction interpolation position of the abstract image that is used for odd-numbered frame, the HD picture position of directly using odd-numbered frame.
Fig. 9 is illustrated in the motion vector of the motion motion of objects in each frame of frame number, HD picture position, expression HD image of the order of each frame in the HD image, as by the predicted position of the motion object in the next frame of the motion-vector prediction of each frame of HD image, the motion vector that is illustrated in the motion motion of objects in each frame of abstract image, expression as by the predicted position of the abstract image of the position of the motion object in the next frame of the motion-vector prediction of each frame of abstract image, the prediction interpolation position of abstract image, and interpolated error.
More particularly, in Fig. 9,, and represent the position of the motion object each frame of HD image from second field on a left side from the frame number of the frame of first field (row) on left side expression HD image.Represent the motion motion of objects vector that each frame to the HD image detects from the 3rd field on a left side, and represent predicted position as the motion object in the next frame of the HD image of the motion motion of objects vector prediction from each frame of HD image from the 4th field on a left side.
In addition, the 5th field is represented the motion motion of objects vector that each frame to abstract image detects from a left side, and represents predicted position as the abstract image of the motion object in next frame vector detection, abstract image of the motion motion of objects from each frame of abstract image from a left side the 6th field.Represent the predetermined interpolation position of abstract image from the 7th field on a left side, and from Eight characters section (first field from the right side) the expression interpolated error on a left side.
In Fig. 8 and 9, as previously mentioned, the prediction interpolation position that is used for the abstract image of even frame be before the even frame and after the mean value of position of motion object of odd-numbered frame.Therefore, when the rapid change of motion object, because this change produces the non-zero interpolated error.
More particularly, in Fig. 8 and 9, the speed of motion object changes in the 6th frame (frame with frame number 6) of HD image, and because this changes ,-1.5 interpolated error occurs.
Obtain the difference information MPd of unit 54 acquisitions corresponding to this interpolated error by the MPd difference information.By using difference information MPd corresponding to this interpolated error and the motion vector that obtains from abstract image (as predetermined interpolation position) from the abstract image of this motion-vector prediction, accurate motion vector that can reconstruct (acquisition) HD image.
Then, will the processing of carrying out in the recording controller 13 shown in Figure 6 be described with reference to flow chart shown in Figure 10.
When with the HD image when HDTV video camera 12 offers recording controller 13, recording controller 13 receives these HD images and this HD image is offered HDD14, so that this HD image is recorded on the HDD14.Then, recording controller 13 is according to flow chart shown in Figure 10, carry out and handle, for example, when the user in executable operations on the operating unit (not shown) or when there is not pending processing in (basically).
More particularly, input/output interface 21 reads the HD image from HDD14, and this HD image is offered MP1 acquisition unit 22.At step S31, the HD image of unit 22 from being provided by this input/output interface 21 is provided MP1, obtains kinematic parameter MP1, and this kinematic parameter MP1 is offered MPd difference information acquisition unit 54.Simultaneously, MP1 obtains unit 22 this HD image is offered frame withdrawal device 52.Then, processing enters step S32.
At step S32, frame withdrawal device 52 is carried out the extraction of the even frame (or odd-numbered frame) that the HD image that is provided by MP1 acquisition unit 22 is provided, and then final abstract image is offered MP2 and obtains unit 53.Handle then and enter step S33.
At step S33, the abstract image of unit 53 from being provided by frame withdrawal device 52 is provided MP2, obtains kinematic parameter MP2, and this kinematic parameter MP2 is offered MPd difference information acquisition unit 54.Simultaneously, MP2 obtains unit 53 abstract image and kinematic parameter MP2 is offered compressor reducer 55.Then, processing enters step S34.
At step S34, the MPd difference information obtains unit 54 and calculates, thereby and obtain relevant from MP1 obtain kinematic parameter MP1 that unit 22 provides and the kinematic parameter MP2 that provides from MP2 acquisition unit 53 between the difference information MPd of one or more differences, and this difference information MPd offered multiplexer 24.Then, processing enters step S35.
At step S35, compressor reducer 55 uses also and obtains the kinematic parameter MP2 that unit 53 provides from MP2, and for example, according to the MPEG scheme, compression obtains the abstract image that unit 53 provides from MP2, and the final packed data of abstract image is offered multiplexer 24.Then, processing enters step S36.
At step S36, multiplexer 24 will from the MPd difference information obtain difference information MPd that unit 54 provide and the packed data of the abstract image that provides from compressor reducer 55 multiplexing, and final multiplex data offered input/output interface 21.Then, processing enters step S37.
At step S37, input/output interface 21 will offer HDD14 from the multiplex data that multiplexer 24 provides, so that multiplex data is recorded on the HDD14.Finish this processing then.
Figure 11 is illustrated under the situation of constructing recording controller 13 as shown in Figure 6, the block diagram of the exemplary configurations of playback controller 15 shown in Figure 1.
In Figure 11, by identical numeral, and suitably the descriptions thereof are omitted corresponding to parts shown in Figure 4.
Playback controller 15 shown in Figure 11 comprises the frame interpolater, replaces interpolater 45 shown in Figure 4, and newly comprises decompressor 83 and MP1 reconstructor 84.Other structures of playback controller 15 shown in Figure 11 are same as shown in Figure 4.
Decompressor 83 is according to the decompression scheme corresponding to the compression scheme that is adopted by compressor reducer shown in Figure 6 55, the packed data of the abstract image that provides from demodulation multiplexer 42 of decompressing, and final abstract image offered image processor 43.
More particularly, with reference to Figure 11, packed data that will be by the multiplexing abstract image that obtains by compressor reducer shown in Figure 6 55 and obtain unit multiplex data 54 that obtain, that obtain as the difference information MPd of moving parameter information by the MPd difference information and be recorded on the HDD14.Demodulation multiplexer 42 is packed data and difference information MPd with the multiplex data demultiplexing, and packed data is offered decompressor 83, and difference information is offered MP1 reconstructor 84.Decompressor 83 will be as mentioned above, and the packed data that provides from demodulation multiplexer 42 de-compresses into abstract image, and abstract image is offered image processor 43.
As previously mentioned, compressor reducer 55 shown in Figure 6 uses the kinematic parameter MP2 that obtains from abstract image, for example according to the MPEG scheme, and the compression abstract image.Therefore, the kinematic parameter MP2 that is used for compressing abstract image is included in the packed data of abstract image.Decompressor 83 uses kinematic parameter MP2, and this packed data decompresses.Then, decompressor 83 will be used to the to decompress kinematic parameter MP2 of this packed data offers MP1 reconstructor 84.
MP1 reconstructor 84 is by difference information MPd that provides from demodulation multiplexer 42 and the kinematic parameter MP2 that provided by demodulation multiplexer 83, reconstruct high-precision motion parameter MP1, and kinematic parameter MP1 offered image processor 43.
The kinematic parameter among the high-precision motion parameter MP1 that is provided by MP1 reconstructor 84 for example is provided for frame interpolater 85, the interpolation of execution interpolated image on the abstract image that (through denoiser 44) provided by decompressor 83, thereby convert abstract image to high accuracy HD image, and the HD image is offered monitor 16.
Then, will the processing of carrying out in the playback controller 15 shown in Figure 11 be described with reference to flow chart shown in Figure 12.
When the image replaying instruction is sent to input/output interface 41, for example, when the user on the operating unit (not shown) during executable operations, at step S41, input/output interface 41 reads multiplex data and multiplex data is offered demodulation multiplexer 42 from HDD14.Then, processing enters step S42.
At step S42, the multiplex data demultiplexing that demodulation multiplexer 42 will be provided by input/output interface 41 is the packed data and the difference information MPd of abstract image.In addition, demodulation multiplexer 42 offers decompressor 83 with abstract image, and difference information MPd is offered MP1 reconstructor 84.Handle then and enter step S43.
At step S43, demodulation multiplexer 83 is according to the decompression scheme corresponding to the compression scheme that is adopted by compressor reducer shown in Figure 6 55, the packed data of the abstract image that provides by demodulation multiplexer 42 of decompressing, and final abstract image offered image processor 43.In addition, decompressor 83 will be used to the to decompress kinematic parameter MP2 of packed data of this abstract image offers MP1 reconstructor 84.Handle then and enter step S44.
At step S44, for example, as described in reference to figure 7, difference information MPd that is provided by demodulation multiplexer 42 and the kinematic parameter MP2 that is provided by decompressor 83 are provided MP1 reconstructor 84, reconstruct (acquisition) high-precision motion parameter MP1, and this kinematic parameter MP1 offered image processor 43.Then, this processing enters step S45.
At step S45, the kinematic parameter MP1 that is provided by MP1 reconstructor 84 is provided for image processor 43, carries out image processing on the abstract image that provides by decompressor 83, and final image offered monitor 16.Finish this processing then.
Figure 13 is the block diagram of another exemplary configurations of expression recording controller 13 shown in Figure 1.
In Figure 13, corresponding to Fig. 2 or parts shown in Figure 6, and suitably the descriptions thereof are omitted by identical numeral.
Recording controller 13 shown in Figure 13 comprises that downconverter 102, MP2 obtain unit 103, the MPd difference information obtains unit 104 and compressor reducer 105, replaces frame withdrawal device 52 shown in Figure 6, MP2 to obtain unit 53, MPd difference information acquisition unit 54 and compressor reducer 55.Other structures of recording controller 13 shown in Figure 13 are same as shown in Figure 6.
Downconverter 102 obtains unit 22 from MP1 and receives the HD image.Downconverter 102 is carried out the extraction of the pixel of each frame that the HD image that provides from MP1 acquisition unit 22 is provided, thereby the HD image transitions is become SD (single-definition) image, the abstract image that it is made up of low volume data, and the SD image is offered MP2 obtain unit 103 and compressor reducer 105.
MP2 obtains unit 103 by the SD image that provides from downconverter 102, detect (calculatings), thereby and obtain kinematic parameter MP2, and kinematic parameter MP2 is offered MPd difference information acquisition unit 104.
The MPd difference information obtains unit 104 and obtains unit 103 reception kinematic parameter MP2 from MP2, and obtains unit 22 reception kinematic parameter MP1 from MP1.In addition, similar with MPd difference information acquisition unit 54 shown in Figure 6, the MPd difference information obtains the difference information MPd that unit 104 obtains the difference between relevant kinematic parameter MP1 and kinematic parameter MP2, only be used for being used in each kinematic parameter MP1 of image processor shown in Figure 16 43, and this difference information MPd offered multiplexer 24, as moving parameter information.
Compressor reducer 105 receives the SD image from downconverter 102, and obtains unit 22 reception kinematic parameter MP1 from MP1.Use obtains the kinematic parameter MP1 that unit 22 provides by MP1, and compressor reducer 105 will become the SD image compression data from the SD image compression that downconverter 102 provides, and the SD image compression data is offered multiplexer 24.
Figure 14 is used for illustrating obtaining in MPd difference information shown in Figure 13 that the unit is 104 that carry out, the figure of the example of the processing that is used to obtain difference information MPd.
For example, suppose by reducing to 1/4 of a pixel and extract that the HD image transitions is become the SD image, and it is an abstract image by four pixels that 2 * 2 pixels of each frame of HD image are formed, and with motion vector as kinematic parameter MP1 and kinematic parameter MP2.In addition, for example suppose,, detect motion vector the piece of forming by 8 * 8 pixels.
Because the size (pixel count) of SD image is 1/4 of a HD image, form by 8 * 8 pixels of SD image one macro block of forming corresponding to four 16 * 16 pixels of forming by 8 * 8 pixels that comprise the HD image.
In addition, the motion vector in be made up of 8 * 8 pixels of SD image will be expressed as motion vector mv (X n), and with four, each piece is made up of 8 * 8 pixels, is arranged in upper left, upper right, the lower-left of respective macroblock of HD image and the motion vector of bottom right and is expressed as motion vector mv (A respectively n), mv (B n), mv (C n) and mv (D n).
The MPd difference information obtains the motion vector mv (A that unit 104 obtains the HD image n) and the mv (X of corresponding SD image n) between difference mv (A n)-mv (X n), and with this difference mv (A n)-mv (X n) be set to relevant motion vector mv (A n) difference information MPd (A n).Similarly, the MPd difference information obtains other motion vectors mv (B that unit 104 obtains the HD image n), mv (C n) and mv (D n) with the motion vector mv (X of SD image n) between difference mv (B n)-mv (X n), mv (C n)-mv (X n) and mv (D n)-mv (X n), respectively as relevant motion vector mv (B n) difference information MPd (B n), relevant motion vector mv (C n) difference information MPd (C n) and relevant motion vector mv (D n) difference information MPd (D n).
Motion vector mv (X by the piece that will form by 8 * 8 pixels of corresponding SD image n) and as difference information MPd (A n) difference mv (A n)-mv (X n) be added to together, can reconstruct the motion vector mv (A of (acquisition) piece of forming by 8 * 8 upper left pixels of the macro block of HD image n).
Similarly, use the motion vector mv (X of SD image respectively n) and as the difference mv (B of difference information MPd n)-mv (X n), mv (C n)-mv (X n) and mv (D n)-mv (X n), the motion vector mv (B of energy reconstruct HD image n), mv (C n) and mv (D n).
As described below, MP1 reconstructor 125 shown in Figure 16 is used the motion vector mv (X of SD image n) and with the motion vector mv (A of this HD image n) relevant difference information MPd (An), the motion vector mv (A of reconstruct HD image n), as mentioned above.Similarly, MP1 reconstructor 125 is used the motion vector mv (A of SD image respectively n) and difference information MPd (B n), MPd (C n) and MPd (D n), the motion vector mv (B of reconstruct HD image n), motion vector mv (C n) and motion vector mv (D n).
Then, will the processing of carrying out in the recording controller 13 shown in Figure 13 be described with reference to flow chart shown in Figure 15.
When the HD image when HDTV video camera 12 offers recording controller 13, recording controller 13 receives these HD images and this HD image is offered HDD14, so that this HD image is recorded on the HDD14.Then, recording controller 13 is according to flow chart shown in Figure 15, for example when the user in executable operations on the operating unit (not shown) or when there is not pending processing in (basically), carry out and handle.
More particularly, input/output interface 21 reads the HD image and this HD image is offered MP1 from HDD14 and obtains unit 22.In step S51, the HD image of unit 22 from being provided by input/output interface 21 is provided MP1, obtains kinematic parameter MP1, and this kinematic parameter MP1 is offered MPd difference information acquisition unit 104 and compressor reducer 105.Simultaneously, MP1 obtains unit 22 and will offer downconverter 102 by the HD image that input/output interface 21 provides.Then, processing enters step S52.
At step S52, the pixel of each frame of the HD image that provides from MP1 acquisition unit 22 is provided downconverter 102, thereby the HD image transitions is become the SD image, the abstract image that it is made up of low volume data, and the SD image is offered MP2 obtain unit 103 and compressor reducer 105.Then, processing enters step S53.
At step S53, the SD image of unit 103 from being provided by downconverter 102 is provided MP2, obtains kinematic parameter MP2, and kinematic parameter MP2 is offered MPd difference information acquisition unit 104.Handle then and enter step S54.
At step S54, the MPd difference information obtain unit 104 obtain relevant from MP1 obtain kinematic parameter MP1 that unit 22 provides and the kinematic parameter MP2 that provides from MP2 acquisition unit 103 between the relevant difference information MPd of one or more differences, and difference information MPd offered multiplexer 24.Then, processing enters step S55.
At step S55, compressor reducer 105 uses from MP1 and obtains the kinematic parameter MP1 that unit 22 provides, and the SD image that is provided by downconverter 102 is provided, and final SD image compression data is offered multiplexer 24.Then, processing enters step S56.
For example, in passing through downconverter 102, with the pixel decimation of HD image is 1/4, obtained the SD image, and will be as the motion vector of kinematic parameter MP2 corresponding under the situation as four motion vectors of kinematic parameter MP1, as described in reference Figure 14, when compressor reducer 105 for example according to the MPEG scheme, use the motion vector of HD image, when carrying out compression, will be as corresponding to as the motion vector of mean value of four motion vectors of the motion vector MP1 of the motion vector of kinematic parameter MP2 or the like as the HD image.
In step S56, multiplexer 24 multiplexing from the MPd difference information obtain the unit 104 that provide, as the difference information MPd of moving parameter information and the SD image compression data that provides from compressor reducer 105, and final multiplex data offered input/output interface 21.Handle then and enter step S57.
At step S57, input/output interface 21 will offer HDD14 from the multiplex data that multiplexer 24 provides, so that multiplex data is recorded on the HDD14.Finish this processing then.
Figure 16 is illustrated under the situation of constructing recording controller 13 as shown in figure 13, the block diagram of the exemplary configurations of playback controller 15 shown in Figure 1.
In Figure 16, with identical numeral identical parts shown in Figure 11, and with suitably the descriptions thereof are omitted.
Playback controller 15 shown in Figure 16 comprises decompressor 123, MP1 reconstructor 125 and up converter 126, replaces decompressor 83 shown in Figure 11, MP1 reconstructor 84 and frame interpolater 85, and comprises that newly MP2 obtains unit 124.Other structures of playback controller 15 shown in Figure 16 are same as shown in Figure 11.
Decompressor 123 receives the SD image compression data from demodulation multiplexer 42.Decompressor 123 is according to the decompression scheme corresponding to the compression scheme that is adopted by compressor reducer shown in Figure 13 105, the SD image compression data that decompression is provided by demodulation multiplexer 42, and final SD image is offered image processor 43 and MP2 obtain unit 124.
The SD image of unit 124 from being provided by decompressor 83 is provided MP2, detect (calculatings) thereby and acquisition kinematic parameter MP2, and kinematic parameter MP2 offered MP1 reconstructor 125.
MP1 reconstructor 125 the difference information MPd that provided by demodulation multiplexer 42 is provided and is calculated by the kinematic parameter MP2 that MP2 obtains unit 124 and provides, thereby and obtain high-precision motion parameter MP1, and kinematic parameter MP1 is offered image processor 43.
Up converter 126 receives kinematic parameter MP1 from MP1 reconstructor 125, and (through denoiser 44) receives the SD image from decompressor 123.The kinematic parameter MP1 that is provided by MP1 reconstructor 125 is provided up converter 126, and carries out image processing on the SD image that is provided by decompressor 123 so that increase pixel count, that is, is carried out the interpolation of pixel.
Then, will the processing of carrying out in the playback controller 15 shown in Figure 16 be described with reference to flow chart shown in Figure 17.
When the image replaying instruction is sent to input/output interface 41, for example, when the user on the operating unit (not shown) during executable operations, in step S61, input/output interface 41 reads multiplex data from HDD14, and multiplex data is offered demodulation multiplexer 42.Then, processing enters step S62.
At step S62, the multiplex data demultiplexing that demodulation multiplexer 42 will be provided by input/output interface 41 is SD image compression data and difference information MPd.In addition.Demodulation multiplexer 42 offers decompressor 123 with the SD image compression data, and difference information MPd is offered MP1 reconstructor 125.Then, processing enters step S63.
At step S63, decompressor 123 is according to the decompression scheme corresponding to the compression scheme that is adopted by compressor reducer shown in Figure 13 105, the SD image compression data that decompression is provided by demodulation multiplexer 42, and final SD image is offered image processor 43 and MP2 obtain unit 124.Then, processing enters step S64.
At step S64, the SD image detection (calculatings) of unit 124 from being provided by decompressor 123 is provided MP2, thereby and acquisition kinematic parameter MP2, and kinematic parameter MP2 offered MP1 reconstructor 125.Then, processing enters step S65.
At step S65, MP1 reconstructor 125 the difference information MPd that provided by demodulation multiplexer 42 is provided and is obtained the kinematic parameter MP2 that unit 124 provides by MP2, reconstruct (acquisition) high-precision motion parameter MP1, and kinematic parameter MP1 offered image processor 43.Then, processing enters step S66.
At step S66, the kinematic parameter MP1 that is provided by MP1 reconstructor 125 is provided for image processor 43, carries out image processing on the SD image that provides by decompressor 123, and final image offered monitor 16.Finish this processing then.
Figure 18 be represent according to another embodiment of the present invention record and the block diagram of the exemplary configurations of playback system.
Record and playback system comprise recording equipment 141, HDTV video camera 142, reproducing device 151 and monitor 155.Recording equipment 141 comprises recording controller 143, HDD144 and transmission control unit (TCU) 145.Reproducing device 151 comprises reception controller 152, HDD153 and playback controller 154.
The structure of HDTV video camera 142 is identical with HDTV video camera 12 shown in Figure 1.The structure of recording controller 143 is identical with recording controller shown in Figure 1 13.
The multiplex data that the HDD144 record is provided by recording controller 143, similar with HDD14 shown in Figure 1.
The multiplex data that transmission control unit (TCU) 145 control is read from HDD144 is through for example the Internet, LAN (local area network (LAN)), or with the network of IEEE (Institute of Electrical and Electronics Engineers) 1394 or USB (USB) operating such, be sent to reproducing device 151.
Receive the multiplex data that controller 152 control examples transmit from recording equipment 141 as reception, and this multiplex data is sent to HDD153 so that multiplex data is recorded on the HDD153.
The HDD153 record is from receiving the multiplex data that controller 152 provides, and is similar with HDD14 shown in Figure 1.
Playback controller 154 is carried out with playback controller 15 shown in Figure 1 and is similarly handled, and final image is offered monitor 155 from the multiplex data that HDD153 reads in the HDD153 record.Monitor 155 structures are identical with monitor 16 shown in Figure 1.
Structure as mentioned above, in the record and playback system shown in Figure 180, for example, the HD image is offered the recording controller 143 of recording equipment 141 from HDTV video camera 142.Recording controller 143 is provided on the HD image that is provided by HDTV video camera 142 by processing, and is similar with recording controller 13 shown in Figure 1, and final multiplex data is sent to HDD144, so that multiplex data is recorded on the HDD144.Transmission control unit (TCU) 145 reads in the multiplex data that HDD144 goes up record, and through network or the like, multiplex data is sent to the reception controller 152 of reproducing device 151.
The reception controller 152 of reproducing device 151 receives the multiplex data that transmits from recording equipment 141, and this multiplex data is offered HDD153, so that this multiplex data is recorded on the HDD153.As required, playback controller 154 reads in the multiplex data that HDD153 goes up record, carries out with playback controller 15 shown in Figure 1 and similarly handles, and final image is outputed to monitor 155.
Figure 19 be expression according to program, carry out the block diagram of exemplary configurations of the computer of aforesaid a series of processing.
CPU (CPU) 201 carries out various processing according to program stored in ROM (read-only memory) 202 or memory cell 208.As required, the program carried out by CPU201 of RAM (random access memory) 203 storage, data or the like.CPU201, ROM202 and RAM203 are connected to each other through bus 204.
As CPU201, can adopt at " Cell tanjou " (Birth of Cell) NikkeiElectronics, Nikkei Business Publications, Inc., on February 28th, 2005, " Cell " described in the page or leaf 89-117.
CPU201 also is connected to input/output interface 205 through bus 204.Input/output interface 205 is connected to and comprises for example input unit 206 of keyboard, mouse, microphone or the like, and comprises for example output unit 207 of display, loud speaker or the like.CPU201 carries out various processing according to the instruction from input unit 206 inputs.Then, CPU204 outputs to output unit 207 with result.
Input/output interface 205 is also connected to memory cell 208.Memory cell 208 is made up of for example hard disk, and memory cell 208 storages are by the program and the various data of CPU201 execution.Communication unit 209, is carried out and is communicated by letter with external device (ED) such as the Internet or local area network (LAN) through network.
Simultaneously, can and be stored in the memory cell 208 through communication unit 209 acquisition programs.
In addition, drive 210 and be connected to input/output interface 205.Mounted thereto when removable medium 211, such as disk, CD, magneto optical disk, or semiconductor storage, drive 210 and drive these removable mediums 211 so that obtain program, data of record thereon or the like.As required, program that is obtained or data transmit and are stored in the memory cell 208.
Can carry out above-mentioned a series of processing by hardware or software.When carrying out a series of processings by software, the program that will constitute software from program recorded medium is installed on the computer of embedding specialized hardware, maybe can be by various programs mounted thereto, carry out on the all-purpose computer or the like of various functions.
Be used to store installation program on computers so that the program recorded medium that can carry out these programs by computer is interim or permanent storage program, for example removable medium 211, be the encapsulation medium that forms by disk (for example flexible disk), CD (for example CD-ROM (compact disk-read-only memory), DVD (digital universal disc) or magneto optical disk), semiconductor memory or the like, or the hard disk of ROM202, memory cell 208 or the like, as shown in figure 19.As required, through as interface, such as the communication unit 209 of router or modulator-demodulator, or through the wired or wireless communication medium, such as local area network (LAN), the Internet or digital satellite broadcasting, program can be stored on the program recorded medium.
The step that is defined in program stored on the program recorded medium can comprise not necessarily sequentially to be carried out, but the process that can walk abreast or carry out separately, and by described order, the sequentially process of Zhi Hanging.
In this manual, system is meant the integral body of a plurality of equipment.
One skilled in the art should appreciate that according to design needs and other factors, can expect various improvement, combination, sub-portfolio and change, as long as they fall in accessory claim or its equivalent scope.

Claims (31)

1. one kind is write down and reproducing device, is used for image is recorded in recording medium, and plays described image from described recording medium, and described record and reproducing device comprise:
First obtains device, is used for obtaining sports one or more kinematic parameter from first image;
Conversion equipment is used for described first image transitions is become second image of being made up of the data volume of lacking than described first image;
Recording control apparatus is used for moving parameter information and described second image are recorded in described recording medium, and described moving parameter information is relevant with the kinematic parameter of described first image;
Read control device is used for reading described moving parameter information and described second image from described recording medium; And
Image processing apparatus is used to use the kinematic parameter of described first image, and carries out image processing on second image that reads from described recording medium obtains the kinematic parameter of described first image from the described moving parameter information that is read by described recording medium.
2. record as claimed in claim 1 and reproducing device,
Wherein, the kinematic parameter that is obtained by the described first acquisition device comprises that the frequency band of the change of rank of the intensity of variation in motion vector, expression brightness or the color signal, the zoom ratio that degree is amplified or dwindled in expression, the specific rotation of representing swing, expression frequency band intensity of variation changes, and the one or more parameters in the focal variation of the intensity of variation of expression focus.
3. record as claimed in claim 1 and reproducing device,
Wherein, described conversion equipment is by extracting the frame of described first image, or extracts the pixel of each frame of described first image, described first image transitions become second image of being made up of data volume still less.
4. record as claimed in claim 1 and reproducing device,
Wherein, described image processing apparatus is with the one or more image processing that are implemented as in frame interpolation, up conversion, Y/C separation, noise reduction, object extraction and the I/P conversion.
5. record as claimed in claim 1 and reproducing device further comprise:
Second obtains device, is used for obtaining one or more kinematic parameters from described second image;
Difference information obtains device, is used to obtain the difference information about the one or more differences between the kinematic parameter of the kinematic parameter of described first image and described second image; And
Reconfiguration device is used for the kinematic parameter of described first image of reconstruct;
Wherein, described recording control apparatus is recorded in described difference information on the described recording medium, as described moving parameter information; And
Wherein, described reconfiguration device is by the kinematic parameter of described difference information and described second image, the kinematic parameter of described first image of reconstruct, read described difference information as moving parameter information from described recording medium, and the kinematic parameter that obtains described second image from described second image that reads by described recording medium.
6. record as claimed in claim 5 and reproducing device,
Wherein, described difference information obtains device and obtains in the kinematic parameter of described first image, only with the relevant difference information of one or more kinematic parameters that is used for by the image processing of described image processing apparatus execution.
7. record as claimed in claim 5 and reproducing device further comprise:
Compression set is used to use the kinematic parameter that is obtained by the described second acquisition device, and described second image compression is become packed data; And
Decompressing device is used for described packed data is de-compressed into described second image;
Wherein, described recording control apparatus is recorded in the packed data and the difference information of described second image on the described recording medium; And
Wherein, described read control device reads packed data and difference information from described recording medium.
8. record as claimed in claim 5 and reproducing device further comprise:
Compression set is used to use the kinematic parameter that is obtained by the described first acquisition device, and described second image compression is become packed data;
Decompressing device is used for described packed data is de-compressed into described second image; And
The 3rd obtains device, is used for obtaining one or more kinematic parameters from second image by described decompressing device decompression;
Wherein, described recording control apparatus is recorded in the packed data and the difference information of described second image on the described recording medium;
Wherein, described read control device reads described packed data and described difference information from described recording medium; And
Wherein, described reconfiguration device uses the kinematic parameter of described difference information and described second image, and the kinematic parameter of described first image of reconstruct, the kinematic parameter of described second image obtain device by the described the 3rd and obtain.
9. the record and the playback method of record and reproducing device are used for image is recorded in recording medium, and play described image from described recording medium, and described record and playback method comprise step:
Obtain sports one or more kinematic parameter from first image;
Described first image transitions is become second image of forming by the data volume of lacking than described first image;
Moving parameter information and described second image are recorded on the described recording medium, and described moving parameter information is relevant with the kinematic parameter of described first image;
Read described moving parameter information and described second image from described recording medium; And
Use the kinematic parameter of described first image, carries out image processing on second image that reads from described recording medium obtains the kinematic parameter of described first image from the described moving parameter information that is read by described recording medium.
10. a program that allows the computer executive logging and reset and handle is used for image is recorded in recording medium, and plays described image from described recording medium, and the described record and the processing of resetting comprise step:
Obtain sports one or more kinematic parameter from first image;
Described first image transitions is become second image of forming by the data volume of lacking than described first image;
Described moving parameter information and described second image are recorded on the described recording medium, and described moving parameter information is relevant with the kinematic parameter of described first image;
Read described moving parameter information and described second image from described recording medium; And
Use the kinematic parameter of described first image, carries out image processing on second image that reads from described recording medium obtains the kinematic parameter of described first image from the described moving parameter information that is read by described recording medium.
11. a recording equipment is used for image is recorded in recording medium, described recording equipment comprises:
First obtains device, is used for obtaining sports one or more kinematic parameter from first image;
Conversion equipment is used for described first image transitions is become second image of being made up of the data volume of lacking than described first image;
Recording control apparatus is used for moving parameter information and described second image are recorded in described recording medium, and described moving parameter information is relevant with the kinematic parameter of described first image.
12. recording equipment as claimed in claim 11 further comprises:
Transmission control unit, the described moving parameter information and described second image that are used for writing down on described recording medium are sent to another equipment that is used for playing image.
13. recording equipment as claimed in claim 11,
Wherein, the kinematic parameter that is obtained by the described first acquisition device comprises that the frequency band of the change of rank of the intensity of variation in motion vector, expression brightness or the color signal, the zoom ratio that degree is amplified or dwindled in expression, the specific rotation of representing swing, expression frequency band intensity of variation changes, and the one or more parameters in the focal variation of the intensity of variation of expression focus.
14. recording equipment as claimed in claim 11,
Wherein, described conversion equipment is by extracting the frame of described first image, or extracts the pixel of each frame of described first image, described first image transitions become second image of being made up of data volume still less.
15. recording equipment as claimed in claim 11 further comprises:
Second obtains device, is used for obtaining one or more kinematic parameters from described second image; And
Difference information obtains device, is used to obtain the difference information about the one or more differences between the kinematic parameter of the kinematic parameter of described first image and described second image;
Wherein, described recording control apparatus is recorded in described difference information on the described recording medium, as described moving parameter information.
16. recording equipment as claimed in claim 15,
Wherein, when the image processing apparatus of the reproducing device carries out image processing that is used for being used for playing image on second image that reads from described recording medium during carries out image processing, described difference information obtains device and obtains in the kinematic parameter of described first image, only with the relevant difference information of one or more kinematic parameters that is used for the image processing that described image processing apparatus carries out.
17. recording equipment as claimed in claim 15 further comprises:
Compression set is used to use the kinematic parameter that is obtained by the described second acquisition device, and described second image compression is become packed data;
Wherein, described recording control apparatus is recorded in the packed data and the difference information of described second image on the described recording medium.
18. recording equipment as claimed in claim 15 further comprises:
Compression set is used to use the kinematic parameter that is obtained by the described first acquisition device, and described second image compression is become packed data;
Wherein, described recording control apparatus is recorded in the packed data and the difference information of described second image on the described recording medium.
19. the recording method of a recording equipment is used for image is recorded in recording medium, described recording method comprises step:
Obtain sports one or more kinematic parameter from first image;
Described first image transitions is become second image of forming by the data volume of lacking than described first image; And
Moving parameter information and described second image are recorded on the described recording medium, and described moving parameter information is relevant with the kinematic parameter of described first image.
20. one kind is used to allow computer to carry out the program that is used for image is recorded in the recording processing on the recording medium, described recording processing comprises step:
Obtain sports one or more kinematic parameter from first image;
Described first image transitions is become second image of forming by the data volume of lacking than described first image; And
Moving parameter information and described second image are recorded on the described recording medium, and described moving parameter information is relevant with the kinematic parameter of described first image.
21. a reproducing device is used for playing image, described reproducing device comprises:
Read control device, be used for having write down from it the moving parameter information and the second record images medium, read described moving parameter information and described second image, described moving parameter information is relevant with one or more kinematic parameters of first image, and, obtain described second image by reducing the data volume of described first image; And
Image processing apparatus is used to use the kinematic parameter of described first image, and carries out image processing on second image that reads from described recording medium obtains the kinematic parameter of described first image from the described moving parameter information that is read by described recording medium.
22. reproducing device as claimed in claim 21 further comprises:
Receiving control device is used to receive described moving parameter information and described second image that transmits from another equipment,
Wherein, described moving parameter information and described second image that is received by described receiving control device is recorded on the described recording medium.
23. reproducing device as claimed in claim 21,
Wherein, described image processing apparatus is with the one or more image processing that are implemented as in frame interpolation, up conversion, Y/C separation, noise reduction, object extraction and the I/P conversion.
24. reproducing device as claimed in claim 21 further comprises:
Reconfiguration device is used for the kinematic parameter of described first image of reconstruct;
Wherein, the difference information about the one or more differences between one or more kinematic parameters of the kinematic parameter of described first image and described second image is recorded on the described recording medium, as moving parameter information; And
Wherein, described reconfiguration device is by the kinematic parameter of described difference information and described second image, the kinematic parameter of described first image of reconstruct, read described difference information from described recording medium, as described moving parameter information, and the kinematic parameter of described second image obtains from second image that is read by described recording medium.
25. reproducing device as claimed in claim 24 further comprises:
Decompressing device, be used for the packed data of described second image is de-compressed into described second image, by using the kinematic parameter of described second image, compress the packed data that described second image obtains described second image, and it is recorded on the described recording medium.
26. reproducing device as claimed in claim 24 further comprises:
Decompressing device is used for the packed data of described second image is de-compressed into second image, by using the kinematic parameter of described first image, compresses described second image, obtains this packed data, and it is recorded on the described recording medium; And
Obtain device, be used for obtaining one or more kinematic parameters from second image by described decompressing device decompression;
Wherein, described reconfiguration device uses the kinematic parameter of described difference information and described second image, and the kinematic parameter of described first image of reconstruct by described acquisition device, obtains the kinematic parameter of described second image.
27. the playback method of a reproducing device is used for playing image, described playback method comprises step:
Write down the recording medium of second image and moving parameter information from it, read described second image and described moving parameter information, described moving parameter information is relevant with one or more kinematic parameters of first image, and, obtain described second image by reducing the data volume of described first image; And
Use the kinematic parameter of described first image, carries out image processing on second image that reads from described recording medium obtains the kinematic parameter of described first image from the described moving parameter information that is read by described recording medium.
28. the program that the playback that allows the computer execution to be used for playing image is handled, described playback is handled and is comprised step:
Write down the recording medium of second image and moving parameter information from it, read described second image and described moving parameter information, described moving parameter information is relevant with one or more kinematic parameters of first image, and, obtain described second image by reducing the data volume of described first image; And
Use the kinematic parameter of described first image, carries out image processing on second image that reads from described recording medium obtains the kinematic parameter of described first image from the described moving parameter information that is read by described recording medium.
29. one kind is write down and reproducing device, is used for image is recorded in recording medium, and plays described image from described recording medium, described record and reproducing device comprise:
First obtains the unit, is configured to obtain sports one or more kinematic parameter from first image;
Transducer is configured to described first image transitions is become second image of being made up of the data volume of lacking than described first image;
Recording controller is configured to moving parameter information and described second image are recorded on the described recording medium, and described moving parameter information is relevant with the kinematic parameter of described first image;
Read Controller is configured to read described moving parameter information and described second image from described recording medium; And
Image processor is configured to use the kinematic parameter of described first image, and carries out image processing on second image that reads from described recording medium obtains the kinematic parameter of described first image from the described moving parameter information that is read by described recording medium.
30. a recording equipment is used for image is recorded in recording medium, described recording equipment comprises:
First obtains the unit, is configured to obtain sports one or more kinematic parameter from first image;
Transducer is configured to described first image transitions is become second image of being made up of the data volume of lacking than described first image; And
Recording controller is configured to moving parameter information and described second image are recorded on the described recording medium, and described moving parameter information is relevant with the kinematic parameter of described first image.
31. a reproducing device that is used for playing image, described reproducing device comprises:
Read Controller, be configured to write down from it the moving parameter information and the second record images medium, read described moving parameter information and described second image, described moving parameter information is relevant with one or more kinematic parameters of first image, and, obtain described second image by reducing the data volume of described first image; And
Image processor is configured to use the kinematic parameter of described first image, and carries out image processing on second image that reads from described recording medium obtains the kinematic parameter of described first image from the described moving parameter information that is read by described recording medium.
CN200610143979A 2005-11-07 2006-11-07 Recording and playback apparatus, and recording and playback method, recording apparatus and recording method, playback apparatus and playback method Expired - Fee Related CN100592778C (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2005322405 2005-11-07
JP2005322405A JP4529874B2 (en) 2005-11-07 2005-11-07 Recording / reproducing apparatus, recording / reproducing method, recording apparatus, recording method, reproducing apparatus, reproducing method, and program

Publications (2)

Publication Number Publication Date
CN1964460A true CN1964460A (en) 2007-05-16
CN100592778C CN100592778C (en) 2010-02-24

Family

ID=37594487

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200610143979A Expired - Fee Related CN100592778C (en) 2005-11-07 2006-11-07 Recording and playback apparatus, and recording and playback method, recording apparatus and recording method, playback apparatus and playback method

Country Status (6)

Country Link
US (1) US7983530B2 (en)
JP (1) JP4529874B2 (en)
KR (1) KR20070049074A (en)
CN (1) CN100592778C (en)
DE (1) DE102006051469A1 (en)
GB (1) GB2432473B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105657541A (en) * 2015-12-29 2016-06-08 华为技术有限公司 Frame processing method and device

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8526500B2 (en) * 2009-08-11 2013-09-03 Seiko Epson Corporation System and method for global inter-frame motion detection in video sequences
KR101893075B1 (en) * 2012-02-28 2018-08-30 삼성디스플레이 주식회사 Organic Light Emitting Display Device and Driving Method Thereof

Family Cites Families (28)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4963995A (en) * 1988-12-27 1990-10-16 Explore Technology, Inc. Audio/video transceiver apparatus including compression means
GB2248361B (en) * 1990-09-28 1994-06-01 Sony Broadcast & Communication Motion dependent video signal processing
US5647049A (en) * 1991-05-31 1997-07-08 Kabushiki Kaisha Toshiba Video recording/reproducing apparatus which uses a differential motion vector determined using two other motion vectors
EP0520765B1 (en) 1991-06-25 1999-05-12 Canon Kabushiki Kaisha Movement vector detecting method/apparatus and encoding method/apparatus using such method/apparatus
GB2264415B (en) 1992-02-13 1995-09-20 Sony Broadcast & Communication Motion compensation for colour video signals
US6236682B1 (en) * 1993-03-08 2001-05-22 Sony Corporation Video motion vector detection including rotation and/or zoom vector generation
JP3499254B2 (en) * 1993-06-04 2004-02-23 富士写真フイルム株式会社 Image data compression processing method
JPH08149480A (en) 1994-11-25 1996-06-07 Matsushita Electric Ind Co Ltd Image encoding device
CN1113537C (en) * 1996-12-06 2003-07-02 松下电器产业株式会社 Method and apparatus for transmitting, encoding and decoding video signal and recording/reproducing method of optical disc
US5844613A (en) * 1997-03-17 1998-12-01 Microsoft Corporation Global motion estimator for motion video signal encoding
US5929911A (en) * 1997-10-27 1999-07-27 International Business Machines Corporation Multiformat reduced memory MPEG-2 compliant decoder
KR100328417B1 (en) 1998-03-05 2002-03-16 마츠시타 덴끼 산교 가부시키가이샤 Image enconding/decoding apparatus, image encoding/decoding method, and data recording medium
JP3709092B2 (en) * 1999-03-09 2005-10-19 ペンタックス株式会社 Image compression apparatus and image expansion apparatus
KR20000059799A (en) * 1999-03-09 2000-10-05 구자홍 Device and method for motion compensation coding using wavelet coding
JP4224748B2 (en) 1999-09-13 2009-02-18 ソニー株式会社 Image encoding apparatus, image encoding method, image decoding apparatus, image decoding method, recording medium, and image processing apparatus
JP3797208B2 (en) * 2001-11-30 2006-07-12 日本ビクター株式会社 Color moving image encoding apparatus, decoding apparatus, encoding method, decoding method, and color moving image code string transmission method
GB0228281D0 (en) * 2002-12-04 2003-01-08 Imec Inter Uni Micro Electr Coding of motion vectors produced by wavelet-domain motion estimation
JP2004221757A (en) * 2003-01-10 2004-08-05 Renesas Technology Corp Motion detector and searching area shape variable- motion detector
US7869516B2 (en) * 2003-03-31 2011-01-11 Hewlett-Packard Development Company, L.P. Motion estimation using bit-wise block comparisons for video compresssion
US7567617B2 (en) * 2003-09-07 2009-07-28 Microsoft Corporation Predicting motion vectors for fields of forward-predicted interlaced video frames
US7317839B2 (en) * 2003-09-07 2008-01-08 Microsoft Corporation Chroma motion vector derivation for interlaced forward-predicted fields
US7474767B2 (en) 2003-09-24 2009-01-06 Avago Technologies Ecbu Ip (Singapore) Pte. Ltd. Motion detection using multi-resolution image processing
EP1574995A1 (en) * 2004-03-12 2005-09-14 Thomson Licensing S.A. Method for encoding interlaced digital video data
KR100631777B1 (en) * 2004-03-31 2006-10-12 삼성전자주식회사 Method and apparatus for effectively compressing motion vectors in multi-layer
EP1631089A1 (en) * 2004-08-30 2006-03-01 Matsushita Electric Industrial Co., Ltd. Video coding apparatus and decoding apparatus
US20060062303A1 (en) * 2004-09-17 2006-03-23 Sony Corporation Hybrid global motion estimator for video encoding
WO2006080662A1 (en) * 2004-10-21 2006-08-03 Samsung Electronics Co., Ltd. Method and apparatus for effectively compressing motion vectors in video coder based on multi-layer
KR100959541B1 (en) * 2005-10-05 2010-05-27 엘지전자 주식회사 Method and apparatus for a encoding/decoding video signal

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105657541A (en) * 2015-12-29 2016-06-08 华为技术有限公司 Frame processing method and device

Also Published As

Publication number Publication date
GB2432473A (en) 2007-05-23
US20070122131A1 (en) 2007-05-31
KR20070049074A (en) 2007-05-10
GB2432473B (en) 2010-06-02
DE102006051469A1 (en) 2007-05-10
US7983530B2 (en) 2011-07-19
JP2007129647A (en) 2007-05-24
GB0622183D0 (en) 2006-12-20
CN100592778C (en) 2010-02-24
JP4529874B2 (en) 2010-08-25

Similar Documents

Publication Publication Date Title
EP2161928B1 (en) Image processing device, image processing method, and program
JP3901287B2 (en) Video signal conversion apparatus, video signal conversion method, and video providing system
EP2094018A1 (en) Encoding apparatus for high frame rate videos, method and program
US10587892B2 (en) Image processing apparatus, image processing method, and program for generating motion compensated image data
JP5424930B2 (en) Image editing apparatus, control method thereof, and program
EP3570543A1 (en) Image processing device and image processing method
CN101969557B (en) Image recording device, and image recording method
CN101364305A (en) Electronic apparatus, motion vector detecting method, and program therefor
CN100592778C (en) Recording and playback apparatus, and recording and playback method, recording apparatus and recording method, playback apparatus and playback method
JP3532709B2 (en) Moving picture coding method and apparatus
JP4310689B2 (en) Signal processing apparatus and method, recording medium, and program
JP4574771B2 (en) Image information description method
JP2009100112A (en) Image signal processing apparatus and image signal processing method
EP2166758A2 (en) Image signal processing apparatus and image signal processing method
KR100982625B1 (en) Information signal processing device and processing method
JP6416255B2 (en) Image processing system and image processing method
JPH0851598A (en) Image information converter
JP3774988B2 (en) Still image capturing apparatus, color copying apparatus, and display apparatus
JP6316640B2 (en) VIDEO RECORDING DEVICE, VIDEO REPRODUCTION DEVICE, AND VIDEO RECORDING PROGRAM
JP4526529B2 (en) Video signal converter using hierarchical images
US20040179592A1 (en) Image coding apparatus
GB2443581A (en) Recording and playback using motion parameters and reduced data image version
JP2007027857A (en) Multimedia data recording device and method therefor
JPH08149465A (en) Band-compressed signal restoring device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20100224

Termination date: 20131107