CN1035747A - Utilize the coloring black and white signal of motion detection - Google Patents

Utilize the coloring black and white signal of motion detection Download PDF

Info

Publication number
CN1035747A
CN1035747A CN 88101312 CN88101312A CN1035747A CN 1035747 A CN1035747 A CN 1035747A CN 88101312 CN88101312 CN 88101312 CN 88101312 A CN88101312 A CN 88101312A CN 1035747 A CN1035747 A CN 1035747A
Authority
CN
China
Prior art keywords
picture
signal
motion
frame
video signal
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN 88101312
Other languages
Chinese (zh)
Inventor
威尔逊·马克里
布林·汉特
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Colorization Inc
Original Assignee
Colorization Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Colorization Inc filed Critical Colorization Inc
Priority to CN 88101312 priority Critical patent/CN1035747A/en
Publication of CN1035747A publication Critical patent/CN1035747A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Television Signal Processing For Recording (AREA)

Abstract

Monochrome film colorize method and equipment.Film transfers videotape to, utilizes generation movement mark in movable body edge in the picture, in order to noise reduction and painted.Select a frame to produce the color property sign indicating number to each scene of black-and-white film, adjacent pictures is all given same hue with it except that motive position.Motive position, an optional method is painted as pressing the direction of motion.New color property sign indicating number is as the painted reference of next frame.Color characteristic sign indicating number and black-and-white signal are combined into colour-video signal.

Description

Utilize the coloring black and white signal of motion detection
The present invention relates to a kind of motion detection of utilizing monochrome film is carried out method of colouring and device.
The televiewer is for the preference of colored scene rather than black and white scene, and feasible monochrome film to a large amount of storages carries out painted a kind of needs that become.
Painted to monochrome film, refer to the film of video tape form need on black-and-white video signal, add a colour subcarrier herein.Because a monochrome film is that this coloring process that is made of a large amount of picture is difficult.In the video tape signal that is produced by monochrome film, each picture constitutes a series of scan lines, and each scan line constitutes a series of point or pixel.Painted to the black-and-white film vision signal, the colour subcarrier value need be composed on each point or pixel of black-and-white film vision signal.Because the number of pixels in a frame picture is just very big, the number of picture elements in a film is just bigger certainly, so this process is very time taking.
Yet when the applicant had recognized that from a frame picture to the next frame picture, the change in the black-and-white film video tape signal changed corresponding to the brightness value of certain concrete part in the frame picture.The applicant has been found that each picture has only very little percentage, and with this variation, the variation from a frame picture to the next frame picture causes owing to mobile edge or noise.Only just can receive motor message,, keep identical brightness when a frame changes to another frame, being close to because corresponding to the point or the pixel of a moving target inside at the edge that moves.
Because when a frame picture changes to another frame picture, every frame only has very little percentage to change, thereby as long as each point or the pixel of a frame picture have been endowed color, the corresponding points of next frame picture or pixel just can be endowed same color, and change in color is only required in corresponding to the place of moving region carries out.This has reduced the painted necessary operations amount of monochrome film of giving effectively.
Therefore, just need be under the situation of not introducing noise, be partitioned into video tape signal section, and only give new color, and the colour signal of remainder still keeps identical at a frame during to another frame those parts corresponding to the vision signal of moving region corresponding to the moving region.By this method, can produce a color property sign indicating number and when it is combined with black-and-white video signal, just produce colour-video signal.Former monochrome film contains a noise contribution usually, its can detract interest of people's ornamental film.Because the noise between frame and the frame is at random, (thereby appearing at the different local of picture in succession) is so the method for the vision signal that this noise can be by average drawing in succession reduces.
Motion also occurs because of the difference of picture and picture, however it from a frame to descending the ground progression of frame picture.Thereby.The average method of picture in succession causes easily erases motion.
Therefore, people think always needs to avoid the picture part noise reduction of motion is arranged.This means to keep noise contribution in the moving region, but because the moving region is compared with stagnant zone is less, this noise can not upset spectators.
The topmost place of the present invention is to produce the color property sign indicating number and have the method for motion cue mark for the black-and-white video signal of being made up of continuous pictures provides a kind of.This method comprises: (a) determine in every frame picture with this picture in the pixel of motion video signal corresponding, to produce the motion cue mark of every frame picture; (b) give colour signal to the black-and-white video signal of a frame picture, to produce the color property sign indicating number; (c) select colored configuration mark method; (d) select and the adjacent picture (work picture) of picture (reference picture) with color property sign indicating number; (e) on the corresponding pixel with the colour signal tax work picture of the color property sign indicating number of reference picture, produce the color property sign indicating number of work picture; (f) use colored configuration mark method from removing colour signal corresponding to the pixel the work picture that change is arranged and the colour signal of moving object being composed to those pixels; (g) repeating step (d) arrives (f) color property sign indicating number of every frame picture generation to black-and-white video signal, and this color property sign indicating number is combined with black-and-white video signal, produces colour-video signal.
In another embodiment, comprise corresponding to the method for the video signal portions of moving region at determining of mentioning of above-mentioned (a) step and " select a motion thresholding; One of picture that two frames are contiguous is anti-phase and it is added to forms a composite signal on another frame, with the value of composite signal and motion thresholding relatively, produces a motor message, and amplitude is than the zone of motion thresholding in this signal indication composite signal; Every frame video signal is repeated these steps.
In another embodiment, described method also comprises by following step: vision signal is carried out noise reduction: select a frame video signal work picture, the picture of average at least two frame next-door neighbour work pictures produces the average picture of a frame; By from the work picture of motion cue mark indication motion, selecting brightness value, and indicate from the motion cue mark and to select brightness value to constitute a synthetic picture the nonmotile average picture; And the picture of every frame video signal repeated these steps.
Other embodiment of the present invention will see in the claim of this patent file.
Referring now to accompanying drawing, most preferred embodiment of the present invention is described by way of example.
Fig. 1 is the schematic diagram to the painted overall process of monochrome film.
Fig. 2 is the schematic diagram of recording colour vision signal process.
Fig. 3 is the schematic representation of apparatus that is used for producing the input signal that the motion cue mark takes place.
Fig. 4 is the schematic diagram that is used to produce the generator of motion cue mark.
Fig. 5 is the schematic diagram that is used for the motion cue mark on vision signal is carried out apparatus for encoding.
Fig. 6 is used for the schematic representation of apparatus of disengaging movement cue mark as painted computer input.
Fig. 7 is the schematic diagram of the pulse shaping circuit of a motion cue mark, and this mark is extended by the illustrated device of Fig. 4.
Fig. 8 is a schematic diagram that is used for the fuzzy edge controller of vision signal noise reduction.
Consult Fig. 1, generally include following process with the described black-and-white video signal of way of example painted here.
1. produce vision signal with standard broadcasting scanner (not marking) by monochrome film.Read the SMPTE audio frequency time encoding that was separated originally, and when the beginning of each frame picture, VITC(vertical flyback coding) place on video screen content 20 row before.As this VITC fixedly the time, provide video tape control.
2. read this black-and-white video signal by video tape reproducer 8 then, and be input to generator 12 by one group of single-image container 10.12 pairs in this generator has the picture of motion to produce the motion cue mark with unified signal form.
3. with improved standard coders 14, the motion cue mark as colour subcarrier, is coded on the black-and-white video signal.We use the line subcarrier for simplicity.
4. black-and-white video signal is input to painted computer 16 by a standard conveyer (not marking), and here the motion cue mark is by to separate in the black-and-white video signal.Mark and signal all are placed on the disk.Painted computer 16 is used to according to the motion cue mark video signal generating one color property sign indicating number.This computer has monitor 18, is used for observing the color property sign indicating number of its generation.Computer utilizes standard VITC counter to come the position of control of video signal by the VITC sign indicating number.
5. also be input to fuzzy edge controller 20 by the black-and-white video signal that produces by one group of single-image frame memory 10.Controller 20 utilizes at the 12 motion cue marks that produce and removes to mix the signal of being made up of average consecutive frame and non-average frame, is the signal of noise reduction to be created in its zone of moving not passive movement cue mark indication.If the noise of primary signal is enough little, just can omit noise reduction measure.
6. color property sign indicating number and de-noising video signal are delivered to the input of modulator/encoder 22 simultaneously by passage independently.The modulator of modulator/encoder 22 part is utilized the gray-scale modulation or colored the color property sign indicating number of drawing of black-and-white video signal in the known manner.Modulator is drawn various colors by the method that reduces color between complete black and full white level.Take out the encoder section of system device/encoder 22, for example the NTSC encoder as the red, green and blue colour subcarrier, is coded in the color property sign indicating number on the black-and-white video signal.
7. be input to color corrector 24 at 22 colour-video signals that produce,, there, can on monitor 26, observe colour-video signal as steersman (COX) color corrector.
8. described color corrector 24 can be used for revising 8 brightness values of black-and-white video signal, produces vision and strengthens image.Usually each scene of monochrome film is only required this process of doing once.Colour corrector 24 can be controlled by the microcomputer 28 that has digital-to-analogue converter (not marking).Microcomputer 28 can be controlled color color correction device 24 in program ground, and stores the required colour correction value of each scene on disk.When recording beginning, the corrected value of these storages is accessed and is used for working out last finished product.
9. arrive this step,, also do not have the video tape that includes the color/monochrome composite signal though seen last finished product.This will produce in editing process as shown in Figure 2 usually.The painted computer 16 of microcomputer 30 control, black and white enlarger 8 is also being controlled video tape recorder 34 and microcomputer 28, with in 34 recording color vision signals.Use a master tape that has with the same vertical flyback period of former monochrome image recording band coding.By the black-and-white video signal of enlarger 8 (noise reduction or do not have noise reduction) with from 16 li colour signals of coming of painted computer is driven use.Operator by microcomputer 30 selects master and slave position.Under the control of microcomputer 30, painted computer 16 is read colored tape, and black and white video tape recorder 8 is read the de-noising video signal.The output of painted computer 16 by modulator/encoder 22, with the intensity correction values correction black-and-white video signal of storing, is imported into colour corrector 24 with the de-noising video signal here again.Microcomputer 30 is also controlled the output of microcomputer 28.The output of colour corrector 24 is imported into video tape recorder 34 and records.Painted computer, replay video machine 8(are used for resetting) and video tape recorder each all be by editing microcomputer 30, utilize vertical flyback period on each tape to encode to control.In such a way, just can produce colored video tape 34.
Said process will be described in detail now.The generation of motion cue mark is at first described.This mark not only is used to monochrome film to produce the color property sign indicating number, also is used to produce the de-noising video signal.
The motion cue mark is the signal of moving region in a kind of instruction video signal.The motion cue mark comprise with vision signal in every frame picture each the row in each point or each pixel information corresponding.For convenience, the motion cue mark can be made up of the unit signal and the nonmotile zero-signal of expression of motion expression.If this motion cue mark is inserted black-and-white video signal as colour subcarrier, when black-and-white video signal and motion feature sign indicating number showed on screen together, the moving region was rendered as colored region so.
In the described here most preferred embodiment of the present invention, the motion cue mark that is produced includes indication has motion in vision signal unit value and the nonmotile null value of indication.Among Fig. 3, black-and-white video signal 36 input single-image containers 38, here, convenient for reference, the first frame picture is designated as A, and it is stored in 38 li of picture containers.Subsequently, be transported to single-image container 42 through data/address bus 40 again by 36 vision signals of importing, the picture that is stored in here is the picture that is postponed a frame by picture A, is designated as picture B for convenience's sake.This vision signal is transported to picture container 46 via data/address bus 44, and 46 li of video pictures containers, the picture conversation structure B that is stored has postponed a frame.For convenience, will make picture C at the 46 li picture of being stored marks of video pictures container.
With reference to Fig. 3, owing to store the process need time that postpones picture, need use the lock-out pulse and the pulse that disappears to come synchronous A, B, three pictures of C to every frame picture, with box lunch they when processed afterwards, have the part of the picture area of corresponding physical location in these pictures, can handle simultaneously.
Video pictures container 38,42 and 46 output signals be synchronously by with each video container 38,42, the 46 horizontal variable delay devices 48 that link to each other, and press the vertical variable delayer 50 that similar manner connects, and be connected the variable delay device 54 between video container 38 and the digital to analog converter 62 and be connected video container 42 and digital to analog converter 64 between variable delay device 56 finish.
Each all receives analog input and with the picture digitlization of storing video pictures container 38,42,46.The corresponding analog signal of simple shear head among Fig. 3, double shear head corresponding digital signals.Be input as digital to analog converter 62,64 in 58 and the 60 synchronous and blankings to digital to analog converter 62,64 and 66 places, it is synchronous that 66 output signal provides.
The corresponding picture A that digital to analog converter 62,64,66 digital signals with each video pictures container 38,42,46 convert to respectively at 68,70 and 72 places, the analog output signal of B, C, being separated under the reason of three pictures picture can introduce.Yet, having only and separate the adjacent pictures that is close together, the present invention just can realize.Tell about the method and apparatus that two pictures are combined now, suppose that combined picture is picture C and A.
Comprising by one group that the signal of telecommunication that the every row of many scan lines comprises many pixels again forms though should understand picture, will be that the signal of telecommunication is discussed by unit with the picture.
Referring to Fig. 4, picture A, the output of picture container 38 is to be imported into adder 74.Adder 74 can be a simple functional block easily, is formed by the integrated circuit 76 and the resistor 78,80 and 82 of 4.5 anti-phase summing amplifier by constituting gain.The integrated circuit both end voltage is among Fig. 4, and pin one is+12V that pin two is-12V that pin 3 is+5V.
When picture A was imported into adder 74, picture C also was input to adder 74 by inverter 84 after anti-phase.Inverter 84 can be easily is that the integrated circuit 86 and the resistor 88,90 of 0.6~2.0 motion amplifier formed by constituting variable gain, regulates the gain of inverter 84, and when making picture A equal picture C, adder 74 is that produce and be zero.
Integrated circuit 76 and 86 can be, for example the LM318N of National Semiconductor.
The output of adder 74 is composite signals, equals the negative value of difference of the bright value of the bright value of picture A and picture C, i.e. C-A.The output C-A of adder 74 is used as and is transported to two comparators 96 and 98, and comparator can be easily by the differential amplifier integrated circuit, as the LM306H formation of National Semiconductor.Output C-A signal with signal strength signal intensity, the absolute value that its size is defined as C-A here is C-A, it is along with two frame pictures, is the luminance difference of C and A and changing here.Like this, for example the movement edge with high brightness contrast between moving target and the static background will produce the C-A signal of a high value.The number of pixels of being crossed by the movement edge between the picture depends on the speed of moving target with respect to background.
Then, the value of C-A or composite signal is compared with the motion thresholding that the following mode that will describe is chosen.The motion thresholding is E except as otherwise noted.The positive threshold value that produces is input to comparator 96 through 100.The negative threshold value that produces is input to comparator 98 through 102.Threshold voltage can be provided by the power supply 104 through capacitor 106 ground connection, can regulate variable resistor 108 by the operator and change.Threshold voltage can be input to comparator 96 by amplifier 110 positive threshold value is provided, by amplifier 110 be input to comparator 98 by the inverter 112 that operational amplifier 114 and resistance 116,118 are formed negative threshold value is provided.Amplifier 110 and 112 can be as the LM5532N type integrated circuit of National Semiconductor each half.
When C-A is bigger than positive thresholding, the comparator 96 output unit signals among Fig. 4, in the C-A value during less than negative threshold value, comparator 98 output unit signals.Thereby when the merging output of comparator 96 and 98 is added up by adder 122, needing only C-A greater than the thresholding absolute value, the output of adder 122 is exactly unit signal.Adder 122 can be an OR-gate integrated circuit as shown in Figure 4 easily, and such integrated circuit can be used the MM74HC32 of National Semiconductor.
At input signal is unprocessed vision signal, signal by comparator 96 and 98 and adder 122 said on the processed continuously meaning, system described herein is simulated, and finds will be easy to manage manyly than carry out digitized processing in computer when being used for the film coloring process.But, in adder 74, add up mutually and in comparator 96 and 98 with on the meaning that threshold value is compared, say that the system of description is again digitized in the corresponding pixel value of adjacent picture A and anti-phase picture C.
Threshold value definite as follows.Noise in the mute with a frame typically at random to another frame picture, in picture in succession and be not inclined to and appear at same place.Thereby when getting the luminance difference of adjacent pictures, noise also remains in the synthetic C-A signal.
Yet luminance difference also can be caused by motion, also contains noise information so synthetic C-A signal has both comprised movable information.The applicant has been found that noise generally causes less C-A value than motion.Movement edge is the border of sharp contrast degree normally, and noise generally is to be an intermediate gray-scale value on the background of middle-gray range in mean flow rate.Therefore small poor in the movement edge both sides of the difference of noise and background.
Can distinguish noise and motion by the careful threshold value of selecting that adjusting variable resistance 108 is obtained.Comparator 96 and 98 output those greater than positive thresholding or less than the C-A value of negative thresholding, this threshold value can be referred to as motion thresholding or noise gate.
Therefore, the output of adder 22 is signals of strong contrasted zones between an indication adjacent pictures.In this embodiment, the adjacent frame that means inserts picture.This composite signal is referred to as the motion feature sign indicating number.For to whole video signal establishment motion feature sign indicating number, the whole video signal is sequentially by system as described herein, and each picture except first and last, becomes picture B again successively.
The resultant motion signal of one frame picture or motion feature sign indicating number are used as colour subcarrier such as green then and insert picture C.If watch the black-and-white video signal that has the green movement condition code, movement edge is green flash of light, and this helps to determine in every frame picture corresponding to the zone of moving for the painted operator of monochrome film on a frame one frame ground.In addition, thus observing the motion feature sign indicating number just can change the motion thresholding eliminate noise from the motion feature sign indicating number under not eliminating motion conditions.
Thereby if the motion thresholding is too low, noise will occur as green.If the motion thresholding is too high, in background luminance and the approaching place of movement edge brightness, the moving region will be lost.The operator can adjust this motion thresholding with the method for regulating variable resistance 108 simply.Though it is difficult reading all motions in noisy occasion, can make any loss of motion all drop to minimum level by the method for reasonably adjusting the motion thresholding.If noise level is not too high, and thresholding is selected through suitable, and the motion of loss generally will can not have a strong impact on final products.
Be video signal generating color property sign indicating number, in painted computer 16, carry out that as the Dubner GBG-2 graphic computer of the Dubner computer system company of New Jersey, the Dubner graphic computer generally is used to produce motion picture film.This computer can be used in conjunction with black-and-white video signal and motion cue mark, produces vision signal color property sign indicating number, and need not the hard work with the every frame picture of Freehandhand-drawing (using graphic computer) vision signal.
Here in the most preferred embodiment of Miao Shuing, the motion cue mark of being exported by the C-A generator also possesses the condition that inputs to graphic computer.In order to be input into graphic computer, the motion cue mark, at first to be encoded on the black-and-white video signal of wanting painted as the colour subcarrier on the vision signal, then when being input to graphic computer again to separate in the vision signal, make graphic computer have its where having motion in every frame video signal of a signalisation to take place.
For with the motion cue mark to video signal coding, in order on the black-and-white video signal that can buy in a large number, to variegate the subcarrier coding, our following such encoder 14 that improved.Referring to Fig. 5, colour subcarrier is 124 through as shown in the figure grounding resistor 126, and capacitor 128 and resistor 130 are transfused to encoder, and are integrated circuit 132, as the LM318N integrated circuit of National Semiconductor, and buffering and direct current double right shift.The voltage of pin 4,5,6 is provided by the voltage modulator circuit 134 that capacitor 136,138 and adjuster 140 show in Fig. 5, adjuster circuit 134 with direct current 9V input, provide-5V at 4 ends, OV is provided, provides+4V at 5 ends, and input to integrated circuit like that as shown in the figure at 6 ends.
Then, the colour subcarrier of input by integrated circuit 142, is adjusted level as LM318N type and 143 of variable resistors.The output of integrated circuit 142 is transported to integrated circuit 144, and it is one group of bidirectional analog switch, can be by the MM54 HC4066 of motorola inc.The motion cue mark that is produced by the C-A generator is imported into 146 and has resistor 152,154, and two triodes 148 of 156 and 158 and 150 are then delivered to integrated circuit 144.The switch of integrated circuit 144 is to be controlled by the pulse of C-A generator.
When the indication of motion cue mark had motion, integrated circuit 144 closures allowed colour subcarrier be inserted on the vision signal of exporting from encoder 14 by capacitor 160 and at diagram 162 places.When indication did not have motion, integrated circuit 144 was an open circuit, does not influence the vision signal of output.
In order to be input to painted computer 16, the motion cue mark is the colour subcarrier on vision signal now, is separated according to the following procedure on vision signal.Referring to Fig. 6, the vision signal of coding by one by capacitor 166 and resistor 168 and 170 and the band pass filter 164 formed of inductor 172, it can be the product of National Semiconductor to be transported to integrated circuit 174(, LM733CH), this circuit is used as buffer, and produces the colour subcarrier conveying capacity that opens 2 mutual out-phase 180 degree at 180 places.These conveying capacities are by 182 rectifications of diode capacitance filter and a filtering that has capacitor 188 and resistance 190, and filter 182 is the diode of IN914 by model and forms at the capacitor 186 of integrated circuit 174 outputs.It is double subcarrier that this circuit has motion place in 192 output in the indication of motion cue mark.This double subcarrier is imported into a high-speed comparator 194, National Semiconductor's LM710CH integrated circuit of producing for example, and its level is adjusted to and can detects double subcarrier.Resistor 196 is in the comparator feedback control loop, and reference level is by resistor 200, and the circuit 198 that voltage divider 202 and capacitor 204 are formed produces.Constant level signal of these high-speed comparator 194 outputs when the indication of motion cue mark has motion.This constant level signal is by resistor 206, and triode 208 and resistor 210,214 and capacitor 212 are sent into painted computer 16, and the place that makes the pattern coloring computer be instructed to motion on vision signal produces a signal.The two-fold subcarrier also by field effect (FET) transistor 193 and triode 195 and resistor 197,199,201 and by capacitor 205 and resistor 203 at 191 places output remove to drive an oscilloscope, to adjust the thresholding of the motion detector of controlling by voltage divider 202.
As previously mentioned, painted computer can produce the color property sign indicating number for every frame picture of vision signal.When color property sign indicating number quilt was again on black-and-white video signal, vision signal had seemed look.Painted computer passes through the method for a color of each configuration of pixels of each picture of vision signal is produced the color property sign indicating number.This color can utilize mouse beacon manually to dispose, and any one in also can ining all sorts of ways disposes by painted computer.
In general, monochrome film is made up of a series of independently scenes.The color that has been found that any scene does not from first to last have great changes.Therefore in some occasions,,, come to all the other pictures of scene painted with painted computer 16 according to the motion cue mark then as long as give the first frame picture hand colouring in order to give black-and-white video signal painted.This just can be by an operator with painted computer 16(as having mouse beacon) color scheme given the pixel of every frame picture in the vision signal.This look of painting carries out black-and-white video signal on colour correction monitor 26.This colour just appears at the colour on the painted computer monitor 18.Subsequently, this picture that is colored is stored in the memory of painted computer 16.For beginning operation, painted computer 16 requires to have following several key elements, just can begin to carry out painted automatically to the scene of black-and-white video signal: use as described in according with and the first frame picture of the scene that produces (for it is good equally that the reverse work of this process is got, this can be last picture, or any midway film of selecting) the color property sign indicating number; The motion cue mark and the black-and-white video signal of vision signal.The painted of picture is to carry out to the Automatic Program ground of compiling in 16 li utilizations of painted computer for this reason.To describe the operation of this program here, and the copy of this program is attached to the back as a present disclosure part.
In a scene automatic painted, painted computer 16 is adjusted to the picture of a secondary tracking some, makes the operator can polish any wrong distribution of color on request.Thereby in order to begin operation, the operator will select and send into picture interval to computer, and this computer is adjusted to can follow the tracks of a group of pictures.Selecteed interval is different because of film, and different because of scene, but generally is 2 or 4.In order to begin operation, painted computer 16 also requires the time encoding (VITC) of painted initial picture and discerns the color information of the initial color property sign indicating number of being selected by the operator.As long as one receive this information of operator, just selecteed color property sign indicating number is packed into its graphics card of painted computer.Painted computer 16 also utilizes time encoding, the picture (work picture) of black-and-white video signal to be colored is deposited in its memory.
If picture interval is 2, if work picture be picture C so the color property sign indicating number will be the color property sign indicating number of picture A, picture A also is designated as reference picture here.The motion cue mark of picture C will derive by checking that picture C and A(see about the discussion of C-A generator.In the condition code of packing into, be inserted into motion cue mark on the black-and-white video signal as colour subcarrier, from black-and-white video signal, separated, and be digitized and be stored in the memory of painted computer 16.Any picture between work picture and reference picture is endowed with the same color property sign indicating number of reference picture.Because do not have a large amount of moving between picture usually, we find that this can not have much influences to last generation.
The operator be for will select a kind of program to the work picture is painted, and it can be in several programs of using the motion cue mark for same color property sign indicating number described below any one.Thereby each pixel of work picture has and the corresponding same colour signal of reference picture pixel.
The coloring process pixel is as described below like that, with colour signal from the work picture corresponding to having mobile pixel location to move between the picture with working at reference picture.This step occurs in all painted processes of picture.
In a frame picture coloring process, painted computer 16 is determined moving direction by comparing the motion cue mark of reference picture and work picture.Be specified with those pixels and be endowed the suitable color of indicating by the direction of motion by the mobile corresponding work picture of that indicated frame of motion cue mark.
This equates according to the direction of motion in the work picture mobile chrominance signal to substitute the colour signal be removed.In order to do these, process supposes that the forward position of moving in the reference picture is equivalent to the back edge of moving in the work picture.Therefore, if the A picture is the work picture, picture C is a reference picture, so the motion forward position among the picture C just after the motion of supposition and picture A along identical.Only at picture A, the color that occurs between the forward position of work picture and the edge, back changes.
In other words, be according to the motion forward position in the color property sign indicating number of work picture, promptly move forward the colour signal of the pixel of a side, with colour signal compose in the work picture with the corresponding pixel of motion on.Thereby the background place that manifests at mobile object gives the colour signal of background, and is kept off the place in background, gives the colour signal of moving object.So the mobile motion cue mark that only occurs in the work picture of colour signal is pointed out in the zone of motion.If picture interval is not , its process is answered corresponding correction, but principle promptly moves colour along the direction of motion and remains unchanged with the color that replaces corresponding to the pixel that moves.
The colored tracking once finishing automatically in the manner described, the operator can determine whether all motions all look, whether vicious color is moved.The operator can utilize the standard painting system of coloring process manually to revise picture then.This program is a standard mouse beacon that joins with painting system, has the ability of doing following work: drawing, change the brush size, and select the palette position to move to left or move to right, and fill a closed area.
When work the completing of picture, painted computer 16 just completed colour picture storage on disk, and accompany by suitable identifier.The color property sign indicating number of work picture also is stored in the storage buffer as the reference of following the tracks of next picture.Computer upgrades required image time coding by increase the method for Counter Value according to the number of tracked picture then, name of the information, and (discerning the color property sign indicating number of usefulness after being) number.Thereafter, this program is returned and is made this circulation proceed to be done up to picture sequence.The subclass of black-and-white video signal scene can be colored by this way.
In case the operator has been satisfied with to the color that is colored picture, the operator just can select a NEW BEGINNING position, and this process can begin all to be colored up to film again.
Painted another kind of process is as follows: computer can be according to the grey level color matching of pixel.Just for work picture each movement edge, computer can be in an adjacent pictures (this can be the work picture) seek contiguous movement edge and the pixel that gives the grey level in the fixed movement edge pixel grey level scope arranged, and according to the colour signal of the color property sign indicating number of pixel in this grey level scope with color scheme to the movement edge pixel.Also can use other process.As grey level according to the movement edge either side, or according to the direction of motion.Can on several pictures, seek the pixel of corresponding grey scale level, perhaps can on more than a frame picture, analyze the direction of motion.
By graphic computer color property sign indicating number that produce and that described in the above, can be presented on the colour correction monitor 26 with black-and-white video signal, to produce colour signal.In order to do these, the color property sign indicating number is used as colour subcarrier and is coded on the black-and-white signal, to produce the painted vision signal of standard.If desired, the colour of color property sign indicating number can wait multi-color cord by colour subcarrier being modulated to draw on the black-and-white video signal.Also can use if desired colour corrector 24 for example steersman (COX) colour corrector improve the visual characteristic of painted vision signal.
Referring to Fig. 1, the output of painted computer 16 and black-and-white video signal (can be the noise reduction that will talk about below) merge in modulator/encoder 22.The contrary level of best colour signal is to change as a function of black-and-white video signal brightness.Particularly, the look level at Gao Heigao white level place can reduce to strengthen the visual quality of colour-video signal.
The colour signal that is input to modulator/encoder 22 is the colour subcarrier that is operated in triode-triode-logic (TTL) level, and it is at a standard N TS(National Telerision Standard Commiffee) be coded on the luminance signal of black-and-white video signal in the encoder.Composite color signal is imported into colour corrector 24.
Colour corrector 22 can be that this colour corrector of a steersman (COX) colour corrector (COX Color Corrector) can be used to revise 8 variablees determining black-and-white video signal brightness.They are that peak value is black, ash, white, peak white, black level, from level, γ level and chromaticity.22 brightness of revising black-and-white video signal of colour corrector, but its monitor 26 can show black and white and colour signal.
Colour corrector 24 is controlled by a microcomputer 28, and for example: the IBM-PC of IBM Corporation, operator use microcomputer 28 to change the brightness of a certain picture, and this can observe on monitor 26.Microcomputer 28 also is used for storing correction value on disk.Microcomputer 28 and colour corrector 24 are that the digital to analog converter by known structure is connected, so their I/O is compatible.
Any programming in the known several language of microcomputer 28 usefulness to carry out following operation.
Microcomputer 28 receives the information of 8 passages of 8 brightness variablees of expression from colour corrector 24 by the digital to analog converter interface between colour corrector 24 and microcomputer 28.The keyboard of microcomputer 28 can be used for revising 8 brightness values, and update information is stored on the disk.The frame picture all stores has 8 brightness variablees of expression to add 12 values of 4 colored variablees.When whole object view under the control of painted computer 16, utilize VITC counter (not marking), processed by colour corrector 24, correction value just is stored on the disk by microcomputer 28, and it is other to use the time encoding that is derived by VITC to be debated.After, during encoding, when black-and-white video signal was read out, correction value can be read colored corrector 24 from disk.
In order to encode, the operator is sitting in painted computer 16, microcomputer 28 and microcomputer 30(for example, the CMX computer of CMX company) keyboard before work.
For black-and-white video signal and color property sign indicating number and the brightness correction value of being stored by microcomputer 28 are combined; These outputs synchronously.Use is inserted in the VITC time encoding on color property sign indicating number and the black-and-white video signal, just can accomplish this point.
Identical time encoding is placed on the master tape of record colour signal.The operator tells painted computer 16 to be used to wait to record the time encoding of scene, and make computer 28 set, make suitable correction value be ready to output, also will preset black-and-white video signal enlarger 8 makes it resetting on the correct time encoding and giving and put video tape recorder 34 and record on correct time encoding.Black-and-white video signal can be a noise reduction, also can be noise reduction not.Because visual playback machine 8 and video tape recorder 34 have a stable good leader tape part, are equipped with 6 frames so painted computer 16 is drawn before treating the record part.Microcomputer 30 make all operations at one time, beginning, and guarantee that when painted computer 16 began to export, all time encodings were all by synchronously.
Output by the painted computer of being formed by the color property sign indicating number of the scene recorded 16 merges mutually with the output of black-and-white video signal playback machine 8 in encoder 22.Use the value of storing to carry out colour correction by painted adjuster 24.Carry out colour-video signal after the colour correction by video tape recorder 34 records down to produce colour-video signal.
As mentioned above, black-and-white video signal also can be as following by noise reduction.
Fortune is driven cue mark and also can be used to eliminate noise and don't fuzzy movement edge from vision signal.The method and apparatus of carrying out this noise reduction is just described now.
For the embodiments described herein, the desired movement cue mark is made up of a series of pulses, and for example each is+5V voltage, and each pulse is extended in the corresponding pixel coverage of movement edge in those and vision signal of a frame picture.Is the part of stationary object or the pixel of representing the part of a moving object inside corresponding to expression in the signal from a frame picture to the next frame picture to those, and this mark preferably has zero level.Motion cue mark as above-mentioned generation just forms a kind of good input.
The general use of motion cue mark is as follows.At first the motion cue mark is to indicate the both sides of each pulse of moving region to be trimmed to the slope.Next selects a frame video signal as key frame.At least two frames are average with key frame with the adjacent picture of key frame then.Key frame and average picture are input in the device that will be discussed in more detail below together.The output of this device is determined by the motion cue mark.Indicate the place that motion is arranged at the motion cue mark, select main screen signal as output.Indicate the place that does not have motion at the motion cue mark, the signal that selects average picture is as output.The picture part adjacent with the moving region will be subjected to the influence on motion cue mark slope, and this slope is used for merging progressively key frame and average picture between moving region and other zones.Interface between this slope assurance noise reduction and normal video signal is (this is known as fuzzy edge control) of bluring, so the synthetic output that produces is noise reduction in the major part of picture, except with the corresponding zone of strenuous exercise, and mobile edge is provided with and is darkened.
Referring to Fig. 4, at the output of the C-A generator shown in 220, each pulse of motion cue mark is elongated, and the amount of elongation following manner is determined.
The pulse of motion cue mark, by integrated circuit 122,222,224 and 226 and resistor 228, extended in the circuit that variable resistance 230 and capacitor 232 are formed.Output 220 is exactly the input at 234 places, and the pulse of being extended is in 236 outputs.Integrated circuit 122 and 222 can be the MM74HC32 of Motorola semiconductor device company for example.Integrated circuit 224 and 226 can be respectively the 74LS121 of Texas instrument company and the MM74HC04 of motorola inc.
Have the motion cue mark that extends pulse by pulse former shown in Figure 7 rising and fall time to slow down pulse.This step is the input that the square-wave pulse of motion cue mark is delivered to integrated circuit 240 through resistor 238 to be brought in finish, and this integrated circuit can be the LM318N of National Semiconductor, and it is configured an integrator that slows down and change between level.Oblique wave speed is by the voltage divider in the feedback control loop of integrated circuit 240 242, resistor 244 and capacitor 246, and resistor 249,250 is controlled together.Integrated circuit 248 can be LM318N.
Then, pulse shaping circuit is admitted to fuzzy edge controller among Fig. 8 in 251 output as 252 input.
The mean value of three frame adjacent pictures in the black-and-white video signal is to be transfused to 254 by resistance 258 and earth resistance 260.Very clear, can get other mean value, but this mean value is better.The midway film of three frame adjacent pictures is to import by resistor 262 and earth resistance 264 backs 256 as key frame.
Variable gain amplifier 266 and 268(each can be the integrated circuit CA3080A of RCA and resistor 270,272 and 274 and capacitor 276 together) be by can being the LM318N of National Semiconductor by integrated circuit 278 and these two of 280() the paraphase control device formed controls.Variable gain amplifier 266 and 268 output by behind the resistor 284,286, are additions at the amplifier that is made of integrated circuit 282 respectively, and this integrated circuit can be LM318N.
Integrated circuit 278 and 280 gain are inverted mutually, and this makes that amplifier 266 and 268 is inverted mutually.Therefore, when motion occurs, the mark input 252, the gain that just increases amplifier 268; When motion does not take place, just reduce gain.Opposite process takes place in 266 of pair amplifiers.By this way, the input signal of average picture and motion picture is blended in 288 the output.
Integrated circuit 278 and 280 is respectively by the voltage divider in its feedback loop 286,288 control, feedback loop with shown in mode be connected with resistor 294,296,298 and 300 and variable resistance 302,304.Integrated circuit voltage tie point 1,2,3,4 is+12V-12V ,+5V ,-5V respectively.
Like this, the slopeization of motion cue mark guarantees that conversion place of output between motion and non-motion 285 demonstrates fuzzy edge.The application of fuzzy edgeization has improved the visual performance of de-noising signal, has avoided any dazzling and visible defiber.
Can improve quality by adjusting oblique wave speed in the motion video at movement edge place.Requirement adds long pulse and retouches the mark part that shows motion so that oblique wave is no more than.If the motion parts of mark has the slope, image quality may just weaken.The degree that prolongs depends on the method for obliqueization motion impulse of use and the speed of obliqueization.This de-noising video signal can combine with top described mode and the color property sign indicating number that has produced with painted computer 16, produces colour-video signal.
The various modification of method and apparatus described here can not left the present invention spirit and make. For example, in the C-A generator, the picture that is inverted can be any frame of some contiguous pictures. If the number of pictures between the picture that is compared is increased and the constraint of loss of accuracy by the number of picture just. In other words, mutually away from picture between difference can be because motion or the number of edges of intervention or other variations in the picture of a plurality of movement edges. So the most handy contiguous screen operation, such as two pictures delays here.
In addition, in the claims, " picture " can be any subset of vision signal. For example, vision signal can be line by line processing or a few frame pictures of single treatment.
In addition, when the pixel that colour signal is assigned in the black-and-white video signal, the process of configuration colour signal, available other processes in addition of describing here. Can come paintedly with those determined colors of brightness value of having specified by color such as the part of adjacent pictures. Can also seek the corresponding colored color that also disposes on this basis at a few frame pictures.
Moreover, although we find to produce average picture with three frame continuous pictures to input to the fuzzy edge controller be best in noise reduction, be possible with other picture combinations.

Claims (21)

1, produced a kind of method of colour-video signal by black-and-white video signal, black-and-white video signal is made up of many frame continuous pictures, and every frame picture includes many pixels again, and its feature of this method comprises:
(a) determine to be arranged in the picture pixel of every frame black-and-white video signal of moving region, so that produce the cue mark of the motion of each frame;
(b) chrominance signal is distributed to a frame black-and-white video signal to produce the color property sign indicating number;
(c) be chosen as the colouration process that the pixel in the picture distributes chrominance signal;
(d) selection has the adjacent picture (work picture) of picture (reference picture) of color property sign indicating number.
(e) chrominance signal of reference picture color property sign indicating number is distributed to pixel corresponding in the work picture, to produce the color property sign indicating number of work picture;
(f) implement match color procedure replace in the work picture color property sign indicating number with the determined work picture of motion cue mark in the chrominance signal of the corresponding pixel in zone of action;
(g) repeating step (d) and (f) produce the color property sign indicating number of each frame black-and-white video signal; And the color property sign indicating number combined with black-and-white video signal produce colour-video signal.
2, the method for claim 1, it is characterized by the colouration process trample one the step comprise:
The motion cue mark of analytical work picture and reference picture, and the pixel location of zone of action in the pixel location of moving region in the reference picture and the work picture compared, determine the direction of motion; Remove chrominance signal on the pixel with the work picture, and use the method that moves chrominance signal by the direction of motion to give these pixels chrominance signal corresponding to the color property sign indicating number in motion picture zone.
3, the colouration process that the process of claim 1 wherein comprises:
Be the pixel corresponding to motion of work picture, seek and the adjoining black-and-white video signal pixel of pixel, and have and the pixel that gives the grey level in the fixed grey level scope, to produce one group of adjacent image point corresponding to the pixel that moves corresponding to motion; And with the colour signal of adjacent image point compose to corresponding to the motion pixel.
4, the method for claim 2, the process that it is characterized by the motion cue mark comprises:
Select the motion threshold value of difference motion and noise;
One frame video signal is anti-phase;
Consecutive frame and anti-phase frame addition are produced composite signal;
The amplitude of composite signal is compared with the motion threshold value, producing motor message, in this signal indication composite signal amplitude greater than the pixel of motion threshold value, and
Each frame to vision signal repeats these steps, to produce the motion cue mark of this vision signal.
5, the method for claim 3, it is characterized by the motion cue mark determine comprise:
Select the motion threshold value of difference motion and noise;
One frame video signal is anti-phase;
Consecutive frame and anti-phase frame addition are produced composite signal;
The amplitude of composite signal is compared with the motion threshold value, and producing motor message, this signal indicates in the composite signal amplitude greater than the pixel of motion threshold value;
Each frame to vision signal repeats these steps, to produce the motion cue mark of vision signal.
6, the method for claim 4 is characterized by and also further comprises the black-and-white video signal noise reduction, by:
Select a prime frame vision signal;
At least two frame pictures before adjacent with key frame are averaged, produce an average picture;
By selecting to select the method for each brightness value to construct the compound picture of a frame in each brightness value and the average picture in the key frame that the moving region is arranged with the indication of motion cue mark with the no moving region of motion cue mark indication; And
Every frame video signal is repeated these steps, produce the vision signal of noise reduction.
7, the method for claim 5 is characterized by and also further comprises the black-and-white video signal noise reduction, by,
Select a prime frame vision signal;
At least two frame pictures adjacent with key frame are averaged, produce the average picture of a frame;
By selecting each brightness value and from the average picture of the no moving region of motion cue mark indication, select each brightness value to construct the compound picture of a frame the key frame that the moving region is arranged from the indication of motion cue mark; And
Every frame video signal is repeated these steps, produce the vision signal of noise reduction.
8, the method for claim 6, it is characterized by that the composite signal amplitude compares with the motion threshold value is by composite signal and positive motion thresholding being compared, produce first signal, its index signal intensity is greater than the composite signal zone of motion threshold value; Composite signal and negative motion thresholding are compared, produce secondary signal, its index signal intensity is less than the composite signal zone of negative motion threshold value; Make up first and second signals, produce described motor message.
9, the method for claim 7, it is characterized by that the composite signal amplitude compares with the motion threshold value is by composite signal and positive motion thresholding being compared, produce first signal, its index signal intensity is greater than the composite signal zone of motion threshold value; Composite signal and negative motion thresholding are compared, produce secondary signal, its index signal intensity is less than the composite signal zone of negative motion threshold value; Make up first and second signals, produce described motor message.
10, the method for claim 8, its feature also comprise to be made motion cue mark slopeization and makes average picture and the mixing of key frame fuzzy edge ground.
11, the method for claim 9, its feature also comprise to be made motion cue mark slopeization and makes average picture and the mixing of key frame fuzzy edge ground.
12, the method for claim 10 is characterized by the picture that carries out anti-phase picture than being added on the anti-phase picture and postpones two frames.
13, the method for claim 11 is characterized by the picture that carries out the phase phase and postpones two frames than the picture that is added on the anti-phase picture.
14, the method for claim 12 is characterized by and averages picture, comprises first frame picture of average picture front and the first frame picture of average picture back.
15, the method for claim 13 is characterized by and averages picture, comprises first frame picture of average picture front and the first frame picture of average picture back.
16, the method for claim 14 is characterized by the work picture and postpones two frames than reference picture.
17, the method for claim 15 is characterized by the work picture and postpones two frames than reference picture.
18, the method for claim 5, it is characterized by the method for determining the motion cue mark is to carry out in such equipment, it comprises:
Select the device of fortune fortune threshold value;
The inverter apparatus that one frame video signal is anti-phase;
Adjacent pictures is added to the addition assembling device that produces composite signal on the anti-phase picture; And
Comparator device compares the generation motor message with composite signal value and motion threshold value, and this signal index signal value is greater than the pixel of the composite signal of motion threshold value.
19, the method for claim 18 is characterized by described method and carries out in analog circuit.
20, the method for claim 6, it is characterized by the method for determining the motion cue mark is to carry out in such equipment, it comprises:
Select the device of motion threshold value;
The inverter apparatus that one frame picture signal is anti-phase;
Adjacent pictures is added to the adder unit that produces composite signal on the anti-phase picture; And
Comparator device compares composite signal value and motion threshold value, produces motor message, and this signal index signal value is greater than the pixel of the composite signal of motion threshold value.
21, the method for claim 20 is characterized by described method and carries out in analog circuit.
CN 88101312 1988-03-10 1988-03-10 Utilize the coloring black and white signal of motion detection Pending CN1035747A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 88101312 CN1035747A (en) 1988-03-10 1988-03-10 Utilize the coloring black and white signal of motion detection

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 88101312 CN1035747A (en) 1988-03-10 1988-03-10 Utilize the coloring black and white signal of motion detection

Publications (1)

Publication Number Publication Date
CN1035747A true CN1035747A (en) 1989-09-20

Family

ID=4831706

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 88101312 Pending CN1035747A (en) 1988-03-10 1988-03-10 Utilize the coloring black and white signal of motion detection

Country Status (1)

Country Link
CN (1) CN1035747A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN100417179C (en) * 2006-04-14 2008-09-03 浙江大学 Single-colour image area colour displacing method for virtual displaying system
US8682112B2 (en) 2006-03-14 2014-03-25 Canon Kabushiki Kaisha Storage apparatus and method for processing the same
CN112884866A (en) * 2021-01-08 2021-06-01 北京奇艺世纪科技有限公司 Coloring method, device, equipment and storage medium for black and white video

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8682112B2 (en) 2006-03-14 2014-03-25 Canon Kabushiki Kaisha Storage apparatus and method for processing the same
CN100417179C (en) * 2006-04-14 2008-09-03 浙江大学 Single-colour image area colour displacing method for virtual displaying system
CN112884866A (en) * 2021-01-08 2021-06-01 北京奇艺世纪科技有限公司 Coloring method, device, equipment and storage medium for black and white video
CN112884866B (en) * 2021-01-08 2023-06-06 北京奇艺世纪科技有限公司 Coloring method, device, equipment and storage medium for black-and-white video

Similar Documents

Publication Publication Date Title
AU600998B2 (en) Coloring a black and white signal using motion detection
US5050984A (en) Method for colorizing footage
DE60020957T2 (en) METHOD AND DEVICE FOR VOTING NATURAL COLORS
US4606625A (en) Method for colorizing black and white footage
AU2002305387B2 (en) Image sequence enhancement system and method
US5191645A (en) Digital signal processing system employing icon displays
DE68927903T2 (en) Image signal processing apparatus for use in a color image display system
US6720971B1 (en) Image processing method and apparatus, and storage medium
US4608596A (en) System for colorizing video with both pseudo-colors and selected colors
US6075887A (en) High definition color modification
CN1217126A (en) Device and process for producing composite picture
KR20000068697A (en) Image data processing device and method, and transmission medium
DE68928803T2 (en) COMPENSATING THE BACKGROUND COLOR AND THE LUMINUM UNIFORMITY FOR A LINEAR IMAGE COMPOSITION
US5212544A (en) Method and apparatus for manipulating video image signals
FR2610160A1 (en) IMAGE SYNTHESIZER
CN1298160A (en) Image processing apparatus, image processing method and storage medium
CN1109435C (en) Image pickup apparatus and solid state image pickup device
CN1035747A (en) Utilize the coloring black and white signal of motion detection
DE2103126A1 (en) Field sequential to simultaneous color signal converter
CA1332192C (en) Method for colorizing footage
JP2008527951A (en) Adaptive chroma key composition apparatus and method
GB2283384A (en) High definition colour correction for use in telecine
JPH01229583A (en) Method of converting black and white signal into color signal by detecting movement
DE69013968T2 (en) Camera.
JPH02502236A (en) How to color a black and white scene

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C01 Deemed withdrawal of patent application (patent law 1993)
WD01 Invention patent application deemed withdrawn after publication