JP4606802B2 - Telop character image processing method, apparatus and program, and recording medium recording the program - Google Patents

Description

  The present invention relates to a telop character image processing method, apparatus and program, and a recording medium on which the program is recorded. More specifically, the telop character generates a video image of a telop character moving on a screen at a specified scroll speed in units of frames. A video image of a telop character sent from the telop character generation device to the telop character display device between the generation device and a telop character display device capable of frame-displaying the video image of the telop character generated by the telop character generation device On the other hand, a telop character image processing method for performing image processing in accordance with the scroll speed of the telop character, a telop character image processing apparatus, a telop character image processing program, and this telop character image processing program used directly in the implementation thereof It relates to the recording medium which recorded.

  For example, a character string that moves a predetermined display area from the right to the left or from the bottom to the top, such as an electric character displayed on a street light news or a bulletin board, or a telop displayed on a television receiver or a computer screen ( An information presentation method based on “telop characters” (hereinafter referred to as “telop characters”) is generally used, and a dedicated telop presentation device (so-called “video tellopa”) is also commercially available.

  In particular, in a telop character generating apparatus used for displaying telop characters on a television receiver or a computer screen, the font type, size, and color prepared in advance for each character constituting the telop character, and the telop character The scroll direction (moving speed on the screen) and the display area on the screen can be designated, and in addition to this, the scrolling speed of the telop characters (moving speed on the screen) can be arbitrarily changed.

  Here, in order to improve the recognition rate of telop characters moving on the screen (reading rate through human vision), it is necessary to suppress the scrolling speed within a certain range.

For example, according to the research material shown in Non-Patent Document 1 below, the upper limit of the scrolling speed suitable for reading is about 5.3 characters / second when the character size is a viewing angle of about 1 degree. If the character / second is exceeded, the recognition rate is extremely deteriorated. That is, when a telop character is moved on the screen, a person's reading speed is reduced from 1/2 to 1/3 of an understanding speed by speaking or reading.
Nakamitsu Kazumitsu, Natomi Kazuhiro, Ishida Toshiro, “Effect of Number of Characters on Reading Speed of Horizontal Scroll Display”, Psychological Study of the Japanese Psychological Association, December 1993, Vol. 64, No. 5, p. 360-368

  Thus, one of the factors that deteriorates the recognition rate of telop characters moving on the screen at high speed (about 10 characters / second or more) is the limit of detection accuracy of moving objects (moving image patterns) in the human visual system. is there.

  In other words, if image processing that takes into account the characteristics of the human visual system is applied to telop characters in advance, it is expected that the recognition rate can be improved even for telop characters that move at high speed.

Here, the main objects to be solved by the present invention are as follows.
That is, the first object of the present invention is to provide a telop character image processing method, apparatus and program for performing image processing for improving the recognition rate of telop characters moving at high speed, and a recording medium on which the program is recorded. To do.

  The second object of the present invention is to provide a telop character image processing method, apparatus and program for improving the limit of the scroll speed at which reading is possible, and a recording medium on which the program is recorded.

  Other objects of the present invention will become apparent from the specification, drawings, and particularly the description of each claim.

  First, in the method of the present invention, every time frame image data is input, an orthogonal transformation process is performed in which orthogonal transformation is performed on the frame image data by a predetermined method to obtain a corresponding spatial frequency distribution, and the orthogonal transformation process is performed. The slope changing process of changing the slope of the spatial frequency distribution to a new slope that reduces the high-frequency amplitude component relative to the low-frequency amplitude component while maintaining the form of the spatial frequency distribution, An inverse orthogonal transformation is performed on the spatial frequency distribution that has been changed to a new inclination by the inclination changing process, and the inverse operation of the orthogonal transformation is performed by a predetermined method, and frame image data after image processing corresponding to the spatial frequency distribution is obtained. The parameter of the deterioration index of the telop character specified from the outside when changing the slope of the spatial frequency distribution in the inverse orthogonal transformation process and the slope changing process, Performing a character deterioration degree specified process to be applied to the slope change process as a single, take characteristic configuration method called.

  Further, in the present invention device, every time frame image data is input, orthogonal transform means that obtains a corresponding spatial frequency distribution by performing orthogonal transform on the frame image data by a predetermined method is obtained by the orthogonal transform means. Inclination changing means for changing the inclination of the spatial frequency distribution to a new inclination that reduces the high-frequency amplitude component relative to the low-frequency amplitude component while maintaining the form of the spatial frequency distribution; Inverse orthogonal transformation is performed on the spatial frequency distribution changed to a new inclination by the inclination changing means, and inverse operation of orthogonal transformation is performed by a predetermined method to obtain frame image data after image processing corresponding to the spatial frequency distribution. The deterioration index of the telop character specified from the outside when changing the slope of the spatial frequency distribution in the inverse orthogonal transform means and the slope changing means One as to include a character deterioration degree designating means for giving to the inclination changing means, characteristic configuration take steps that.

  On the other hand, in the program of the present invention, a characteristic configuration procedure for causing a computer to function as each means constituting the apparatus of the present invention is taken.

  On the other hand, the recording medium of the present invention has a characteristic configuration procedure in which the program of the present invention is recorded so as to be readable by a computer.

  More specifically, in order to solve the problem, the object is achieved by adopting a novel characteristic configuration method, means, procedure or procedure from the superordinate concept to the subordinate concept that the present invention enumerates. It is made to achieve.

  That is, the first feature of the method of the present invention is that a telop character generation device that generates a video image of a telop character moving on the screen at a specified scroll speed in units of frames, and the telop character generation device generated by the telop character generation device. A telop character image processing device interposed between a telop character display device capable of frame-displaying the video image of the telop character, the telop character of the telop character sent from the telop character generation device to the telop character display device. A telop character image processing method for performing image processing according to the scroll speed of the telop character on a moving image, wherein the image data input means included in the telop character image processing device includes the telop character image A data input for frame image data sequentially output from the telop character generator for moving images. An image processing execution process in which the image processing execution means included in the telop character image processing apparatus performs the image processing on the frame image data input in the data input process, and the telop character image processing apparatus. The image processing control means included in the image processing control process in which the image processing form in the image processing execution process is controlled by parameters, and the image data output means included in the telop character image processing apparatus includes the image processing execution A data output process for outputting the frame image data after the image processing that has undergone the process to the telop character display device, and each time the frame image data is input in the image processing execution process, the frame image data The orthogonal transformation process to obtain the corresponding spatial frequency distribution by performing the orthogonal transformation to the specified method, and this orthogonal transformation The slope of the spatial frequency distribution obtained in the step is changed to a new slope that reduces the high frequency amplitude component relative to the low frequency amplitude component while maintaining the form of the spatial frequency distribution. The image corresponding to the spatial frequency distribution by performing an inverse orthogonal transformation that performs an inverse operation of the orthogonal transformation according to the predetermined method on the spatial frequency distribution changed to the new inclination by the changing process and the gradient changing process An inverse orthogonal transform process for obtaining processed frame image data, and the image processing control process includes a degree of deterioration of the telop character designated from the outside when the inclination of the spatial frequency distribution is changed in the inclination changing process. The telop character image processing method employs a character deterioration degree designating process in which an index is given as one of the parameters to the inclination changing process.

  According to a second feature of the method of the present invention, the character deterioration degree designation process in the first feature of the method of the present invention is characterized in that the slope of the spatial frequency distribution relating to a plurality of continuous frame image data in the slope change process. At the time of the change, the telop character image processing method adopts a configuration in which a plurality of deterioration degree indexes that repeatedly increase and decrease over time are given to the inclination change process.

  A third feature of the method of the present invention is a telop character image in which the deterioration degree index in the first or second feature of the method of the present invention is expressed by a coefficient multiplied by the slope of the spatial frequency distribution. The configuration of the processing method is adopted.

  The fourth feature of the method of the present invention is that the image processing execution process in the first, second, or third feature of the method of the present invention is configured such that the frame image data is A frame determining process for determining whether or not to use the image processing after the orthogonal transform process; and the image processing control process is designated from outside when determining whether or not the image processing is necessary in the frame determining process. The telop character image processing method adopts a configuration further comprising a processing frequency designation step of giving an image processing frequency index as one of the parameters to the frame determination step.

  The first feature of the device of the present invention is that a telop character generating device that generates a video image of a telop character moving on the screen at a specified scroll speed in units of frames, and the telop character generating device generated by the telop character generating device. The telop is displayed with respect to the video image of the telop character that is interposed between the telop character display device capable of displaying the video image of the telop character in a frame and sent from the telop character generation device to the telop character display device. A telop character image processing device for performing image processing according to the scroll speed of characters, wherein image data input for inputting frame image data sequentially output from the telop character generation device with respect to the video image of the telop character And the frame image data input through the image data input means Image processing execution means for performing image processing, image processing control means for controlling the form of the image processing in the image processing execution means by parameters, and frame image data after the image processing passed through the image processing execution means Image data output means for outputting to a character display device, and each time the frame image data is input, the image processing execution means performs orthogonal transform on the frame image data by a predetermined method to correspond to the corresponding spatial frequency An orthogonal transform unit that obtains a distribution, and a slope of the spatial frequency distribution obtained by the orthogonal transform unit, while maintaining the form of the spatial frequency distribution, the high frequency range amplitude component is relative to the low frequency range amplitude component. The inclination changing means for changing to a new inclination to be reduced to the new inclination, and the spatial frequency changed to the new inclination by the inclination changing means. An inverse orthogonal transform unit that performs an inverse orthogonal transform that performs an inverse operation of the orthogonal transform according to the predetermined method on the distribution to obtain frame image data after the image processing corresponding to the spatial frequency distribution, and the image processing control A character deterioration degree designating means for giving a degree of deterioration index of the telop character designated from the outside when changing the inclination of the spatial frequency distribution in the inclination changing means to the inclination changing means as one of the parameters; The configuration of the telop character image processing apparatus is provided.

  A second feature of the device according to the present invention is that the character deterioration degree designating unit according to the first feature of the device according to the present invention is configured such that the slope of the spatial frequency distribution relating to a plurality of consecutive frame image data in the slope changing unit. In the change, the structure of the telop character image processing apparatus is provided which includes a function unit that gives the slope changing unit a plurality of the deterioration degree indices that repeatedly increase and decrease over time.

  A third feature of the device of the present invention is a telop character image in which the deterioration degree index in the first or second feature of the device of the present invention is expressed by a coefficient multiplied by the slope of the spatial frequency distribution. The configuration of the processing apparatus is adopted.

  The fourth feature of the device of the present invention is that the image processing execution means in the first, second, or third feature of the device of the present invention receives the frame image data each time the frame image data is input. A frame determining unit that determines whether or not to use the image processing after the orthogonal transform unit; and the image processing control unit is externally designated when determining whether or not the image processing is necessary in the frame determining unit The telop character image processing apparatus further comprises processing frequency designation means for giving an image processing frequency index to the frame determination means as one of the parameters.

  On the other hand, the first feature of the program of the present invention is that each computer constitutes the image processing execution means in the telop character image processing device according to the first, second, third or fourth feature of the device of the present invention. The telop character image processing program is made to function.

  On the other hand, a first feature of the recording medium of the present invention is a configuration of a recording medium on which a telop character image processing program is recorded so that the telop character image processing program in the first feature of the present invention program can be read by a computer. Adopted.

  As described above, according to the present invention, image processing for reducing the characteristics of the contour component of each character constituting a telop character in consideration of the characteristics of the human visual system that sensitivity to moving edges and contour components is poor. That is, since the image processing is performed to reduce the high frequency region amplitude component characterizing the outline component of the character in the spatial frequency distribution of the image pattern relative to the low frequency region amplitude component, the image pattern moves at a high speed. Image processing for improving the recognition rate of telop characters is realized, and accordingly, the limit of the scroll speed at which reading can be performed can be improved.

  DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the present invention will be described below in order with reference to the accompanying drawings, by way of example apparatus, method example, program example, and recording medium.

(Example of equipment)
FIG. 1 is a functional block diagram showing a configuration of a telop character image processing apparatus according to an example of the present invention.

  As shown in the figure, the telop character image processing apparatus α according to the present apparatus example includes a telop character generation apparatus 1 that generates a moving picture image of a telop character moving on the screen at a specified scroll speed in units of frames. A telop character generated by the telop character generation device 1 is interposed between the telop character display device 2 capable of displaying a video image of the telop character as a frame and sent from the telop character generation device 1 to the telop character display device 2. An image data input interface 3 (“image data input means” in the present invention) and an image processing execution unit 4 (referred to in the present invention) are used to perform image processing corresponding to the scroll speed of the telop characters on a moving image. "Image processing execution means"), image processing control section 5 ("image processing control means" according to the present invention), and image data output interface 6 It referred to in the present invention configured provided with a "image data output means").

  Here, the telop character generation apparatus 1 can specify the scroll speed of the telop character, and also the font type, size, and color of each character constituting the telop character, and the scroll direction of the telop character (“right to left (Directions such as “from left to right for some languages”) and “from bottom to top”), and the display area on the screen of the telop character display device 2 (area such as “bottom” and “right”) it can. The telop character generation apparatus 1 has a basic computer configuration (not shown) such as a CPU (central processing unit), various storage devices, a timing device, and various input / output devices, and a video image of a required telop character. For the output of the frame image data related to general purpose RGB data is used.

  The telop character display device 2 includes a CRT (cathode ray tube), an LCD (liquid crystal display device), and the like, and directly displays frame image data composed of the RGB data given from the telop character generation device 1 through the telop character image processing device α. can do.

  The image data input interface 3 constitutes an interface for inputting frame image data sequentially output from the telop character generation device 1 with respect to a moving image of telop characters.

  The image processing execution unit 4 is a functional unit that performs image processing on frame image data input through the image data input interface 3. Specifically, the image processing execution unit 4 includes a frame determination unit 41 (“frame determination unit” in the present invention). , An orthogonal transform unit 42 (“orthogonal transform unit” according to the present invention), an inclination change unit 43 (“tilt change unit” according to the present invention), and an inverse orthogonal transform unit 44 (“inverse orthogonal transform unit” according to the present invention). )).

  Among these, the frame determination unit 41 is a functional unit that determines whether or not the frame image data is to be subjected to image processing in the subsequent orthogonal transform unit 42 every time frame image data is input. When it is determined that the image data is to be used for image processing, the image data is transferred to the orthogonal transformation unit 42, and when it is determined that the image data is not to be used, it is transferred to the image data output interface 6.

  Each time frame image data is input, the orthogonal transform unit 42 converts the format from RGB data to, for example, YUV data, and further converts all the components of the frame image data into discrete cosine transform, discrete sine transform, and discrete Fourier transform. This is a functional means for obtaining a corresponding spatial frequency distribution by performing orthogonal transformation by any one of transformation, Walsh-Hadamard transformation, Karoonen-Loeve transformation, slant transformation, Haar transformation and other methods.

  The inclination changing unit 43 reduces the inclination of the spatial frequency distribution obtained by the orthogonal transform unit 42 relative to the low frequency region amplitude component while maintaining the form of the spatial frequency distribution. This is a functional means for changing to a new inclination.

  The inverse orthogonal transform unit 44 performs an inverse orthogonal transform that performs an inverse operation of the orthogonal transform by the method used in the orthogonal transform unit 42 on the spatial frequency distribution changed to a new tilt by the tilt changing unit 43, and The functional means obtains frame image data after image processing corresponding to the spatial frequency distribution by converting frame image data, for example, YUV data obtained by the inverse orthogonal transformation into RGB data.

  On the other hand, the image processing control unit 5 is a functional unit that controls the image processing mode in the image processing execution unit 4 with parameters. Specifically, the image processing control unit 5 includes a processing frequency designation unit 51 (“processing frequency designation unit” according to the present invention). ) And a character deterioration degree designation unit 52 (“character deterioration degree designation means” according to the present invention).

  Among these, the processing frequency specifying unit 51 is the frequency of the image processing specified from the outside (the user of the telop character image processing apparatus α) when determining whether or not the image processing is necessary in the frame determining unit 41 of the image processing execution unit 4. Functional means for expressing the index x as a percentage (x = 0.0 to 100.0 (%)) indicating the necessity ratio and giving the frequency index x to the frame determination unit 41 as one of the parameters. is there.

  When changing the slope of the spatial frequency distribution in the slope changing unit 43 of the image processing execution unit 4, the character deterioration degree specifying unit 52 uses the deterioration degree index d of a telop character specified from the outside (same as above) of the spatial frequency distribution. It is a functional means that is expressed by a coefficient (for example, d = 1.0 to 2.0) multiplied by the slope and gives the deterioration degree index d to the slope changing unit 43 as one of the parameters. The character deterioration degree designating unit 52 applies a single deterioration degree index d having a fixed value to the inclination changing unit 43 when changing the inclination of the spatial frequency related to a series of frame image data in accordance with designation from the outside. In addition to the function of giving, the slope changing unit 43 is also provided with a plurality of deterioration degree indices d that repeatedly increase and decrease over time when changing the slope of the spatial frequency distribution for a plurality of continuous frame image data.

  Then, the image data output interface 6 outputs frame image data after image processing that has passed through the image processing execution unit 4 (and frame image data that has not undergone image processing as determined by the frame determination unit 41) to the telop character display device 2. Configure the interface.

  The frame determining unit 41 of the image processing execution unit 4 controlled by the processing frequency specifying unit 51 of the image processing control unit 5 and the inclination changing unit 43 controlled by the character deterioration degree specifying unit 52 are caused to function simultaneously. Of course, depending on circumstances, it is possible to cause only the inclination changing unit 43 and the corresponding character deterioration degree specifying unit 52 to function, and not allowing the frame determining unit 41 and the corresponding processing frequency specifying unit 51 to function. (The frame determination unit 41 and the processing frequency designation unit 51 may be omitted).

  The telop character image processing apparatus α includes the basic configuration of a computer (not shown) such as a CPU, various storage devices, a timing device, various input / output devices, and the like, similar to the telop character generation device 1 described above. Each of the above constituent means is obtained by the constituent elements and the telop character image processing program (details will be described later).

  Next, a specific mode when the inclination changing unit 43 changes the inclination of the spatial frequency distribution obtained by the orthogonal transformation unit 42 of the image processing execution unit 4 described above will be described.

  First, in consideration of the characteristics of the human visual system, the factor that deteriorates the recognition rate of telop characters that move at high speed on the screen is the characteristics of the characters that make up the telop characters. In other words, the moving object detection mechanism existing in the human visual system is insensitive to the edges and contour components of moving image patterns. For this reason, if an image pattern characterized by the contour components itself, such as characters, moves at high speed. A time delay occurs in the response from the moving object detection mechanism. As a result, the human visual system does not clearly perceive the image pattern itself (character itself), and the image pattern and the afterimage (character afterimage) called the ghost are simultaneously perceived, and the corresponding telop character Recognition rate deteriorates.

  Therefore, in the telop character image processing apparatus α according to the present apparatus example, image processing for reducing the characteristics of the contour component of each character constituting the telop character, that is, a high frequency region that characterizes the contour component of the character in the spatial frequency distribution of the image pattern. Performs image processing to reduce the amplitude component relative to the low frequency range amplitude component, thereby suppressing the afterimage of the character from being perceived by the human visual system and moving at high speed on the screen Improve overall recognition rate.

  FIG. 2 is an explanatory diagram showing an aspect when the slope changing unit 43 changes the slope of the spatial frequency distribution obtained by the orthogonal transform unit 42 shown in FIG. Also, FIG. 3 shows the telop character when a plurality of deterioration degree indices d (1.0 to 2.0) having different values are given from the character deterioration degree designation unit 52 shown in FIG. It is a conceptual diagram which shows the change of a degradation state.

First, the spatial frequency distribution obtained by orthogonally transforming the frame image data relating to the video image of the telop character by the orthogonal transform unit 42 of the image processing execution unit 4 has an amplitude of A, a spatial frequency of sf, and a slope of −a. For example, it can be approximated by the following equation (1) (see Non-Patent Document 2 below).
A∝sf ^-a (1)
Field, DJ, “Relations between the statistics of natural images and the response properties of cortical cells,” Journal of the Optical Society of America A, December 1987, Vol. 4, No. 12, pp. 2379-2394.

Here, if the equation (1) is equalized by giving a proportionality constant k, and the equation is converted to a common logarithmic scale,
A = k × sf ^−a
log ₁₀ A = −alog ₁₀ sf + K (2)
(Where K = log ₁₀ k), and a spatial frequency distribution with a direct current component “K” and a slope “−a” as shown in FIG. 2 is obtained.

  In the above equation (2), since the inclination -a corresponds to the relative value of the spatial frequency amplitude component of the character, the deterioration degree (blurring degree) of each character constituting the telop character by changing this -a. Can be controlled. Therefore, in the telop character image processing apparatus α according to the present apparatus example, the gradient conversion unit 43 of the image processing execution unit 4 performs the character deterioration degree designation unit 52 of the image processing control unit 5 with respect to the gradient −a of the spatial frequency distribution. Is multiplied as a coefficient to obtain a new slope of “−a × d”.

  By the above calculation, image processing is performed to reduce the high frequency region amplitude component characterizing the contour component of the character in the spatial frequency distribution of the image pattern relative to the low frequency region amplitude component, and the deterioration degree index d at this time Is specified in the range of 1.0 to 2.0, as shown in FIG. 3, each character constituting the telop character can be arbitrarily deteriorated (when d = 1.0, the character is Degradation does not occur).

  Next, a specific aspect regarding the necessity determination of the image processing performed by the frame determination unit 41 of the image processing execution unit 4 described above will be described.

  FIG. 4 is a conceptual diagram showing changes in the display state of telop characters when the frequency index of two examples ((a) and (b)) is given from the processing frequency specifying unit 51 shown in FIG. 1 to the frame determining unit 41. FIG.

  First, in the telop character image processing apparatus α according to the present apparatus example, the frequency of the image processing related to the inclination change in the inclination changing unit 43 of the image processing execution unit 4 is determined from the processing frequency specifying unit 51 of the image processing control unit 5. Control is performed by the frequency index x given to the unit 41 (when x = 100.0 (%), image processing is performed on all frame image data, and when x = 0.0 (%), image processing is not performed at all. Absent). 4A shows a case where 50 (%) is given as the frequency index x, and FIG. 4B shows a case where 66.6 (%) is given as the frequency index x ( Degradation index d is both 1.6, and S in the drawing indicates the screen display range of the frame image data).

  As shown in the figure, the frame image data subjected to image processing and the frame image data not subjected to image processing are mixed for the following reason. That is, the degree of afterimage that occurs when a telop character is moved at a high scroll speed naturally increases as the scroll speed increases. Therefore, in the telop character image processing apparatus α according to the present apparatus example, in order to suppress this afterimage, when the scroll speed of the telop character is high, the value of the deterioration index d is set to be large. To do.

  However, if the value of the deterioration index d is set too large, the deterioration state of each character constituting the telop character becomes excessive, and it is impossible to visually distinguish the character itself. For this reason, in the telop character image processing apparatus α according to the present apparatus example, the frame determination unit 41 converts frame image data that has not been subjected to image processing (or that has been subjected to slight image processing with a small degradation index d). The above character discrimination is assisted by periodically inserting one frame every several frames.

  As described above, the frame determination unit 41 and the corresponding processing frequency designation unit 51 can be configured to exclude these. This is equivalent to setting the value of the frequency index x given from the processing frequency designation unit 51 to 100.0 (%). In this case, an afterimage generated when the telop character is moved at a high scroll speed is used. In order to suppress this, a plurality of deterioration degree indices d that repeatedly increase and decrease over time are given from the character deterioration degree specifying part 52 of the image processing control part 5 to the inclination changing part 43 of the image processing execution part 4. It is sufficient (for example, d: “1.0” → “1.6” → “1.6” → “1.0” can be repeated to realize a frequency index x of 66.6 (%). D: “1.4” → “1.6” → “1.6” → “1.4”, it is also possible to always perform processing that causes character deterioration).

(Example method)
Next, an example of a method performed by the telop character image processing apparatus α according to this apparatus example configured as described above will be described.

  First, when the image data input interface 3 of the telop character image processing device α inputs frame image data in the RGB data format sequentially output from the telop character generation device 1 with respect to the moving image video of the telop character (data input process), the image Each time the frame determination unit 41 of the image processing execution unit 4 inputs the frame image data, the processing execution unit 4 performs image processing on the input frame image data (image processing execution process). Then, it is determined whether or not the frame image data is to be subjected to image processing in the orthogonal transform unit 42 and thereafter (frame determination process).

  At this time, the processing frequency designation unit 51 of the image processing control unit 5 for controlling the image processing mode in the image processing execution unit 4 with parameters (image processing control process) is the necessity of the image processing in the frame determination unit 41. The frequency index x (percentage) of the image processing specified from the outside at the time of determination is given to the frame determination unit 41 as one of the parameters (processing frequency specifying process).

  Next, the frame determination unit 41 transfers the frame image data to the orthogonal transformation unit 42 according to the value of the frequency index x given from the processing frequency designation unit 51, or the frame image data is transferred to the image data output interface. 6 is determined to be transferred. At this time, when the frame image data is transferred to the image data output interface 6, the frame image data is output to the telop character display device 2 in the RGB data format as it is and displayed.

  On the other hand, when the frame image data is transferred to the orthogonal transform unit 42, the orthogonal transform unit 42 converts the frame image data into, for example, the YUV data format every time the frame image data in the RGB data format is input. Further, for example, orthogonal transformation by discrete cosine transformation is performed to obtain a corresponding spatial frequency distribution (orthogonal transformation process), which is transferred to the inclination changing unit 43.

  Next, when the spatial frequency distribution is transferred to the inclination changing unit 43, the inclination changing unit 43 maintains the form of the spatial frequency distribution while maintaining the original inclination (−a) of the spatial frequency distribution. Then, the high frequency region amplitude component is changed to a new gradient (−a × d) that reduces relative to the low frequency region amplitude component (inclination changing process), and this is transferred to the inverse orthogonal transform unit 44.

  At this time, the character deterioration degree designating section 52 of the image processing control section 5 has a fixed telop character deterioration degree index d, that is, a value fixed from the outside when changing the inclination of the spatial frequency distribution in the inclination changing section 43. A single or a plurality of deterioration degree indices d (coefficients) that repeatedly increase and decrease over time are given to the inclination changing unit 43 as one of the parameters (character deterioration degree designation process).

  Next, when the spatial frequency distribution having a new gradient (−a × d) is transferred to the inverse orthogonal transform unit 44, the inverse orthogonal transform unit 44 converts the spatial frequency distribution into the spatial frequency distribution by the orthogonal transform unit 42. For example, the inverse orthogonal transformation that performs the inverse operation of the used discrete cosine transformation is performed, and the frame image data in the YUV data format obtained by the inverse orthogonal transformation is converted into the RGB data format to correspond to the spatial frequency distribution. The frame image data after image processing is obtained (inverse orthogonal transformation process), and this is transferred to the image data output interface 6.

  Then, the image data output interface 6 outputs the frame image data after image processing that has been transferred from the inverse orthogonal transform unit 44 (through the image processing execution unit 4) to the telop character display device 2 (data output process). ).

  Here, when the scroll speed of the telop character moving on the screen of the telop character display device 2 is high, the deterioration degree index d designated by the character deterioration degree designation unit 52 and the processing frequency designation unit 51 are designated. If at least one of the frequency index x is increased, the afterimage (ghost) caused by the high frequency range amplitude component of the telop character can be reduced.

  Actually, on the screen of the telop character display device 2, a telop character composed of characters having a viewing angle of about 1 degree (approximately 2 cm square at an observation distance of 60 cm), a deterioration index d of “1.6”, and a frequency index When x was designated as “66.6 (%)” and presented, the recognizable scrolling speed without image processing was about 15 characters / second. The recognizable scrolling speed was improved to about 25 characters / second.

  This is because it is difficult for a neural circuit that sends information from the human eye to the brain to transmit high-speed movement of an object at the same time as a fine pattern such as a contour. This is because it is easy to capture the movement.

  When the scroll speed of the telop characters is as low as about 5 characters / second, the conventional presentation may be performed without applying the image processing according to this method example (deterioration index d is set to “1.0”. And the frequency index x may be designated as “0.6 (%)”).

(Program example and recording medium example)
As is clear from the above description, since the telop character image processing apparatus α according to the present apparatus example has a basic configuration of a computer, the required function to be embodied in the present invention is determined by a software program. Can be configured.

  That is, when configuring the required telop character image processing program, each means excluding the hardware elements among the constituent elements of the telop character image processing apparatus α, that is, the frame determination unit 41 in the image processing execution unit 4 described above, The function means of the conversion unit 42, the inclination changing unit 43, and the inverse orthogonal transform unit 44 are described by program steps, and thereby the telop character image processing apparatus α as a computer is caused to function as each of the above means. That's fine.

  In configuring the recording medium, the telop character image processing program including the above-described programs and steps may be recorded on an arbitrary recording medium such as a computer-readable CD-ROM.

  Finally, an example of a usage pattern of the telop character image processing apparatus α according to this apparatus example will be described as an example.

  FIG. 5 is a diagram showing an example of a usage pattern of the telop character image processing apparatus shown in FIG. It should be noted that the constituent elements shown in this figure are given the same reference numerals for those having the same or equivalent functional means as those already shown in FIG. 1, and detailed explanations of the corresponding constituent elements are as follows. Shall be omitted.

  As shown in the figure, in the telop character image processing apparatus α used in the present embodiment, a video display device as a screen of a television receiver or a computer (CRT or LCD) is used instead of the telop character display device 2 described above. 7 is applied, and the telop characters output from the telop character image processing device α and displayed on the video display device 7 are combined with the video image output from the video providing device 8 such as a video playback device. It has become so.

  Here, in general, the reading speed of the telop characters moving on the screen is slowed down from 1/2 to 1/3 of the understanding speed by speaking or reading as described above. Therefore, for example, even if the announcer's utterance content is played as a telop while maintaining the utterance speed, it is extremely difficult to recognize it.

  However, if the telop character image processing apparatus α described in the embodiment is used, the recognizable scrolling speed is dramatically improved to about 25 characters / second. Therefore, according to the configuration of this example, for example, Even when a video in which the announcer's utterance record has been recorded in advance is reproduced by the video providing device 8 and the utterance video of the announcer and the corresponding telop character are synthesized by the video display device 7, the utterance speed and telop character of the announcer are also synthesized. Both scrolling speeds can be presented in perfect synchronization.

  As mentioned above, although embodiment and the Example of this invention were described, this invention is not necessarily limited only to the means, method, procedure, and procedure which were mentioned above, In the range which has the effect mentioned above, suitably It can be changed.

It is a functional block diagram which shows the structure of the telop character image processing apparatus which concerns on the example of 1 apparatus of this invention. It is explanatory drawing which shows the aspect at the time of changing the inclination of the spatial frequency distribution obtained by the orthogonal transformation part shown in FIG. 1 by an inclination change part. It is a conceptual diagram which shows the change of the degradation state of a telop character when the character degradation degree designation | designated part shown in FIG. 1 gives several degradation degree index | exponents from which a value differs. It is a conceptual diagram which shows the change of the display state of a telop character when the frequency index of two examples ((a) and (b)) is given to the frame determination part from the processing frequency designation | designated part shown in FIG. It is a figure which shows an example of the usage condition of the telop character image processing apparatus shown in FIG.

Explanation of symbols

α ... telop character image processing device 1 ... telop character generation device 2 ... telop character display device 3 ... image data input interface 4 ... image processing execution unit 41 ... frame determination unit 42 ... orthogonal transformation unit 43 ... tilt change unit 44 ... inverse orthogonal Conversion unit 5 ... Image processing control unit 51 ... Processing frequency designation unit 52 ... Character degradation level designation unit 6 ... Image data output interface 7 ... Video display device 8 ... Video providing device d ... Degradation level index x ... Frequency index S ... Frame image Data display range

Claims (8)

A telop character generating device that generates a video image of a telop character that moves on the screen at a specified scroll speed in units of frames, and a telop that can display the video image of the telop character generated by the telop character generating device in a frame display A telop character image processing device interposed between the character display device and the scroll speed of the telop character for the video image of the telop character sent from the telop character generation device to the telop character display device. A telop character image processing method for performing image processing according to
A data input process in which the image data input means included in the telop character image processing device inputs frame image data sequentially output from the telop character generation device with respect to the moving image of the telop character;
An image processing execution step in which the image processing execution means included in the telop character image processing apparatus performs the image processing on the frame image data input in the data input step;
An image processing control unit provided in the telop character image processing apparatus includes: an image processing control process for controlling the form of the image processing in the image processing execution process with parameters;
An image data output means included in the telop character image processing apparatus includes a data output process of outputting frame image data after the image processing that has undergone the image processing execution process to the telop character display apparatus;
The image processing execution process includes:
Each time the frame image data is input, an orthogonal transformation process is performed to obtain a corresponding spatial frequency distribution by performing orthogonal transformation on the frame image data according to a predetermined method.
Using the logarithmic value of the amplitude of the spatial frequency as the vertical axis and the logarithmic value of the spatial frequency as the horizontal axis, the spatial frequency distribution obtained in the orthogonal transformation process has the logarithmic value of the amplitude and the logarithmic value of the spatial frequency as variables. expressed in a linear function, said given the inclination when the linear function linearly approximated the obtained degradation index d (1.0 ≦ d ≦ 2.0) multiplied by the slope of the linear approximation to a new inclination Change the tilt change process,
The image-processed frame corresponding to the spatial frequency distribution is obtained by performing an inverse orthogonal transformation that performs an inverse operation of the orthogonal transformation according to the predetermined method on the spatial frequency distribution changed to the new inclination by the inclination changing process. An inverse orthogonal transform process for obtaining image data,
The image processing control process includes:
In the inclination changing process, the deterioration degree index for changing the degree of blur of each character constituting the telop character specified from the outside when changing the inclination of the spatial frequency distribution in the inclination changing process is used as one of the parameters. Has a character deterioration degree designation process to be given to
The telop character image processing method characterized by the above-mentioned. The character deterioration degree designation process includes:
When changing the slope of the spatial frequency distribution with respect to the plurality of continuous frame image data in the slope changing process, a plurality of deterioration degree indices that repeatedly increase and decrease over time are given to the slope changing process.
The telop character image processing method according to claim 1, wherein: The image processing execution process includes:
Each time the frame image data is input, the method further includes a frame determination process for determining whether or not the frame image data is subjected to the image processing after the orthogonal transform process.
The image processing control process includes:
A frequency index indicating the ratio of the number of frames to be subjected to the image processing with respect to all frames, which is designated from the outside when determining the necessity of the image processing in the frame determination process, is given to the frame determination process as one of the parameters. A process frequency designation process;
The telop character image processing method according to claim 1 or 2, characterized in that: A telop character generating device that generates a video image of a telop character that moves on the screen at a specified scroll speed in units of frames, and a telop that can display the video image of the telop character generated by the telop character generating device in a frame display An image process according to the scroll speed of the telop character is performed on the moving image of the telop character that is interposed between the character display device and sent from the telop character generation device to the telop character display device. A telop character image processing apparatus for
Image data input means for inputting frame image data sequentially output from the telop character generation device with respect to the video image of the telop character;
Image processing execution means for performing the image processing on the frame image data input through the image data input means;
Image processing control means for controlling the form of the image processing in the image processing execution means with parameters;
Image data output means for outputting the frame image data after the image processing that has passed through the image processing execution means to the telop character display device,
The image processing execution means includes
Orthogonal transformation means for obtaining a corresponding spatial frequency distribution by performing orthogonal transformation according to a predetermined method on the frame image data each time the frame image data is input;
Using the logarithmic value of the amplitude of the spatial frequency as the vertical axis and the logarithmic value of the spatial frequency as the horizontal axis, the spatial frequency distribution obtained in the orthogonal transformation process has the logarithmic value of the amplitude and the logarithmic value of the spatial frequency as variables. expressed in a linear function, said given the inclination when the linear function linearly approximated the obtained degradation index d (1.0 ≦ d ≦ 2.0) multiplied by the slope of the linear approximation to a new inclination An inclination changing means for changing;
A frame after the image processing corresponding to the spatial frequency distribution is performed by performing an inverse orthogonal transformation that performs an inverse operation of the orthogonal transformation according to the predetermined method on the spatial frequency distribution changed to the new inclination by the inclination changing unit. An inverse orthogonal transform means for obtaining image data,
The image processing control means includes
The slope changing means, using the deterioration index as a parameter for changing the degree of blur of each character constituting the telop character specified from the outside when the slope of the spatial frequency distribution is changed by the slope changing means. A character deterioration degree designation means to be given to
A telop character image processing apparatus characterized by that. The character deterioration degree designating means is:
A function unit that provides the slope changing unit with a plurality of deterioration degree indices that repeatedly increase and decrease over time when the slope of the spatial frequency distribution relating to the plurality of continuous frame image data in the slope changing unit is changed. To
The telop character image processing apparatus according to claim 4. The image processing execution means includes
Each time the frame image data is input, further comprises a frame determining means for determining whether or not the frame image data is subjected to the image processing after the orthogonal transform means;
The image processing control means includes
A frequency index indicating the ratio of the number of frames to be subjected to the image processing with respect to all the frames, which is designated from the outside when determining the necessity of the image processing in the frame determining means, is given to the frame determining means as one of the parameters. Further comprising processing frequency designation means;
The telop character image processing apparatus according to claim 4 or 5, characterized in that: A computer is caused to function as each means constituting the image processing execution means in the telop character image processing apparatus according to claim 4, 5 or 6.
A telop character image processing program characterized by that. The telop character image processing program according to claim 7 is recorded so as to be readable by a computer.
A recording medium on which a telop character image processing program is recorded.