JP4310698B2 - Video processing apparatus and video processing method - Google Patents

Description

  The present invention relates to a video processing apparatus and a video processing method, and is suitable for application to a video display apparatus such as a television receiver.

  Conventionally, in this type of video display device, a standard television (SD) signal obtained from a received broadcast signal is converted into a high definition (HD) signal using an image conversion process such as a class classification adaptive process. Some have been proposed to upconvert signals.

  In such class classification adaptation processing, for example, a high-resolution HD image is generated in a spatial direction based on a predetermined coefficient generated in advance for an input SD image. Conventionally, there has been proposed a video display device that can be adjusted by operating a volume axis for image quality adjustment such as resolution adjustment or noise suppression using a class classification adaptive processing circuit having a volume structure. (For example, refer to Patent Document 1).

In addition, in the class classification adaptive processing, the operation history by the user is stored in the memory in advance, and when the user adjusts the image quality of the resolution and the noise suppression amount, A video display device has been proposed in which an operation history is read and analyzed to reflect the operation history in image processing (see, for example, Patent Document 2).
JP 2002-218414 A JP 2003-224830 A

  By the way, this video display device does not adopt anything other than whether the class classification adaptive processing circuit is used in a single configuration or the LSI (large-scale integration) chip of the class classification adaptive processing circuit is used alone. After the volume value is adjusted so that the user has a desired image quality, the adjusted image is displayed each time.

  For this reason, the user cannot visually check the image processed with the volume value before adjustment and the image processed with the volume value after adjustment at the same time. Thus, it is very difficult to determine whether the adjusted image is closer to the desired resolution.

  In fact, since it is easier for humans to determine the superiority or inferiority of direct comparison of both comparison targets at the same time, the method of separately displaying images before and after adjustment cannot be said to match human visual characteristics.

  Furthermore, in the method of displaying both the pre-adjustment and post-adjustment processed images separately in time, even when the user adjusts the volume value to the desired value and then returns to the pre-adjustment value, the adjustment is performed. Since the image changes in real time each time, it is often difficult to accurately return to the volume value before adjustment. In particular, it is very difficult to adjust the volume value due to a malfunction or forgetting the volume value before the adjustment because the adjustment was made a plurality of times although it was adjusted by the user's intention.

  In order to solve such a problem, according to the method of reflecting the operation history by the user in the image processing as in Patent Document 2 described above, there is a possibility that a problem may occur when the operation history is uniformly used. That is, even if the adjustment of the volume value has changed due to a malfunction as described above, or the case where the adjustment was made by the user's intention but was adjusted several times and stopped halfway, those cases are This is because, as a result, the operation history determined in step S1 is stored in the memory, and as a result, the operation history unnecessary for the user is analyzed and reflected in the image processing.

  In this way, when the class classification adaptive circuit is used in a single configuration, or when the LSI chip of the class classification adaptive processing circuit is used alone, the user-friendliness is required when generating the processed image and displaying it on the screen in real time. However, since the analysis of the user history is complicated, there is still a problem that is still difficult in practical use.

  The present invention has been made in consideration of the above points, and an object of the present invention is to propose a video processing apparatus and a video processing method that can be easily performed while adjusting the degree of image quality adjustment to the user's preference.

In order to solve such a problem, in the present invention, in a video processing apparatus that performs predetermined video processing on video based on a supplied video signal, a plurality of systems are provided for each frame image for each frame image forming the video. A plurality of image conversion processing means each performing image conversion processing, and processed images sequentially obtained as a result of the image conversion processing from each of the plurality of image conversion processing means, all or a part of the plurality of processed images being displayed on the display screen The image display means for sequentially displaying in frame units so as to be simultaneously contained in the image, and one of the plurality of processed images simultaneously displayed on the image display means is designated by an external operation, and the designated image Operation input means for determining a volume value representing the degree of image quality adjustment of the processed image, and the processed image designated via the operation input means After the image quality adjustment is set to the volume values determined for the processed image, the display setting means and a plurality of types of volume space capable of image quality adjustment to be sequentially displayed in frames on the video display unit, the respective image quality Storage means for storing, as a frequency, the number of each volume value determined through the operation input means among the volume values representing the degree of adjustment, and the display setting means provides the desired volume via the operation input means. When the value is determined, the frequency of each volume value is read from the storage means, and the step width of each volume value is set more finely as the frequency is higher, while the step width of each volume value is made rougher as the frequency is lower. I set it.
Thus, every time the user performs a predetermined operation for adjusting the volume value, the volume value indicating the degree of image quality adjustment can be brought close to the value desired by the user in a relatively short time, and the desired value Fine adjustment is possible in the vicinity.

Further, in the present invention, in a video processing apparatus that performs predetermined video processing on video based on a supplied video signal, image conversion processing is performed for each frame image in a plurality of systems for each frame image forming the video. A plurality of image conversion processing means, and processed images sequentially obtained as a result of the image conversion processing from each of the plurality of image conversion processing means, so that all or a part of the plurality of processed images can be accommodated in the display screen at the same time. The image display means for sequentially displaying in frame units, and one of the plurality of processed images simultaneously displayed on the image display means is designated by an external operation, and the image quality adjustment of the designated processed image is performed An operation input means for determining a volume value representing the degree of the image, and a processed image designated via the operation input means. Display setting means for sequentially displaying the image display means in units of frames after setting the volume value determined in this way and adjusting the image quality, and the display setting means in the volume space where a plurality of types of image quality adjustment is possible. Divide the multi-dimensional coordinate system consisting of multiple adjustment axes to change the volume value corresponding to each image quality adjustment into multiple areas, and adjust the image quality by setting each volume value at the representative point of each area The image display means sequentially displays a plurality of processed images adjusted in image quality with each volume value on the display screen at the same time, and each time one of the processed images is designated via the operation input means. In addition, the volume value is converged by further dividing the area corresponding to the processed image into a plurality of areas so as to narrow the area in the multidimensional coordinate system.
Thereby, the volume value indicating the degree of image quality adjustment can be set to a value desired by the user with a small number of operations.

Further, according to the present invention, in a video processing apparatus that performs predetermined video processing on video based on a supplied video signal, image conversion processing is performed for each frame image in a plurality of systems for each frame image forming the video. A plurality of image conversion processing means, and processed images sequentially obtained as a result of the image conversion processing from each of the plurality of image conversion processing means, so that all or a part of the plurality of processed images can be accommodated in the display screen at the same time. The image display means for sequentially displaying in frame units, and one of the plurality of processed images simultaneously displayed on the image display means is designated by an external operation, and the image quality adjustment of the designated processed image is performed In each of the operation input means for determining the volume value representing the degree of the image and the volume space in which multiple types of image quality adjustment are possible, Among the volume values representing the degree of quality adjustment, a storage means for storing the number of times of each volume value determined through the operation input means as a frequency, and a feature for sequentially extracting feature values for each frame image forming the video Regularity is determined based on the quantity extraction means, the feature amount of each frame image extracted from the feature quantity extraction means, and each volume value stored in the storage means, and stored in the storage means based on the regularity The image quality adjustment is performed by setting the determination image that is selectively read from each volume value that has been set, and the processed image that is designated via the operation input unit to the volume value that is selectively read by the determination device for the processed image. After that, display setting means for sequentially displaying the image display means in units of frames is provided.
Thereby, the image quality of the processed image can be adjusted with the volume value based on the feature amount of the frame image and the frequency of the volume value determined by the user, so that the processed image with the image quality preferred by the user can be generated .

Furthermore, in the present invention, in a video processing method for performing predetermined video processing on a video based on a supplied video signal, image conversion processing is performed for each frame image in a plurality of systems for each frame image forming the video. And sequentially processing images obtained as a result of a plurality of systems of image conversion processing in units of frames so that all or some of the plurality of processing images can be simultaneously accommodated in the display screen. In the second step, one of the plurality of processed images simultaneously displayed on the display screen is designated by an external operation, and a volume value representing the degree of image quality adjustment is determined for the designated processed image. Then, after setting the volume value determined for the processed image and adjusting the image quality, the image is sequentially displayed on the display screen in units of frames. 3 and a step is provided, in the third step, when each desired volume value is determined by reading the frequency of the stored the respective volume value, the more the frequent finer step size for each volume value On the other hand, the step width of each volume value is set to be rougher as the frequency is lower.
Thus, every time the user performs a predetermined operation for adjusting the volume value, the volume value indicating the degree of image quality adjustment can be brought close to the value desired by the user in a relatively short time, and the desired value Fine adjustment is possible in the vicinity.

Furthermore, in the present invention, in a video processing method for performing predetermined video processing on a video based on a supplied video signal, image conversion processing is performed for each frame image in a plurality of systems for each frame image forming the video. And sequentially processing images obtained as a result of a plurality of systems of image conversion processing in units of frames so that all or some of the plurality of processing images can be simultaneously accommodated in the display screen. In the second step, one of the plurality of processed images simultaneously displayed on the display screen is designated by an external operation, and a volume value representing the degree of image quality adjustment is determined for the designated processed image. Then, after setting the volume value determined for the processed image and adjusting the image quality, the image is sequentially displayed on the display screen in units of frames. In the third step, a multi-dimensional coordinate system including a plurality of adjustment axes for changing a volume value corresponding to each image quality adjustment in a volume space in which a plurality of types of image quality adjustment is possible is provided. The image is divided into a plurality of areas, set to each volume value at the representative point of each area, and image quality is adjusted. Each time one of the processed images is specified, the area corresponding to the processed image is further divided into a plurality of parts so that the area in the multidimensional coordinate system is narrowed so that each volume value is converged. did.
Thereby, the volume value indicating the degree of image quality adjustment can be set to a value desired by the user with a small number of operations.

Furthermore, in the present invention, in a video processing method for performing predetermined video processing on a video based on a supplied video signal, image conversion processing is performed for each frame image in a plurality of systems for each frame image forming the video. And sequentially processing images obtained as a result of a plurality of systems of image conversion processing in units of frames so that all or some of the plurality of processing images can be simultaneously accommodated in the display screen. In the second step and a volume space in which a plurality of types of image quality adjustments are possible, the number of times of each of the volume values determined among the volume values representing the degree of each image quality adjustment is stored as a frequency, and the video is After determining the regularity based on the feature amount sequentially extracted for each frame image to be formed and each of the stored volume values Based on the regularity, a third step of selectively reading out each of the volume values corresponding to the feature points, and any one of the plurality of processed images simultaneously displayed on the display screen by an external operation When an image is designated, a volume value selectively set in the third step for the processed image is set and the image quality is adjusted, and then the fourth step of sequentially displaying the frame unit on the display screen. And so on.
Thereby, the image quality of the processed image can be adjusted with the volume value based on the feature amount of the frame image and the frequency of the volume value determined by the user, so that the processed image with the image quality preferred by the user can be generated.

As described above, according to the present invention, every time the user performs a predetermined operation for adjusting the volume value, the volume value indicating the degree of image quality adjustment can be brought close to the value desired by the user in a relatively short time. At the same time, it is possible to make a fine adjustment in the vicinity of the desired value, thus realizing a video processing apparatus that can be easily performed while adjusting the degree of image quality adjustment to the user's preference.

Further, in the present invention, the volume value representing the degree of image quality adjustment can be set to a value desired by the user with a small number of operations, and thus can be easily performed while adjusting the degree of image quality adjustment to the user's preference. Can be realized.
Furthermore, in the present invention, the image quality of the processed image can be adjusted with the volume value based on the feature amount of the frame image and the frequency of the volume value determined by the user, so that the processed image having the image quality preferred by the user can be generated. Thus, it is possible to realize a video processing apparatus that can be easily performed while adjusting the degree of image quality adjustment to the user's preference.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

(1) Configuration of Video Display Device According to this Embodiment In FIG. 1, reference numeral 1 denotes a video display device according to this embodiment. After various image conversion processes by the class classification adaptive process are sequentially performed, these processed images are sequentially synthesized as frame images and displayed.

  This video display device 1 includes a video input unit 2 for inputting a video signal S1 supplied from the outside, a signal processing unit 3 for performing video conversion processing of a plurality of systems on a frame basis for the video obtained from the video input unit 2. A video memory unit 4 that temporarily accumulates and appropriately synthesizes the processing results supplied from the signal processing unit 3, and a display unit 5 that displays the synthesized video read from the video memory unit 4 on a display screen; It is composed of

  The video display device 1 also has a receiving circuit 7 corresponding to the external remote control transmitter 6, and the remote control transmitter 6 responds to user operations (for example, adjustment of volume values such as resolution adjustment and noise suppression). The remote control signal RM that is output is received, and an operation signal S2 corresponding to the remote control signal RM is supplied to a comprehensive determination unit 8 provided in the signal processing unit 3.

  As shown in FIG. 2, the remote control transmitter 6 has a main body portion 6A that is a flat rectangular parallelepiped as a whole, and an operation portion 9 that is a push button group to which various functions are assigned on the surface. A wireless communication port 10 compliant with the same communication standard as the video display device 1 is provided on the upper end surface.

  In the operation unit 9, as a group of buttons, a cursor button 9A is arranged in the center of the lower stage, and a determination button 9B for determining various setting states and the setting state are displayed on the right and left sides of the upper stage of the cursor button 9A. Cancel buttons 9C for canceling are respectively arranged. A plurality of numeric buttons 9D are arranged in a predetermined pattern above the decision button 9B and the cancel button 9C.

  As shown in FIG. 3, the remote control transmitter 6 includes a CPU 11, an operation unit 9, a flash memory 12, a program ROM (Read Only Memory) 13, and a transmission circuit 14 connected via a bus 15. A battery (not shown) made of, for example, a button battery or the like is built in as a drive source.

  The CPU 11 reads out a corresponding program from various programs stored in the flash memory 12 in response to an input operation of the operation unit 9 by the user, expands the program in the program ROM 13, and performs various control processes according to the program. Execute. The transmission circuit 14 transmits data transmitted from the CPU 11 via the wireless communication port 10 (FIG. 2).

  In the signal processing unit 3 in the video display device 1 (FIG. 1), the comprehensive determination unit 8 that controls the entire system sequentially uses the video supplied to the video input unit 2 as a frame image and the feature quantity extraction unit 20 and a plurality of video images. To the class classification adaptive processing unit 21 (21A, 21B, 21C, 21D,...). Among these, the feature amount extraction unit 20 extracts feature amounts from the sequentially supplied frame images, and then sends them to the comprehensive determination unit 8.

  Here, the feature amount includes a statistical amount such as an average and a variance of the frame image, an autocorrelation, a dynamic range (DR), a histogram, and the number of edges exceeding an arbitrary gradient in the frame image.

  In the signal processing unit 3 in the video display device 1 in FIG. 1, the plurality of class classification adaptive processing units 21 perform predetermined image conversion processing on the sequentially supplied frame images under the control of the comprehensive determination unit 8. After that, the obtained frame image (hereinafter simply referred to as a processed image) is converted into the difference feature quantity extraction unit 22 and the video memory unit 4 and the corresponding feature quantity extraction unit 23 (23A, 23B, 23C, 23D,...

  The difference feature quantity extraction unit 22 extracts a difference feature quantity between two or more designated process images for the process images sequentially supplied from each class classification adaptation processing unit 21, and then extracts them from the comprehensive determination unit 8. To supply. Here, the difference feature amount represents a feature amount such as the above-described feature amount in a difference value between two or more processed images and a correlation value between the processed images.

  Further, the comprehensive determination unit 8 receives the transmission contents of the remote control transmitter 6 (that is, user operation contents) from the receiving circuit 7 and supplies them in real time from each class classification adaptive processing unit 21 via the corresponding feature amount extraction unit 23. And each difference feature amount supplied in real time from each class classification adaptation processing unit 21 via the difference feature amount extraction unit 22 and stored in the feature amount history holding unit 24. The past feature amount and the operation history information held in the operation history holding unit 25 can be read as necessary.

  The comprehensive determination unit 8 determines the operation content of the remote control transmitter 6 by the user based on the remote control signal RM obtained through the receiving circuit 7, and adjusts the image quality adjustment volume such as resolution adjustment and noise suppression. In the case of adjustment of the value, the volume value is sent to each class classification adaptive processing unit 21. On the other hand, in the case of setting contents relating to the display form of other processed images, the control signal S3 corresponding to the setting contents Is sent to the video memory unit 4.

  In the present embodiment, as shown in FIG. 4, the volume space that can be adjusted by the user has an adjustment axis for changing the resolution (hereinafter referred to as the resolution axis) as the vertical axis, and the noise suppression amount changes. Can be represented by a two-dimensional coordinate system FR having a horizontal axis as an adjustment axis (hereinafter referred to as a noise axis), and the resolution and noise suppression amount adjusted by the user in the two-dimensional coordinate system FR. The volume value can be expressed as coordinates (hereinafter referred to as adjustment points) AD.

  In the two-dimensional coordinate system FR forming the volume space as shown in FIG. 4, the volume value can be adjusted in 256 steps for each of the resolution axis and the noise axis, and a total of 65536 (= 256 × 256) steps can be adjusted. Is possible.

  The user can freely move the adjustment point AD in a desired direction in the two-dimensional coordinate system FR by operating the cursor button 9A mounted on the remote control transmitter 6 up, down, left, and right according to the operation. As a result, the volume values of the resolution and the noise suppression amount can be determined according to the position of the adjustment point AD.

  Specifically, when the adjustment point AD is moved in the left-right direction, the volume value that determines the amount of noise suppression is adjusted. On the other hand, when the adjustment point is moved in the up-down direction, the volume value that determines the resolution is adjusted. The In this way, the user can freely and easily adjust the resolution and the amount of noise suppression independently of each other by operating the cursor button 9A of the remote control transmitter 6.

  In addition, the control signal S3 (FIG. 1) includes information indicating whether the designated processed image is displayed at the designated position at the designated enlargement ratio or reduction ratio, and only the designated portion of the input frame image. Information indicating whether to extract.

  Each class classification adaptive processing unit 21 adjusts image quality (resolution adjustment and noise suppression amount adjustment) based on the volume values respectively given from the comprehensive determination unit 8 when performing image conversion processing on sequentially supplied frame images. Then, the processed image after the image quality adjustment is sequentially supplied to the video memory unit 4 and is also recursively sequentially supplied to the difference feature amount extraction unit 22 and the corresponding feature amount extraction unit 23.

  The comprehensive determination unit 8 temporarily stores the processed images sequentially supplied from the class classification adaptive processing units 21 in the video memory unit 4 and processes the necessary processed images from the video memory unit 4 at a predetermined timing based on the control signal S3. Are selectively read out and these processed images are combined so as to have a display form designated by the user (for example, reduction, clipping, or pasting of images) to generate a combined image.

  For example, as illustrated in FIG. 5A, a composite image PMX as illustrated in FIG. 5B is generated for the processed images PA to PD supplied from the four class classification adaptive processing units 21A to 21D. It is possible. That is, among the four processed images PA to PD, the three processed images PA to PC are images in which the resolution and the noise suppression amount are adjusted with different volume values, and the processed image PD is the other processed images PA to PC. This is an image whose size is reduced as compared to (Fig. 5A). The composite image PMX is an image in which only the left half is cut out from the processed image PA, an image in which the upper right and lower right quarters are cut out from the processed images PB and PC, respectively, and the ratio in which the processed image PD is specified. And the image that has been reduced and pasted to the processed image PA (FIG. 5B).

  Subsequently, the comprehensive determination unit 8 displays the composite image generated in the video memory unit 4 on the display screen of the display unit 5 including, for example, a CRT (cathode-ray tube) or an LCD (liquid crystal display).

  Here, an internal configuration of each class classification adaptive processing unit 21 is shown in FIG. In the class classification adaptive processing unit 21, a control unit (not shown) temporarily stores the supplied video in the first frame memory 30 in units of frames, and sequentially sends the video as a frame image to the mapping unit 31.

  The mapping unit 31 includes a class classification unit 32, a prediction tap acquisition unit 33, and a prediction calculation unit 34. The frame image supplied from the first frame memory 30 is supplied to the class classification unit 32 and the prediction class tap acquisition unit 33, respectively. Supply.

  The class classification unit 32 includes a class tap acquisition unit 32A that acquires a predetermined number of class taps corresponding to the image of interest among the supplied frame images, and one of a predetermined number of classes based on the acquired class taps. It comprises a waveform classification unit 32B that classifies the target pixel into a class and assigns a class number.

  Further, the prediction tap acquisition unit 33 corresponds to the class classified from the frame image stored in the first frame memory 30 based on the class number given from the waveform classification unit 32B in the class classification unit 32. A predetermined number of prediction taps are acquired, and the acquired prediction taps and class numbers are supplied to the prediction calculation unit 34.

  The prediction calculation unit 34 obtains a coefficient set corresponding to the class from the coefficient set stored in the coefficient set memory 35 based on the class number, and then predicts by linear prediction based on the coefficient set and the prediction tap. Predict the pixel value of the image.

  Such a coefficient set is composed of coefficients for generating a high-density image by linear prediction or the like, and when generating a predicted image corresponding to an image in a specified region in a class classification adaptive process for predicting pixel values. used. Processing for generating a higher density image or the like from such a coefficient set and input image is called mapping processing.

  In this way, the control unit (not shown) temporarily stores the pixel value of the predicted image predicted by the prediction calculation unit 34 in the second frame memory 36, and the predicted pixel value is set. Outputs a high-resolution frame image.

(2) First Embodiment (2-1) Volume Value Adjustment Processing by Two-Screen Display In the video display device 1 shown in FIG. 1 described above, the user selects the remote control transmitter 6 when selecting the image quality adjustment mode. Is used to adjust the volume values of the resolution axis and noise axis to desired values while maintaining the correlation, and the images before and after the adjustment (continuous processed images) are displayed in real time on the display screen of the display unit 5 Are simultaneously displayed, and image quality adjustment can be performed while directly comparing the two images.

  First, when the image quality adjustment mode is selected by the user operating the remote control transmitter 6 while the image is displayed on the display screen of the display unit 5, the overall determination unit 8 performs the volume value adjustment processing procedure RT1 shown in FIG. Is started from step SP0, and in the subsequent step SP1, after waiting for an operation input for adjusting the volume values of the resolution axis and the noise axis by the user, the process proceeds to step SP2.

  In step SP2, the comprehensive determination unit 8 includes two specific class classification adaptive processing units (hereinafter referred to as first and second class classification adaptive processing units) among the plurality of class classification adaptive processing units 21. In 21A and 21B, the first class classification adaptive processing unit 21A obtains a processed image (hereinafter referred to as a pre-adjustment image) obtained by performing image conversion processing after performing image quality adjustment with the volume value before adjustment. The second class classification adaptive processing unit 21B obtains a processed image (hereinafter referred to as an “adjusted image”) obtained by performing image conversion processing after adjusting the image quality with the adjusted volume value.

  Then, the overall determination unit 8 cuts and combines the pre-adjustment image and the post-adjustment image into half the size of one frame via the video memory unit 4, and then displays the obtained composite image on the display screen of the display unit 5. Let

  As a method for displaying the composite image, as shown in FIGS. 8A to 8D, two predetermined images of the image portion within a predetermined range in the input frame image P0 (FIG. 8A) are displayed. A method of dividing and displaying a pre-adjustment image P1 and an after-adjustment image P2 (FIG. 8B) simultaneously as a composite image P3 of one frame (hereinafter referred to as a first display method) (FIG. 8C) ) And a method of combining the pre-adjustment image P1 and the post-adjustment image P2 (FIG. 8B) in half so as to form the same image as the input frame image P0 and displaying it as a composite image P4 (hereinafter referred to as this). (Referred to as a second display method) (FIG. 8D).

  In the case of the first display method, since processed images at the same position can be displayed at the same time, there is an advantage that the user can easily compare both images. There is an advantage that the user can visually observe the volume value without being lost (there is no image portion that is not output).

  The comprehensive determination unit 8 proceeds to step SP3 with the pre-adjustment image and the post-adjustment image displayed at the same time, and determines whether or not the cancel button 9C in the operation unit 9 of the remote control transmitter 6 has been pressed by the user. To do.

  If an affirmative result is obtained in step SP3, this means that the user intends to return to the volume value of the pre-adjustment image. At this time, the comprehensive determination unit 8 proceeds to step SP4 and proceeds to each volume. The processed image (pre-adjustment image) whose resolution and noise suppression amount have been adjusted with values is sequentially displayed as a frame image on the entire display screen of the display unit 5, and then the process proceeds directly to step SP5 to execute the volume value adjustment processing procedure RT1. finish.

  On the other hand, if a negative result is obtained in step SP3, the overall determination unit 8 proceeds to step SP6 and determines whether or not the determination button 9B on the operation unit 9 of the remote control transmitter 6 has been pressed by the user. .

  If an affirmative result is obtained in step SP6, this means that the user is satisfied with the current volume value of the adjusted image. At this time, the comprehensive determination unit 8 proceeds to step SP7 and proceeds to step SP7. After changing the value to the volume value indicating the resolution of the adjusted image and the noise suppression amount, the process proceeds to step SP8, and the changed volume value is stored in the operation history holding unit 25 as operation history information.

  Then, the comprehensive determination unit 8 proceeds to step SP4, and the processed images (adjusted images) in which the resolution and the noise suppression amount are adjusted with the volume value determined to be adjusted are sequentially displayed on the display screen of the display unit 5 as frame images. After displaying the entire screen, the process proceeds to step SP5 as it is, and the volume value adjustment processing procedure RT1 is terminated.

  As described above, in the video display device 1, when performing the image conversion process by the class classification adaptive process, the pre-adjustment image before starting the adjustment of the respective volume values of the resolution axis and the noise axis and the adjustment of the respective volume values. The adjusted image during execution or after execution can be displayed on the display screen of the display unit 5 at the same time. As a result, the user can easily perform image quality adjustment while directly comparing the two simultaneously.

  As a result, the user can efficiently adjust the image quality by adjusting the volume value, and can easily find the volume value corresponding to the image quality that the user has determined to be the best.

  Furthermore, only when the user is satisfied with the processed image after the image quality adjustment, the determination button 9B on the operation unit 9 of the remote control transmitter 6 is pressed to reflect the image quality adjustment result on the output image. When signal processing using past operation history information or the like as in the past is performed, it is possible to prevent the operation history information from being erroneously stored contrary to the user's preference and intention.

(2-2) Information Amount Acquisition Processing Further, in the video display device 1 according to the present embodiment, when the above-described first and second class classification adaptive processing units 21A and 21B perform image conversion processing by class classification adaptive processing. In addition, a synthesized image obtained by synthesizing the pre-adjustment image and the post-adjustment image with different volume values of the resolution axis and the noise axis can be sequentially displayed in real time on the display screen of the display unit 5. .

  At this time, the composite image displayed on the display screen of the display unit 5 is an image obtained by combining the pre-adjustment image and the post-adjustment image for each half frame in the first and second display methods described above. The remaining half-frame images of the pre-adjustment image and the post-adjustment image are not displayed on the display screen of the display unit 5.

  Therefore, in the signal processing unit 3 of the video display device 1 illustrated in FIG. 1, the difference feature amount extraction unit 22 uses the image portion that is not actually displayed among the pre-adjustment image and the post-adjustment image, and the pre-adjustment image and the adjustment. It is possible to extract a difference feature amount between subsequent images. In other words, the pre-adjustment image and the post-adjustment image are images in which the volume values of the resolution axis and the noise axis are different, but are images that have undergone image conversion processing by class classification adaptation processing on the same frame image. Pixels whose image quality has been adjusted with different volume values for pixels at all positions of the processed image.

  Therefore, the difference feature quantity extraction unit 22 has two pixels at the same position in the processed images (pre-adjustment image and post-adjustment image) supplied from the first and second class classification adaptive processing units 21A and 21B. Since there are two, it is possible to perform an operation such as a difference between the two processed images.

  In this way, in the video display device 1, by providing the plurality of class classification adaptive processing units 21 (21A, 21B,...) In the signal processing unit 3, the resolution axis and the volume value of the noise suppression amount are set to different values. With respect to a plurality of adjusted processed images, difference feature amounts such as an average, a variance, a dynamic range, and a correlation value of difference values can be calculated in real time. In this case, real time means the same speed as the speed at which a single class classification adaptive processing unit generates one processed image by image conversion processing.

  By using the signal processing unit 3 having a plurality of class classification adaptive processing units 21 (21A, 21B,...) As in the present embodiment, two screens can be obtained using a conventional single class classification adaptive processing unit. Compared to the case where display is realized, it is not necessary to increase the processing speed to twice the real-time speed, and the volume value for image quality adjustment can be arbitrarily switched even during one-screen processing. There are advantages.

(3) Second Embodiment (3-1) Volume Value Adjustment Processing Using Operation History Information In the second embodiment, when the image quality adjustment mode is selected in the video display device 1 shown in FIG. When the user uses the remote control transmitter 6 to adjust the volume values of the resolution axis and noise axis to desired values while maintaining the correlation, the operation speed is further reflected by reflecting the user's past operation history information. It has been made to improve.

  In the signal processing unit 3 of the video display device 1, in the two-dimensional coordinate system forming the volume space, each volume value of the resolution axis and noise axis has 256 levels, and the user usually operates the operation unit 9 of the remote control transmitter 6. Each time the cursor button 9A is pressed once in the desired direction, the step width is set as a default so as to increase or decrease by one step.

  According to the second embodiment, the step value of the volume value is increased or decreased every time the cursor button 9A is pressed once in accordance with the user's past operation history information, and the user goes through all the stages. Thus, it is possible to avoid the trouble of visually confirming the change of the processed image while increasing or decreasing by one step width.

  Specifically, in the signal processing unit 3 of the video display device 1, the comprehensive determination unit 8 uses the volume values representing the resolution and noise suppression amount of the adjusted image determined by the user in the past as operation history information as an operation history holding unit. 25, the operation history information is read out as needed, and a map (hereinafter referred to as a relationship) between each volume value in the volume space and the number of times the user has determined as an adjusted image for each volume value. This is called a frequency map).

  In this frequency map, in the two-dimensional coordinate system forming the volume space, the adjustment points representing the volume values of the resolution axis and the noise axis determined by the user as the adjusted image have been determined by how many times until now. It is expressed as a frequency.

  When creating the frequency map, the comprehensive determination unit 8 classifies the number of determinations of the user as a plurality of types of frequency levels, and the number of determinations of adjustment points determined by the user corresponds to the frequency level of any stage. Each volume value representing the adjustment point, the number of determinations of the adjustment point, and the corresponding frequency level are stored in the operation history holding unit 25 as operation history information.

  Here, in step SP8 of the volume value adjustment processing procedure RT1 (FIG. 7) in the first embodiment described above, each volume value representing the resolution and noise suppression amount of the adjusted image determined by the user is used as operation history information. Although stored in the operation history holding unit 25, in the second embodiment, the comprehensive determination unit 8 executes the operation history holding processing procedure RT2 shown in FIG. The operation history information to which the number of determinations based and the corresponding frequency level is added can be created.

  When the adjusted image is determined in step SP6 shown in FIG. 7, the comprehensive determination unit 8 starts the operation history holding processing procedure RT2 shown in FIG. 9 from step SP10, and proceeds to the subsequent step SP11 to perform the adjusted image. After reading operation history information corresponding to an adjustment point representing each volume value for image quality adjustment, a past determination number n (n is a natural number) of the adjustment point is extracted from the operation history information.

  Subsequently, the comprehensive determination unit 8 proceeds to step SP12, increments 1 to the past determination number n of the determined adjustment point and updates the determination number to (n + 1), and then stores the operation history information of the adjustment point. It is stored in the operation history holding unit 25.

  The overall determination unit 8 proceeds to step SP13, and the current determination number (n + 1) of the determined adjustment point is smaller than the first threshold value TH1 or not less than the first threshold value TH1 and not more than the second threshold value TH2. Or greater than the second threshold TH2.

  In step SP13, if the current determination number (n + 1) of the determined adjustment point is smaller than the first threshold value TH1, the overall determination unit 8 proceeds to step SP14 and sets the frequency level to “0”. On the other hand, if it is not less than the first threshold value TH1 and not more than the second threshold value TH2, the process proceeds to step SP15 to set the frequency level to “1”, and if it is greater than the second threshold value TH2, Proceeding to SP16, the frequency level is set to “2”.

  After executing any of these steps SP14 to SP16, the overall determination unit 8 proceeds to step SP17, and sets the frequency level corresponding to the current number of determinations (n + 1) of the determined adjustment points as the operation history of the adjustment points. After being stored in the operation history holding unit 25 so as to be included in the information, the process proceeds to step SP18 and the operation history holding processing procedure RT2 is finished.

  Thereafter, the overall determination unit 8 proceeds to step SP4 of the volume value adjustment processing procedure RT1 shown in FIG. Image) is sequentially displayed as a frame image on the entire display screen of the display unit 5, and then the process proceeds directly to step SP5 to end the volume value adjustment processing procedure RT1.

  As described above, in the second embodiment, as the operation history information, not only each volume value indicating the resolution of the adjusted image and the noise suppression amount but also the number of determinations based on the frequency map described above and the corresponding volume value are applicable. A frequency level can be added.

  Next, in the video display device 1, when the user adjusts the image quality using the remote control transmitter 6, the user desires each volume value of the resolution axis and the noise axis in a relatively short time by using such operation history information. The value of can be reached.

  First, when the image quality adjustment mode is selected by the user operating the remote control transmitter 6 while the image is displayed on the display screen of the display unit 5, the overall determination unit 8 performs the volume value adjustment processing procedure RT2 shown in FIG. Is started from step SP20, and in step SP21, after waiting for the user to input an operation for adjusting the volume values of the resolution axis and noise axis, the process proceeds to step SP22.

  In step SP22, the overall determination unit 8 reads out operation history information for the adjustment point representing each volume value for image quality adjustment of the current image after adjustment from the operation history holding unit 25, and then determines the number of adjustment point determinations. The frequency level L (L is a natural number) is extracted.

  Subsequently, the comprehensive determination unit 8 proceeds to step SP23, and the frequency level L with respect to the number of determinations of the adjustment point representing each volume value for image quality adjustment of the adjusted image is “0”, “1”, or “2”. Judge which one it is.

  In step SP23, if the frequency level L with respect to the number of adjustment points representing the volume value for adjusting the image quality of the current adjusted image is “0”, the overall determination unit 8 proceeds to step SP24. While the step width of each volume value for image quality adjustment is set to “10”, in the case of “1”, the process proceeds to step SP25, and the step width of each volume value is set to “5”. In the case of “2”, the process proceeds to step SP26, and the step width of each volume value is set to “1”.

  That is, the comprehensive determination unit 8 sets the amount of change in the volume values of the resolution axis and noise axis each time the cursor button 9A in the operation unit 9 of the remote control transmitter 6 is pressed once, the step width corresponding to the corresponding frequency level. Reset to.

  Specifically, the comprehensive determination unit 8 performs a single pressing operation of the cursor button 9A in an area (a coordinate group of each volume value of the resolution axis and the noise axis) in the volume space where the determination frequency of the user is relatively high. On the other hand, while the step value of the volume value is set relatively finely, in the region where the determination frequency of the user is relatively low, the step value of the volume value is relatively rough for one pressing operation of the cursor button 9A. Set.

  Eventually, the overall determination unit 8 proceeds to step SP27, and adds or subtracts each volume value of the current adjustment point with a step width corresponding to the corresponding frequency level to determine the next adjustment point.

  Thereafter, the comprehensive determination unit 8 performs the same processing as step SP2 of the volume value adjustment processing procedure RT1 shown in FIG. 7 described above from step SP28, and the subsequent processing of steps SP29 to SP34 shown in FIG. The volume value adjustment processing procedure RT3 shown in FIG. 10 is completed in the same manner as the processing of SP8.

  As described above, in the second embodiment, when a user performs image quality adjustment using the remote control transmitter 6, the step width of the volume value is set more finely in an area where the user is frequently determined in the volume space. Therefore, each time the cursor button 9A is pressed in the desired direction, the volume values of the resolution axis and the noise axis can be brought close to the values desired by the user in a relatively short time, and in the vicinity of the desired values, Can be adjusted.

  In the second embodiment, the case has been described in which the step width of the volume value is set more finely in an area where the user determination frequency is higher in the volume space. However, the present invention is not limited to this, and the present invention is not limited to this. You may make it change the quantity changed according to a use frequency with the frequency for every volume axis | shaft. That is, a histogram may be generated for each resolution axis and each noise axis, and the amount of change may be changed depending on which axis.

(4) Third Embodiment (4-1) Volume Value Adjustment Processing by Selecting Display Area In the second embodiment described above, the operation history information is effectively utilized to obtain the best volume value for the user. In the third embodiment, the video display device 1 uses a two-dimensional coordinate system that forms a volume space on the display screen of the display unit 5. The same effect can be obtained by causing the volume value to converge while being displayed and sequentially dividing the display area into two according to the user's selection.

  First, when the image quality adjustment mode is selected by the user operating the remote control transmitter 6 while the image is displayed on the display screen of the display unit 5, the overall determination unit 8 performs the volume value adjustment processing procedure RT4 shown in FIG. Is started from step SP40, and in the subsequent step SP41, after waiting for the user to input an operation for adjusting the volume values of the resolution axis and the noise axis, the process proceeds to step SP42.

  In step SP42, the overall determination unit 8 selects the entire area AR in which the volume values of the resolution axis and the noise axis can be adjusted in the two-dimensional coordinate system FR forming the volume space, as shown in FIG. Dividing into two, each volume value at the center of gravity of each of the areas AR1 and AR2 is set to be an adjustment point representing the area (hereinafter referred to as a representative point). At this time, the comprehensive determination unit 8 sequentially displays two processed images in which the resolution and the noise suppression amount are adjusted with the volume values of these two representative points on the display screen of the display unit 5.

  The comprehensive determination unit 8 proceeds to step SP43 with these two processed images being displayed simultaneously, and determines whether or not the cancel button 9C in the operation unit 9 of the remote control transmitter 6 has been pressed by the user.

  If an affirmative result is obtained in step SP43, this means that the user has an intention to return to each volume value of the processed image before adjustment. At this time, the comprehensive determination unit 8 proceeds to step SP44, The processed images in which the resolution and the noise suppression amount are adjusted with the respective volume values are sequentially displayed on the entire display screen of the display unit 5 as frame images, and then the process proceeds directly to step SP45 to end the volume value adjustment processing procedure RT4. .

  On the other hand, if a negative result is obtained in step SP43, the overall determination unit 8 proceeds to step SP46, and the user operates the cursor key in the operation unit 9 of the remote control transmitter 6, and either processing is performed. It is determined whether an area corresponding to the image has been selected.

  When a positive result is obtained in step SP46, the overall determination unit 8 proceeds to step SP47 and determines whether or not the determination button 9B on the operation unit 9 of the remote control transmitter 6 has been pressed by the user.

If a negative result is obtained in step SP47, the overall determination unit 8 further divides the area AR1 selected by the user from these two areas into two, and sets the representative points of the respective areas AR1 ₁ and AR1 _2. After the setting (FIG. 12B), the processed images in which the resolution and the noise suppression amount are adjusted with the volume values of these two representative points are sequentially displayed on the display screen of the display unit 5 in two screens.

Then, the overall determination unit 8 returns to step SP43 again and repeats the same processing as described above until the cancel button 9C is pressed or the determination button 9B is pressed in the subsequent step SP47. That is, of the two areas AR1 ₁ and AR1 ₂ shown in FIG. 12 (B), the designated area AR1 ₁ is divided into two areas AR1 ₁₁ and AR1 ₁₂ to set representative points. (FIG. 12 (C)), and further, the convergence setting of the region is repeated such that the designated region AR1 ₁₁ is divided into regions AR1 ₁₁₁ and AR1 ₁₁₂ and representative points are respectively set (FIG. 12 (D)). .

  In the two-dimensional coordinate system FR that actually forms the volume space according to the present embodiment, the region selection is performed by the two-choice method, so that the region is narrowed to half by one selection by the user (that is, the candidates are reduced to half). Therefore, a representative point of one volume value is determined by 16 selections.

  On the other hand, if an affirmative result is obtained in step SP47, this means that the representative point of the region selected by the user corresponds to the converged values of the volume values of the resolution axis and the noise axis, At this time, the overall determination unit 8 proceeds to step SP49, changes each volume value of the resolution axis and noise axis of the current processed image to each volume value of the representative point, and then proceeds to step SP44.

  In this step SP44, the overall determination unit 8 sequentially displays the processed image in which the resolution and the noise suppression amount are adjusted with the volume value for which the adjustment change is determined as a frame image on the display screen of the display unit 5, and then continues as it is. Proceeding to step SP45, the volume value adjustment processing procedure RT4 is terminated.

  In this way, the two-dimensional coordinate system forming the volume space is divided into two areas, and the adjustment result of each volume value at the representative point of each area is simultaneously displayed on the screen as two processed images, and the user desires Every time a processed image is selected, by converging so that the area in the volume space is narrowed, it is possible to reduce the user's trouble of visually observing all processed images (65536 levels). ing.

(5) Fourth Embodiment (5-1) Volume Value Adjustment Processing Using Operation History Information Based on Feature Quantity In the fourth embodiment, image quality adjustment is performed in the video display device 1 shown in FIG. When the mode is selected, when the user uses the remote control transmitter 6 to adjust the volume values of the resolution axis and noise axis to desired values while maintaining the correlation, Based on the predetermined regularity obtained from the relationship with past operation history information, the burden of operation by the user can be further reduced.

  In the fourth embodiment, a case where a dynamic range (DR) is used as a feature amount will be described. This dynamic range is used to evaluate how much the brightness of the subject can be reproduced, and it is a numerical value that represents how many times the amount of light can be reproduced with respect to the incident light amount of 100 [%]. .

  First, when the image quality adjustment mode is selected by the user operating the remote control transmitter 6 while the image is displayed on the display screen of the display unit 5, the comprehensive determination unit 8 performs the operation history holding processing procedure RT5 shown in FIG. Is started from step SP60, and in the subsequent step SP61, the dynamic range value is calculated as the feature amount from the sequentially input frame images, and the process proceeds to step SP62 to adjust the volume values of the resolution axis and noise axis by the user. After waiting for an operation input for, go to step SP63.

  In step SP63, the comprehensive determination unit 8 stores the pre-adjustment image and the post-adjustment image obtained by image conversion through the first and second class classification adaptation processing units 21A and 21B (FIG. 1) in the video memory unit 4. Then, each image is cut into a half size of one frame and synthesized, and the obtained synthesized image is displayed on the display screen of the display unit 5.

  Subsequently, the comprehensive determination unit 8 proceeds to step SP64 with the pre-adjustment image and the post-adjustment image displayed at the same time, and whether or not the user has pressed the cancel button 9C on the operation unit 9 of the remote control transmitter 6. Judging.

  If an affirmative result is obtained in step SP64, this means that the user intends to return to the volume value of the pre-adjustment image. At this time, the overall determination unit 8 proceeds directly to step SP65 to perform the operation. The history holding processing procedure RT is terminated.

  On the other hand, when a negative result is obtained in step SP64, the overall determination unit 8 proceeds to step SP66 and determines whether or not the user has pressed the enter button 9B on the operation unit 9 of the remote control transmitter 6. .

  If an affirmative result is obtained in this step SP66, this means that the user is satisfied with the current volume value of the adjusted image. At this time, the comprehensive determination unit 8 proceeds to step SP67 and proceeds to step SP67. The dynamic range value of the frame image calculated when 9B is pressed is stored in the feature amount history holding unit 24 (FIG. 1), and the operation history corresponding to each adjustment point representing each volume value for image quality adjustment of the adjusted image. After the information is read from the operation history holding unit 25 (FIG. 1), the past determination number n (n is a natural number) of the adjustment point is extracted from the operation history information.

  On the other hand, if a negative result is obtained in step SP66, the comprehensive determination unit 8 returns to step SP61 again and repeats the same processing as described above.

  Subsequently, the comprehensive determination unit 8 proceeds to step SP68, increments 1 to the past determination number n of the determined adjustment point and updates the determination number to (n + 1), and then stores the operation history information of the adjustment point. It is stored in the operation history holding unit 25.

The comprehensive determination unit 8 proceeds to step SP69, and the resolution axis corresponding to the dynamic range whose value is less than the predetermined threshold value TH _DR and whose adjustment point is currently determined most frequently (that is, the one with the highest frequency). Each volume value on the noise axis (hereinafter referred to as the first most frequent volume value) is stored in the operation history holding unit 25 so as to be included in the operation history information of the adjustment point, and then is directly subjected to step SP70. Proceed to

In step SP70, the overall determination unit 8 determines the resolution axis corresponding to the dynamic range having a value equal to or greater than the predetermined threshold value TH _DR and the current adjustment frequency of the adjustment point being the largest (that is, the frequency having the highest frequency). Each volume value of the noise axis (hereinafter referred to as the second most frequent volume value) is stored in the operation history holding unit 25 so as to be included in the operation history information of the adjustment point, and then directly proceeds to step SP71. move on.

  In step SP71, the overall determination unit 8 stores the first and second most frequent volume values and the number of determinations thereof in the operation history holding unit 25, and then proceeds to step SP65 to perform the operation history holding processing procedure. End RT5.

  As described above, in the fourth embodiment, the operation history information for the adjustment point representing the volume values of the resolution axis and the noise axis of the determined adjusted image includes the first and second most frequent volumes of the adjustment point. Values and the number of these decisions can be added.

  Next, in the video display device 1, when the user performs image quality adjustment using the remote control transmitter 6, a predetermined regularity obtained from the relationship between the feature amount extracted from the input frame image and past operation history information. Based on the above, each volume value of the resolution axis and noise axis can reach a desired value in a relatively short time.

First, when the image quality adjustment mode is selected by the user operating the remote control transmitter 6 while the image is displayed on the display screen of the display unit 5, the overall determination unit 8 performs the volume value adjustment processing procedure RT6 shown in FIG. Is started from step SP80, and in step SP81, the dynamic range value is calculated as a feature amount from the sequentially input frame images, and the process proceeds to step SP82, where the dynamic range value is less than a predetermined threshold value TH _DR . Determine whether or not.

In step SP82, if the dynamic range value is less than the threshold value TH _DR , the overall determination unit 8 proceeds to step SP83 and applies to the adjustment point representing each volume value for image quality adjustment of the current adjusted image. After the operation history information is read from the operation history holding unit 25 (FIG. 1), the first most frequently used volume value and the number of adjustment point determinations corresponding thereto are extracted.

Subsequently, the overall determination unit 8 proceeds to step SP84 to determine whether or not the number of determinations of the adjustment point representing each volume value for adjusting the image quality of the adjusted image is greater than a predetermined threshold value TH _DR. Is obtained, the process proceeds to step SP85, where each volume value is changed to the first most frequent volume value. On the other hand, if a negative result is obtained, the process returns to step SP81 and is the same as described above. Repeat the process.

On the other hand, when the dynamic range value is equal to or greater than the threshold value TH _DR in step SP82, the overall determination unit 8 proceeds to step SP86 and represents each volume value for image quality adjustment of the current adjusted image. After the operation history information for the adjustment point is read from the operation history holding unit 25 (FIG. 1), the second most frequently used volume value and the number of adjustment points determined corresponding thereto are extracted.

  Subsequently, the overall determination unit 8 proceeds to step SP87, determines whether or not the number of determinations of the adjustment point representing each volume value for image quality adjustment of the adjusted image is greater than a predetermined threshold value TH, and the positive result is If it is obtained, the process proceeds to step SP88 to change each volume value to the second most frequent volume value. On the other hand, if a negative result is obtained, the process returns to step SP81 and the same processing as described above. repeat.

  Eventually, in step SP89, the comprehensive determination unit 8 sequentially displays the processed images (adjusted images) in which the resolution and the noise suppression amount are adjusted with the first or second most frequent volume value for which adjustment change is determined as frame images. After the entire screen is displayed on the display screen of the unit 5, the process returns to the above-described step SP81 again, and the same processing as described above is repeated while sequentially monitoring the input frame images until there is an end operation from the user.

  As described above, in the fourth embodiment, when the user performs image quality adjustment using the remote control transmitter 6, when the dynamic range of the input frame image is relatively small, the user performs the first most frequent volume value. When the dynamic range is relatively large, the user automatically adjusts to the image quality that the user likes most by automatically determining the regularity that the second most frequently used volume value is used frequently. The processed image can be obtained in a relatively short time without the user being aware of it.

  Note that in the fourth embodiment, the above-described automatic determination processing based on regularity is performed on an arbitrary part of an input frame image, and the image part of the output image A processed image that is adjusted in image quality with a volume value appropriate for the user may be displayed.

(6) Operations and Effects According to First to Fourth Embodiments First, in the configuration of the first embodiment, the video display device 1 performs resolution conversion and noise when performing image conversion processing by class classification adaptive processing. The image before adjustment before starting the adjustment of each volume value of the axis and the image after adjustment during or after the adjustment of each volume value are displayed on the display screen of the display unit 5 at the same time, By enabling the user to easily perform image quality adjustment while directly comparing both, the user can efficiently perform image quality adjustment by adjusting the volume value, and the image quality that the user has determined to be the best individually The volume value corresponding to can be easily found.

  Further, only when the user is satisfied with the processed image after the image quality adjustment, the image quality adjustment result is reflected in the output image based on the operation of the remote control transmitter 6, so that past operation history information and the like as in the past can be used. Thus, it is possible to prevent storing erroneous operation history information contrary to the user's preference and intention when performing the signal processing.

  Furthermore, in the video display device 1, by providing a plurality of class classification adaptive processing units 21 (21A, 21B,...) In the signal processing unit 3, a plurality of resolution axes and noise suppression amount volume values adjusted to different values. By using the single class classification adaptive processing unit as in the past by calculating the difference feature amount such as the average, variance, dynamic range, and correlation value of the difference values in real time for the processed image of Compared with the case of realizing two-screen display, it is not necessary to increase the processing speed to twice the real-time speed, and the volume value for image quality adjustment can be arbitrarily switched even during one-screen processing. it can.

  In the configuration of the second embodiment, when the user performs image quality adjustment using the remote control transmitter 6, the step value of the volume value is set more finely in an area where the user is frequently determined in the volume space. As a result, each time the user presses the cursor button 9A in the desired direction, the volume values of the resolution axis and the noise axis can be brought close to the values desired by the user in a relatively short time, and the desired values Fine adjustment is possible in the vicinity of.

  In the configuration of the third embodiment, the two-dimensional coordinate system forming the volume space is divided into two areas, and the adjustment results of the volume values at the representative points of the areas are simultaneously obtained as two processed images. Every time a user selects a desired processed image on the screen, the volume value is converged so as to narrow the area in the volume space. It is possible to remarkably reduce the user's trouble of having to adjust all the steps in the axial direction while viewing the processed image.

  Further, in the configuration of the fourth embodiment, when the user performs image quality adjustment using the remote control transmitter 6, when the dynamic range of the input frame image is relatively small, the user performs the first most frequent volume value. When the dynamic range is relatively large, the user prefers the regularity such that the frequency of using the second most frequently used volume value is high automatically. The processed image adjusted to the image quality can be obtained in a relatively short time without the user being aware of it.

(7) Other Embodiments As described above, in the first to fourth embodiments, the case where the present invention is applied to the video display device as shown in FIG. 1 has been described. The present invention is not limited to this, and can be widely applied to video processing apparatuses that perform predetermined video processing on video based on supplied video signals.

  As described above, in the first to fourth embodiments, for each frame image forming a video, as a plurality of image conversion processing means for performing image conversion processing on each frame image in a plurality of systems. Although the case where a plurality of class classification adaptive processing units 21 (21A, 21B,...) Provided in the signal processing unit 3 shown in FIG. 1 is applied has been described, the present invention is not limited thereto, The present invention may be widely applied to a plurality of image conversion processing means having various configurations according to the image conversion processing.

  Further, as described above, in the first to fourth embodiments, processed images sequentially obtained as a result of the image conversion processing from the plurality of class classification adaptation processing units (image conversion processing means) 21 are processed as the plurality of processing. The case has been described where the display unit 5 in the video display device 1 shown in FIG. 1 is applied as video display means for sequentially displaying in units of frames so that all or part of the image can be simultaneously accommodated in the display screen. However, the present invention is not limited to this, and may be widely applied to video display means having other various configurations.

  Further, as described above, in the first to fourth embodiments, one of the plurality of processed images displayed simultaneously on the display unit (video display means) 5 is designated by an external operation. The case where the remote transmitter 6 wirelessly connected to the video display device 1 is applied as the operation input means for determining the volume value indicating the degree of image quality adjustment of the designated processed image has been described. The present invention is not limited to this, and an operation panel or the like provided in the remote control transmitter 6 may be directly mounted on the video display device 1.

  Further, as described above, in the first to fourth embodiments, the processing image designated via the remote transmitter (operation input means) 6 is set to the volume value determined for the processing image. After the image quality adjustment is performed, display setting means for sequentially displaying the display unit (video display means) 5 in units of frames includes an overall determination unit 8 and a plurality of class classification adaptive processing units provided in the signal processing unit 3 shown in FIG. 21 and the video memory unit 4 have been described. However, the present invention is not limited to this, and may be widely applied to display setting means having various other configurations.

  Further, as described above, in the second embodiment, the display setting unit (mainly the comprehensive determination unit 8) is configured to display a volume value representing the degree of each image quality adjustment in a volume space in which a plurality of types of image quality adjustment is possible. Among them, an operation history holding unit (storage unit) 25 that stores the frequency of each volume value determined through the remote transmitter (operation input unit) 6 as a frequency is provided, and the remote transmitter (operation input unit) 6 is provided. When each desired volume value is determined via the operation history storage unit (storage means) 25, the frequency of each volume value is read, and the higher the frequency, the finer the step width of each volume value is set. The case where the step width of each volume value is set to be rougher as the frequency is lower has been described. However, the present invention is not limited to this. Each time a predetermined operation for adjusting the volume value is performed, the volume value indicating the degree of image quality adjustment can be brought close to the value desired by the user in a relatively short time, and fine adjustment is performed in the vicinity of the desired value. If possible, the step width of each volume value may be adjusted using various other configurations.

  Further, as described above, in the third embodiment, the display setting unit (mainly the comprehensive determination unit 8) changes the volume value corresponding to each image quality adjustment in a volume space in which a plurality of types of image quality adjustment is possible. A two-dimensional coordinate system (multi-dimensional coordinate system) composed of two adjustment axes is divided into two areas, and each volume value at the representative point of each area is set to adjust the image quality. (Video display means) 5 sequentially displays on the display screen two processed images each adjusted in image quality with each volume value, and one of the two processed images is displayed on the remote transmitter (operation input). Means) Each time the value is specified via 6, each volume value is divided so that the region corresponding to the processed image is further divided into two to narrow the region in the two-dimensional coordinate system (multidimensional coordinate system). Although the case of convergence is described, the present invention is not limited to this, and three adjustment axes may be used in the three-dimensional coordinate system, and the number of divided regions in the multidimensional coordinate system is three or more. In essence, it is possible to remarkably reduce the user's trouble of having to adjust each volume value while viewing the processed image in all stages in the adjustment axis direction for image quality adjustment. If possible, the present invention can be widely applied to other various configurations.

  Furthermore, as described above, in the fourth embodiment, a feature amount extraction unit (feature amount extraction means) 20 that sequentially extracts feature amounts for each frame image forming a video, and a plurality of types of image quality adjustments are possible. In the volume space, an operation history holding unit (storage unit) that stores, as a frequency, the number of each volume value determined via the remote transmitter (operation input unit) 6 among the volume values representing the degree of image quality adjustment. 25, the regularity based on the feature amount of each frame image extracted from the feature amount extraction unit (feature amount extraction unit) 20 and each volume value stored in the operation history holding unit (storage unit) 25 is determined. And an overall determination unit (determination unit) 8 that determines each volume value corresponding to the feature point from the operation history holding unit (storage unit) 25 based on regularity. The case of selectively reading out has been described, but the present invention is not limited to this. In addition to the dynamic range, the feature quantity includes statistical quantities such as average and variance of frame images, autocorrelation, histogram, Can be widely applied to the number of edges in a frame image exceeding an arbitrary gradient, etc. In short, a processed image adjusted to the image quality most preferred by the user can be obtained in a relatively short time without the user being aware of it. Can be widely applied to various other configurations.

  INDUSTRIAL APPLICABILITY The present invention can be widely applied to video equipment such as other display devices having a display screen capable of displaying video, in addition to television receivers, in video processing devices and video processing methods.

It is a block diagram which shows the structure of the video display apparatus by this Embodiment. It is a basic diagram which shows the external appearance structure of the remote control transmitter shown in FIG. It is a block diagram which shows the internal structure of the remote control transmitter shown in FIG. It is a rough-line top view with which it uses for description of the two-dimensional coordinate system which forms volume space. It is a rough-line top view with which it uses for description of the production | generation of a synthesized image. It is a block diagram which shows the internal structure of the class classification adaptive process part shown in FIG. It is a flowchart with which it uses for description of the volume value adjustment process sequence in 1st Embodiment. It is a rough-line top view with which it uses for description of the display method of a synthesized image. It is a flowchart with which it uses for description of the operation log | history holding process procedure in 2nd Embodiment. It is a flowchart with which it uses for description of the volume value adjustment process sequence in 2nd Embodiment. It is a flowchart with which it uses for description of the volume value adjustment process sequence in 3rd Embodiment. It is a conceptual diagram with which it uses for description of the convergence state of the volume value by the area | region selection in volume space. It is a flowchart with which it uses for description of the operation history holding | maintenance process sequence in 4th Embodiment. It is a flowchart with which it uses for description of the volume value adjustment process sequence in 4th Embodiment.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Video display apparatus, 2 ... Video input part, 3 ... Signal processing part, 4 ... Video memory part, 5 ... Display part, 6 ... Remote control transmitter, 7 ... Reception circuit, 8 ... Comprehensive determination unit, 9... Operation unit, 9 A .. cursor button, 9 B... Decision button, 9 C .. cancel button, 11... CPU, 20 .. feature extraction unit, 21 (21 A, 21 B,...) Class classification adaptive processing unit, 22... Difference feature amount extraction unit, 23 (23A, 23B,...)... Feature amount extraction unit, 24... Feature amount history holding unit, 25 .. operation history holding unit, RT1, RT3, RT4, RT6: Volume value adjustment processing procedure, RT2, RT5: Operation history holding processing procedure.

Claims (6)

In a video processing apparatus that performs predetermined video processing on video based on a supplied video signal,
For each frame image forming the video, a plurality of image conversion processing means for performing image conversion processing in a plurality of systems for each frame image,
Video that sequentially displays the processed images sequentially obtained as a result of the image conversion processing from the plurality of image conversion processing means in units of frames so that all or a part of the plurality of processed images can be simultaneously accommodated in the display screen. Display means;
Among the plurality of processed images that are simultaneously displayed on the image display means, one of the processed images is designated by an external operation, and a volume value that represents the degree of image quality adjustment of the designated processed image is determined. Operation input means for
Display setting for sequentially displaying the processed image designated through the operation input means on the video display means in units of frames after setting the volume value determined for the processed image and adjusting the image quality. Means ,
Storage means for storing, as a frequency, the number of volume values determined via the operation input means among volume values representing the degree of image quality adjustment in a volume space in which a plurality of types of image quality adjustment is possible.
With
The display setting means is
When each desired volume value is determined via the operation input means, the frequency of each volume value is read from the storage means, and the step width of each volume value is set more finely as the frequency is higher. The lower the frequency, the rougher the step width of each volume value
Film image processing apparatus. In a video processing apparatus that performs predetermined video processing on video based on a supplied video signal,
For each frame image forming the video, a plurality of image conversion processing means for performing image conversion processing in a plurality of systems for each frame image,
Video that sequentially displays the processed images sequentially obtained as a result of the image conversion processing from the plurality of image conversion processing means in units of frames so that all or a part of the plurality of processed images can be simultaneously accommodated in the display screen. Display means;
Among the plurality of processed images that are simultaneously displayed on the image display means, one of the processed images is designated by an external operation, and a volume value that represents the degree of image quality adjustment of the designated processed image is determined. Operation input means for
Display setting for sequentially displaying the processed image designated through the operation input means on the video display means in units of frames after setting the volume value determined for the processed image and adjusting the image quality. Means and
With
The display setting means is
In a volume space in which a plurality of types of image quality adjustment is possible, a multi-dimensional coordinate system including a plurality of adjustment axes for changing the volume value corresponding to each image quality adjustment is divided into a plurality of regions. Set each of the above volume values at the representative point of
The video display means includes
The plurality of processed images, each of which is adjusted in image quality with each of the volume values, are sequentially displayed on the display screen at the same time,
Each time one of the plurality of processed images is designated via the operation input means, the region corresponding to the processed image is further divided into a plurality of regions in the multidimensional coordinate system. Converge each of the above volume values in a narrower manner
Film image processing apparatus. In a video processing apparatus that performs predetermined video processing on video based on a supplied video signal,
For each frame image forming the video, a plurality of image conversion processing means for performing image conversion processing in a plurality of systems for each frame image,
Video that sequentially displays the processed images sequentially obtained as a result of the image conversion processing from the plurality of image conversion processing means in units of frames so that all or a part of the plurality of processed images can be simultaneously accommodated in the display screen. Display means;
Among the plurality of processed images that are simultaneously displayed on the image display means, one of the processed images is designated by an external operation, and a volume value that represents the degree of image quality adjustment of the designated processed image is determined. Operation input means for
Storage means for storing, as a frequency, the number of times of each of the volume values determined via the operation input means among the volume values representing the degree of each image quality adjustment in a volume space in which a plurality of types of image quality adjustment is possible;
Feature amount extraction means for sequentially extracting feature amounts for each frame image forming the video;
The regularity based on the feature quantity of each frame image extracted from the feature quantity extraction means and each volume value stored in the storage means is determined, and based on the regularity, the storage means Determining means for selectively reading from each of the volume values stored in
The processed image designated via the operation input means is set to the volume value selectively read out by the determining means for the processed image and adjusted for image quality, and then the image display means displays the processed image. that comprises a display setting means for sequentially displayed in frames Film image processing apparatus. In a video processing method for performing predetermined video processing on video based on a supplied video signal,
For each frame image forming the video, a first step of performing image conversion processing on each frame image in a plurality of systems,
A second step of sequentially displaying the processed images sequentially obtained as a result of the image conversion processing of the plurality of systems in units of frames so that all or a part of the plurality of processed images are all simultaneously accommodated in the display screen;
When one of the processed images is designated by an external operation among the plurality of processed images that are simultaneously displayed on the display screen, a volume value indicating the degree of image quality adjustment is determined for the designated processed image. Setting the volume value determined for the processed image to adjust the image quality, and then displaying the frame sequentially on the display screen in units of frames;
With
In the third step,
When each desired volume value is determined, the frequency of the stored volume value is read, and the step width of each volume value is set more finely as the frequency is higher. A video processing method for setting a rough step width of the volume value . In a video processing method for performing predetermined video processing on video based on a supplied video signal,
For each frame image forming the video, a first step of performing image conversion processing on each frame image in a plurality of systems,
A second step of sequentially displaying the processed images sequentially obtained as a result of the image conversion processing of the plurality of systems in units of frames so that all or a part of the plurality of processed images are all simultaneously accommodated in the display screen;
When one of the processed images is designated by an external operation among the plurality of processed images that are simultaneously displayed on the display screen, a volume value indicating the degree of image quality adjustment is determined for the designated processed image. Setting the volume value determined for the processed image to adjust the image quality, and then displaying the frame sequentially on the display screen in units of frames;
With
In the third step,
In a volume space in which a plurality of types of image quality adjustment is possible, a multi-dimensional coordinate system including a plurality of adjustment axes for changing the volume value corresponding to each image quality adjustment is divided into a plurality of regions. Set each of the above volume values at the representative point of
The plurality of processed images, each of which is adjusted in image quality with each of the volume values, are sequentially displayed on the display screen at the same time,
Each time any one of the plurality of processed images is designated, the volume corresponding to the processed image is further divided into a plurality of volumes so that the area in the multidimensional coordinate system is narrowed. A video processing method that converges values . In a video processing method for performing predetermined video processing on video based on a supplied video signal,
For each frame image forming the video, a first step of performing image conversion processing on each frame image in a plurality of systems,
A second step of sequentially displaying the processed images sequentially obtained as a result of the image conversion processing of the plurality of systems in units of frames so that all or a part of the plurality of processed images are all simultaneously accommodated in the display screen;
In a volume space where a plurality of types of image quality adjustment is possible, the number of each volume value determined among the volume values representing the degree of each image quality adjustment is stored as a frequency, and each frame image forming the video is stored. After determining the regularity based on the feature quantity sequentially extracted and the stored volume values, the volume values corresponding to the feature points are selectively read based on the regularity. A third step;
Among the plurality of the processing image which is simultaneously the video displayed on the display screen, when any of the above processes the image by an external operation Ru is specified, selectively read out by said third step with respect to the processed image and after the image quality adjustment is set to the volume value, the fourth step and the comprises that Film image processing method for sequentially displaying in the frame on the display screen.

Images