JPH04150177A - Processing content display device in picture processing unit - Google Patents

Abstract

PURPOSE:To automatically select a part having less significance as a picture and to display the picture processing content by calculating respective brightness differences in the potential areas for displaying the content, selecting an area with least brightness difference and displaying the picture processing content. CONSTITUTION:Plural picture processing contents (icon menu) in pictographs stored in an internal memory of a processor section 26 are written in a menu use memory 31 and outputted to a D/A converter section 29 via a data selector section 25 synchronously with a picture signal and displayed to a part of a screen of a display device while being overwritten onto the picture. Then plural display object areas for a display area of the icon menu on the screen are set, the processor section 26 calculates respectively the brightness difference in each area and an area with a small in-area brightness difference is selected and the icon menu is displayed for the selection. Thus, the display area of the icon menu is set to a place in which the brightness distribution is monotonous on the memory picture and the possibility of the picture processing object is less.

Description

[Detailed Description of the Invention] <Industrial Application Field> The present invention provides an image processing apparatus that imports image data from the outside and performs image processing, in order to select image processing contents.
Multiple image processing contents (menu) on part of the image display screen
The present invention relates to a processing content display device that displays a process content display device.

<Conventional technology> In recent years, with the spread of video decks and video cameras, interest in image processing devices has rapidly increased.In particular, advances in digital processing technology have led to the development of inexpensive and easy home-use image processing devices. (See Japanese Unexamined Patent Publication No. 2-94893, etc.).

Such an image processing device is, for example, connected between a video deck and a display such as a television, and displays an image by outputting an image signal from the video deck to the display via the image processing device. When set to processing mode, the image signal from the video deck is taken into the memory in the image processing device, and then the memory image is displayed on the display. Then, when the operator visually checks this and selects an image processing content such as image color conversion or chromakey processing, image processing (data processing) is performed based on this, and the processed image is displayed on the display.

Here, to select the image processing content, display multiple image processing content (icons and menus) using pictograms on a part of the display screen, and select the desired image processing content by moving the pointer on the screen with the mouse. This is done by specifying.

In such a case, the image processing contents will be displayed superimposed on the image on the display screen, so it is necessary to ensure that the visibility of the image is not impaired. Various attempts have also been made to display the contents of image processing, as described below.

Conventional Example 1 As shown in Fig. 9, if the pop-up position of the icon is constant on the left and right sides, it will cover a part of the natural image, so the natural image itself is moved by the panning operation, but the The display area is reduced and displayed, but a menu is provided to move or delete the icon itself.

Conventional Example 2 As shown in Figure 1O, similar functions are grouped into one block of menus, and their representative symbols or characters are displayed in the minimum necessary form, for example at the top of the screen, and the pointer is When you move and specify it, the next lower level icon menu will be displayed below it. However, even in this case, if a lower layer icon menu is displayed, it is displayed above the natural image regardless of its position.

<Problem to be solved by the invention> However, in the conventional display of image processing contents as described above, the display is performed independently of the image data imported into the memory from the outside, and each time, The problem is that the operator has to move the natural image itself or move the display position of the image processing content as necessary, which is cumbersome.

The present invention aims to solve such conventional problems by making it possible to automatically display image processing contents in a relatively meaningless area of an image in memory.

<Means for Solving the Problems> Therefore, as shown in FIG. an image processing content display means for displaying at least one image processing content on a part of a display screen for displaying data; In an image processing apparatus equipped with an image processing means for performing image processing, a plurality of display candidate areas are set as display areas on the display screen for the image processing contents, and a luminance difference in each of the display candidate areas is calculated. An intra-area brightness difference calculation means for calculating, a selection means for selecting a display candidate area having a small intra-area brightness difference from among these, and a display area switch for switching to display the image processing content in the selected display candidate area. and a processing content display device in the image processing apparatus.

More specifically, it is assumed that the intra-area brightness difference calculating means samples the brightness of pixels at predetermined intervals within the area and calculates the intra-area brightness difference.

Further, the intra-area brightness difference calculation means calculates the intra-area brightness difference based on the brightness distribution within the area, excluding a predetermined amount of lower limit data and upper limit data.

Further, the selection means has a priority order of display areas, and selects a display candidate area with a high priority when there is no intra-area luminance difference of a predetermined amount or more.

<Operation> In the above configuration, the brightness differences within multiple display candidate areas on the display screen are calculated, the display candidate area with the smallest intra-area brightness difference is selected, and image processing is applied to that display candidate area. By switching to display the content, it is possible to automatically select the part that has the least meaning as an image and display the image processing content.

Furthermore, when calculating the intra-area brightness difference, the calculation time can be shortened by sampling the brightness for all pixels within the area at predetermined intervals.

Furthermore, by calculating the intra-area luminance difference based on the luminance distribution within the area excluding a predetermined amount of lower limit data and upper limit data, the stability of the luminance difference calculation can be improved.

Further, by selecting a display candidate area with a high priority when there is no intra-area luminance difference of a predetermined amount or more, the stability of the display position can be ensured.

<Example> Examples of the present invention will be described below with reference to FIGS. 2 to 8.

FIG. 2 shows the circuit configuration of the image processing device.

Image signal (video signal) from video deck (not shown)
is input to the synchronization separation section 2I and the preprocessing section 22. The synchronization separator 21 extracts a vertical synchronization signal, a vertical synchronization signal, and
Various timing pulse signals such as a horizontal synchronization signal and a blank pulse signal are extracted and these signals are output to the timing controller 23.

The timing controller 23 controls P based on the signal.
A sample clock signal for reading or writing is created through processing by an LL (phase locked loop) circuit. Furthermore, in the timing controller 23, when no image signal is input, the PLL circuit is in a free-running state, and the sample clock signal is stable at a reference value.

The preprocessing section 22 separates the image signal into RGB color signals and outputs them to the A/D conversion section 24 . A/D converter 2
4 digitizes the signal based on the timing clock signal from the timing controller 23;
The data is output to the data selector section 25.

The data selector section 25 operates according to a signal from the processor section 26. That is, when a control signal is input from the processor section 26 to the timing controller 23 via an address bus or a data bus, the timing controller 23 outputs a control signal corresponding to the signal to the data selector section 25. The data selector unit 25 transfers the digital image data from the A/D converter 24 to the first and second memories 27 and 28 based on the input control signal.
The data transfer is performed by determining whether to transfer the data to the D/A converter 29 side or to the D/A converter 29 side.

The D/A converter 29 converts the digital image data into an analog image signal according to the timing clock signal from the timing controller 23 and outputs the analog image signal to the post-processor 30 . The post-processing section 30 outputs the analog image signal to a display (not shown) after passing it through a low-pass filter for clock noise shaving.

In addition, the data selector section 25 also outputs data from the first and second memories 2.
The digital image data output to the 7.28 side is written and stored in the first memory 27 or the second memory 28 in accordance with a timing signal for internal synchronization from the timing controller 23. The first and second memories 27 and 28 are
■It is possible to store image data for each frame.

Here, when displaying the memory image in the first memory 27 or the second memory 28 on the display, the processor section 2
6 inputs a control signal to the timing controller 23, and the timing controller 23 outputs a control signal to the data selector section 25.

As a result, the memory image in the first memory 27 or the second memory 28 is transferred to the A/D converter 2 via the data selector 25.
9 side, and the memory image is displayed on the display.

Further, a menu memory 31 is provided, and a plurality of image processing contents (icons and menus) using pictographs stored in the internal memory of the processor section 26 are written in this menu memory 31. The menu stored in the menu memory 31 is then D/A converted via the data selector section 25 in synchronization with the image signal from the video deck or the image signal of the memory image in the first memory 27 or the second memory 28. The image is output to the unit 29 side and displayed on a part of the display screen by overwriting the image.

Further, a mouse 32 is provided as means for selecting image processing contents, and a pointer position control signal from the mouse 32 is outputted to the processor section 26 via a control register 33. The processor unit 26 moves the pointer on the screen of the display according to the pointer position control signal, and determines whether the pointer is set on the menu.

In the image processing mode, the image signal from the video deck is processed by the preprocessing section 22. After importing the memory image into, for example, the first memory 27 via the A/D conversion unit 24 and the data selector unit 25, the memory image is transferred to the data selector unit 25. D/
A conversion section 29. The data is outputted and displayed on a display via the post-processing section 30. At the same time, an icon menu is output from the menu memory 31 and displayed on a part of the display screen superimposed on the image. Then, when the operator visually checks this and moves the pointer using the mouse 32 to select the image processing content, the processor section 26 performs the image processing based on the image data in the first memory 27 ( data processing) and writes the processed image data to the second memory 28,
Data selector section 25. D/A converter 29. The data is outputted and displayed on a display via the post-processing section 30.

Here, as the display area of the icon menu on the display screen, four display candidate areas Δ to D are set as shown in FIG. Also, the priority order is set in the order of A to D.

The processor unit 26 calculates the brightness difference within each area of A to D according to the main flowchart in FIG. 4 and the subflowchart in FIG. Switch to display the icon menu in that area. However, a mode for moving the display position is provided in the icon menu so that the display area can also be switched by the operator's selection.

The main flowchart in FIG. 4 will be explained.

In step 1 (denoted as Sl in the figure; the same applies hereinafter), a luminance difference d within area A is determined according to the sub-flowchart of FIG. 5, which will be described later, and in step 2, this is set as dA.

Similarly, in steps 3 to 8, areas B and C.

Find the brightness difference d within D, and calculate dB, dC, and dD, respectively.
shall be.

In step 9, as a tentative determination, the brightness difference dA within the area A is
Set it to the minimum value and store it in MIN, step 10,
Set area A as the display area and store it in LOC.

Then, in step 11, MIN (brightness difference dA of area A with priority level l) and brightness difference dB of area B with priority level 2
plus a predetermined brightness difference DEF (dB+DEF)
If MIN≦dB+DEF, then MIN,
If LOC is not changed but MIN>dB+DEF, step 12 sets the luminance difference dB in area B to the minimum value and stores it in MIN, and step 13 sets area B to the display area. Set and store in LOG.

In other words, the brightness difference in area A and the brightness difference in area B are compared, and the one with the smaller brightness difference is set as the display area, but if there is little or no difference between the two (DEF range), priority is given to the brightness difference in area B. Set the display area according to the ranking.

Similarly, in steps 14 to 16, processing is performed with area C, and in steps 17 to 19, processing is performed with area C.

As a result, among areas A-D, the brightness difference is the smallest, but
If there is not much difference in brightness, an area with a high priority is determined as the LOG as the display area.

Next, in step 20, the display area LOG (areas A to D) is determined, and accordingly, the process branches to steps 21 to 24, and the icon menu is displayed in the determined area.

Note that steps 1 to 8 correspond to intra-area luminance difference calculation means, steps 9 to 19 correspond to selection means, and steps 20 to 24 correspond to display area switching means.

Next, the sub-flowchart of FIG. 5 (method for calculating intra-area brightness difference) will be described as calculating the brightness difference within the Z area shown in FIG. 6.

Note that the brightness of 1 um at a point P (i, j) in the area can be obtained from the following equation, where the R, G, and B values of that point are r, g, and b, respectively.

lum = (r×g×b)/3 It is also assumed that the memory arrangement in which r, g, and b are stored at that time is as shown in FIG.

In steps 31 to 34, the starting X position of the Z area is set to SX,
, the starting Y position of the Z area is sy, the ending X position of the z area is EX, , the ending Y position of the Z area is EY.

shall be.

Then, in step 35, initialize the Y coordinate value j=sYo, in step 37, initialize the X coordinate value 1=sX, and then proceed to step 3.
9 to step 44 are executed.

In step 39, the coordinates (i, j) on the screen are converted into a numerical value (relative address) P counted from the left corner of the screen using the following equation.

P←i +X5IZE * j Step 40: Address ROF from the memory in Figure 7
Take the data of 10P and set it as r.

Similarly, in step 41, data at address GOF+P is fetched from the memory shown in FIG. 7 and is set as g.

Similarly, in step 42, data at address BOF+P is fetched from the memory shown in FIG. 7 and is set as b.

Step 43: Brightness 1um-(r 10g+b)/
Calculate 3.

In step 44, the frequency Di of the brightness distribution (see FIG. 8) is
s(lum) is counted up as shown in the following equation.

DIS(lum)=DIS(lum)+1 After this, steps 39 to 44 are repeatedly executed while shifting the X coordinate value i by a predetermined interval (shiftx) in step 45.

If the X coordinate value i exceeds EXo, the process proceeds from step 38 to step 46, where the Y coordinate value j is set at a predetermined interval (shi
fty) After shifting, in step 37 the X coordinate value 1=s
Reset to X0 and repeat steps 39 to 45.

If the Y coordinate value j or EY is exceeded, the process proceeds from step 36 to step 47 because sampling has ended.

In step 47, the number of sampling pixels in the X direction is calculated using the following formula:
Further, in step 48, the number of sample link pixels in the X direction is calculated using the following equation.

Y= (EYoSYo) /5hifty +
1 step 49 is the total number of sampling pixels.
Calculate =X*Y.

In step 50, set the lower limit of 33% as shown in the following formula,
Further, in step 51, an upper limit of 33% is set as shown in the following equation. This value maintains the stability of brightness difference calculation, and it is obvious that the present invention is not particularly limited to this value.

low = total / 3 high = Iow * 2 In step 52, clear the pixel counter plx,
Further, in step 53, the luminance is initialized to 1 um.

Next, the process proceeds to step 55 via step 54, where the frequency Dis(lum) is added to the pixel counter piX to accumulate the pixel counter plX, and in the next step 56, the luminance 1um is softened to the next value. , return to step 54,
While comparing the pixel counter pIX and the lower limit value low, p
Steps 55 and 56 are repeatedly executed within the range of IX≦IOW.

If pix>low is determined in step 54, the process proceeds to step 57, where the luminance l[Jm at that time is stored as the lower limit value d.

Next, the process proceeds to step 59 via step 58, where the frequency DIS(lum) is added to the pixel counter plx to accumulate the pixel counter pix, and in the next step 60, the luminance 1um is shifted to the next value. , return to step 58,
While comparing the pixel counter pIX and the upper limit value high,
Steps 59 and 60 are repeatedly executed within the range of plX≦high.

If it is determined in step 58 that pix >high, the process proceeds to step 60, and the brightness 1 um at that time is stored as the upper limit value d2.

Finally, in step 62, the upper limit value d2 and the lower limit value d
, the luminance difference d=d2-d is calculated.

2, from the brightness values obtained by calculation for each point in the area, the distribution characteristics as shown in Figure 8 (a) or (bl) are obtained, and in order to remove singular points (noise etc.) in the image, For example, discard the frequency of 33% on the lower limit side and 33% on the upper limit side, and
Brightness d1 at 3% and brightness d2 at 33% on the upper limit side
Let the difference d''d2 d+ between the two values be the representative brightness difference within the area.

For example, if the area is not uniform and there is another object, the brightness distribution becomes two peaks as shown in FIG. 8(b), and the brightness difference d becomes large.

Since there is a high possibility that such a part will be subject to image processing by the operator, by avoiding it in advance, the need for the operator to move the icons and menus will be reduced.

By providing a menu deletion mode in the icon menu, it is possible to output all images when outputting to a video printer, for example.

In addition, the icons are in a hierarchical format, and the processing groups and
When displaying an icon, when moving the processing specification pointer from the upper level to the lower level, set it to the most frequently used icon, and when moving from the bottom to the top, set it on the previously specified icon. This can reduce the amount of time it takes to move.

In addition, in the process group display of icons, by arranging icons that are related to the process content in the vicinity in chronological order, it is possible to reduce the effort required to move each process, and also to automatically move the icon pointer. , it is possible to avoid giving an unnatural visual movement.

<Effects of the Invention> As explained above, according to the present invention, the display area of image processing contents (icons and menus) is set in advance to a monotonous brightness distribution on the memory image. This eliminates the need to move icons and menus, but it has the effect of reducing the number of moves.

In addition, when calculating the brightness difference, sampling is performed at predetermined intervals to shorten the calculation time, and furthermore, by removing the lower limit data and upper limit data, the stability of the brightness difference calculation can be improved. It can be improved.

Furthermore, by having a priority order of display areas, stability of the display position can be ensured even when there is not much difference in brightness within the area.

[Brief explanation of drawings]

FIG. 1 is a functional block diagram showing the configuration of the present invention, FIG. 2 is a circuit configuration diagram of an image processing device showing an embodiment of the present invention, and FIG. 3 is a display candidate area for icons and menus on the image display screen. Figure 4 is a main flowchart, Figure 5 is a sub-flowchart, Figure 6 is a diagram showing an RGB screen,
Fig. 7 shows the memory map, Fig. 8 (a), (b)
) is a diagram showing an example of luminance distribution, and FIGS. 9 and 10 are diagrams showing a conventional method of displaying an icon menu. 22... Preprocessing section 24... A/D conversion section 25... Data selector section 26... Processor section 27... First memory 28... Second memory
29...D/A conversion section 30...Post processing section 31...Menu memory 32...Mouse applicant Konica Stock Figure 4 Part 2 Figure 5 Part 2 Figure 7 Figure 8 (a)

Claims (4)

[Claims] (1) A memory for storing image data, an image data importing means for importing image data into the memory from the outside, and at least one image processing on a part of the display screen that displays an image based on the image data in the memory. An image processing device comprising: an image processing content display unit for displaying content; and an image processing unit for performing image processing on image data in a memory according to an image processing content selected from the displayed image processing content; A plurality of display candidate areas are set as display areas on a display screen for image processing contents, and an intra-area brightness difference calculating means for calculating a brightness difference within each of the display candidate areas; Processing content display in an image processing apparatus, characterized in that it is provided with a selection means for selecting a display candidate area with a small difference, and a display area switching means for switching to display the image processing content in the selected display candidate area. Device. (2) The image processing apparatus according to claim 1, wherein the intra-area brightness difference calculating means samples the brightness of pixels at predetermined intervals within the area and calculates the intra-area brightness difference. Processing content display device. (3) The intra-area brightness difference calculation means calculates the intra-area brightness difference based on the luminance distribution within the area excluding a predetermined amount of lower limit side data and upper limit side data. A processing content display device in an image processing apparatus according to claim 1. (4) A claim characterized in that the selection means has a priority order of display areas, and selects a display candidate area with a high priority when there is no intra-area luminance difference of more than a predetermined amount. 2. A processing content display device in the image processing device according to 1.