JPS6365791A - Picture information offering device - Google Patents

Abstract

PURPOSE:To decrease man-hour of original establishment and to obtain an excellent picture by using a simple display element symbol described on an original sheet so as to apply proper picture processing such as coloring to offered information described on the original sheet. CONSTITUTION:Desired offer information is described on the original sheet and a display element symbol to decide the display element such as the shape, color and position on the picture display device 8 of the offer information and to command picture processing is described. A CPU 1 receives an input data read from the original sheet inputted from an operation switch 3 via an interface 4 to control the picture input and picture display and extract and identify the display element symbol to the fetched input picture data and generates a display picture data by the execution of picture processing such as coloring and filling as to the input picture data by the command of the display element symbol.

Description

[Detailed Description of the Invention] [Industrial Field of Application] The present invention relates to an image information presentation device equipped with a digital image processing function, and in particular, to a method for modifying and changing an image to make it a good image. The present invention relates to an image information presentation device that presents this image using an image display device, a printing means, or both.

[Prior art]

2. Description of the Related Art In general, so-called "fussentation" is commonly used at conferences, lectures, etc., in which various types of image information such as diagrams, text, pictures, or photographs are presented to assist in explanation and communication.

Conventional image information presentation devices used in the above-mentioned means include, as those based on an optical method, an over 7 dobro projector (hereinafter referred to as ?&oHp) and a slide projector. In addition, as for electrical methods,
There are devices that combine a video camera and a video monitor. Furthermore, as for a device with a complicated and high-class configuration, an image memory and a CPU are attached to a device that combines the above-mentioned video camera and video monitor, and an input image is once loaded into the image memory, and digital processing is performed on this image data. A device that displays the image on a video monitor after performing image processing is also being considered. This device uses digital image processing to modify or modify the input image to make it look better and display it, as well as to draw the audience's attention.
It performs processing such as changing or moving a part of the displayed image. Data input for such processing is performed using an input device such as a keyboard, tablet, or digitizer connected to the CPU or the like.

However, in the above-mentioned conventional structure, in the case of devices that do not have functions such as modifying input images, such as OHPs, slide projectors, or video cameras and video monitors, the appearance of the input image when displayed is determined in advance on the manuscript of the input image. Considering the quality of
It is necessary to add coloring or decoration, and it takes a lot of time and effort to create the manuscript. In addition, in the case of a device that combines a video camera and a video monitor with an image memory and a CPU, it is difficult to operate the device manually.
It is very complicated to explain the presented materials and perform manual operations at the same time.

Therefore, it usually has the disadvantage that an operator of the input device is required in addition to the explainer.

In addition, as an application of rubber stamp marks or handwritten marks to data saws for automatic manuscript editing or drawing editing, ``Data Input Method from a Facsimile Using Rubber Stamp Mark Identification'' (Transactions of the Institute of Electronics and Communication Engineers, 1981) Year 1
Monthly vol.1. J64 D 1), “Design and Identification of Handwritten Marks for Editing Drawings Using Facsimile” (Transactions of the Institute of Electronics and Communication Engineers, March 1981 v o 1. J 6
4-DNo., 3), “Automatic manuscript editing using handwritten mark identification” (9th Image Engineering Conference Proceedings, 1
(December 1978, pp. 63-66), etc. were proposed earlier.

However, these techniques are used for editing drawings, manuscripts, etc., and are not applicable to image information presentation devices for presentations. Further, only black and white binary input images are considered, and color input images are not considered. Furthermore, the above-mentioned drawbacks, such as the need for image input using a facsimile machine with high resolution, cannot be solved.

[Purpose of the invention]

The present invention has been made in consideration of the above-mentioned conventional problems, and aims to simplify the work of creating a presentation information manuscript by making it possible to present good-looking information using a simple manuscript. Another object of the present invention is to provide an image information presentation device that can improve operability by eliminating the need for sequential input operations for processing images to be presented.

[Structure of the invention]

In order to achieve the above object, the image information presentation device of the present invention not only records presentation information but also displays information for determining display elements such as the shape, color, and position of the presentation information on the image presentation means. A manuscript sheet on which element symbols are written,
an image input device that captures the presentation information and display element symbols of the manuscript sheet as an input image; an input image memory that records the values of each pixel constituting the input image captured by the image input device as input image data; an image processing means for extracting and identifying the input image data of the display element symbol in the input image memory, and performing image processing on the input image data of the presentation information according to the instructions of the display element symbol; The present invention includes a display image memory for recording processed display image data and an image presentation means for presenting the display image data of the display image memory, thereby simplifying the work of creating a presentation information manuscript and improving operability. It is characterized by being configured so that it can be used. The above image presentation means is, for example, an image display device or a printing means. Further, the above-mentioned manuscript sheet has, for example, an opaque band-shaped symbol area in which display element symbols are written at one end, and a transparent display image area in which display information is written in areas other than the symbol area. have.

[Embodiment 1] A first embodiment of the present invention will be described below based on FIGS. 1 to 9.

As shown in FIGS. 1 and 2, the image information presentation device according to the present invention includes a central processing unit (hereinafter referred to as C
(referred to as PU) 1, a memory 2 that stores program data for processing performed by the CPU 1 and functions as a data area, an operation switch 3 that operates the start and end of image reading, etc., and an interface connected to this operation switch 3. 4. An input image memory 5 for recording the input image obtained from the image input device 6; an image input device 6 which is an image input means for importing the presentation information and display element symbols of the manuscript sheet 10 as an input image; A display image memory 7 that records display image data of presentation information created by the CPU 1 from input image data recorded in the image memory 5, and an image presentation that displays the display image data recorded in the display image memory 7. An image display device 8 as a means, and a manuscript sheet 1 on which presentation information and display element symbols are written.
Consists of 0. The memory 2, interface 4, input image memory 5, and display image memory 7 are connected to the CPUI via a bus 9.

Further, the above-mentioned apparatus is provided with a photographing stand (not shown) for inputting images.

The CPUI receives input data input from the operation switch 3 via the interface 4, controls image input and image display, extracts and identifies display element symbols from the input image data that has been taken in, and extracts and identifies display element symbols from the input image data. It creates display image data by performing image processing such as coloring and filling on input image data according to instructions. The input image memory 5 samples and quantizes a color image and captures it, and captures an image of an input document at approximately 512×512 pixels, 8 bits/pixel for each of RGB. The capture time for one image is 1×30 seconds.

Further, the contents of this input image memory 5 can be freely read and written by the CPU 1. The image input device 6 consists of a color video camera or the like. Image display device 8
The display screen is composed of a color CRT monitor or the like, and if the display screen is to be shown to a large number of people, it is recommended to provide a plurality of color CRT monitors or use a large screen projector with a screen size of 100 inches. The display image memory 7 is a memory that records the values of each pixel forming the display image. This display image memory 7 has a look-up table function (color palette function) and a video signal creation function when displaying an image. The configuration of the display image memory 7 is as follows:
There are 640 x 400 pixels x 3 frames, and one pixel in each frame is 8 bits. Pixel data read out from each frame for displaying an image is converted by a look-up table, and then passes through a D/A converter, a low-pass filter, etc., and becomes a video signal. One lookup table is provided for each frame. The three frames are RGB three monochrome image memories, and a color image is displayed in these three frames. The contents of these three frames and the lookup table can be freely read and written by the CPUI.

On the other hand, the document sheet 10 is used to record desired presentation information, determine display elements such as shape, color, and position on the image display device 8 of this presentation information, and instruct image processing. Display element symbol is written. The above-mentioned presentation information and display element symbols serve as input images in this device, and for example, as shown in FIG. 2, a symbol area 11 in which only display element symbols are written is provided in a strip shape at the right end of the manuscript sheet hlo. Then, the remaining left portion becomes the display image area 12. The photographing stand also includes an input image memory 5.
A boundary line corresponding to the boundary position between the symbol area 11 and the display image area 12 in is drawn. Then, the document sheet 10 is placed on the photographing table so that the border between the symbol area 11 and the display image area 12 substantially coincides with the boundary line of the photographing table, thereby making the relative position between the photographing table and the camera. The position, etc. is determined appropriately in advance, and the image memo I for input is always available.
The symbol area 11 and the display image area 12 can be taken into a predetermined position of J5.

Examples of display element symbols written in the symbol area 11 of the document sheet 10 are shown in FIGS. 3(a) to 3(d). The symbol A shown in FIG. 3A indicates that a character string or the like written in the display image area 12 on the left side of the symbol A is surrounded by a rectangle filled with a specified color. A vertical bar 13 to the symbol indicates the vertical position of this rectangle, and the upper and lower ends of the rectangle coincide with the upper and lower ends of this vertical bar 13. The circle 14 is used to specify the color within the rectangle, and the background other than the characters within the rectangle is filled with the same or similar color as the circle 14. The circle 14 is written at the center of the vertical bar 13 in the vertical direction and slightly to the right. Further, the left end and right end of the rectangle are such that the present apparatus automatically finds the left end and right end of the character string, etc. in the display image area 12 on the left side of the symbol A, and the coordinates thereof are determined.

The symbol B shown in FIG.
The same IN in the display image area 12
This command instructs that the background portion in the area represented by the symbol shown in (d) be filled in and specifies its color.

The color of the rectangle 16 of the symbol B and the color of the curved frame 18 of the symbol must be the same. The symbol is a symbol that designates a closed area, and is written in the display image area 12. The shape of the designated closed region may be more complicated than that shown in FIG. 2(d). Also, the symbol RI is a symbol used in pair with the symbol B, and the symbol RI alone has no meaning. That is, only when the symbol B is written in the symbol area 11, a symbol with the same color as the symbol B is displayed in the image area 12.
Search processing is performed from . Furthermore, there may be a plurality of symbols for one symbol B.

The symbol C shown in FIG. 3C is a circle 17 written alone and specifies the color of the background, which is the area not colored by the symbols A-B-D.

The symbol C shall be written at the bottom of the symbol area 11. As above, following the symbols A-D shown in Fig. 3, the manuscript sheet 1 is
If the original of the input image is created in 0, it will look like the one shown in FIGS. 4 and 5, for example.

By the way, as the document sheet 10 used in this apparatus, the one shown in FIG. 6 or 7 is suitable. The manuscript sheet 10 shown in FIG. 6 is made by coating a transparent film 19 on which writing can be done with a felt-tip pen or the like with a white opaque paint with good adhesion on the part corresponding to the symbol area 11 from the back side.
A band-shaped opaque portion 20 is formed. Therefore, the transparent portion 21 serves as the display image area 12. This manuscript sheet 10 can be used as a manuscript for both the image information presentation apparatus and the OHP. That is, when using this device as a document, the back side of the transparent part 21, which is the transparent display image area 12, is covered with white paper or the like to make the background white, so that the information written in the display image area 12 is made white. information can be entered as an image. Meanwhile, the original sheet 10 is
When used as a HP document, only the image in the display image area 12 is projected onto the OHP screen by using the display image area 12 as it is transparent.

At this time, the image of the symbol area 11, which is the band-shaped unfavorable bright area 20, becomes a shadow and is not displayed on the screen at all. Alternatively, shift the band-shaped opaque portion 20 and open the original sheet 10.
By arranging it at a predetermined position on P, it is also possible to prevent the shadow of the symbol area 11 from appearing on the screen.

Further, the manuscript sheet 10 shown in FIG. 7 is provided so that a completely transparent film 22 having the same dimensions can be superimposed on the manuscript sheet 10 shown in FIG. 6, that is, the transparent film 19. It is something. The transparent film 22 is placed so as not to be misaligned with respect to the transparent film 19.
It is closed with the transparent film 19 at the right end. The above-mentioned symbols are mainly written on the transparent film 22. This document sheet 10 can also be used as a document for this apparatus and OHP. When used for OHP, the transparent film 22 is turned over so that only the input image in the display image area 12 of the transparent film 19 is displayed on the screen. At this time, the element symbols in the symbol area 11 and the display element symbols in the display image area 12 are not projected onto the screen at all.

In the above configuration, the operations of the present apparatus are performed in the following order: (1) inputting an image of a document, (2) extracting and identifying display element symbols, (3) creating a display image, and (4) displaying the image.

(1) When inputting an image of a manuscript, first place the manuscript sheet 10 on the contrast table! ! place At this time, the boundary line marked on the photographing table is made to substantially coincide with the boundary between the symbol area 11 and the display image area 12 of the document 10. Manuscript sheet 1
When the 0 cent is completed, the operation switch 3 is operated. When the operation switch 3 is operated, the device becomes operational,
An image of the original sheet 10 is input by the image input device 6, and the input image data is recorded in the input image memory 5.

(2) Next, symbols are extracted and identified from the symbol area 11 in the captured input image by the following operation by the CPU. At this time, since the placement position of the original sheet 10 on the imaging table and the relative positional relationship with the image input device 6 are fixed, the symbol area 1 of the input image
The position 1 is always given in advance to the main body of the apparatus as a constant position. In the CPUI, a histogram of pixel values in the symbol area 11 is first created for the input image, and background pixel values are determined. Since the background occupies the largest area in the image, it becomes a peak with a large area and a high frequency in the histogram. The value of the background pixel is determined from the position of this mountain. Next, pixels other than the background are found in the symbol area 11, and labeling processing is performed on these pixels.

Next, each labeled area is examined, and the vertical bar 13 of symbol A and the rectangular frame 15 of symbol B are extracted. these are,
Since both are black and have distinct shapes, they can be easily found. In the case of the symbol A, if a vertical bar 13 is found, a circle 14 filled with the specified color is found near the vertical bar 13. The RGB values for displaying the specified color are the average of the values of the pixels at several locations in the above-mentioned 14 (this is also a three-value set of RGB). In the case of symbol B,
If the rectangular frame 15 is found, the square 16 in the rectangular frame 15
The RGB values of the specified color are determined by the average value of the plurality of pixels in . Then, when symbol B is found, the symbol B is searched for. At this time, a range of pixel values is determined by including some margin in the values of the pixels of the rectangle 16 in symbol B, and pixels included in the range of pixel values are determined from the display image area 12. By examining these pixels under the condition of 4-connection and examining the presence or absence of a 4-connection area and a hole in that area, the symbol 18, which is the curved frame 18, is determined. Even if it is a 4-connected region, it will not become a symbol unless a hole in the region is found. If the symbol is not found, the range of pixel values to be investigated is slightly widened and the search is performed again. Further, the symbol C is written at the bottom of the symbol area 11, and is searched for here. Although the symbol C lacks clear features in shape and color like the vertical bar 13 of the symbol A or the rectangular frame 15 of the symbol B, it is easy to find because its position is limited as described above.

As a result of the above extraction and identification processing of each display element symbol, the following data is obtained, and these are recorded in the memory 2 and the input image memory 5.

(B) For symbol A, the vertical coordinates of the upper end of the vertical bar 13 The vertical coordinates for the lower end of the vertical bar 13 Color (three values of RGB) (B) For symbol B, the color (three values of RGB) ) In the case of symbol C, the color (three values of RGB) (d) In the case of symbol C, the coordinates of all pixels constituting the symbol (3) Next, each data stored in the memory 2 and the input image memory 5 is For each image, predetermined image processing is performed, and display image data is created in the display image memory 7. At this time, first, the contents of the three lookup tables are initialized. That is, the value a is written to address a, and the lookup table is set so that the value in the display image memory 7 becomes the pixel value without being changed by the lookup table. Next, write a value i, which will be described later, into all three frames of the display image memory 7, and change the contents of address i in the lookup table to a value that will display the background color of the display image area in the input image. . Therefore, the pixel to which the value i is written is
It will be displayed in the background color.

Next, processing for symbol C is performed. A value j, which will be described later, is written into all pixels of all three frames in the display image memory 7. Then, the value of the specified color of the symbol C is written into address j of the lookup table of each frame. As a result, the pixel to which the value j is written is displayed in the color specified by the symbol C. However, if there is no symbol C, this process is not performed.

Next, processing for symbol A is performed. First, the display image area 12 of the input image on the left side of the vertical bar 13 to the symbol is examined to determine the position of characters, etc., and the coordinates of the rectangle surrounding it are determined.

Since the upper and lower ends of the vertical bar 13 of the symbol A are already known when determining the symbol A, the coordinates of these upper and lower ends are used as the coordinates of the upper and lower ends of the display image area 12 of the input image.
All you have to do is examine the area cut horizontally into strips.

From this area, pixels other than the background are found based on the difference in pixel values. It is assumed that the values of the background pixels have already been determined. This value can be found by creating a histogram of pixel values and setting the most frequent values as background pixel values, as described above, or by using the upper and lower edges of images, etc. A possible method is to find out the value of a background pixel based on the value of a pixel in a part that is not written, or a part that is designated as not to be written.

Next, for the determined non-background pixels, an area of 8 connected pixels is determined. Areas whose size is less than a certain value are judged to be noise and are removed.
Only those that exceed a certain value are considered to be parts such as characters. In this way, the coordinates of both the left and right ends of the rectangle are determined so that all of the determined portions, such as characters, are included in the rectangle. The coordinates of the left end of the rectangle are the coordinates of a position shifted to the left by a certain constant value from the position of the leftmost pixel in the leftmost 8-connected region.

Conversely, the rightmost coordinates are the coordinates of a position shifted to a certain constant value distribution from the rightmost pixel position in the rightmost 8-connected region. The leftmost and rightmost coordinates and the vertical bar 13 of symbol A
The rectangular area defined by the coordinates of the upper and lower ends of is the range filled with symbol A. In this way,
Once the rectangular area to be filled in is determined, processing is performed to fill in the rectangular area at the corresponding coordinates in the display image memory 7. That is, a value k, which will be described later, is written into pixels in rectangular areas of three frames in the display image memory 7. Then, a value is written into the address of the lookup table of each frame so that the designated color of symbol A is displayed. As a result, the rectangular area in which the value has been written is displayed in the color specified by symbol A on the display screen.

If there is another symbol A, the same processing is performed. However, k
The values of are all different. When the processing for all symbols A is completed, the processing for symbols BD is performed next.

In the processing for the symbol B-D, first, the curved frame 1 of the symbol
8 to the display image memory 7.

However, the value written to the pixel of the display image memory 7 is the value l that has not yet been written to the display image memory 7 in the processing up to now. After copying the curved frame 18, a process is performed in which the inside of the curved frame 18 (pixel value Il) is set as a boundary and filled with the value l. After performing these steps for all three frames of the display image memory 7, the ! of each of the three lookup tables! Write the value so that the color specified by symbol B is displayed at the address. As a result, the area indicated by the symbol B will be displayed in the color specified by the symbol B. In addition, symbol B-
If there is D, process it in the same way. At this time, the corresponding symbol and symbol B can be easily distinguished because they have the same color. Furthermore, a plurality of symbols may correspond to one symbol B.

By performing the processing on the symbols A-B-C-D as described above, the display image memory 7 stores an image in which the area designated by each display element symbol is filled with the designated color. Created.

Thereafter, a portion of the display image area of the input image in the input image memory 5 is copied to the image in the display image memory 7. This copying operation is performed by writing the remaining pixels, excluding those forming the background and symbols, from the pixels forming the image in the display image area of the input image to the pixels in the corresponding part of the display image memory 7. be exposed. Background pixels can be determined from the pixel values, and the pixels forming the symbol have already been determined. That is, the above copy is created by processing the display element symbol, and the display image area 12 of the input image is added to the image consisting of the colored area.
It refers to copying characters and figures other than the symbols that were used in ancient times. In this case, if the value to be written to the display image memory 7 is already the same as the value i-l written to the display image memory 7 by the processing for the display element symbol, then the value Instead, it attempts to write relatively similar values before and after that value. This operation results in a display with a different color and brightness from the input image because the pixel values used in the processing for the display element symbol have already changed the contents of the look amplifier table read by the pixel values. It is for.

By the way, i, 'j, and l are codes that specify the color of each area of the image, and each image is displayed according to the contents of the lookup table at the address specified by this code. Displayed in color. Since all areas in which the same code is written are displayed in the same color, it is naturally necessary to write different codes in areas to be displayed in different colors. Therefore, for i, j,
l is all different values. However, areas with symbols shown in the same color may have the same value. Above i, j.

The values of k and l may be brightness and color values that are not used in the display image, such as the background color of the input image, or may be from 0 to
From the values up to 255, for example, 0.10.20.3
You may also choose and use values at intervals of 10, such as 0... In the latter case, i, j,
When the luminance of a value selected as the value of l and already used is required, an approximate luminance close to that value is substituted.

(4) By creating the display image in the display image memory 7 as described above, the image display device 8 has the eighth
The images shown in FIG. 9 and FIG. 9 can be displayed.

[Example 2] A second example of the present invention will be described below based on FIG. 10. It should be noted that those having the same functions as those in the first embodiment will be noted with the same function, and the explanation thereof will be omitted.

In this image information presentation device, as shown in FIG. 10, the image display device 8
It is also possible to print out the displayed image. The printer 23 is a thermal transfer printer capable of color printing with 64 gradations of YMC (yellow, magenta, cyan) each. In the above configuration, the content of the display image memory 7 is read out by the CPUI and converted into data for the printer 23, and this data is sent to the printer 23 via the interface 24.
3, the printer 23 can be operated to print the same image as the displayed image.

〔Effect of the invention〕

As described above, in the image information presentation device of the present invention, presentation information is written, and display element symbols for determining display elements such as shape, color, and position on the image presentation means of this presentation information are written. an image input means for importing the presentation information and display element symbols of the original sheet as an input image; and recording the values of each pixel constituting the input image taken by the image input means as input image data. an image processing means for extracting and identifying the input image data of the display element symbol in the input image memory and performing image processing on the input image data of the presentation information according to instructions of the display element symbol; , the configuration includes a display image memory for recording display image data image-processed by this image processing means, and an image presentation means for presenting the display image data of this display image memory, so that it can be used in many ways as shown below. This effect can be achieved.

(1) Appropriate image processing such as coloring can be applied to the presentation information written on the manuscript sheet using the simple display element symbols written on the manuscript sheet.The effort required to create the manuscript can be reduced. , the image presented to the image presentation means is
You can get something that looks good.

(2) Presentation information and a display element symbol that instructs image processing of this presentation information can be input at the same time, and
Since the image processing of the presentation information is performed based on the display element symbols, there is no need to sequentially perform operation input for image processing, and the operation is very simple.

(3) Since the display element symbol can be a simple one, extraction and fixing of the display element symbol can be performed easily and quickly, and the display element symbol can be written by hand on the manuscript sheet, making it easier to write the symbol. No special equipment is required.

[Brief explanation of the drawing]

1 to 9 show an embodiment of the present invention, in which FIG. 1 is a block diagram showing the configuration of an image information presentation device, FIG. 2 is an explanatory diagram of a document sheet, and FIG. (a)～(
d) is an explanatory diagram showing each display element symbol; FIGS. 4 and 5 are explanatory diagrams each showing an example of a manuscript written on a manuscript sheet; FIG. 6 is an explanatory diagram showing an example of a manuscript sheet; FIG. 8 is an explanatory diagram showing another example of a manuscript sheet, FIGS. 8 and 9 are explanatory diagrams showing display images in an image display device, and FIG. 10 is an image information presentation device showing another embodiment of the present invention. FIG. 1 is a CPU (image processing means), 2 is a memory, 3 is an operation switch, 4 and 24 are interfaces, 5 is an input image memory, 6 is an image input device (image input means), 7 is a display image memory, 8 is an image display device (image presentation means),
10 is a document sheet, 11 is a symbol area, 12 is a display image area, 13 is a vertical bar (display element symbol), 14 and 17 are circles (
Display element symbol), 15 is a rectangular frame (display element symbol), 16
is a square (display element symbol), 18 is a curved frame (display element symbol), 19 and 22 are transparent films, 20 is a band-shaped opaque part,
21 is a transparent portion, and 23 is a printer (printing means of image presentation means). Figure 4 (Bun 11 Tobi @ 5 Seikosato $ + 11. Eup) Figure 6

Claims (1)

[Claims] 1. A manuscript sheet on which presentation information is written and display element symbols for determining display elements such as shape, color, and position on the image presentation means of this presentation information; and an image input means for capturing presentation information and display element symbols as an input image; an input image memory for recording the values of each pixel constituting the input image captured by the image input means as input image data; an image processing means for extracting and identifying input image data of a display element symbol, and performing image processing on the input image data of presentation information according to instructions of the display element symbol; and display image data subjected to image processing by the image processing means. What is claimed is: 1. An image information presentation device comprising: a display image memory for recording a display image; and an image presentation means for presenting display image data of the display image memory.