JP5991406B2 - Image processing system, image processing method, and image processing apparatus - Google Patents

Description

  The present invention relates to an image processing system, an image processing method, and an image processing apparatus.

  In e-mails and the like, there are many examples in which pictographic images are inserted into created sentences. A pictographic image is a graphic representation of faces, animals, symbols, items, and the like of various expressions, with font sizes commonly used in documents, and is displayed together with text by a corresponding application. As an example, in an e-mail function installed in a mobile phone terminal, for example, a pictographic image having a size of about 20 dots long × 20 dots wide is used. Pictogram images are widely used because they are considered to expand the range of document expression when used in documents.

  Patent Document 1 describes a mail tool that can write an image input by handwriting using a tablet capable of pen input into an email document being created by email creation software. According to this patent document 1, the user can paste an image created by handwriting into an e-mail document and transmit it.

The present invention has been made in view of the above, and an object of the present invention is to make it easier to create a pictographic image based on a handwritten image .

In order to solve the above-described problems and achieve the object, the first invention is configured by one or more information processing apparatuses, and displays a drawing area drawn by a user and a picture drawn in the drawing area. reading the paper including the operation settings Teiryo area to specify the pattern of the operation to be given to the pattern of the image, and an image processing system for moving the picture image on the display screen, and acquires the read image data to paper Reading means; extraction means for extracting image data of a drawn pattern from the drawing area of the image data; generation means for generating a display image to be displayed on the display screen based on the image data extracted by the extraction means; A pattern using any one of a movement operation, a rotation operation, an enlargement operation, a reduction operation, and an operation based on a combination of a plurality of operations among a movement operation, a rotation operation, an enlargement operation, and a reduction operation. The image processing corresponding to each of the patterns of a plurality of operations of, performed on the extracted image data, image processing means for giving an operation to display an image, detects the operation setting Teiryo region from the image data, Detection means for specifying an operation pattern specified by an operation setting area among a plurality of operation patterns, and image processing according to the operation pattern specified by the detection means for the extracted image data And an operation setting means for operating a display image to which an operation based on the operation pattern is given on the display screen.

The second invention includes a drawing area for the user to draw, and operation setting Teiryo area to specify the pattern of the operation that gives the picture of the picture when displaying the picture drawn in the drawing area, the paper containing the An image processing method for reading and moving an image of a pattern on a display screen, reading a sheet to acquire image data, and extraction for extracting image data of the drawn pattern from a drawing area of the image data A generation step for generating a display image to be displayed on the display screen based on the image data extracted in the step, the extraction step, a movement operation, a rotation operation, an enlargement operation, a reduction operation, and a movement operation, a rotation operation, and an enlargement operation And image processing corresponding to each of a plurality of operation patterns patterned using any one of the operations of a combination of a plurality of operations among reduction operations Performed on the extracted image data, an image processing step of giving an operation to display an image, detects the operation setting Teiryo region from the image data, the pattern of operation specified by the operation setting area of the pattern of a plurality of operation The image processing step performs image processing according to the operation pattern specified in the detection step on the extracted image data, and displays a display image to which an operation based on the operation pattern is given. And an operation setting step for operating on the screen.

A third aspect of the present invention is a drawing area for the user to draw, and operation setting Teiryo area to specify the pattern of the operation that gives the picture of the picture when displaying the picture drawn in the drawing area, the paper containing the An image processing apparatus that reads and moves an image of a pattern on a display screen, an acquisition unit that acquires image data read from a sheet by a reading unit, and an image of the drawn pattern from a drawing area of the image data Extraction means for extracting data; generation means for generating a display image to be displayed on the display screen based on the image data extracted by the extraction means; movement operation, rotation operation, enlargement operation, reduction operation, and movement operation; Image processing corresponding to each of a plurality of operation patterns patterned using any one of a rotation operation, an enlargement operation, and a reduction operation in combination of a plurality of operations. The performed on the extracted image data, image processing means for giving an operation to display an image, detects the operation setting Teiryo region from the image data is designated by the operation setting area of the pattern of a plurality of operation Operation And a display image to which an operation based on the operation pattern is given to the extracted image data by performing image processing on the extracted image data according to the operation pattern specified by the detection unit. having a operation setting means causes operation on the display screen a.

According to the present invention, an effect that pictographic image that Do more easily create based on the handwritten image.

FIG. 1 is a schematic diagram showing an example of a usage pattern of each embodiment of the present invention. FIG. 2 is a functional block diagram showing functions of an example of the image processing apparatus according to the first embodiment of the present invention. FIG. 3 is a flowchart of an example showing a pictographic image generation method according to the first embodiment of the present invention. FIG. 4 is a schematic diagram for explaining an example of a sheet for drawing a pattern. FIG. 5 is a schematic diagram for explaining the shaping process in the shaping processing unit. FIG. 6 is a schematic diagram for explaining exaggeration processing in the case of a grayscale image. FIG. 7 is a schematic diagram for explaining exaggeration processing in the case of a grayscale image. FIG. 8 is an example flowchart for explaining the exaggeration processing in the case of a color image. FIG. 9 is a schematic diagram for explaining that the exaggeration process is repeatedly performed. FIG. 10 is a schematic diagram for explaining the trimming process performed in the trimming processing unit. FIG. 11 is a schematic diagram for explaining a reduction process performed by the reduction processing unit. FIG. 12 is a schematic diagram for explaining how to determine the number of exaggeration processes. FIG. 13 is a schematic diagram illustrating an example of a sheet according to a first modification of the first embodiment of the present invention. FIG. 14 is a schematic diagram illustrating an example of a sheet according to a second modification of the first embodiment of the present invention. FIG. 15 is a functional block diagram showing functions of an example of an image processing apparatus according to the second embodiment of the present invention. FIG. 16 is a flowchart of an example showing a pictographic image generation method according to the second embodiment of the present invention. FIG. 17 is a schematic diagram illustrating an example of setting information. FIG. 18 is a schematic diagram for explaining rotation of an image. FIG. 19 is a schematic diagram for explaining a moving image relating to enlargement / reduction. FIG. 20 is a schematic diagram for specifically explaining an example of the movement process. FIG. 21 is a schematic diagram showing a summary of pictogram image generation processing using moving images according to the second embodiment of the present invention. FIG. 22 is a schematic diagram illustrating an example of a setting input area for setting the movement of a pictographic image by a moving image. FIG. 23 is a schematic diagram for explaining a difference in reduced images due to a difference in the procedure of rotation processing. FIG. 24 is a schematic diagram for explaining that the strength of the exaggeration process is adjusted according to the rotation angle. FIG. 25 is a block diagram illustrating a configuration example of a PC that can be commonly applied to the image processing apparatuses according to the first and second embodiments of the present invention. FIG. 26 is a schematic diagram illustrating an example of a configuration of a pictographic image creation system using a non-contact proximity wireless communication system according to the third embodiment of the present invention. FIG. 27 is a schematic diagram illustrating an example of creating a pictographic image according to the prior art.

  Embodiments of an image processing apparatus according to the present invention will be described below in detail with reference to the accompanying drawings. In the embodiment of the present invention, based on an original image drawn using continuous straight lines and curves, for example, a pictographic image having a size of 20 dots vertically × 20 dots horizontally is generated. At this time, an exaggeration process for exaggerating the drawing portion is performed on the original image, and then the original image is reduced to 20 dots vertically by 20 dots horizontally to generate a desired pictographic image. Since the reduction process to the size of the pictographic image is performed after exaggerating the drawing portion of the original image, it is possible to prevent a necessary line from being lost in the original image and to obtain an easy-to-see pictographic image.

  FIG. 1 shows an example of a usage pattern of each embodiment of the present invention. A personal computer (PC) 10, an MFP (Multi Function Printer) 20, and a tablet terminal 21 are examples of apparatuses that create an original image that is the basis of a pictographic image and generate a pictographic image from the created original image. Note that the MFP 20 implements a plurality of functions such as a printer function, a scanner function, a copy function, a FAX function, and a communication function in a single casing. On the other hand, the mobile phone terminal 40 and the PC 41 are examples of apparatuses that perform document creation using pictographic images generated by the PC 10, the MFP 20, the tablet terminal 21, and the like.

  For example, pictographic images generated by the PC 10, MFP 20, tablet terminal 21, and the like are transmitted to the mobile phone terminal 40 and the PC 41 via the network 30 such as the Internet. The mobile phone terminal 40 and the PC 41 receive and store pictographic images transmitted via the network 30 and use them when creating a document. For example, the mobile phone terminal 40 or the PC 41 inserts a stored pictographic image into an e-mail document and transmits the e-mail.

  A method for generating a pictographic image will be schematically described. For example, the user prepares a document 1 in which a pattern 2 to be converted into a pictographic image is drawn on paper or the like using a marker pen or the like, and causes the scanner device 11 connected to the PC 10 to read the document 1. In addition, the content of the pattern 2 for making a pictographic image is not specifically limited. For example, a picture, a design, a character, a symbol, or the like can be used as the design 2.

  The PC 10 is equipped with an image processing program for generating pictographic images according to an embodiment of the present invention, and an original image obtained by reading the original 1 with the scanner device 11 is input to the PC 10. Using the image processing program, the PC 10 extracts a predetermined area including a drawing portion of the pattern 2 from the input original image as an original image that is a source of the pictographic image, and performs an exaggeration process on the original image to perform the original drawing. An image exaggerating the part is generated, and the image is reduced to the size of the pictographic image to generate a pictographic image.

  The pattern 2 that is the basis of the pictographic image is not limited to being drawn on paper or the like. For example, the pattern 2 may be drawn using a pointing device such as the pen tablet 12 connected to the PC 10 to directly create the original image as electronic data. For example, the user activates drawing software on the PC 10 and draws the pattern 2 using the pen tablet 12. The drawing software generates an original image including a drawing portion by the pattern 2 in accordance with the drawing by the pen tablet 12. The PC 10 generates a pictographic image by an image processing program based on the original image. Similarly, a pictographic image can also be generated using a tablet terminal 21 in which a display device and a tablet are integrally formed and have a function equivalent to that of a computer.

  The pictographic image can also be generated using the MFP 20. The MFP 20 is preinstalled with an image processing program for generating a pictographic image according to the embodiment of the present invention. For example, the user causes the MFP 20 to read the document 1 on which the pattern 2 to be converted into a pictographic image is drawn using the scanner function. In accordance with the image processing program, the MFP 20 performs extraction, exaggeration processing, and reduction processing of the original image on the document image obtained by scanning the document 1 with the scanner function to generate a pictographic image.

  Further, the pictogram image processing may be performed at a place different from the place where the original image to be pictographed is input. In the example of FIG. 1, for example, an image processing program according to an embodiment of the present invention is installed in a server 42 connected to the network 30. When the image data including the drawing portion of the pattern 2 is input, the PC 10, MFP 20, and tablet terminal 21 transmit the input image data to the server 42 via the network 30 as it is or after compression encoding. To do.

  The server 42 receives the image data transmitted via the network 30 and extracts a predetermined area including a drawing portion by the pattern 2 in the received image data as original image data. The exaggeration process and the reduction process are performed to obtain pictographic image data of, for example, a pictographic image of vertical 20 dots × horizontal 20 dots. This pictographic image data is transmitted to the mobile phone terminal 40 and the PC 41 via the network 30. A pictographic image based on the picture 2 drawn by the user can be obtained without installing an image processing program in the PC 10, MFP 20, tablet terminal 21, or the like.

(First embodiment)
Next, a first embodiment of the present invention will be described. In the first embodiment, a pictographic image as a still image is generated based on the pattern 2 drawn by the user. FIG. 2 is a functional block diagram showing functions of an example of the image processing apparatus 100 according to the first embodiment. The image processing apparatus 100 includes a shaping processing unit 110, a normalization / exaggeration processing unit 111, a trimming processing unit 112, and a reduction processing unit 113.

  When the input original image is not a square, the shaping processing unit 110 adds margins to the top and bottom or the left and right of the image to create a square image including the original image. The normalization / exaggeration processing unit 111 performs normalization processing to normalize the number of dots on the image shaped by the shaping processing unit 110, and then performs exaggeration processing so that the drawing portion by the pattern 2 is exaggerated. Create The exaggeration process is, for example, a process for increasing the width of a line constituting the drawing portion. Details of the exaggeration process will be described later.

  The trimming processing unit 112 cuts out a necessary part from the image created by the normalization / exaggeration processing unit 111. The necessary part is, for example, a minimum square part from which a blank part included in the image is removed. The trimming processing unit 112 performs an enlargement or reduction process on an image of a necessary part cut out from the image, and creates an image having a predetermined size. The reduction processing unit 113 performs a reduction process on the image created by the trimming processing unit 112 to generate, for example, a pictographic image of 20 dots vertically × 20 dots horizontally.

  FIG. 3 is a flowchart illustrating an example of a pictographic image generation method according to the first embodiment. Here, it is assumed that a pictographic image is generated using the PC 10 and the scanner device 11 shown in FIG. In this case, each unit constituting the image processing apparatus 100 is expanded on the main memory of the PC 10 as a module of an image processing program mounted on the PC 10.

  Prior to the execution of the flowchart of FIG. 3, the user prepares a document 1 in which a picture 2 to be converted into a pictographic image is drawn on paper using a marker pen or the like. Then, the original image obtained by causing the scanner device 11 to read the original 1 is input to the PC 10. The PC 10 extracts a predetermined area including a drawing portion of the pattern 2 from the document image data, and uses it as an original image.

  The paper on which the pattern 2 is drawn is not particularly limited. For example, as illustrated in FIG. 4, when a dedicated paper 5 on which a frame 4 indicating a drawing area 3 having a predetermined size is printed is used, The process of extracting the original image from the document image obtained by reading the document 1 with the scanner device 11 is easy and preferable. Note that the size of the original image depends on the resolution when the scanner 11 reads the document 1. As an example, if the resolution of the scanner 11 when reading the document 1 is 100 dpi (dot per inch), the size of the paper 5 is A4 size, and the size of the frame 4 is 5 inches long × 6 inches wide, the size of the original image Is 500 dots long × 600 dots wide.

  In addition, it is preferable that the drawing area 3 has a predetermined background color because the exaggeration processing by the normalization / exaggeration processing unit 111 and the trimming processing by the trimming processing unit 112 are facilitated. In general, when drawing using a marker pen or the like, the color of the drawn portion becomes dark (the luminance value decreases), so the background color is, for example, white or a light value whose luminance value is higher than a predetermined value. Color.

  In the flowchart of FIG. 3, in step S10, an original image is input to the image processing apparatus 100, and in the next step S11, setting information is read by a CPU (not shown) that controls the entire image processing apparatus 100. It is. The setting information includes a value indicating the number of exaggeration processes performed by the normalization / exaggeration processing unit 111. The number of exaggeration processes is selected from a range of 0 to 30 times, for example.

  The original image input to the image processing apparatus 100 is supplied to the shaping processing unit 110. In step S12, the shaping processing unit 110 performs shaping processing to add a blank to the supplied original image to form a square image in which the ratio of the number of vertical and horizontal dots is 1: 1.

  The shaping process in the shaping process part 110 is demonstrated using FIG. FIG. 5A shows an example of the original image. Thus, the original image may not be a square. The shaping processor 110 creates a square image by adding margins equal in width to the upper and lower sides or the left and right sides of the original image that is not square as illustrated in FIG. 5B. (FIG. 5C).

  In the next step S13, the normalization / exaggeration processing unit 111 performs a normalization process on the square image created in step S12, and then performs an exaggeration process to exaggerate the drawing portion included in the image.

  The normalization process will be schematically described. The normalization process is a process of converting the image resolution (vertical and horizontal dot numbers) to a predetermined value. As will be described later, the normalization / exaggeration processing unit 111 replaces the pixel value of the target pixel with the pixel values of the pixels around the target pixel in the image, thereby reducing the line width of the drawing portion included in the image. Apply exaggeration processing to thicken. Here, for example, when the document 1 is read by the scanner 11, the number of dots included in the line width of the same thickness line on the document 1 increases as the resolution at the time of reading increases. Therefore, the effect of the exaggeration process becomes more prominent as the resolution at the time of reading the document 1 is lower.

  Therefore, in step S13, before performing the exaggeration process, a resolution conversion process for converting the resolution of the image to a predetermined resolution is performed on the image to be exaggerated, and normalization is performed. The exaggeration process is performed on the image whose resolution is normalized as described above.

  The exaggeration process will be described in detail. The exaggeration process performed by the normalization / exaggeration processing unit 111 is a process of increasing the line width of a drawn line. By increasing the line width of the drawn line by the exaggeration process, the drawing part expands compared to before the exaggeration process. Thereby, the drawing portion is exaggerated.

  The exaggeration process is a process in which, when the background color is white to light color, the lowest pixel value is set as the pixel value of the target pixel among the pixel values of nine pixels by the target pixel and the eight pixels around the target pixel. For example, in the case of a binary image, if there is at least one black pixel (pixel value = 0) in nine pixels including the target pixel and eight pixels around the target pixel, the target pixel is set to black. In the case of a gray scale image, the lowest luminance value among the luminance values (pixel values) of nine pixels by the target pixel and the eight pixels around the target pixel is set as the luminance value of the target pixel.

  The exaggeration process in the case of a gray scale image will be described more specifically with reference to FIGS. 6 and 7, each of the vertical 5 square × horizontal 5 square represents a pixel (dot), and the pixel has a bit depth of 8 bits and a luminance of 256 gradations. The background color is white with a luminance value = 255.

  FIG. 6A shows an example of an image before the exaggeration process. In this example, it can be seen that a black line having a width of 1 to 2 pixels is drawn from the upper right to the lower left. Exaggeration processing is performed on this image as described above.

  FIG. 7 shows a specific example of the exaggeration process. In each drawing of FIG. 7, the target pixel is indicated by hatching the square. In FIG. 7A, the second pixel from the top and the left is the target pixel, and the luminance value of the target pixel is 190. As illustrated on the left side of FIG. 7A, “10” is the lowest luminance value among the luminance values of the pixel of interest and the eight pixels around the pixel of interest. Therefore, as illustrated on the right side of FIG. 7A, the target pixel has a luminance value = 10.

  Next, as illustrated on the left side of FIG. 7B, the same processing is performed with the pixel immediately adjacent to the previous pixel of interest as the new pixel of interest. In this case, “0” is the lowest luminance value among the luminance values of the target pixel and the surrounding eight pixels. Therefore, as illustrated on the right side of FIG. 7B, the target pixel has a luminance value = 0. Further, as illustrated on the left side of FIG. 7C, the same processing is performed with the pixel immediately adjacent to the previous pixel of interest as the new pixel of interest. In this case, “0” is the lowest luminance value among the luminance values of the target pixel and the surrounding eight pixels. Therefore, as illustrated on the right side of FIG. 7C, the target pixel has a luminance value = 0.

  In the example of FIGS. 7D and 7E, the exaggeration process is similarly performed. In the example of FIG. 7D, the luminance value of the target pixel is “10”, and in the example of FIG. 7E, the luminance value of the target pixel is “10”.

  FIG. 6B shows an example of a result obtained by performing the exaggeration process on all the pixels of the image exemplified in FIG. In this case, the exaggeration process is performed on the assumption that all the areas outside the vertical 5 pixels × horizontal 5 pixels area are background colors having a luminance value of “255”. As illustrated in FIG. 6B, the result of the exaggeration process appears as a black line with a width of 3 to 4 pixels from the upper right to the lower left of the image, and before the exaggeration process in FIG. 6A. It can be seen that the line width of the black line becomes thicker with respect to the state of FIG.

  In the case of a color image, the image is exaggerated for each color element of R (red), G (green), and B (blue), and finally the image of each element is synthesized. An example of exaggeration processing in the case of a color image will be described using the flowchart of FIG. First, in step S20, the target image is decomposed into images of elements of R, G, and B colors.

  In the next step S21, the images of the R, G, and B color elements are converted to gray scales. That is, the pixel value of the image of each R, G, B color element formed in step S20 is converted into a luminance value. Then, in the next step S22, an exaggeration process is performed on the gray scaled R, G, B color element images as described with reference to FIGS.

  In the case of a color image, for a certain color, for example, a line of color R, the pixel value of color R is the maximum value, and the pixel values of other colors G and B are “0”. On the other hand, when the background color is white, that is, when the pixel values of the R, G, and B colors are all the maximum values, the pixel values of the color R are all the maximum values except for the line portion of the color R. Therefore, the process of increasing the line width of any one of the R, G, and B color elements is synonymous with performing the above-described exaggeration process on each color element image other than the target color.

  In the next step S23, the image of the R, G, B color elements subjected to the exaggeration process in step S22 is colored with the original color. That is, the luminance values of the R, G, and B color element images that have been grayscaled and exaggerated are converted into pixel values of the R, G, and B colors. In the next step S24, the colored R, G, B color element images are synthesized. Thereby, an exaggeration process is performed on the color image.

  Note that when the exaggeration process is performed on a color image as described above, a color that is different from any of the colors on both sides of the boundary may occur in the color boundary part before the exaggeration process. That is, in the above-described exaggeration process, a smaller pixel value is prioritized in the color element images of R, G, and B colors. For this reason, a darker color than the colors on both sides of the original boundary, such as black, may occur in the boundary portion. However, in the first embodiment, as will be described later, since the reduction process is performed on the image after the exaggeration process, this point can be ignored.

  Further, this exaggeration process is repeatedly executed as many times as the number of exaggeration processes included in the setting information read in step S11. That is, as illustrated in FIG. 9, the first exaggeration process is performed on the original image 302 before the exaggeration process to obtain an exaggerated image 303a. A second exaggeration process is performed on the image 303a to obtain an image 303b in which the drawing line width is exaggerated wider than the image 303a. Images 303c, 303d, and 303e are examples of images obtained by performing the third, fourth, and fifth exaggeration processes on an image that has been similarly exaggerated immediately before. As the number of exaggeration processes increases, it can be seen that the line width of the drawing portion increases.

  Returning to the flowchart of FIG. 3, when the exaggeration process in step S <b> 13 is completed for the number of processes included in the setting information, the process proceeds to step S <b> 14. In step S14, the trimming processing unit 112 performs trimming processing on the exaggerated image obtained in step S13. Thereby, a drawing part is cut out from the image.

  The trimming process performed by the trimming processing unit 112 will be described with reference to FIG. FIG. 10A shows an example of the image 304 before the trimming process. The trimming processing unit 112 generates a mask image 305 for extracting a drawing portion in the image 304 (see FIG. 10B). The mask image 305 is generated by binarizing the pixel value of each pixel in the image 304 by determining the threshold value. The trimming processing unit 112 cuts out a minimum rectangle including the mask image 305 from the image 304. FIG. 10C shows an example of an image 306 obtained by cutting out a drawing portion from the image 304.

  Here, the trimming processing unit 112 has been described so as to obtain the trimmed image 306 by cutting out the minimum rectangle including the mask image 305 from the image 304, but this is not limited to this example. For example, a trimmed image 306 may be obtained by cutting out from the image 304 an area obtained by adding some margin area to the minimum rectangle including the mask image 305.

  Returning to the flowchart of FIG. 3, when the trimming process in step S14 is completed, the trimming processing unit 112 sets the aspect ratio of the trimmed image 306 to 1: 1 in the next step S15. In step S15, similarly to step S12 described above, margins having the same width are added to the trimmed image 306 on the upper and lower sides or the left and right sides, respectively, to create a square image.

  In the next step S16, the reduction processing unit 113 performs reduction processing on the image whose aspect ratio is 1: 1 in step S15, and generates a reduced image having a sufficiently small size with respect to the image before the reduction processing. The generated reduced image is output from the image processing apparatus 100 as a pictographic image. Note that the reduction processing by the reduction processing unit 113 can be performed using a general image interpolation method such as a bilinear method or a bicubic method.

  The reduction process will be described more specifically. As described above, the pictographic image is used by being inserted into an e-mail document or the like in the mobile phone terminal 40 or the PC 41, for example. Therefore, it is preferable to make the size of the pictographic image the same as the font size generally used in an e-mail document because the document becomes easy to read. As an example, in the mobile phone terminal 40, for example, when the standard font size used in an e-mail document is 20 dots long x 20 dots wide, the size of the pictographic image is also 20 dots long x 20 dots wide in accordance with the font size. It can be considered. The screen resolution of the mobile phone terminal 40 is considered to be generally about 320 dots × 240 dots to 960 dots × 480 dots, for example.

  This will be described with reference to FIG. FIG. 11A shows an example of an image 307 whose resolution has been normalized by the trimming processing unit 112. Here, it is assumed that the size of the image 307 is 400 dots long × 400 dots wide. The reduction processing unit 113 performs a reduction process on the image 307 and has a sufficiently small size with respect to the image 307 as illustrated in FIG. The reduced image 308 is generated.

  As described above, as the size of the reduced image 308, a size corresponding to a standard font size used in an e-mail document or the like in the mobile phone terminal 40 is selected. That is, the size of the reduced image 308 is not limited to vertical 20 dots × horizontal 20 dots, and uses of the pictogram image by the reduced image 308 such as vertical 16 dots × horizontal 16 dots, vertical 32 dots × horizontal 32 dots, It is determined according to the specifications of the image transmission destination. Further, the reduction processing unit 113 may generate the reduced images 308 with a plurality of sizes.

  Note that the number of exaggeration processes in step S13 in FIG. 3 may be determined in advance by executing the processes in steps S12 to S16 on one or more types of original images. At this time, the reduced image 308 is generated by sequentially changing the number of exaggeration processes in step S13, such as 0, 1, 2 and so on. Then, the number of exaggeration processes when the reduced image 308 that is determined to be optimal in appearance is generated is included in the setting information in advance.

  A method of determining the number of exaggeration processes will be schematically described with reference to FIG. 12, the reduced image 308a is an example of the reduction process result in the reduction processing unit 113 when the exaggeration process is not performed in step S13 of FIG. 3, and the reduced images 308b to 308i are subjected to the exaggeration process in step S13. An example of the reduction processing result in the reduction processing unit 113 when performed once to eight times is shown. The reduced images 308a to 308i are generated using the image shown in FIG. 5A as the original image.

  As the number of exaggeration processes increases, it becomes a strong exaggeration, and when it is less, it becomes a weak exaggeration. When there is no exaggeration or when the exaggeration is too weak, the main line of the drawing part in the original image has faded, or some colors have disappeared, and the shape of the original image has collapsed in the reduced image (For example, reduced images 308a to 308c). On the other hand, if the exaggeration is too strong, the line of the drawing portion in the original image becomes too thick, color collapse occurs in the reduced image, and the shape of the original image is destroyed (for example, the reduced images 308h and 308i).

  The user or the provider of the image processing apparatus 100 (image processing program) selects the reduced image that seems to be optimal by looking at the reduced images 308a to 308i generated with different exaggeration processing times. Then, the number of exaggeration processes when the selected reduced image is generated is included in the setting information. In this example, it is determined that the reduced image 308e is optimally exaggerated, and the number of exaggeration processes (4 times) of the reduced image 308e is included in the setting information read in step S11.

  In the above description, the number of exaggeration processes is included in the setting information in advance and is read in step S11. However, this is not limited to this example. For example, the number of exaggeration processes can be input to the image processing apparatus 100 by the user when creating a pictographic image from the original image.

  As described above, in the first embodiment, the reduction processing is performed after the exaggeration processing of the drawing portion is performed on the original image. For this reason, it is possible to prevent the main lines in the drawing portion of the original image from being blurred or the necessary colors to disappear, and it is possible to generate an easy-to-see pictographic image while maintaining the shape of the drawing portion as a whole. .

(First modification of the first embodiment)
In the above description, an example in which the frame 4 indicating the drawing region 3 is printed on the paper 5 when the original image is extracted from the original image obtained by reading the handwritten original 1 by the scanner device 11 has been described. This is not limited to this example. FIG. 13 shows an example of a sheet 5 ′ according to a first modification of the first embodiment. In FIG. 13, the same reference numerals are given to portions common to FIG. 4 described above, and detailed description thereof is omitted.

  The sheet 5 ′ according to the first modification of the first embodiment further includes an address input area 6 in which an address of a transmission destination for transmitting a pictographic image created from the picture 2 drawn in the drawing area 3 is entered. In the address input area 6, for example, the e-mail address of the mobile phone terminal 40 or the PC 41 to which the pictographic image is transmitted is written by handwriting by the user. The PC 10 extracts the image in the drawing area 3 and the image in the address input area 6 from the original image obtained by reading the original 1 in which the e-mail address is written by the scanner device 11. The image in the drawing area 3 is processed as an original image, and a pictographic image is generated as described above.

  The PC 10 performs OCR (Optical Character Recognition) processing on the image in the address input area 6 and extracts character information. Then, it is determined whether or not the character string composed of the extracted character information represents an electronic mail address. For example, when a symbol “@ (at mark)” is included in a portion other than the beginning and end of a character string, it may be determined that the character string is an e-mail address. The PC 10 transmits a pictographic image obtained by processing the image in the drawing area 3 to the e-mail address extracted from the address input area 6 as a transmission destination.

  According to the first modification, there is no need to key-in the e-mail address that is the destination of the pictographic image. For this reason, the first modification is suitable not only for generating a pictographic image using not only the PC 10 but also the MFP 20 that does not have a dedicated character input means such as a keyboard.

(Second modification of the first embodiment)
FIG. 14 shows an example of a sheet 5 ″ according to the second modification of the first embodiment. In FIG. 14, the same reference numerals are given to the same parts as those in FIG. The sheet 5 ″ according to the second modification of the first embodiment further includes an additional information input area 7 for inputting additional information with respect to the sheet 5 ′ according to the first modification described above. Provide. In the additional information input area 7, for example, additional information related to the pattern 2 drawn in the drawing area 3 is written by handwriting by the user. As the additional information, for example, the title of the pattern 2 drawn in the drawing area 3 can be considered. The additional information is not limited to the title of the picture 2, and may be, for example, the name of the user who has drawn in the drawing area 3, or information that is not directly related to the picture 2.

  The PC 10 extracts the image in the drawing area 3, the image in the address input area 6, and the image in the additional information input area 7 from the original image obtained by reading the original 1 on which the additional information is written by the scanner device 11. Extract. The image in the drawing area 3 is processed as an original image. Further, the image in the address input area 6 is subjected to OCR processing as described above, and a destination e-mail address to which a pictographic image obtained by processing the image in the drawing area 3 is transmitted is extracted. Further, the image of the additional information input area 7 is similarly subjected to OCR processing to extract character information, and a character string composed of the extracted character information is temporarily held in a memory or the like as additional information.

  The PC 10 transmits a pictographic image obtained by processing the image in the drawing area 3 to the e-mail address extracted from the address input area 6 as a transmission destination. At this time, the PC 10 adds the additional information extracted from the additional information input area 7 to the pictographic image and transmits it to the transmission destination.

  According to the second modification, the additional information related to the pictographic image can be transmitted to the transmission destination together with the pictographic image without inputting the key one by one. For this reason, the second modification is suitable not only for generating a pictographic image using not only the PC 10 but also the MFP 20 or the like that does not have a dedicated character input means such as a keyboard.

(Second Embodiment)
Next, a second embodiment of the present invention will be described. In the first embodiment described above, the pictographic image is generated as a still image. In contrast, in the second embodiment, a pictographic image is generated as a moving image. At this time, the moving image is generated from one original image. For example, the moving image generated in the second embodiment includes rotation, movement, enlargement / reduction, and combinations thereof.

  FIG. 15 is a functional block diagram showing functions of an example of the image processing apparatus 200 according to the second embodiment. In FIG. 15, the same reference numerals are given to the portions common to FIG. 2 described above, and detailed description thereof is omitted. The image processing apparatus 200 includes a shaping processing unit 110, a first storage unit 210, a rotation processing unit 211, a normalization / exaggeration processing unit 111, a trimming processing unit 112, a reduction processing unit 212, and a movement processing unit 213. And a second storage unit 214 and a moving image generation unit 215.

  In FIG. 15, the first storage unit 210 stores an image that has been shaped by the shaping processing unit 110 so that the aspect ratio of the original image is 1: 1. The rotation processing unit 211 reads the shaped image from the first storage unit 210 and rotates the read image by a specified angle. The normalization / exaggeration processing unit 111 performs the exaggeration processing on the rotated image generated by the rotation processing unit 211 after normalizing the resolution as described in the first embodiment. become.

  The trimming processing unit 112 cuts out a necessary part from the image rotated by the rotation processing unit 210 and exaggerated by the normalization / exaggeration processing unit 111, and shapes the aspect ratio of the cut-out image to 1: 1. The reduction processing unit 212 performs reduction processing on the image created by the trimming processing unit 112 to reduce the image to a specified size. The movement processing unit 213 performs a movement process for moving the image reduced by the reduction processing unit 212 in a designated direction and movement amount. The image output from the movement processing unit 213 is stored in the second storage unit 214.

  In the image processing apparatus 200, each process performed by the rotation processing unit 211, normalization / exaggeration processing unit 111, trimming processing unit 112, reduction processing unit 212, and movement processing unit 213 is performed on an image read from the first storage unit 210. Is repeated the specified number of times. Further, the second storage unit 214 stores images generated by each repetition in an accumulative manner. When the designated number of processes is completed, the moving image generation unit 215 reads out the images for each process from the second storage unit 215, arranges them in time series, and generates a pictographic image based on the moving images.

  FIG. 16 is a flowchart illustrating an example of a pictographic image generation method according to the second embodiment. Here, it is assumed that a pictographic image is generated using the PC 10 and the scanner device 11 shown in FIG. In this case, each unit constituting the image processing apparatus 200 is expanded on the main memory of the PC 10 as a module of an image processing program mounted on the PC 10.

  Prior to the execution of the flowchart of FIG. 16, the user prepares a document 1 in which a picture 2 to be converted into a pictographic image is drawn on paper using a marker pen or the like. Then, the original image obtained by causing the scanner device 11 to read the original 1 is input to the PC 10. The PC 10 extracts a predetermined area including a drawing portion of the pattern 2 from the document image data, and uses it as an original image.

  In the flowchart of FIG. 16, an original image is input to the image processing apparatus 200 in step S30. The input original image is supplied to the shaping processing unit 110. In the next step S31, for example, setting information is read by a CPU (not shown) that controls the entire image processing apparatus 200.

  FIG. 17 shows an example of setting information. FIG. 17A shows an exemplary format of setting information. In the first line of the setting information, the number of images constituting the moving image (unit: sheet) and the display time of one image in the moving image (unit: 1/100 second) are shown.

  The second line of the setting information indicates information set for each image constituting the moving image. In this example, the number of exaggerations, the rotation angle (unit: degree), the size, the amount of movement in the x direction (unit: dot), and the amount of movement in the y direction (unit: dot) are shown as information set for each image. Has been. Among these, the number of exaggerations is selected from a range of 0 to 30 times, for example. The size is, for example, a square and is selected from a range of 1 dot × 1 dot to 30 dots × 30 dots. The rotation angle is, for example, an angle with respect to the x direction of the original image. It is assumed that the movement amount in the x direction and the movement amount in the y direction are for the image at the initial position where the movement process has not been performed once. The information on the second line of the setting information is described for the number of images constituting the moving image.

  FIG. 17B shows an example of the contents of a setting information file in which setting information is stored. In this way, each item is separated by “, (comma)”, each line is separated by a line feed character (not shown), and the setting information is stored in the file. In the example of FIG. 17B, it is described in the first row that the moving image is composed of four images, and the display time of one image is 0.5 seconds. In the second and subsequent lines, setting information of each image constituting the moving image is described. For example, in the second row, the first image constituting the moving image has an exaggeration count of 7 times, a rotation angle of 5 degrees, a size of 20 dots vertically × 20 dots horizontally, x direction and y direction. It is shown that there is no transfer. Similarly, the setting information is described for each image in the third to fifth lines.

  In the flowchart of FIG. 16, when the setting information is read in step S31, the process proceeds to the next step S32. In step S32, the shaping processing unit 110 adds margins having the same width to the top and bottom or the left and right of the supplied original image, and shapes the original image into a square image with an aspect ratio of 1: 1. . The image shaped by the shaping processing unit 110 is stored in the first storage unit 210.

  In the next step S <b> 33, the rotation processing unit 211 reads an image from the first storage unit 210. In the loop processing from step S33 to step S41 described later, the processing by each loop is performed on the same image read from the first storage unit 210. At that time, in each loop, the setting information of each row is sequentially applied to the processing target image for each loop from the second row of the setting information (see FIG. 17B).

  In the next step S <b> 34, the rotation processing unit 211 performs a rotation process for rotating the image read from the first storage unit 210 by the angle indicated in the rotation angle item of the setting information. The center of rotation is, for example, the center of the image. As an example, a rotation process of −15 degrees (15 degrees counterclockwise) is performed on the image shown in FIG. 18A to obtain a rotated image shown in FIG. The image rotation process can be realized using a known rotation matrix.

  In the next step S35, the normalization / exaggeration processing unit 111 normalizes the resolution of the image created in step S34 in the same manner as in step S13 in FIG. Exaggeration is performed as many times as indicated. In the next step S36, the trimming processing unit 112 performs a trimming process on the image exaggerated in step S35 in the same manner as in step S14 of FIG. 3 described above, and cuts out the minimum rectangle including the drawing portion from the exaggerated image. . The minimum rectangle may be cut out by adding some margin area. In the next step S37, the trimming processing unit 112 sets the aspect ratio of the trimmed image to 1: 1 and creates a square image.

  Next, in step S <b> 38, the reduction processing unit 212 performs reduction processing on the image output from the trimming processing unit 112 according to information indicating the size of the image included in the setting information. In this setting information, by setting the information indicating the size of the image to a different value for each row, that is, for each image constituting the moving image, it is possible to create a moving image in which the pattern 2 in the pictographic image is enlarged or reduced.

  A moving image relating to enlargement / reduction will be described with reference to FIG. As an example, a moving image is composed of four images, and the size of a pictographic image that is finally output is 20 dots long × 20 dots wide. In the setting information, “5”, “10”, “15”, and “20” are set as the image size for the first to fourth images constituting the moving image, respectively. Shall.

  In this case, in the first loop, the size of the image 310 is reduced to 5 dots vertically by 5 dots horizontally. An image reduced to 5 dots vertically by 5 dots horizontally is arranged at a predetermined position within a frame of 20 dots vertically by 20 dots horizontally to generate a reduced image 311a. The arrangement position of the reduced image may be a position designated in advance, or information indicating the arrangement position may be added to the setting information.

  The same processing is performed in the second and subsequent loops. That is, in the second loop, the image 310 is reduced to 10 dots vertically × 10 dots horizontally, and is arranged at a predetermined position within a frame of 20 dots vertically × 20 dots horizontally to generate a reduced image 311b. Also in the third and fourth loops, the image 310 is reduced to 15 dots vertically by 15 dots horizontally and 20 dots vertically by 20 dots horizontally and placed at predetermined positions within a frame of 20 dots vertically by 20 dots horizontally. Reduced images 311c and 311d are generated.

  By displaying the generated reduced images 311a to 311d in the order of the reduced images 311a, 311b, 311c, and 311d, it is possible to express a state in which the pattern 2 in the pictographic image is gradually enlarged. Similarly, by displaying the reduced images 311d, 311c, 311b, and 311a in this order, it is possible to express how the pattern 2 in the pictographic image is gradually reduced.

  It is also possible to reduce the image 310 to a size larger than the size specified for the finally output pictographic image. In this case, a process of cutting out the reduced image with a size specified for the pictographic image is performed.

  When the reduction process in step S38 ends, the process proceeds to step S39. In step S39, the movement processing unit 213 performs movement processing on the reduced image according to the movement amount in the x direction and the movement amount in the y direction included in the setting information. Note that the movement is performed with the upper left corner point of the reduced image as the origin. In this setting information, at least one of the information indicating the amount of movement in the x direction and the information indicating the amount of movement in the y direction is set to a different value for each row, that is, for each image constituting the moving image. It is possible to create a moving image in which the pattern 2 moves.

  An example of the movement process will be described more specifically with reference to FIG. It is assumed that the movement amount in the x direction and the y direction is set to “−5”, respectively. The movement processing unit 213 holds, for example, a reduced image before movement at the time of the first loop, that is, a reduced image 312a that has not been subjected to movement processing in a memory or the like. The movement process is performed, for example, by reading the reduced image 312a held in the memory and moving each pixel of the read reduced image 312a in units of dots according to the movement amount in the x direction and the movement amount in the y direction.

  In the example of FIG. 20A, each pixel of the reduced image 312a has “−5” in the x direction (5 dots on the left) and “−5” in the y direction with the upper left corner point of the reduced image 312a as the origin. (5 dots on top) are moved respectively. At this time, pixels that are outside the range of the original reduced image 312a due to movement are discarded. In this way, a reduced image 312b is obtained in which the reduced image 312a is moved by -5 dots in the x direction (5 dots to the left) and -5 dots in the y direction (5 dots upward).

  When the movement process for the reduced image is performed in step S39, the process proceeds to step S40, and the reduced image subjected to the movement process is stored in the second storage unit 214.

  In the next step S41, it is determined whether or not the processing for the number of images constituting the moving image in the setting information has been completed. If it is determined that the processing has not been completed, the process returns to step S33, the normalization original image stored in the first storage unit 210 is read, and the process for the read normalization original image is executed. .

  On the other hand, if it is determined in step S41 that the processing for the number of images constituting the moving image has been completed, the process proceeds to step S42. In step S42, moving image generation processing by the moving image generation unit 215 is performed. More specifically, the moving image generation unit 215 reads a plurality of reduced images stored in the second storage unit 214. Then, the plurality of read out reduced images are arranged in time series and connected in accordance with the display time of one image included in the setting information to generate one moving image file.

  There is a GIF (Graphics Interchange Format) as one of the formats of a moving image file that forms a moving image by connecting a plurality of images. In GIF, for a single file, a plurality of sets of image control information including delay time (display time) information and image data that is the main body of an image to be displayed, following predetermined header information, By storing, moving image display is possible. In addition, information indicating the number of times the moving image loops can be added as extension information to the header information.

  The moving image generated by the moving image generation unit 215 is output from the image processing apparatus 200 as a pictographic image based on the moving image.

  FIG. 21 shows a summary of pictogram image generation processing using a moving image according to the flowchart of FIG. 16 described above. FIG. 21A shows a case where a moving picture pictographic image of 20 dots long × 20 dots wide is generated, the rotation angle is −15 degrees, the number of exaggerations is 5 times, and the size is 16 dots long × horizontal with respect to the setting information. This is an example in a case where 16 dots, a movement amount of 3 in the x direction, and 8 in the y direction are set. Further, FIG. 21B shows that when a moving picture pictographic image of 20 dots vertically × 20 dots horizontally is generated similarly, the rotation angle is 15 degrees, the number of exaggerations is 8 times, and the size is 20 vertically. This is an example in the case where a movement amount of dots × 20 dots in the horizontal direction, −5 in the x direction, and −5 in the y direction is set.

  In the example of FIG. 21A, in step S30 of FIG. 16, the original image 313 on which the pattern 2 to be converted into a pictographic image is drawn is input, and in step S31, setting information corresponding to the original image 313 is read. In the next step S32, an image 314a in which the aspect ratio of the original image 313 is shaped by the shaping processor 110 is created. By setting the aspect ratio of the original image 313 to 1: 1, it is possible to prevent the drawing portion from being lost during the rotation processing in step S34. This image 314 a is stored in the first storage unit 210.

  Next, the rotation processing unit 211 reads the image 314a from the first storage unit 210 (step S33), performs rotation processing (clockwise) of −10 degrees on the image 314a according to the setting information, and displays the image 314b. Generate. In the next step S35, the image 314b is normalized in resolution, the degree of exaggeration in one exaggeration process is made constant, and then the exaggeration process is performed with the number of exaggerations (5 times) according to the setting information. To generate an image 314c.

  When the exaggeration process is performed, next, in step S36, the trimming processing unit 112 generates a mask image 314d based on the image 314c. Then, the mask image 314d cuts out an image including a drawing portion of the pattern 2 that is to be converted into a pictographic image from the image 314c. In step S <b> 37, the trimming processing unit 112 performs a shaping process to set the aspect ratio to 1: 1 on the cut image, and obtains a square image 314 e.

  Next, in the reduction processing unit 212, the image 314e is reduced to a size of 16 dots vertically × 16 dots horizontally according to the setting information (step S38), and the reduced image is arranged in a frame of 20 dots vertically × 20 dots horizontally. Thus, a reduced image 314f is obtained. Further, the movement processing unit 213 applies a movement process of 3 dots in the x direction and 8 dots in the y direction according to the setting information to the reduced image 314f (step S39), and a moving image 314g is obtained.

  The process in the example of FIG. 21B is also substantially the same as in the case of FIG. The original image 315 is input in step S30 of FIG. 16, and setting information corresponding to the original image 313 is read in step S31. In the next step S 32, an image 316 a in which the aspect ratio of the original image 315 is shaped to 1: 1 is created, and this image 316 a is stored in the first storage unit 210. The rotation processing unit 211 performs a 15-degree rotation process (counterclockwise) on the image 316a read from the first storage unit 210 in step S33 according to the setting information to generate an image 316b. In the next step S35, the image 316b is subjected to resolution normalization and then subjected to exaggeration processing with the number of exaggerations (8 times) according to the setting information to generate an image 316c.

  When the exaggeration processing is performed, next, in step S36, an image including a drawing portion by the design 2 that is desired to be converted into a pictographic image is cut out from the image 314c by the mask image 316d generated based on the image 316c in the trimming processing unit 112. Then, the trimming processing unit 112 performs a shaping process to set the aspect ratio of the cut-out image to 1: 1 to obtain a square image 316e.

  Next, in the reduction processing unit 212, the image 316e is reduced to a size of 20 dots vertically × 20 dots horizontally according to the setting information (step S38), and a reduced image 316f is obtained. Further, the movement processing unit 213 applies a movement process of −5 dots in the x direction and −5 dots in the y direction according to the setting information to the reduced image 316f (step S39), and an image 316g is obtained.

  In the second embodiment, various moving images can be generated from one original image by combining a plurality of processes. For example, in the moving process, by appropriately setting the amount of movement in the x direction and y direction for each image constituting the moving image in the setting information, the drawing portion in the reduced image is moved up and down, left and right, and obliquely moved. , And a combination of these (such as zigzag movement). Also, in the rotation process, it is possible to set either the clockwise or counterclockwise direction of the drawing portion in the reduced image by appropriately setting the rotation angle in the setting information. Furthermore, by appropriately setting the size of the image in the setting information, the drawing portion in the reduced image can be enlarged and reduced. Furthermore, by combining these movement processing, rotation processing, and enlargement / reduction processing, more complicated movements can be easily realized from one original image.

  FIG. 22A shows an example of a setting input area 350 for setting the movement of a pictographic image by a moving image. The setting input area 350 is printed and presented in advance on the paper 5 as exemplified in FIG. In this example, the setting input area 350 is provided with a plurality of check boxes 351 to 355 for setting movement.

  The user performs various settings by checking the check boxes 351 to 355 using a marker pen or the like. The PC 10 extracts the image of the setting input area 350 from the original image obtained by reading the original 1 including the setting input area 350 by the scanner device 11, and detects the position checked with a marker pen or the like. Then, setting information is generated according to the setting item corresponding to the detected position.

  The check box 351 sets that the pictographic image is not moved. When the check box 351 is checked, for example, a pictographic image is generated by the image processing apparatus 100 according to the first embodiment. The display time of the setting information may be infinite, and the number of images constituting the moving image may be set to one. The check boxes 352a to 352d set operations in the upward direction, the downward direction, the right direction, and the left direction, respectively. Check boxes 353a and 353b set clockwise and counterclockwise rotation operations, respectively. Check boxes 354a and 354b set enlargement and reduction operations, respectively. The check box 355 sets a predetermined small movement. These check boxes 351 to 355 can simultaneously set a plurality of items whose operations do not contradict each other, for example.

  Although the setting input area 350 is described as being printed on the paper 5 here, this is not limited to this example. For example, the setting input area 350 can be presented as a setting input screen displayed on a display unit in a device such as the PC 10 or the MFP 20 in which the image processing apparatus 200 is configured. The user checks the check boxes 351 to 355 by operating a pointing device such as a mouse, a touch panel, and various keys in accordance with a setting input screen displayed on the display unit of the PC 10 or the MFP 20. The PC 10 and the MFP 20 generate setting information based on the checked content.

(Rotation processing in the second embodiment)
Next, some processes unique to the second embodiment in the rotation process in moving image creation will be described. The first process relates to the procedure of the rotation process in the entire process. In the second embodiment, as illustrated in the flowchart of FIG. 16 described above, the rotation processing by the rotation processing unit 211 is executed before the reduction processing by the reduction processing unit 212. Therefore, it is possible to suppress blurring or collapse of the image due to the rotation process.

  This will be described with reference to FIG. In the following, for example, a reduced image of vertical 20 dots × horizontal 20 dots in which the pattern 2 drawn in the original image 317 is rotated 15 degrees counterclockwise from the original image 317 of approximately 400 vertical dots × horizontal 400 dots. The case of generating will be described.

  FIG. 23A shows an example in which the image is rotated after being reduced. The original image 317 is subjected to exaggeration processing, trimming processing, normalization processing, and the like, and then reduced using image interpolation to generate an image 318a. The image 318a is rotated to obtain an image 318b in which the pattern 2 is rotated. Note that the image 318b 'is enlarged so that the image 318b can be easily seen. Since the rotation processing is applied after reducing the resolution by reducing the original image 317, the image 318b appears to be greatly blurred with respect to the original image 317.

  On the other hand, FIG. 23B shows an example in which an image is reduced after being rotated. The original image 317 is rotated to obtain an image 319a. Thereafter, the image 319a is subjected to exaggeration processing, trimming processing, normalization processing, and the like, and then reduced using image interpolation to generate an image 319b. Note that the image 319b 'is enlarged so that the image 319b is easy to see. In this case, the rotation process is performed with a sufficiently high resolution, and then the reduction process is performed through an exaggeration process. For this reason, the image 319b is very easy to see and has less bleeding compared to the image 318b that has been subjected to the rotation processing after the reduction processing described above.

  The second process is adjustment of the strength of the exaggeration process according to the rotation angle. In the second embodiment, when rotation processing is performed by the rotation processing unit 211, the degree of exaggeration processing in the normalization / exaggeration processing unit 111 is changed according to the rotation angle.

  This will be described with reference to FIG. The original image 320 illustrated in FIG. 24A is subjected to a rotation process at a specified rotation angle, the image subjected to the rotation process is subjected to an exaggeration process a predetermined number of times, and then subjected to a reduction process. For example, it is assumed that a reduced image of 20 dots vertically × 20 dots horizontally is obtained. The resolution of the original image 320 is about 400 dots long × 400 dots wide, for example.

  FIG. 24B shows that when the rotation angle is 0 degree, 15 degrees, 30 degrees, 45 degrees, 60 degrees, 75 degrees and 90 degrees, the original image 320 is rotated and exaggerated, respectively. Furthermore, an example in the case of performing reduction processing will be shown. Here, it is assumed that the optimum number of exaggeration processes when the rotation process is not performed is 7. In FIG. 24B, an example when the exaggeration process number is 7 and an example when the exaggeration process is 9 times. Is shown.

  As can be seen from the example of FIG. 24B, when the rotation angles are 15 degrees, 30 degrees, 60 degrees, and 75 degrees, the lines in the oblique direction are more prominent than the reduced image with the rotation angle of 0 degrees. On the other hand, a reduced image with a rotation angle of 90 degrees has no difference in appearance from a reduced image with a rotation angle of 0 degrees. Also, a reduced image with a rotation angle of 45 degrees does not show a significant difference in appearance with respect to a reduced image with a rotation angle of 0 degrees.

  On the other hand, in the example in which the number of exaggeration processes is nine in FIG. 24B, the reduced images with the rotation angles of 15, 30, 60, and 75 degrees are visible as compared with the case where the exaggeration process is seven times. It can be seen that there is an improvement. FIG. 24C shows an enlarged view of a reduced image 321a with seven exaggeration processes and a reduced image 321b with nine exaggeration processes when the rotation angle is 15 degrees. On the other hand, it can be seen that the reduced image with the rotation angle of 45 degrees is increased in the number of exaggeration processes to 9 and the line becomes too thick and difficult to see.

  In this example, when the rotation angles are 0 degree, 45 degrees, and 90 degrees, the number of exaggeration processes remains seven. When the rotation angle is 15, 30, 60, and 75 degrees, the number of exaggeration processes is increased to 9, and the degree of exaggeration is increased with respect to the cases where the rotation angles are 0 degree, 45 degrees, and 90 degrees. ramp up. In this manner, by changing the number of exaggeration processes in accordance with the rotation angle and changing the degree of exaggeration, it is possible to prevent the appearance of the reduced image from changing greatly during rotation in a moving image in which the reduced image rotates.

  As described above, according to the second embodiment, the exaggeration process is performed after the rotation process is performed on the original image, and then the reduction process is performed to generate a pictographic image using a moving image. Therefore, it is possible to generate a pictographic image with a moving image that is easier to see when reproduced. Further, according to the second embodiment, it is possible to easily create moving images having various movements from one original image.

(PC configuration)
FIG. 25 shows a configuration of an example of the PC 10 that can be commonly applied to the image processing apparatus 100 according to the first embodiment and the image processing apparatus 200 according to the second embodiment.

  In FIG. 25, a CPU 410, a RAM 411, a ROM 412, a display control unit 413, and a communication I / F (interface) 414 are connected to a bus 401. An HDD (hard disk drive) 415, a drive device 416, and an input I / F 417 are connected to the bus 400. Note that the RAM 411 and the HDD 415 can be applied to the first storage unit 210 and the second storage unit 214 in the image processing apparatus 200 shown in FIG.

  The CPU 410 controls the operation of the computer using the RAM 411 as a work memory in accordance with programs stored in the ROM 412 and the HDD 415. The display control unit 413 converts the display control signal generated by the CPU 410 into a signal that can be displayed by the display device 420 and outputs the converted signal.

  The HDD 415 stores a program executed by the CPU 410, data used by the program, and the like. The drive device 416 can be loaded with a removable recording medium 421 and can read / write data from / to the recording medium 421. As the recording medium 421 that the drive device 416 can handle, a disk recording medium such as a CD (Compact Disk), a DVD (Digital Versatile Disk), and a flexible disk, and a readable / writable nonvolatile semiconductor memory can be considered.

  The input I / F 417 inputs data from the outside. For example, the input I / F 417 has a predetermined interface such as USB (Universal Serial Bus) or IEEE 1394 (Institute of Electrical and Electronics Engineers 1394). By this interface, data from an external device such as the tablet 424 or the scanner device 425 is obtained. Make input. Input devices such as a keyboard 422 and a mouse 423 are connected to the input I / F 417. The user can issue an instruction to the computer by operating these input devices in accordance with the display on the display device 420, for example.

  The communication I / F 414 communicates with an external communication network using a predetermined protocol.

  An image processing program for realizing the image processing apparatus 100 and the image processing apparatus 200 on the PC 10 is a file in an installable or executable format, such as a CD (Compact Disk), a DVD (Digital Versatile Disk), or a flexible file. The program is stored in a computer-readable storage medium such as a non-volatile memory such as a disk or a USB (Universal Serial Bus) memory.

  The image processing program may be provided by being stored on a computer connected to a network such as the Internet and downloaded via the network. The image processing program may be provided or distributed via a network such as the Internet. Further, the image processing program may be provided by being incorporated in advance in a ROM or the like.

  For example, in the case of the first embodiment, the image processing program has a module configuration including the above-described units (the shaping processing unit 110, the normalization / exaggeration processing unit 111, the trimming processing unit 112, and the reduction processing unit 113). As actual hardware, the CPU 410 reads out and executes the image processing program from the above-described storage medium, whereby the above-described units are loaded onto the main storage device (RAM 411), and the shaping processing unit 110, normalization / exaggeration processing The unit 111, the trimming processing unit 112, and the reduction processing unit 113 are generated on the main storage device.

(Third embodiment)
Next, a third embodiment of the present invention will be described. In the third embodiment, first communication is performed with a mobile phone terminal, and a transmission destination address for transmitting a pictographic image to the mobile phone terminal is acquired. Then, second communication is performed according to the acquired transmission destination address, and the pictographic image is transmitted to the mobile phone terminal.

  Here, it is assumed that the first communication is possible even if the transmission destination address acquisition side does not have information specific to the communication partner in advance. A non-contact proximity wireless communication method employed in Osaifu-Keitai (registered trademark) or the like can be applied as the first communication method. In this communication method, non-contact wireless communication is performed by supplying power to the IC chip by electromagnetic induction of an antenna for performing wireless communication. According to this proximity wireless communication method, a mobile phone terminal embedded with an IC chip corresponding to the communication method is brought close to a dedicated reader / writer in a non-contact manner, thereby automatically between the IC chip and the reader / writer. Communication is started.

  FIG. 26 shows an example of the configuration of a pictographic image creation system using this non-contact proximity wireless communication system. FIG. 26A shows an example in which the MFP 61 is used to generate a pictographic image based on the original 63 on which the pattern 2 to be converted into a pictographic image is written and transmit it to the user's mobile phone terminal 60. Here, an IC chip (not shown) corresponding to a contactless proximity wireless communication system is embedded in the mobile phone terminal 60, and a reader / writer 62 that performs communication according to the communication system is connected to the MFP 61. It shall be. The MFP 61 has the pictographic image generation function according to the first embodiment or the second embodiment, and also has the function of transmitting data to the transmission destination designated by the e-mail address.

  The user creates a manuscript 63 by writing the pattern 2 to be converted into a pictographic image on paper. Then, the user causes the MFP 61 to read the document 63 using the scanner function. The MFP 61 extracts an original image including a drawing portion of the pattern 2 to be converted into a pictographic image from the original image obtained by reading the original 63, and based on the extracted original image, is the same as in the first and second embodiments described above. Thus, for example, a pictographic image of vertical 20 dots × horizontal 20 dots is generated.

  The user also brings the mobile phone terminal 60 that is the transmission destination of the generated pictographic image close to the reader / writer 62 connected to the MFP 61. Thereby, wireless communication is started between the IC chip in the mobile phone terminal 60 and the reader / writer 62. Through this communication, the MFP 61 can acquire the e-mail address of the mobile phone terminal 60. The MFP 61 transmits a pictographic image generated based on the original image read from the original 63, with the e-mail address acquired by this communication as a transmission destination.

  FIG. 26B shows an example in which the PC 64 is used to draw the pattern 2 to be converted into a pictographic image with a pointing device such as the pen tablet 65 so that the original image of the pictographic image is directly taken into the PC 64. . The PC 64 is connected to a reader / writer 62 and has a pictographic image generation function according to the first embodiment or the second embodiment. Further, the PC 64 has a function of transmitting data to a transmission destination designated by an e-mail address.

  The user draws the pattern 2 to be converted into a pictographic image using the pen tablet 65. The PC 64 generates an original image including a drawing portion of the pattern 2 in accordance with the drawing by the pen tablet 65, and based on this original image, for example, in the same manner as in the first embodiment and the second embodiment described above, for example, A pictographic image of 20 dots × 20 dots horizontally is generated.

  The user also brings the mobile phone terminal 60 that is the transmission destination of the generated pictographic image close to the reader / writer 62 connected to the PC 64. Thereby, wireless communication is started between the IC chip in the mobile phone terminal 60 and the reader / writer 62. Through this communication, the PC 64 can acquire the e-mail address of the mobile phone terminal 60. The PC 64 transmits a pictographic image generated based on the pattern 2 drawn using the pen tablet 65, with the e-mail address acquired by this communication as a transmission destination.

  As described above, according to the third embodiment, the user draws the pattern 2 to be converted into a pictographic image by using the marker pen or the pen tablet 65 and inputs the pattern 2 to the MFP 61 or the PC 64, and is a transmission destination of the pictographic image. By simply holding the mobile phone terminal 60 over the reader / writer 62, a pictographic image created by the user can be used on the mobile phone terminal 60.

1 Manuscript 2 Pattern 2
3 Drawing area 4 Frame 5 Paper 6 Address input area 7 Additional information input area 10, 41, 64 PC
11 Scanner device 12, 65 Pen tablet 20, 61 MFP
21 Tablet terminal 30 Network 40, 60 Mobile phone terminal 42 Server 100, 200 Image processing device 110 Shaping processing unit 111 Normalization / exaggeration processing unit 112 Trimming processing unit 113 Reduction processing unit 210 First storage unit 211 Rotation processing unit 212 Reduction processing Unit 213 movement processing unit 214 second storage unit 215 moving image generation unit

JP 2001-43000 A

Claims (15)

Consists of one or more information processing apparatus, a drawing area for the user to draw, and operation setting Teiryo area to specify the pattern of the operation given to該絵pattern image when displaying the picture drawn in the drawing area, An image processing system that reads a paper including the image and moves an image of the pattern on a display screen,
A reading means for obtaining the read image data of the paper,
Extraction means for extracting image data of a drawn pattern from the drawing area of the image data;
Generating means for generating a display image to be displayed on a display screen based on the image data extracted by the extracting means;
A plurality of operations that are patterned using any one of a movement operation, a rotation operation, an enlargement operation, a reduction operation, and a movement operation, a rotation operation, a combination of a plurality of operations among the enlargement operation and the reduction operation. Image processing means for performing image processing corresponding to each of the patterns on the extracted image data and giving an operation to the display image;
Detection means for detecting the operation setting Teiryo zone before Symbol image data to identify a pattern of behavior that is designated by said operating setting area of the plurality of operation patterns,
The extracted image data is subjected to image processing according to an operation pattern specified by the detection means by the image processing means, and the display image to which an operation based on the operation pattern is given is displayed on the display screen. and operation setting means for creating work on,
An image processing system. Address acquisition means for acquiring address information from a portable terminal that has been communicated by short-range wireless communication means;
Transmitting means for transmitting the display image to a destination indicated by the address information;
The image processing system according to claim 1, further comprising: Further comprising the short-range wireless communication means;
The address acquisition means includes
The image processing system according to claim 2, wherein the address information is acquired from a portable terminal carried by a user who causes the reading unit to read the paper. The detection means includes
Identifying a pattern of an action specified by the action setting area among the plurality of action patterns further including a pattern that does not operate the display image;
The operation setting means includes
The image processing according to any one of claims 1 to 3 , wherein when the pattern that does not operate the display image is designated, the image processing unit does not perform image processing on the extracted image data. system. The detection means includes
The action setting area filled in by the user is detected from the image data, and the action pattern specified by the action setting area is specified from the plurality of action patterns.
The image processing system according to any one of claims 1 to 4. Reading a drawing area for the user to draw, the paper containing the operation setting Teiryo area to specify the pattern of the operation given to該絵pattern image when displaying the picture drawn in the drawing area, the picture An image processing method for moving an image on a display screen,
A step reading acquires read image data of the paper,
An extraction step of extracting image data of a drawn pattern from the drawing area of the image data;
A generation step for generating a display image to be displayed on a display screen based on the image data extracted by the extraction step;
A plurality of operations that are patterned using any one of a movement operation, a rotation operation, an enlargement operation, a reduction operation, and a movement operation, a rotation operation, a combination of a plurality of operations among the enlargement operation and the reduction operation. An image processing step of performing image processing corresponding to each of the patterns on the extracted image data and giving an operation to the display image;
A detection step of detecting the operation setting Teiryo zone before Symbol image data to identify a pattern of behavior that is designated by said operating setting area of the plurality of operation patterns,
The extracted image data is subjected to image processing according to the operation pattern specified in the detection step by the image processing step, and the display image to which an operation based on the operation pattern is given is displayed on the display screen. an operation setting step of causing the operation above,
An image processing method. An address acquisition step of acquiring address information from the mobile terminal that has been communicated by the short-range wireless communication means;
A transmission step of transmitting the display image to a destination indicated by the address information;
The image processing method according to claim 6 , further comprising: A communication step of performing communication by the short-range wireless communication means;
The address acquisition step includes:
The image processing method according to claim 7 , wherein the address information is acquired by the communication step from a portable terminal carried by a user who reads the paper by the reading step. The detecting step includes
Identifying a pattern of an action specified by the action setting area among the plurality of action patterns further including a pattern that does not operate the display image;
The operation setting step includes:
When the display image not to the operation pattern is specified, in any one of the image no image processing by the processing means <br/> claims 6 to 8 for the image data the extracted The image processing method as described. The detecting step includes
The action setting area filled in by the user is detected from the image data, and the action pattern specified by the action setting area is specified from the plurality of action patterns.
The image processing method according to claim 6. Reading a drawing area for the user to draw, the paper containing the operation setting Teiryo area to specify the pattern of the operation given to該絵pattern image when displaying the picture drawn in the drawing area, the picture An image processing apparatus for moving an image on a display screen,
Obtaining means for obtaining the image data read from the sheet by the reading means,
Extraction means for extracting image data of a drawn pattern from the drawing area of the image data;
Generating means for generating a display image to be displayed on a display screen based on the image data extracted by the extracting means;
A plurality of operations that are patterned using any one of a movement operation, a rotation operation, an enlargement operation, a reduction operation, and a movement operation, a rotation operation, a combination of a plurality of operations among the enlargement operation and the reduction operation. Image processing means for performing image processing corresponding to each of the patterns on the extracted image data and giving an operation to the display image;
Detection means for detecting the operation setting Teiryo zone before Symbol image data to identify a pattern of behavior that is designated by said operating setting area of the plurality of operation patterns,
The extracted image data is subjected to image processing according to an operation pattern specified by the detection means by the image processing means, and the display image to which an operation based on the operation pattern is given is displayed on the display screen. and operation setting means for creating work on,
An image processing apparatus. Address acquisition means for acquiring address information from a portable terminal that has been communicated by short-range wireless communication means;
Transmitting means for transmitting the display image to a destination indicated by the address information;
The image processing apparatus according to claim 11 , further comprising: Further comprising the short-range wireless communication means;
The address acquisition means includes
The image processing apparatus according to claim 12 , wherein the address information is acquired from a portable terminal carried by a user who causes the reading unit to read the paper. The detection means includes
Identifying a pattern of an action specified by the action setting area among the plurality of action patterns further including a pattern that does not operate the display image;
The operation setting means includes
Wherein when the display image not to the operation pattern is specified, the image processing according to any one of claims 11 to 13 does not perform the image processing by the image processing means to the image data obtained by said extraction apparatus. The detection means includes
The action setting area filled in by the user is detected from the image data, and the action pattern specified by the action setting area is specified from the plurality of action patterns.
The image processing apparatus according to any one of claims 11 to 14.