JP4185479B2 - Small information terminal, image processing method for small information terminal, and program for the method - Google Patents

Description

  The present invention relates to a small information terminal and an image processing method for performing image processing such as trimming or adding a stamp to an image of an object taken by a camera or a video image in a small information terminal such as a mobile phone or a video camera. About.

Today, stamps are added to images and video images of things taken with small information terminals such as mobile phone terminals, and trimming processing is performed to cut out to the desired size and shape, and this image is attached to an e-mail and sent. Or have a function of printing with a printer (see Non-Patent Document 1, for example).
FOMA N900i "Basic Manual", April 2004, p.298-300

  In conventional small information terminals, there are limitations on the sizes of input devices and display devices, and there are problems with the interface when performing various operations. Specifically, image processing such as trimming and stamp addition requires adjustment of a number of parameters such as positioning processing.

  For example, in the case of trimming processing, it is necessary to set the coordinates of the cutout position from the processing target image that is the target of image processing. In the case of stamp addition processing, it is necessary to set the coordinates of the position where the stamp image is added. Furthermore, for the operation of changing the size of the frame or changing the rotation angle (tilt), it is necessary to set the size and posture (rotation) of the frame and stamp.

  As described above, it is very difficult to adjust a large number of continuous parameters simultaneously with a small information terminal. As described above, the small information terminal has a limited input device, and when inputting a numerical value, it must be performed by continuously pressing a button or key, pressing it several times, or directly inputting a numerical value using a numeric key. Further, when inputting a plurality of parameters at the same time, the operation must be performed while switching the parameters to be input.

  As described above, in the small information terminal, the numerical value input operation is complicated, and as the number of parameters to be further input increases, the number of times of input object switching increases. Therefore, there is a high possibility that the operation steps increase, and the entire operation tends to be difficult.

  The objective of this invention is providing the small information terminal which solved said subject, its image processing method, and the program of this method.

  In order to solve the above-described problems, the present invention captures a thing with a frame by a camera of a small information terminal, extracts a frame of the image with the frame, and changes the shooting direction of the terminal. The position, size, and inclination of the frame superimposed on the processing target image are directly changed to enable processing such as trimming of the processing target image and addition of a stamp to the processing target image.

  A trimming process will be described as an example. When an object with a frame is imaged by the camera of the small information terminal, an image / video of the framed object is superimposed on the processing target image, and the frame is extracted from the image / video. Since this processing is performed in real time, if the user moves the terminal, the frame changes on the processing target image according to the movement. Specifically, when the distance between the frame and the terminal is reduced, the size of the frame is increased, and the position of the frame is moved by a distance in which the center of the frame is shifted from the center of the imaging / video. When the user moves the terminal and saves the image in a state where the superimposed frame surrounds the desired area of the processing target image, the desired area image can be obtained as a trimmed image.

  In the case of stamp addition processing, the figure inside the frame is written in the processing target image, and this image can be obtained as a processing result image.

  As described above, the present invention is characterized by the following small terminal device, image processing method of the small terminal device, and program of this method.

(Invention of small terminal device)
(1) A camera that captures images / videos of a thing, a monitor that can display the imaging / videos, an operation button that can input commands, and performs image processing on the image using the camera, the monitor, and the operation buttons as input / output devices. A small information terminal comprising image processing means,
The image processing means includes
Display processing means for displaying imaging / video of things obtained from the camera or the like as a processing target image on the monitor;
A superimposed display processing unit that superimposes and displays a framed image obtained by photographing a framed thing with a frame on the processing target image;
Frame extraction processing means for extracting a frame of the framed image by operation of the operation button;
And processing means for processing the processing target image using the frame extracted by the extraction means or an image in the frame.

(2) A camera that captures and captures images of things, a monitor that can display the captured images and images, an operation button that can input commands, and trimming and adding stamps to the image using the camera, monitor, and operation buttons as input / output devices A small information terminal comprising image processing means for performing image processing such as
The image processing means includes
Display processing means for displaying imaging / video of things obtained from the camera or the like as a processing target image on the monitor;
Superimposing display processing means for superimposing and displaying a framed image obtained by photographing the framed thing having a frame indicating the trimming or stamp addition area on the processing target image;
Adjustment processing means for changing the position, size, and inclination of the framed image with respect to the processing target image according to a change in the shooting position and posture of the framed thing by the camera,
After the adjustment by the adjustment processing unit, a frame extraction processing unit that extracts a frame of the framed image by operating the operation button;
Processing means for trimming the processing target image within the frame extracted by the extraction means or adding a stamp image within the frame to the processing target image is provided.

(Invention of image processing method)
(3) A camera that captures images / videos of things, a monitor that can display the imaging / videos, an operation button that can input commands, and performs image processing on the image using the camera, the monitor, and the operation buttons as input / output devices. An image processing method of a small information terminal comprising an image processing means,
The image processing means includes
Display processing step of displaying an image / video of an object obtained from the camera or the like as a processing target image on the monitor;
A superimposed display processing step of superimposing and displaying a framed image obtained by photographing a framed thing with a frame on the processing target image;
A frame extraction processing step of extracting a frame of the framed image by operation of the operation button;
And a processing step of processing the processing target image using the frame extracted in the extraction step or an image in the frame.

(4) A camera that captures images and images of things, a monitor that can display the images and images, operation buttons that can input commands, and trimming and adding stamps to the images using the camera, monitor, and operation buttons as input / output devices An image processing method for a small information terminal comprising image processing means for performing image processing such as
The image processing means includes
Display processing step of displaying an image / video of an object obtained from the camera or the like as a processing target image on the monitor;
A superimposed display processing step of superimposing and displaying on the processing target image a framed image obtained by photographing the framed thing having a frame indicating the trimming or stamp addition region;
An adjustment process step of changing the position, size, and inclination of the framed image with respect to the processing target image in accordance with a change in the shooting position and orientation of the framed thing by the camera,
After the adjustment by the adjustment processing step, a frame extraction processing step of extracting a frame of the framed image by operating the operation button;
And trimming the processing target image in the frame extracted in the extraction step, or adding a stamp image in the frame to the processing target image.

(5) The frame extraction step includes:
A step of extracting a region composed of pixels having the specific color as a frame by using an image / video of the frame configured with the specific color;
A step of extracting a boundary area between the inner frame and the outer frame of the imaging / video as a frame by using imaging / video of a double frame having different colors on the inner side and the outer side;
A step of extracting a visual marker from the imaged / video using the image / video of a frame in which an extractable visual marker is arranged at each vertex, and extracting the frame using the visual marker as a vertex;
At least one step.

(6) The processing step includes
Extracting a region composed of pixels having a specific color from the imaging / video region surrounded by the frame and processing the region of the processing target image surrounded by the frame;
A step of painting a region of the processing target image surrounded by the frame with a specific color;
-Using the image / video of a frame having a figure with identification information embedded in the internal area, extracting the identification information from the area of the image / video surrounded by the frame, and identifying the additional information by the identification information Adding the additional information to the processing target image;
At least one step.

(7) The identification information extracting step includes:
A step of reading characters from an imaging / video region surrounded by the frame to obtain identification information;
Using an image / video of a frame having a figure with a two-dimensional code embedded in an internal region, extracting the two-dimensional code and reading identification information;
Using an image / video of a frame having a figure in which a digital watermark is embedded in an internal area, extracting the digital watermark, and reading identification information;
At least one step.

(8) The step of identifying additional information by the identification information includes:
A step in which information about the frame is included in the identification information and the information is used as additional information;
A step of using information on the external network specified by the identification information as additional information;
At least one step.

(9) The step of superimposing and displaying the frame image on the processing target image includes:
A step of switching to a superimposed display of only the frame on the processing target image;
A step of switching to a superimposed display of only the extracted in-frame image on the processing target image;
A step of switching to display only the processing target image surrounded by the frame;
At least one step.

(Invention of image processing method program)
(10) The processing procedure in the image processing method according to any one of (3) to (9) is configured to be executable by a computer.

  As described above, according to the present invention, an object with a frame is photographed with a camera included in the small information terminal, the frame of the image with the frame is extracted, and the processing direction is changed by changing the photographing direction of the terminal. Since the position, size, and tilt of the frame superimposed on the target image can be changed directly to enable processing such as trimming the processing target image and adding a stamp to the processing target image, the small information terminal camera has a frame. The camera position and direction can be adjusted toward the object, and trimming processing and stamp addition processing can be easily performed on the processing target image only by simple operation of the operation buttons. That is, the user can intuitively perform these image processes by moving the small information terminal.

(Embodiment 1)
This embodiment is a case where a trimming processing system for trimming a processing target image using a small information terminal and a printed matter (thing) on which an extractable frame is printed is constructed.

  FIG. 1 shows an example of a device configuration using a mobile phone as a small information terminal. The mobile phone 1 includes a built-in memory 2 serving as an image database means for storing images / videos taken by a camera or the like as image data in the terminal itself, a liquid crystal monitor 3 serving as a display means for images, and the like. A digital camera 4 serving as a photographing means, an operation button 5 serving as a command input means, and a CPU (microprocessor) 6 serving as information processing means such as imaging / video processing photographed by the digital camera 4 using these means as input / output devices. Is done. As with a general computer, the CPU 6 is realized by mounting software described as an information processing program on a hardware configuration such as a ROM, a RAM, and an interface. Although the present embodiment and the like will be described in the case where the present invention is applied to a mobile phone, the present embodiment can be applied to a video camera having a function equivalent to or higher than that of a mobile phone.

  FIG. 2 shows a configuration example of an extractable trimming frame used for trimming processing. The trimming frame 10 is composed of a black frame that can be easily extracted from a white background by image processing. FIG. 3 shows a trimming sheet 12 on which various trimming frames 11 are printed.

  A series of trimming processes in the present embodiment will be described. FIG. 4 shows this series of processing procedures, which are as follows.

(S1) Display of Processing Target Image As shown in FIG. 5, the user selects the processing target image 40 to be trimmed from a plurality of images stored in the built-in memory 2 with the operation button 5, and displays the liquid crystal It is displayed on the monitor 3. The processing target image 40 may be an image / video received via a communication unit or the like in addition to an image / video shot by a camera.

(S2) Frame Shooting / View Angle Adjustment Next, as shown in the example of FIG. 6, the user selects a desired trimming frame from the trimming sheet 42 on which a large number of trimming frames 41 are printed. And within the angle of view of the digital camera 4.

(S3) Frame superimposed display on processing target image The captured image / video is sent from the digital camera 4 to the CPU 6, and the captured frame is superimposed on the processing target image displayed on the liquid crystal monitor 3 as shown in FIG. indicate.

(S4) Trimming frame image generation When the operation button 5 is operated in the state illustrated in FIG. 6, a frame is extracted from the captured image and a trimming frame image 50 is generated. At this time, the CPU 6 performs binarization processing on the trimming frame image 50.

  As described above, the trimming sheet has a white background and a black frame. A pixel that becomes black after binarization can be predicted to be a frame. The CPU 6 generates a temporary work image having the same size as the processing target image. The CPU 6 extracts the black pixel in the frame image as a frame, overwrites the pixel on the temporary work image at the corresponding position with black, and uses the temporary work image as the trimming frame image 50 as a frame extraction result. Get (references, computer image processing, Hideyuki Tamura, Ohmsha).

(S5, S6) Frame Adjustment The frame image is superimposed on the processing target image and the trimming frame image is generated in real time. As shown in FIG. 7, the trimming frame 60 continues to change according to the physical positional relationship 72 between the mobile phone 70 and the trimming sheet 71.

  Specifically, as shown in FIG. 8, as the distance 72 between the mobile phone 70 and the trimming sheet 71 increases, the frame decreases, and as the distance decreases, the frame increases. When the mobile phone 70 is rotated with respect to the trimming sheet 71, the frame rotates, and when the mobile phone 70 is moved, the frame moves. Using this, the user moves the mobile phone 70 (changes the position and direction of the camera) to adjust the position, size, and rotation (tilt) of the trimming frame in the superimposed / captured image / video. .

(S7) Trimming Processing As shown in the example of FIG. 9, when the user decides to end the trimming frame adjustment with the operation button 5, a trimming region 81 surrounded by the trimming frame 80 in the processing target image is extracted. . The CPU 6 creates a temporary work image having the same size as the processing target image. The processing target image is written into the temporary work image, and the frame area composed of the black pixels of the trimming frame image is further overwritten. All the pixels in the area surrounded by the frame in the temporary work image are read, and the trimming area 81 is extracted.

(S8) Saving Trimming Results As shown in FIG. 10, the extracted trimming area 81 is saved as the trimming area image 90 in the built-in memory 2, and the user can acquire a desired image (trimming). it can.

(Embodiment 2)
In the present embodiment, a step addition processing system is constructed in which a frame is extracted using a printed matter (thing) on which a figure is printed in an extractable frame, and the figure can be added to a processing target image as a stamp.

  An example of a stamp used in this stamp addition processing system is shown in FIG. The stamp 100 includes a frame that can be easily extracted from a white background by image processing, and a figure inside the frame. FIG. 12 shows a configuration example of the stamp sheet. The stamp sheet 101 is white, and several types of stamps 102 are printed.

  The stamp addition process in this embodiment will be described. FIG. 13 shows a series of processing steps for adding a stamp, and the following processing is performed.

(S11) Display of processing target image As shown in FIG. 14, a processing target image 142 to which a stamp is to be added is displayed on the liquid crystal monitor 3.

(S12) Angle-of-view display of added stamp image As shown in FIG. 14, the mobile phone is moved, the camera 4 is directed toward the stamp sheet 140, and the frame of the stamp image desired to be used for adding the stamp is included in the angle of view.

(S13) Stamp image is superimposed on the processing target image As shown in FIG. 15, one desired stamp 141 is selected from the stamp sheet 140, and the captured image / video 150 is superimposed on the processing target image on the liquid crystal monitor 3. .

(S14 to S16) Generation / Adjustment of Stamp-added Frame Image Similar to the trimming process of the first embodiment, as shown in FIG. The phone is moved to adjust the place where the stamp image 161 is added and the size of the stamp image. Note that in the stamp addition processing system as well as the trimming processing system, the superimposed display and the generation of the stamp frame image are performed in real time.

(S17, S18) Stamp Addition Processing As shown in FIG. 17, when the addition of the stamp is determined by the operation button 5, the CPU 6 sets the stamp image 170 in the area surrounded by the extracted stamp frame as the processing target image 160. Writing and a stamp is added on the processing target image.

(S19, S20) Save Stamp Additional Image If the above stamp adjustment and addition operations are performed a plurality of times, a plurality of different stamps are added to the processing target image. Then, when the addition of the stamp is ended by the operation button 5, a processing result image 180 to which the stamp is added is obtained as shown in FIG. This processing result image is stored in the built-in memory 2, and the user can obtain an image with a desired stamp added thereto.

  The present invention is not limited to the above-described embodiments, and modified examples of frame extraction processing from captured images / videos, image processing using a framed image, and the like will be described below. Note that the following modifications are not limited to the method of mounting one on the apparatus, and a plurality of modifications may be mounted on the apparatus.

(Modification 1) Color extraction stamp In the above-described stamp addition process, instead of reading the area of the captured image surrounded by the extracted stamp image frame, only the pixels having a specific color in the area are read, It can also be configured to write only the pixels in the processing target image.

  A specific process will be described. As shown in FIG. 19, the CPU 6 generates a temporary work image having the same size as the processing target image, and writes only the pixels 190 having the specific color in the temporary work image within the stamp image area. Next, all the pixels of the temporary work image are overwritten on the pixels of the processing target image at the corresponding positions. Thereby, only the sign 191 within the frame can be written in the processing target image.

(Modification 2) Eraser In the above-described stamp addition processing, the region of the processing target image surrounded by the extracted stamp image frame may be filled with a specific color and written. The region of the processing target image surrounded by the frame can be filled with a specific color, and can be used as an eraser for an image having a special shape.

(Modification 3) Two-dimensional code In the above-described stamp addition process, a two-dimensional code is extracted from an image / video using a stamp sheet in which a two-dimensional code is embedded in a figure in a frame, and additional information included in the two-dimensional code Can be added to the processing target image.

  The two-dimensional code can be configured using a cyber code in “JP 2000-148904, CYBER CODE” or a QR code in “JP 10-208001, QR CODE”.

  A specific process using the QR code as a two-dimensional code will be described with reference to an example shown in FIG. The CPU 6 extracts the QR code 200 from the trimming area of the captured image. This extraction method is performed by the method described in the above reference. The CPU 6 acquires information 201 held by the extracted QR code 200 and adds it to the processing target image.

(Modification 4) Addition of metadata by digital watermark In the above-described stamp addition processing, a digital watermark is extracted from an image / video using a stamp sheet in which the digital watermark is embedded in a figure in the frame, and the digital watermark includes The information is configured to be added to the processing target image.

  Specific processing using a frequency domain-based technique for digital watermarking will be described (references: Basics of Digital Watermarking-New Protect Technology for Multimedia, Morikita Publishing).

  As illustrated in FIG. 21, the CPU 6 extracts a stamp area of the captured image and generates a watermark reading image 210 having the same size as the area. A watermark bit of a digital watermark is extracted from this image by the method described in the reference document, and this is used as additional information 211. The CPU 6 adds the additional information 211 to the processing target image.

(Modification 5) OCR
In the stamp addition process, a character drawn on a figure in the frame is read from the image / video, and the character is added to the processing target image as additional information.

  Specific processing will be described. Some commercially available mobile phones have a character recognition function for recognizing characters included in images. As illustrated in FIG. 22, the CPU 6 uses the character recognition function to extract the character 220 printed on the graphic in the frame from the stamp area in the processing target image. The CPU adds the character 220 as additional information 221 to the processing target image.

(Modification 6) Acquiring additional information from an external network Using a communication function of a mobile phone, network additional information that can identify the additional information as identification information is added to an image to be processed from an external database installed in the external network To be configured.

  Specific processing will be described. As illustrated in FIG. 23, the CPU 6 transmits additional information to the communication unit 230, and the communication unit 230 transmits the additional information to the external database unit 231. The external database means 231 searches the network additional information 241 corresponding to the identification information 240 using the received additional information as the identification information 240. The network additional information 241 includes a stamp name, a URL for obtaining related information, a mail address, and the like. The external database unit 231 transmits the network additional information 241 corresponding to the identification information 240 to the communication unit 230 of the mobile phone, and the CPU 6 adds the network additional information 241 to the processing target image.

(Modification 7) Frame extraction based on hue difference of double frame A frame used for a trimming sheet or a stamp sheet is configured by using two types of frames 250 having different colors on the inner side and the outer side.

  Specific processing will be described. As illustrated in FIG. 24, the CPU 6 generates a temporary work image having the same size as the captured image. Next, a pixel 251 having a hue difference between adjacent pixels equal to the hue difference between the inner and outer frames is examined in the right direction from the upper left corner of the image / video. When the corresponding pixel is extracted, the pixel of the temporary work image at the corresponding position is overwritten with black. When the survey for one line is completed, the right line is similarly investigated for the lower line. Similar processing is performed downward from the upper left corner of the image / video. After these processes, the boundary area between the two frames is written in the temporary work image. The CPU replaces the temporary work image with the trimming frame image and uses it.

(Modification 8) Frame is configured with a marker A frame used for a trimming sheet or a stamp sheet is configured using a visual marker 261 as shown in FIG. An identification number is assigned to a visual marker, and a frame can be easily extracted by connecting the extracted visual marker in the order of the identification number.

  In the example of FIG. 25, a visual marker 260 is used which is a combination of two concentric circles having different colors and sizes. The visual marker 260 is composed of two circles. The ratio of the radius of the large and small circles is 1: 2. The two circles 261 and 262 are concentric circles and are arranged so that their centers coincide. The two circles are filled with colors having different hues.

  In this visual marker, three colors of blue, red and yellow are used for filling. The correspondence between the combination of colors used for the marker and the identification number of the marker is as shown in the table of FIG.

  A process of extracting the visual marker from the trimming area or stamp image / video will be described. First, the CPU 6 replaces the value of the pixel having a hue value other than the fixed three colors with black from the captured image / video. Next, the captured image is examined in the right direction from the upper left corner point, and, for example, a region in which the color changes from red, blue, and red is extracted. At this time, the identification number of the extracted area can be extracted at the same time according to the table of FIG. In the case of this example, the extracted region is a part of a visual marker composed of a circle whose outer side is red and whose inner side is blue, and an identification number of 5 can be extracted.

  When the area that is a part of the visual marker is extracted, the CPU 6 writes the extracted identification number in the area. When the investigation of one line of the captured image is completed, the process moves to the lower line and the same investigation is performed. The same processing is performed downward from the upper left corner point. The pixel that is extracted in both the right direction and the downward direction and the overwritten identification number matches in both directions is assumed to be the region constituting the visual marker, the center of gravity of the region is extracted, and the visual marker Extract the position and identification number in the image.

  Finally, the CPU 6 connects the centers of gravity with lines in the order of the identification numbers assigned to the extracted visual markers, extracts the frames, and writes the frames in black in the trimming frame image. As shown in FIG. 25, a non-convex polygon or a frame that is a complex figure can be recognized.

(Variation 9) Using markers as control points When the frame is configured with visual markers, the frame is configured as a free closed curve as shown in FIG. 27 using a parameter curve technique such as a B-Spline curve or a Bezier curve. Yes (references: Sugihara Akiyoshi, Kyoritsu Publishing, graphics mathematics).

  Specific processing will be described. As shown in FIG. 28, additional information is acquired from the two-dimensional code, digital watermark, etc., the additional information is used as identification information 264, a frame is identified, and control information 265 for each vertex is obtained from the control point database means. get. As a result, it is possible to extract not only the polygonal region but also the region 263 having an arbitrary shape.

(Modification 10) Trimming / stamping by changing the processing target image In the above-described trimming processing and stamp addition processing, if the entire processing frame image does not fall within the angle of view of the captured video, Since the frame cannot be recognized, a part of the corner of the processing target image cannot be cut out. In view of this, the image processing can be performed by changing the size or the like of the processing target image to solve this problem.

  This will be specifically described. As shown in FIG. 29, the size of the processing target image is changed and displayed, and trimming or stamp imaging / video overlay display is performed. The user performs trimming processing or stamp addition processing in the same manner as in the first and second embodiments. As a result, even when the superimposed frame 267 protrudes from the processing target image 266, image processing such as trimming processing and stamp addition can be performed. In the case of trimming processing, as shown in FIG. A trimming region image 268 can be obtained.

(Modification 11) Only the frame is superimposed and displayed In the above-described trimming process, when the frame is extracted from the captured / video, only the extracted frame is superimposed on the processing target image instead of the captured / video. By switching to, the area to be trimmed is displayed more clearly.

  Specific processing will be described. As illustrated in FIG. 31, when the frame is extracted from the image / video, the CPU 6 stops the image / video superimposed display on the processing target image on the liquid crystal monitor. Next, a black pixel that is a frame region in the trimming frame image is extracted, and black is superimposed on the pixel at a position in the processing target image corresponding to the pixel (270).

(Modification 12) Displaying only the trimming area In the above-described trimming process, when the frame is extracted from the captured image / video, the trimming process result is displayed more clearly by switching to the display of only the trimming area. To do.

  Specific processing will be described. As illustrated in FIG. 32, when the frame is extracted, the CPU 6 stops the superimposed display of the captured video and the display of the processing target image on the liquid crystal monitor, and the extracted trimming area in the above embodiment. 280 is displayed on the liquid crystal monitor.

(Modification 13) Only a stamp is superimposed and displayed In the above-described stamp addition process, when a frame is extracted from an image / video, the stamp image extracted from the image / video is not the image / video to be processed. By switching so that the region in the processing target image corresponding to the inside of the frame is displayed in a superimposed manner, the region to be added with the stamp is displayed more clearly.

  Specific processing will be described. As illustrated in FIG. 33, when the frame is extracted, the CPU 6 stops the superimposed image / video display on the liquid crystal monitor, reads all pixels in the region 290 of the captured image surrounded by the frame, All the pixels are superimposed on the processing target image on the liquid crystal monitor.

(Modification 14) Display not only on printed matter but on display In the above-described embodiment, a trimming sheet or stamp sheet, which is a paper medium, is used. As shown in FIG. 34, this is displayed on a CRT display 300 or the like. The image is displayed using an image display means, picked up by a mobile phone, and configured to perform trimming processing and stamp addition processing.

  In the present invention, some or all of the processing functions of the image processing method according to the processing procedures shown in FIGS. 4 and 13 can be configured as a program and executed by a computer.

The apparatus structural example of the small information terminal which shows embodiment of this invention. 3 is a configuration example of a trimming frame in the embodiment. The example of the trimming sheet in embodiment. The trimming processing procedure in embodiment. The example of a display of the process target image in embodiment. The figure which shows the imaging | photography state of the trimming frame in embodiment. The figure which shows the adjustment state of the trimming frame in embodiment. The figure which shows the adjustment state of the trimming frame in embodiment. The figure which shows the process state of the trimming in embodiment. The figure which shows the example of a trimming image in embodiment. The example of the stamp image in embodiment. The structural example of the stamp sheet | seat in embodiment. The stamp addition processing procedure in the embodiment. The example of a display of the process target image in embodiment. The figure which shows the imaging | photography state of the stamp image in embodiment. The figure which shows the adjustment state of the stamp image in embodiment. The figure which shows the state which added the stamp image in embodiment. The example of the image which added the stamp image in embodiment. Explanatory drawing of the stamp image addition by the color extraction in embodiment. Explanatory drawing of the two-dimensional code addition in embodiment. Explanatory drawing of the metadata addition by the digital watermark in embodiment. Explanatory drawing of the character information addition in embodiment. The block diagram of acquiring additional information from the external network in embodiment. Explanatory drawing of frame extraction by the hue difference of the double frame in embodiment. Explanatory drawing which comprises the frame in embodiment with a marker. 6 is an example of a correspondence table of color combinations and marker identification numbers in the embodiment. The structural example of the frame which used the marker in embodiment as a control point. The example of the correspondence table of the additional information of a frame and marker control point in an embodiment. FIG. 6 is a state diagram of trimming in which a processing target image is changed in the embodiment. An example of a trimmed image obtained by changing a processing target image in the embodiment. The state diagram which switches and displays only the frame in embodiment. The state diagram which displays only the trimming area | region in embodiment. FIG. 6 is a state diagram in which only the stamp in the embodiment is switched and displayed in a superimposed manner. The example which displays the trimming frame in embodiment on a display.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Small information terminal 2 Internal memory 3 Liquid crystal monitor 4 Digital camera 5 Operation button 6 CPU

Claims (10)

A camera for obtaining an image / video of a thing, a monitor capable of displaying the image / video, an operation button for inputting a command, and an image processing means for performing image processing on the image using the camera, the monitor and the operation button as an input / output device A small information terminal equipped with
The image processing means includes
Display processing means for displaying imaging / video of things obtained from the camera or the like as a processing target image on the monitor;
A superimposed display processing unit that superimposes and displays a framed image obtained by photographing a framed thing with a frame on the processing target image;
Frame extraction processing means for extracting a frame of the framed image by operation of the operation button;
Processing means for processing the processing target image using the frame extracted by the extraction means or an image in the frame;
A compact information terminal characterized by comprising: A camera that obtains images / videos of things, a monitor that can display the images / videos, an operation button that can input commands, and an image such as trimming or adding a stamp to the image using the camera, monitor, and operation buttons as input / output devices A small information terminal comprising image processing means for processing,
The image processing means includes
Display processing means for displaying imaging / video of things obtained from the camera or the like as a processing target image on the monitor;
Superimposing display processing means for superimposing and displaying a framed image obtained by photographing the framed thing having a frame indicating the trimming or stamp addition area on the processing target image;
Adjustment processing means for changing the position, size, and inclination of the framed image with respect to the processing target image according to a change in the shooting position and posture of the framed thing by the camera,
After the adjustment by the adjustment processing unit, a frame extraction processing unit that extracts a frame of the framed image by operating the operation button;
Processing means for trimming the processing target image in the frame extracted by the extraction means, or adding a stamp image in the frame to the processing target image;
A compact information terminal characterized by comprising: A camera for obtaining an image / video of a thing, a monitor capable of displaying the image / video, an operation button for inputting a command, and an image processing means for performing image processing on the image using the camera, the monitor and the operation button as an input / output device An image processing method for a compact information terminal comprising:
The image processing means includes
Display processing step of displaying an image / video of an object obtained from the camera or the like as a processing target image on the monitor;
A superimposed display processing step of superimposing and displaying a framed image obtained by photographing a framed thing with a frame on the processing target image;
A frame extraction processing step of extracting a frame of the framed image by operation of the operation button;
A processing step for processing the processing target image using the frame extracted in the extraction step or an image in the frame;
An image processing method for a small information terminal characterized by comprising: A camera that obtains images / videos of things, a monitor that can display the images / videos, an operation button that can input commands, and an image such as trimming or adding a stamp to the image using the camera, monitor, and operation buttons as input / output devices An image processing method of a small information terminal comprising image processing means for performing processing,
The image processing means includes
Display processing step of displaying an image / video of an object obtained from the camera or the like as a processing target image on the monitor;
A superimposed display processing step of superimposing and displaying on the processing target image a framed image obtained by photographing the framed thing having a frame indicating the trimming or stamp addition region;
An adjustment process step of changing the position, size, and inclination of the framed image with respect to the processing target image in accordance with a change in the shooting position and orientation of the framed thing by the camera,
After the adjustment by the adjustment processing step, a frame extraction processing step of extracting a frame of the framed image by operating the operation button;
A processing step of trimming the processing target image in the frame extracted by the extraction step or adding a stamp image in the frame to the processing target image;
An image processing method for a small information terminal characterized by comprising: The frame extraction step includes:
A step of extracting a region composed of pixels having the specific color as a frame by using an image / video of the frame configured with the specific color;
A step of extracting a boundary area between the inner frame and the outer frame of the imaging / video as a frame by using imaging / video of a double frame having different colors on the inner side and the outer side;
A step of extracting a visual marker from the imaged / video using the image / video of a frame in which an extractable visual marker is arranged at each vertex, and extracting the frame using the visual marker as a vertex;
5. The image processing method for a small information terminal according to claim 3, comprising at least one of the following steps. The processing step includes
Extracting a region composed of pixels having a specific color from the imaging / video region surrounded by the frame and processing the region of the processing target image surrounded by the frame;
A step of painting a region of the processing target image surrounded by the frame with a specific color;
-Using the image / video of a frame having a figure with identification information embedded in the internal area, extracting the identification information from the area of the image / video surrounded by the frame, and identifying the additional information by the identification information Adding the additional information to the processing target image;
5. The image processing method for a small information terminal according to claim 3, comprising at least one of the following steps. The step of extracting the identification information includes
A step of reading characters from an imaging / video region surrounded by the frame to obtain identification information;
Using an image / video of a frame having a figure with a two-dimensional code embedded in an internal region, extracting the two-dimensional code and reading identification information;
Using an image / video of a frame having a figure in which a digital watermark is embedded in an internal area, extracting the digital watermark, and reading identification information;
The image processing method for a small information terminal according to claim 6, comprising at least one of the following steps. The step of identifying additional information by the identification information includes:
A step in which information about the frame is included in the identification information and the information is used as additional information;
A step of using information on the external network specified by the identification information as additional information;
The image processing method for a small information terminal according to claim 6, comprising at least one of the following steps. The frame image superimposed display step on the processing target image includes:
A step of switching to a superimposed display of only the frame on the processing target image;
A step of switching to a superimposed display of only the extracted in-frame image on the processing target image;
A step of switching to display only the processing target image surrounded by the frame;
5. The image processing method for a small information terminal according to claim 3, comprising at least one of the following steps. A program for an image processing method, wherein the processing procedure in the image processing method according to any one of claims 3 to 9 is configured to be executable by a computer.