CN1186991A - Image synthetic device, image synthetic method and medium used thereof - Google Patents
Image synthetic device, image synthetic method and medium used thereof Download PDFInfo
- Publication number
- CN1186991A CN1186991A CN97125957A CN97125957A CN1186991A CN 1186991 A CN1186991 A CN 1186991A CN 97125957 A CN97125957 A CN 97125957A CN 97125957 A CN97125957 A CN 97125957A CN 1186991 A CN1186991 A CN 1186991A
- Authority
- CN
- China
- Prior art keywords
- image
- mentioned
- information
- unit
- additional
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Image Processing (AREA)
- Processing Or Creating Images (AREA)
Abstract
A device for image composition and medium equipped with an outline extracting function which can extract images of respective object bodies independently only by placing the object bodies on a display and giving one closed curve including all the bodies. An image constituting device equipped with a camera which picks up an image of a document where information is entered, an indication position detection part which detects a position indicated on the document with a pen, etc., an indication information detection part which detects the feature quantity of indication information entered at the indication position, an additional image generation part which generates an image decorating the indication information according to the feature quantity of the indication information, an additional image generation part which stores the generated additional image, a determination part for an information adding method by the indication position which determines the adding method for the information according to the indication position, and an image composition part which puts the video of the camera and the additional image together generates a proper additional image according to the indication position of the pen.
Description
The present invention relates to can be used for image synthesizer, image synthesizing method and medium used thereof thereof in the forming device of composite image of the hypothesis object in actual object and the computing machine.
The flat 9-6798 document of TOHKEMY once disclosed a kind of " information processing method and equipment therefor ", this information processing method and equipment therefor are used as following system, it synthesizes the information relevant with above-mentioned actual object on the video of camera with stacked system by being additional to coloud coding on the actual object to being distinguished by this actual object of camera again.
If above-mentioned existing apparatus is placed the gamma camera that becomes integral body with monitor, and writes the drawing that is added with coloud coding, then can realize following information providing system, at this information providing system the explanation relevant with this drawing is shown in the monitor.
In addition, carry out interactional system, reach at " Procceedings ofUIST ' 91; ACM, pp.27-33 " in " Communications of the ACM, vol 36; no.7, pp.86-96,1993 " and disclose " Digital Desk " as hypothesis object and actual object.
In the said system, above device, camera and projector are set.So, go up information according to the paper that is written on device (actual object), be scopes such as the numerical value row that extract of image or drawing by a finger or an assigned operation personnel work done in the manner of a certain author, just can extract the image of this numerical value row etc. automatically.On the other hand, make another render image (supposing object) of being stored by system as in advance, the image of desk-type small computing machine etc. pass through the projector projection on the other paper (actual object) of device.Thus, the image of above-mentioned desk-top computer and the numerical value row image of above-mentioned extraction are synthesized, and projection is on same paper.This projection image has composite image described as follows, and the key of the desk-type small computing machine that is projected by operation is operated, and imports above-mentioned numerical value row, and this composite image represents to have the state that seems to show above-mentioned numerical value row.Said system can be in the manner described above as the image of actual object and the image synthesizer of the image of hypothesis object.
In addition, " Procceedings of CHI ' 92, ACM, pp.587-592 " document proposes, and at the place, part of device tablet is set, so that also carry out high-precision indication by finger.
Though above-mentioned existing information processing method and equipment therefor thereof are pointed out: can distinguish actual object by coloud coding, show the presentation of information relevant by stacked system with it, but there is following problem in said apparatus, promptly can not be from operating personnel's appointed positions, actual objects such as actual relatively book class, automatically take out the image of required information, this taking-up image and the image of hypothesis object can not be processed jointly and shown.
Also promptly, in above-mentioned existing system, operating personnel can not extract the information needed image automatically from actual object, thereby have following problem, and the actual object and the hypothesis object that promptly can not form storage in advance make up formed composite image.
According to existing systems, can not be by finger or pen input, in the object that extracts as image, specify the suitable fundamental region of quantity with described object or information, so can not distinguish the image that extracts a plurality of objects individually.So, can produce following problems, promptly under the more situation of the number of the object quantity or the image of handling, the object designated treatment that work done in the manner of a certain author is extracted out for image can cause bigger burden to the operating personnel of this device.
Consider the problem of above-mentioned existing apparatus, the object of the present invention is to provide a kind of image synthesizer, image synthesizing method and used medium thereof, show actual object and the image synthesizer of supposing problem as adopting the suspension type photography camera to be applied to, such as in the information that is recorded in the book class, with the required message part of emphasizing of indications such as indicator stem, can automatically detect above-mentioned information, described information refers to the information area that operating personnel intend emphasizing, or its information of intending emphasizing is literal, or photo, can automatically carry out underscore in addition or add netting twine etc., the decoration with its information characteristics is handled.
In addition, consider the problems referred to above in the above-mentioned existing system, another object of the present invention is to provide a kind of image synthesizer, image synthesizing method and medium used thereof, described image synthesizer comprises taking-up profile function, this extraction profile function is to be put on the display by intending extracting a plurality of objects of extracting out, surrounds all modes of the closed curve of these objects only to provide 1, takes out corresponding object respectively.
To achieve these goals, claim 1 is described to the present invention relates to following image synthesizer, it is characterized in that this image synthesizer comprises: given photographic unit; Indicating positions testing agency is used for from the image of photographic unit shooting, and the indication information position that provides on the face to display message is detected; Denoted object information testing agency is used to detect and provides the detected indicating positions of above-mentioned indicating positions testing agency accordingly, is shown in the characteristic quantity of the information of the zone of the denoted object information on described and/or its denoted object; The appended drawings pictograph becomes mechanism, is used for making an addition on the image of above-mentioned denoted object information according to above-mentioned zone and/or characteristic quantity, the additional image of formation; The image combination mechanism, it synthesizes the image and the formed described additional image of the above-mentioned denoted object information of above-mentioned photographic unit gained.
Have, claim 17 is described to the present invention relates to following image synthesizer, it is characterized in that this image synthesizer comprises: the monoblock type display that input shows again; Photographic unit, this photographic unit are used for display part at least a portion of aforementioned display device is taken; Closed curve information testing agency is used to detect closed curve information, and described closed curve surrounds following a plurality of object, and the image that these objects can constitute in a plurality of actual objects that are placed on the aforementioned display device extracts the object candidate; Extraction mechanism respectively is used for the closed curve information measured according to above-mentioned, and the above-mentioned picture information of surrounding a plurality of objects of taking by photographic unit, from the image of a plurality of objects of above-mentioned encirclement, extracts the image of corresponding object respectively; The appended drawings pictograph becomes the unit, and by the above-mentioned image of extracting out respectively, the appended drawings pictograph becomes to be shown in the aforementioned display device; The display packing selected cell is used for selecting the display packing of above-mentioned formed additional image at display; The image combination mechanism is used for the display packing according to above-mentioned selection, and the image of above-mentioned additional image and above-mentioned actual object is synthesized.
In addition, the described image synthesizer that the present invention relates to of claim 18 is characterized in that this image synthesizer comprises: input shows the monoblock type display; Camera, at least a portion shooting that is used to take the aforementioned display device display unit; Closed curve information testing agency is used to detect closed curve information, and this closed curve surrounds following a plurality of object, and the image that these objects can constitute in a plurality of actual objects that are placed on the aforementioned display device extracts the object candidate; Extraction mechanism respectively is used for the closed curve information measured according to above-mentioned, and the above-mentioned picture information of surrounding a plurality of objects by camera, from the image of a plurality of objects of above-mentioned encirclement, extracts the image of corresponding object respectively; The appended drawings pictograph becomes the unit, is used for forming additional image and being shown in the aforementioned display device by the above-mentioned image of extraction respectively; The display packing selected cell is used for selecting the display packing of the additional image of above-mentioned formation at display; Control module is used for the display packing according to above-mentioned selection,, takes at the actual object that is positioned on the aforementioned display device being shown in the additional image in the aforementioned display device by camera.
The described image synthesizer that the present invention relates to of claim 19 is characterized in that this image synthesizer comprises: the monoblock type display that input shows; Photographic unit, at least a portion that is used to take the aforementioned display device display part is taken; The indicating positions detecting unit is used to detect with indicating positions information and indicates the actual object that is placed on the aforementioned display device; The actual object extraction mechanism is used for the indicating positions information measured according to above-mentioned, extracts the image of described actual object from the image that described photographic unit is taken; The appended drawings pictograph becomes the unit, is used for the image by said extracted, forms additional image, is shown in the aforementioned display device; The display packing selected cell is used for selecting the display packing of the additional image of above-mentioned formation at display; The image combination mechanism is used for the display packing according to above-mentioned selection, and the image of above-mentioned additional image and above-mentioned actual object is synthesized.
In addition, claim 27 is described to the present invention relates to following image synthesizing method, it is characterized in that this method comprises the steps: to take information and/or a plurality of object that is shown on the predetermined surface; The closed curve of following a plurality of extraction object candidates is provided, and described a plurality of extraction object candidates constitute the candidate of the image extraction object in above-mentioned photographing information and/or a plurality of actual object; The above-mentioned closed curve information that provides is provided; According to the above-mentioned closed curve of measuring with extract the picture information of object candidate, from the image of a plurality of extraction object candidates of above-mentioned encirclement, take out the corresponding image that extracts the object candidate respectively; By the above-mentioned image that extracts respectively, carry out image and synthesize.
Embodiment to structure of the present invention is described with reference to the accompanying drawings.
Fig. 1 is the block diagram of the present invention the 1st embodiment;
Fig. 2 is the action step process flow diagram of the present invention the 1st embodiment;
Fig. 3 is the synoptic diagram of the book class example in expression the foregoing description;
Fig. 4 is the synoptic diagram of the example that looks like to decorate with painting on picture frame in expression the foregoing description;
Fig. 5 detects the synoptic diagram of indicating positions and indicating area example for the pen type indicating mechanism of expression the foregoing description;
The synoptic diagram that Fig. 6 decorates example for the character area and the photo zone of the pen type indicating mechanism of expression the foregoing description;
Fig. 7 shows the synoptic diagram of transform method example for the existing decorative zones of the pen type indicating mechanism of expression the foregoing description;
Fig. 8 is the block diagram of the present invention the 2nd embodiment;
Fig. 9 is the action step process flow diagram of the present invention the 2nd embodiment;
The a plurality of markers that are provided with in the pen type indicating mechanism of Figure 10 for expression the foregoing description and the synoptic diagram of installation method example thereof;
Figure 11 decorates the synoptic diagram of example with the identification of mark kind for expression in the foregoing description;
Figure 12 is the block diagram of the present invention the 3rd embodiment;
Figure 13 is the action step process flow diagram of the present invention the 3rd embodiment;
Figure 14 has the synoptic diagram of decoration painting as the display packing example now in the foregoing description;
Figure 15 has the synoptic diagram of decoration painting as the system of selection example now in the foregoing description;
Figure 16 has the synoptic diagram of decoration painting as the clone method example now in the foregoing description;
Figure 17 is the block diagram of the present invention the 4th embodiment;
Figure 18 is the action step process flow diagram of the present invention the 4th embodiment;
Figure 19 is for carrying out the synoptic diagram of the example that book class moving parameter infers in the foregoing description by the template manner of comparison;
Figure 20 is the block diagram of the present invention the 5th embodiment;
Figure 21 is the action step process flow diagram of the present invention the 5th embodiment;
Figure 22 decorates the synoptic diagram of example in the foregoing description so that mark to be set;
Figure 23 is for cancelling the synoptic diagram of decoration painting as example so that the mark removing method to be set in the foregoing description;
Figure 24 is the block diagram of the present invention the 6th embodiment;
Figure 25 is the action step process flow diagram of the present invention the 6th embodiment;
Figure 26 use indicating mechanism for being provided with in the foregoing description, the synoptic diagram of the regional example of detection indication information that book class degree of tilt is revised;
Figure 27 is the block diagram of the present invention the 7th embodiment;
Figure 28 is the action step process flow diagram of the present invention the 7th embodiment;
Figure 29 is the block diagram of the present invention the 8th embodiment;
Figure 30 is the action step process flow diagram of the present invention the 8th embodiment;
Figure 31 is the synoptic diagram of the decorative zones indicating means example that the hook-type mark carries out in the foregoing description;
Figure 32 is the synoptic diagram of the hook-type mark example in the foregoing description;
Figure 33 is the synoptic diagram of the ornamental knot fruit example of carrying out with the hook-type mark in the foregoing description;
Figure 34 is the block diagram of the present invention the 9th embodiment;
Figure 35 is the action step process flow diagram of the present invention the 9th embodiment;
Figure 36 is the block scheme of the present invention the 10th embodiment;
Figure 37 is the block scheme of the present invention the 11st embodiment;
Figure 38 is the block diagram of the present invention the 12nd embodiment;
Figure 39 is the action step process flow diagram of the present invention the 12nd embodiment;
Figure 40 is the synoptic diagram that the actual object example is set in the foregoing description on display;
The example schematic of Figure 41 for by the pen input actual object being selected in the foregoing description;
Figure 42 is that the actual object in the foregoing description takes out the synoptic diagram of example as a result;
Figure 43 is by getting the example schematic that actual object is decorated in the foregoing description;
Figure 44 is with an example schematic that the input mode information of carrying out is charged in the foregoing description;
Figure 45 is the block scheme that extracts actual object part 30 concrete structures in the foregoing description;
Figure 46 is the process flow diagram that extracts the actual object step in the foregoing description;
Figure 47 is the example schematic that the skeleton pattern of the foregoing description intersects;
Figure 48 is the block diagram of the present invention the 13rd embodiment;
Figure 49 is the block diagram of the present invention the 14th embodiment;
Figure 50 is the block diagram of the present invention the 15th embodiment.
The 1st embodiment
Fig. 1 is the structural drawing of image synthesizer the 1st embodiment of the present invention.
The camera that label 1 expression among Fig. 1 is taken the book class of the information of recording is preferably the colored CCD camera, the indicating positions detecting unit that label 2 expressions are detected by the indicating positions of 1 pair of pen 100 of camera on the book class.Label 3 expressions detect the indication information detecting unit of note indication information zone, above-mentioned indicating positions place and characteristic quantity.Label 4 expression appended drawings pictographs become the unit, and it can form the additional image corresponding with the indication information characteristic quantity that is detected.The additional visual additional image storage unit that label 5 expression storages are formed by additional image formation department 5.Label 6 expression indicating positions out of Memory addition method determining units, it can determine the synthetic display packing of above-mentioned additional image according to above-mentioned detected indicating positions.The visual synthesis unit that label 7 expression is synthesized video and the above-mentioned additional image in the camera 1, label 8 expressions show the display unit of the image usefulness of being synthesized by visual synthesis unit 7, are preferably projector or display.
In addition, preferably be provided with in the pen 100 and be easy to indicating positions is detected, and have the indicator mark 100a of regulation rgb value, and indicating positions detects beginning switch 100b.The control module that label 1000 expression is made of storeies such as common ROM or RAM and CPU, the part represented with above-mentioned label 1～8 is connected, and controls the action of each several part and the exchanges data between each part.Here, pen 100, parts such as mark 100a are corresponding with indicating mechanism of the present invention, and indication information test section 3 is corresponding with denoted object information of the present invention testing agency.
The action of present embodiment is described below, and describes an embodiment of image synthesizing method of the present invention.
Fig. 2 is the course of work process flow diagram of present embodiment image synthesizer.
For the course of work of present embodiment is described in understandable mode, be described being provided with example of the present invention in formula * * (overhead) camera here.The suspension type camera generally is used for the teaching materials or the demonstration of university.As shown in Figure 3, at this moment be on paper or book class, to write literal, perhaps show photo or actual three-dimensional object.The situation that this situation in statu quo is shown in the video of being taken by camera 1 in the display unit 8 such as display monitor central monitoring system is suitable.
In the manner described above, present embodiment can be used as the device of auxiliary teaching materials etc., the places such as position that hope is emphasized in teaching materials, can be according to the zone or the feature of the indicating positions with pen or the denoted object information (" denoted object information " being abbreviated as " indication information ") of denoted object at this instructions, form various additional images (supposing object), this additional image is synthetic with the video in the camera, book class etc. such as is decorated at operation.
According to the foregoing description, aspect the routine use of writing surplus on blank sheet of paper, the mode of charging to the part in the part by wishing with pen 100 indications to emphasize detects the zone that this charges to part.Below following embodiment is described, and when the control with the corresponding additional image of indicating positions of pen 100 is described, the action step of present embodiment is described, present embodiment refers in particular to the above-mentioned information characteristics amount of charging to part is detected, this is charged to part is that the partial information feature of charging to of literal or photo is judged, carries out and the matched decoration of this feature in this charges to the image of part.
Obtaining of step 1a image:
By camera with book class shown in Figure 3 and indicator stem 100 take for visual l (x, y).
Step 2a indicating positions detects the state-detection of beginning switch:
When indicating positions detection beginning switch 100b closed, the resulting image of step 8a that will be described by the back was shown in the display unit 8.When above-mentioned switch 100b opens, carry out step 3a.
The detection of the indicating positions of mark 100a of step 3a pen:
(x y), detects following zone as indicating positions, this zone refers to the to have specified color zone of given size of (rgb value of the specialized range that mark 100a is had) from visual l by indicating positions test section 2.
Such as, with regard to each pixel l (x, y), whether detection meets the specialized range rgb value of expressive notation color (under the red partially situation of mark in order, such as relation) by 180＜R＜255 and 120＜G＜140 and 60＜B＜120, when the color of mark, be the zone of the given size at center with its pixel, extract the pixel of rgb value out with expressive notation color assignment scope.Calculating comprises the bounding rectangle of whole extraction pixels, if this rectangle is a given size, then is judged to be mark, indicating positions be in mark center (mx, my).Under situation about mark not being detected, carry out step 7a.
Determining of the information addition method of step 4a indicating positions:
Here, carry out near judging whether to indicate visual end, be at indicating positions under the situation of image (book class) end, such as when dimension of picture for long * wide: in the time of 480 * 640, and (mx my) satisfies mx＜30 at the indicator center, my＜30,610＜mx when any one among 450＜my concerns, selects image in step 4a-1.
The selection of step 4a-1 frame image:
Additional visual storage part 5 at least one frame image of storage, this comprises people's the post of demonstration or the time of lecture, when instruction class end, as shown in Figure 4, by visual synthesis unit 7 with the frame image on the video of camera 1, and it is shown in the display unit 8.Under the situation that has a plurality of frame images, when instruction class end, select different images.Thus, can when forming normal page (OHPsheet), show post, time or the frame that is provided, can provide foregoing in the above-mentioned position of the paper of not writing usually simultaneously.
Determining of the information addition method of step 5a indicating positions:
Here, whether the information without decorating that judges whether to indicate indicates, if indication is arranged, by near the indication information detecting unit 3 detection indicator centers whether black pixel being arranged.Having under the situation of black pixel, information such as storage literal are calculated its characteristic quantity by step 5a-1, form and storage and the corresponding decorative image of this characteristic quantity by step 5a-2.
The calculating of step 5a-1 denoted object information area and characteristic quantity:
At first, calculate the denoted object information area by indication information test section 3.(mx is provided with mark in the black pixel in specialized range my) being positioned at relative indicator center.In being arranged, each black pixel of above-mentioned mark mark is set in the mode of returning again.If there is not the black pixel of tape label, the then setting of end mark.
As shown in Figure 5, under such as situation, if corresponding minimum value, the maximal value in the pixel x coordinate y coordinate of mark is made as xl according to the mode display string parallel with the x axle, xr, yr, then rectangle (xl, yl)-(xr yr) is the denoted object information area.
Calculate to be used for distinguishing to be to belong to character string below, still belong to the characteristic quantity of photo, such as the shared ratio of white (rgb value of given range) pixel in the whole pixels in the indicating area.In the indicating area is that white pixel is less under the situation of photo.Relative therewith, under the situation that is character string, because black picture element and white pixel Alternation Display, so, to compare with the zone of photo, the white pixel proportion is bigger.Therefore, if the ratio that white pixel is occupied then is the photo zone less than the ultimate value of regulation,, then be judged to be the zone of character string if greater than above-mentioned ultimate value.
The formation of step 5a-2 decorative image and storage:
Utilize additional image formation department 4,, form and decorate with additional image according to zone of in step 5a-1, calculating and characteristic quantity thereof.
Such as, owing to emphasize the photo zone, be not easy to see clearly in the mode that adds reticulate pattern, so the comparison film zone forms fringing, character string is then emphasized to add the shading mode.Form in the following manner and add the shading image, promptly by in the detected indicating area of step 5a-1, the rgb value of pixel that will be except that black is replaced into the rgb value of specified color.Fig. 6 represents white pixel proportion in the indicating area less than the situation that formed photo at 15% o'clock, and aforementioned proportion is greater than the decoration result who formed the character string situation at 15% o'clock.In addition, the area stores through decorating is in existing decorative zones.
Determining of the information addition method of step 6a indicating positions:
Whether the indicating positions of judging pen 100 is arranged in the existing decorative zones that step 5a-2 is stored, as if judging the existing decorative zones of indication, then by step 7a, according to the display packing of its position change decoration.In addition, carry out step 1a.
The change of the existing decorative zones display packing of step 7a:
As shown in Figure 7, another information addition method determining unit 6 of indicating positions changes display packing in the following manner, be about to existing decorative zones 700 and be divided into a plurality of zones (in Fig. 7, comprise front portion 701 and rear portion 702), such as indication front portion 701, then eliminate its decoration, if indication rear portion 702, then it decorates flicker, itself and video in the camera 1 is synthesized, and be shown in the display unit 8.
In addition,, carry out step 7a, at this moment, stop to show all additional images in step 3a, not detecting in the manner described above under the situation of mark 100a.Thus, can temporarily eliminate all additional image by following manner, promptly once more before beginning to write literal on the different paper, outside the visual field of camera by starting writing 100 switch 100b.
Synthetic and the demonstration of step 8a image:
Above-described situation is, according to order described in step 1a～step 8a, realize the 1st embodiment, the people who then demonstrates indicates the part that will emphasize in my institute's write information with indicator stem, automatically take out the feature of this part, the decoration that stack afterwards is fit to is with visual.
Therefore, need not conversion and use versicolor pen respectively.In addition owing to can carry out simple conversion to trailing according to the indicating positions of pen, if near the end of indication such as the book class, frame, post or time etc. then are provided automatically, or in the message part of having decorated, remove decoration by its indicating positions, or make this decoration flicker, like this, even be not pre-formed the data of demonstration usefulness, still can effectively demonstrate.
In addition, in the above-mentioned steps, be to form additional image according to the denoted object zone of indicating positions or the characteristic quantity that are positioned at pen etc., but also can only synthesize and demonstration following image by modes such as stacks, this image refers to be stored in advance the images such as " arrows " that pen waits the indicating positions place.Aforesaid way is very effective for following situation etc., promptly such as in processes such as English teaching, textbook is positioned over suspension type camera place, the stress position of indication English word, perhaps in video conference or computer conferencing process, the local or current situations such as part that will illustrate of indicating data or model etc. at hand to emphasize separately.
In above-mentioned steps, (x y), also can only open and carry out digitized processing when indicating positions detector switch 100b though illustrate visual l with common digitizing example.
The 2nd embodiment
The following describes the 2nd embodiment of image synthesizer of the present invention.
In the 1st embodiment, the trailing of character string and photo respectively has only a kind, but the 2nd embodiment conceives in the following manner, promptly adopts multiple trailing more simply.
Fig. 8 is the structural drawing of the 2nd embodiment, and in the present embodiment, the structure division identical with the 1st embodiment shown in Figure 1 adopts identical label, so omit specifying them.
The main difference point of the 2nd embodiment and the 1st embodiment is: the kind that replaces indicating positions test sections 2 to be used to discern offering a plurality of marks of pen etc. with mark kind and indicating positions judging unit 9, become unit 10 to replace additional image formation department 4 with the corresponding appended drawings pictograph of isolabeling not, be used to form the additional image that changes along with the difference of indicator kind.Here, mark kind and indicating positions judging unit 9 is corresponding with indicating positions of the present invention testing agency, and the corresponding appended drawings pictograph of isolabeling does not become unit 10 to become mechanism corresponding with appended drawings pictograph of the present invention.
The action of the 2nd embodiment image synthesizer that constitutes in the above described manner below by the flowchart text of Fig. 9 is carried out.But, because Fig. 2 process flow diagram Fig. 9 of expression the 1st embodiment action has increased new step relatively, so step 5b and step 7b only are described here to different step 3b.
In the present embodiment, following example is described, this example constitutes in the following manner, promptly as shown in figure 10, the indicator stem front end is provided with these 4 kinds of marks of 100a-1～100a-4, whether the instruction class is carried out in one of being identified in these 4 kinds of marks of 100a-1～100a-4 according to the video in the camera 1, can use multiple trailing very simply.
The judgement of step 3b marker color:
By mark kind and indicating positions judging unit 9, judge to offer pen 100, towards the color of the indicator of camera 1.
Specifically, visual l (x, y) in, to the color of every kind of appointment (in the present embodiment, comprise redness and cyan that mark shown in Figure 10 has) quantity of calculating pixel, and the color that will have a plurality of pixels is confirmed as towards the pen of camera 1 color with mark.Such as, detect the quantity of red pixel and the quantity of cyan pixel here, relatively the size of these pixel numbers.Thus, can judge more neatly mistake not occur, even, will think that the more color of pixel number is judged to be the color of the indicator that is used to indicate because, detect simultaneously under the situation of 2 kinds of colors in that some pens 100 are arranged.
The judgement of step 5b indicator kind:
By mark kind indicating positions judging part 9, judgement be add shading with mark (100a-1,100a-2), still underscore usefulness mark (100a-3,100a-4).
Specifically, calculate the pixel number of the specified color that marked region had on the pen 100 that records by step 4b.Because adding shading compares with mark with underscore with mark, the pixel number of specified color is less among the former, and like this, it is to belong to any mark that ultimate value according to the rules can be judged.In addition, the specified color pixel number that marked region had is the pixel number of the specified color judged by step 3b.
Step 7a2 forms decorative image according to the digit synbol kind:
The isolabeling mark kind that do not become unit 10 to judge corresponding to the appended drawings pictograph according to step 5b, and, form decorative image by the characteristic quantity of step 7b1 gained.Such as, Figure 11 represents following example, its denoted object information is under the character string situation, the decorative image of red shading (the mark 100a-1 among Figure 11) and cyan underscore (the mark 100a-4 among Figure 11).In addition, be under the situation of photo in denoted object information, only change the color of fringing.
According to the structure of above-mentioned the 2nd embodiment, owing to, can save the time of charging to by the pen of the multiple color of conversion like this, thereby can successfully demonstrate by carrying out identification mode and change trailing to offering pen multiple marks such as 100.
The 3rd embodiment
The following describes the 3rd embodiment of image synthesizer of the present invention.
The 3rd embodiment conceives in the following manner, and promptly relative the 1st, the 2nd embodiment also reuses established existing decoration with image in mode such as duplicate.
Figure 12 is the structural drawing of the 3rd embodiment.Structure division identical with the 1st embodiment shown in Figure 1 in the present embodiment adopts identical label, so omit specifying them.
The main difference point of the 3rd embodiment and the 1st embodiment is: also additional existing additional visual copied cells 11, the video that it will be stored in existing decorative image complete list and camera 1 in the additional image storage unit 5 synthesizes and shows it, by pen 100 grades it is selected, afterwards that it is synthetic and be shown in another indicating positions on the book class.
The course of work of the image synthesizer of the 3rd embodiment that constitutes in the manner described above below by the flowchart text of Figure 13.
As shown in figure 13, because the course of action of the 3rd embodiment is to have inserted step 1c～step 3c between step 3a in the 1st embodiment operation program and the step 4a, so only this insertion portion is described here.
The demonstration of the existing decorative image complete list of step 1c:
At first,, form such as 1 ornamental image, then shown in upper left among Figure 14, will be provided with in the video that the title that is called " complete list " is shown in camera 1 with stacked system by additional image formation department 4 if so far.
Then, if the indicating positions that records according to the mode identical with the step 3a of the 1st embodiment is positioned at this zone, then as shown in figure 14, to be added with the image of shading " 3. press Schizoid skeleton pattern take out actual object " with stacked system, be shown in the video of camera 1 with " the 4. prototype system function " image that indicates underscore.
The selection of the existing decorative image of step 2c:
As shown in figure 15, in the existing decorative image that shows in the complete list mode by step 1c,, select to be positioned at the existing image at this indicating positions place according to the indicating positions of the mode detecting pen 100 identical with step 3a among the 1st embodiment.
Duplicating of the existing decorative image of step 3c:
As shown in figure 16, will be shown in the indicating positions of the pen 100 that detects in the mode identical with stacked system by the selected image of step 2c with step 3a among the 1st embodiment.
By above-mentioned steps, then show existing decorative image owing to implement the mode that the 3rd embodiment can complete list, and with it to duplicate by the mode of indications such as pen, even like this under the situation of using many book classes, still can in the book class, write identical character string, thereby can more successfully demonstrate with any degree.
The 4th embodiment
The following describes the 4th embodiment of image synthesizer of the present invention.
The 1st～3 embodiment contrasts under the situation that camera is maintained fixed at the book class to describe, even but the 4th embodiment then is according to writing in the book class, under the situation that the book class moves relative to its original position, existing decorative image is superimposed on correct position along with moving of book class.
Figure 17 is the structural drawing of the 4th embodiment, and structure division identical with the 1st embodiment shown in Figure 1 among this embodiment uses identical label, so omit specifying in detail them here.
The main difference point of the 4th embodiment and the 1st embodiment is: also additional moving parameter is inferred portion 12 and is used to infer book class shift position, and it makes existing decorative image distortion by the moving parameter of inferring additional visual variant part 13.
The course of work of the 4th embodiment image synthesizer that constitutes in a manner described below with reference to the process flow diagram of Figure 18.The action of the 4th embodiment is to insert following step 1d～step 4d between the step 1a of the 1st embodiment action and step 2a.
Step 1d has or not existing ornamental area:
With reference to additional image formation department 5, have under the occasion of existing decorative image, above-mentioned moving parameter is inferred portion 12 and is carried out step 2d, if not existing decorative image, the above-mentioned portion 12 of inferring carries out step 2a.
Step 2d selects partial images from existing decorative image
For from having now the decorative image arbitrarily, realize the stack between two images continuous in time, select zonule shown in Figure 19 as template.
In addition, above-mentioned two images continuous in time are the image in the moment before and after described book class moves, and this is taken by camera 1.
The comparison of step 3d partial images:
And carry out template between two images continuous in time when meeting, calculate moving parameter.Because it mainly is the parallel (xd of moving that book class in this case moves, yd) with the θ that rotatablely moves, such as template in 0＜θ＜360 °, (xd, yd) motion between the ∈ R (the searching scope R of regulation :) with reference to Figure 19, with the quadratic sum of the difference of brightness value is minimum θ, and (xd is yd) as moving parameter.
The distortion of step 4d decorative image:
By the moving parameter that step 3d calculates, make whole anamorphoses of being deposited in the additional image formation department 5.
According to above-mentioned the 4th embodiment, between continuous frame, carry out template relatively by the part decorative image, thereby the moving parameter of calculated description class makes decorative image distortion, even then under the situation that the book class moves in presentation process, still can correctly decorate the part of being emphasized.
The 5th embodiment
The following describes the 5th embodiment of image synthesizer of the present invention.
The 1st embodiment refers to the part of being emphasized by each places of appointment such as pens, decorates in order to delete it, and this is identical with the situation of decorating, and indicates this part.The design of the 5th embodiment is, promptly carries out emphasizing or deleting of multiple spot in mode more simply and intuitively.
Figure 20 is the structural drawing of the 5th embodiment, and in the present embodiment, the structure division identical with the 1st embodiment shown in Figure 1 uses same numeral, so omit specifying them here.
The main difference point of the 5th embodiment and the 1st embodiment is: except pen type indicating mechanisms such as pen 100, also adopt to be provided with indicating mechanism 200, be used to indicate the part of decorating in the mode that places on the book class; Adopt a plurality of different indicating mechanisms position detection part 14 to replace indicating positions detecting unit 2, be used for a plurality of different indicating mechanisms are detected; Adopt the corresponding indication information detecting unit of following a plurality of different indicating mechanisms 15 to replace indicating positions detecting units 2, this detecting unit 15 is used for according to the species detection of indicating mechanism information area or the characteristic quantity by indicating mechanism's indication; The corresponding appended drawings pictograph of a plurality of different indicating mechanisms in addition becomes unit 16 to replace the appended drawings pictograph to become unit 4, in order to form different additional images according to indicating mechanism's kind.At this, indicating mechanism of the present invention comprises pen 100 indicating mechanisms such as pen type such as grade and the mechanism that uses indicating mechanism 200 is set.In addition, the pen 100 grades pen type indicating mechanism or be provided with indicating mechanism 200 corresponding with indicating device of the present invention respectively.In addition, a plurality of different indicating mechanisms indicating positions test section 14 is corresponding with indicating positions of the present invention testing agency, and the corresponding indication information detecting unit 15 of a plurality of different indicating mechanisms is corresponding with denoted object information of the present invention testing agency.Also have, the corresponding appended drawings pictograph of a plurality of different indicating mechanisms becomes unit 16 to become mechanism corresponding with appended drawings pictograph of the present invention.
The course of work of the 5th embodiment image synthesizer that constitutes in a manner described below with reference to the flowchart text of Figure 21.The step 2e different with the action of the 1st embodiment, step 2e1, step 2e2, step 8e only are described here.Here, adopt following example explanation to be provided with indicating mechanism 200, this example adopts the different yellow mark of indicator with the pen 100 with front the 1st, the 2nd embodiment explanation.As shown in figure 22, be according to mode shown in the 2nd embodiment here equally, be provided with following example explanation and use indicating mechanism, this example has adopted and has added shading mark 200a and underscore these two kinds of indicators of mark 200b.Here, can realize this two kinds of mark 200a simply by following manner, 200b is promptly forming different form shown in Figure 22 such as the circular object surface that is formed by glass or plastic or other material, resemble coin or the button by modes such as printings.In addition, also can form above-mentioned indicator simply by following layered component, the inside surface of these parts constitutes stickup face, and its outside surface is printed with the form different with Figure 22.In addition, go back the above-mentioned layered component of Pasting on the plain color surface of the object of above-mentioned button-shape.
Step 2e is provided with the detection with indicating mechanism:
By a plurality of different indicating mechanisms position detection unit 14, visual l (the x that obtains from the step 1a of the 1st embodiment, y) in, according to the mode identical with step 3a, to have regulation is provided with marker color (in the rgb value of specialized range, here such as being yellow 180＜R＜255, and 180＜G＜255, and 60＜B＜120) the zone of given size detect as being provided with mark.But, because operated by rotary motion has a plurality of establishing to use indicator, so extract the zone of the given size that all has specified color out.
With upper left (xl (i), the yl (i)) of its bounding rectangle, and set of vertices (xl (i), yl (i))-(xr (i), the yr (i)) of bottom right (xr (i), yr (i)) storage is provided with the position with mark.But, the quantity of label j expressive notation.In addition,, can discern and add shading usefulness, and underscore is with these two kinds of mark 200a, 200b according to the pixel number of the specified color that is contained in the zone.
Step 2e-1 calculates indicating area and characteristic quantity according to being provided with indicating mechanism:
As shown in figure 22, by the corresponding indication information detecting unit 16 of a plurality of different indicating mechanisms, seek rectangular region (xr (i), yl (i))-(image width with detected mark position adjacency, yr (i)) black picture element that has maximum x coordinate in, with this x coordinate as xmax (i).At this moment, carry out, under the black situation that does not detect between specified length, stop seeking though seek each y coordinate along the x direction of principal axis.Thus,
*Even form information departing from the vestige place that charges to part that book class stain or hope emphasizes, do not attain that mistake is got and with these information yet.Here, rectangle (xr (i), yl (i))-(xmax (i), yr (i) constitutes indicated zone.
Then,, judge that the indicating area is a literal by the mode identical with the step 5a of the 1st embodiment, or photo.
Step 2e-2 is provided with the formation with additional image with indicating mechanism:
According to the 1st embodiment in the identical mode of step 5a-2, according to zone of calculating and characteristic quantity by step 1e-1, form add shading with or the additional image used of underscore.
Step 8e:
Because in step 1e, be according to the rules the time interval obtain visual l (x, y), so the image of image synthesising part 7 renewable display parts 8 shows.At this moment, the usefulness mark position is corresponding with being provided with, synthetic once more additional image.Thus, if removing to be provided with by mode shown in Figure 23 uses mark, then since synthetic once more additional image decorate thereby remove.
Realize the 5th embodiment in the manner described above and since according to the rules the time interval detect to be provided with and carry out with indicator, decorate so can be provided at when mark is set, when removing mark, will decorate the visual and understandable method of operating of deleting.
The 6th embodiment
The following describes the 6th embodiment of image synthesizer of the present invention.
The 4th embodiment is a situation about describing, even should in the book class, write under the situation of word etc. the book class be offset, produce under the situation about moving relative to its original position, the existing indicating area of pen type indicating mechanism still is superimposed on correct position in the mode that moves with the book class.
Relative therewith, the design of the 6th embodiment is, the used setting in adopting the 5th embodiment with under the situation of indicating mechanism, and the book class is moved.
Figure 24 is the structural drawing of the 6th embodiment, and in the present embodiment, the structure division identical with the 4th embodiment shown in Figure 17 and the 5th embodiment shown in Figure 20 adopts identical label, so omit specifying them here.
The main difference point of the 6th embodiment and the 4th, the 5th embodiment is: adopt following the setting to utilize moving parameter to infer unit 17 with mark to replace moving parameters to infer unit 12, rotatablely moving in the book class moving parameter, i.e. inclination angle are calculated according to the degree of tilt of the indicating section that mark is set by the described portion 17 of inferring.Thus, if remember the indication information and the indication information that is provided with mark of people's pen type indicating mechanism in a parallel manner, then as the degree of tilt of book class demonstration is rotated with partial images to be provided with the degree of tilt of the indication information of mark, but according to the parallel mobile parameter of this rotation calculated description class.At this, mark is set, and to utilize moving parameter to infer unit 17 corresponding with moving parameter calculating part of the present invention.
The course of work of the 6th embodiment image synthesizer that constitutes in a manner described according to the flowchart text of Figure 25 below.The action of the 6th embodiment is the step 1f～step 6f below inserting between the step 1e that moves in the 5th embodiment and the step 3e.
Step 1f calculating and setting is used the indication information inclination angle of indicator:
As shown in figure 26, according to the corresponding indication information detecting unit 15 of a plurality of indicating mechanisms, at first rectangular region (the xr (i) of the position adjacency of indicator is being arranged with detection, yl (i))-(image width, yr (i)) seeks among corresponding each y coordinate figure y (k), black picture element with maximum x coordinate, with this x coordinate as x-max (k).At this moment, in the process that each y coordinate is sought along the x direction of principal axis, under the black situation that does not detect between specified length, stop seeking.Thus, can detect the candidate point on the top of the indication information that only is positioned at inclination by embodiment shown in Figure 26.Then, just charge to the top candidate point of part, obtain minimum 2 and take advantage of near linear A.The angle of the x between centers in this straight line and the camera coordinate system is the inclination angle [theta] of indication information.In addition, y (k) needn't increase according to 1 mode, also can be for more than 2 if charge to the top candidate point of part.
Step 2f is provided with the detection with the tilt correction indicating area of indicator:
Owing to take advantage of straight line A by the minimum 2 that step 1f calculates, with the angle of x between centers in the camera coordinate system be the inclination angle of charging to part, constitute straight line B respectively so be in the straight line of following state, B ', this state instigates straight line A along the direction away from initial point, and parallel mobile, and there is not 1 black picture element on the straight line A near the direction of initial point.At straight line B, B ' with straight line x=xr (i), seeks the black picture element with maximum x coordinate x-max (i) in the zone that x=(image width) surrounds.The inclination angle [theta] of straight line A be on the occasion of the time, following zone constitutes the indication information zone, i.e. intersection points B 3, these 4 zones that point is surrounded of the intersection point coordinate position B4 from this intersection points B 3 to the vertical line of straight line B ' of the intersection points B 1 of straight line B and x=xr (i), the intersection point coordinate position B2 from this intersection points B 1 to the vertical line of straight line B ', x=x-max (i) and straight line B.At this, be benchmark with the camera coordinate system (x-y coordinate system) of camera 1, by mode shown in Figure 26, the inclination angle [theta] that produces along the dextrorotation direction on the occasion of.
Having or not of the existing decorative zones of step 3f pen type indicating mechanism:
Become unit 5 to be provided with reference to the appended drawings pictograph and utilize moving parameter to infer unit 17, when having the existing decorative image that forms by pen type indicating mechanism, carry out step 4f,, then carry out step 3e if there is not above-mentioned image with indicator.
Step 4f partial images is according to the distortion at inclination angle:
Because existing decorative image is out of shape with moving of book class, thereby be provided with and utilize moving parameter to infer unit 17 with indicator to select among the 4th embodiment described template of step 2d relatively to use partial images, make this image according to the book class inclination angle rotational deformation of calculating by step 1f.
Step 5f partial images parallel moving parameter relatively calculates:
In the manner described above, form template, be the time is gone up to comparing between two continuous images, calculate moving parameter with step 4f.Because template rotates according to book class rotation moving parameter θ, thus the moving parameter that is calculated only constitute parallel mobile (xd, yd).
The distortion of step 6f decorative image:
The moving parameter that is calculated by step 5f makes all whole anamorphoses in the additional image formation department 5.
If implement the 6th embodiment in the manner described above, be provided with under the situation of mark in employing, even produce mobile in the book class, still can detect inclination angle and this zone of indicating area and carry out,, still can calculate its moving parameter even the existing decorative image that is produced by pen type indicating mechanism is arranged in addition, and will have decorative image distortion and synthetic now, be provided with in the presentation process of mark in employing like this, move, still can correctly decorate the part that hope is emphasized even the book class produces.
The 7th embodiment
The following describes the 7th embodiment of image synthesizer of the present invention.
The 5th embodiment explanation is that this is provided with the decoration that can carry out mark with the mode of mark simply only to be provided with or to remove.The design of the 7th embodiment is that decoration and effect sound that importing is provided with mark can carry out operation acknowledgement simply in addition, thereby can further improve the effect of demonstration.
Figure 27 is the structural drawing of the 7th embodiment, and structure division identical with the 5th embodiment shown in Figure 20 in the present embodiment adopts identical label, so omit specifying them here.
The main difference point of the 7th embodiment and the 5th embodiment is: add mark quantity increase and decrease detecting unit 18, it is the increase and decrease that the quantity of using mark is set of time interval detection according to the rules, selects the regulation voice data to carry out.In addition, the voice data storage unit of label 19 expression stored sound data, the loudspeaker of the selected voice data of label 20 expression playbacks.Here, mark quantity increase and decrease detecting unit 18 uses mark spare increase and decrease testing agency corresponding with of the present invention the setting.
The course of work of the 7th embodiment image synthesizer that constitutes in a manner described below with reference to the flowchart text of Figure 28.
The action of the 7th embodiment is the step 1g～step 4g below the insertion between the step 8e of the 5th embodiment action and step 9e.
The comparison that usefulness indicator quantity is set between step 1g frame:
By mark quantity increase and decrease detecting unit 18, between frame, the detected quantity that is provided with mark is compared, if increase, carry out step 2g, if the occasion that reduces is carried out step 3g, and under unchanged situation, carried out step 9e.
Step 2g increases the selection with voice data:
Select to increase and use voice data, carry out step 4g.
Step 3g reduces the selection with voice data:
Select to reduce and use voice data, carry out step 4g.
The output of step 4g effect sound:
By above-mentioned steps, when new indicator being set or removing above-mentioned indicator, only detect the variation be provided with indicator quantity on the book class, just can be when indication information be decorated output effect sound.
If according to the 7th embodiment, owing to can discern the situation that makes an addition on the book class or remove indicator from the book class by the increase and decrease of indicator quantity, and can discern situation additive effect sound according to this, like this, the not only affirmation that can be easy to operate, but also can further demonstrate efficiently.
The 8th embodiment
The 8th embodiment that the following describes image synthesizer of the present invention carries out.
The the 1st～the 7th embodiment explanation be with respect to by specifying one by one or the more simple book class that constitutes of taking pictures detects and decorates indicating section.The design of the 8th embodiment is also by the shape of a plurality of signs of identification and the mode of corresponding relation, thereby can decorate the book class that both pictures and texts are excellent.
Figure 29 is the structural drawing of the 8th embodiment, and structure division identical with the 5th embodiment shown in Figure 20 in the present embodiment adopts identical label, so omit specifying them here.
The main difference point of the 8th embodiment and the 5th embodiment is: add mark shape identification unit 21 and the corresponding determining unit 22 of mark, described mark shape identification portion 21 is used to the sign shape of recognizing two or more, and the corresponding determining unit 22 of described mark is determined the corresponding relation of the mark of regulation combination according to the shape of the sign by mark shape identification unit 21 identifications.Here, mark shape identification unit 21 is corresponding with sign shape recognition mechanism of the present invention, and the corresponding definite mechanism with mark of the present invention of the corresponding determining unit 22 of above-mentioned in addition mark is corresponding.
The course of work of the 8th embodiment image synthesizer that constitutes in the manner described above below by the flowchart text of Figure 30.In order more clearly to describe the course of work of present embodiment, below illustrate in the example, in the book class that has character string shown in Figure 31 to mix, adopt two kinds of hook-shaped mark marks to decorate the zones decorations corresponding with the finding hook-type with figure.If described being marked at such as the school teacher place of mentioning in the mark textbook in advance after previewing of teaching also is fine.Mark can also be indicated into stratiform and be pasted on such article, also available e-Pointer etc. is depicted on the book class.
The following describes the action step of the 8th embodiment.The action of the 8th embodiment is the step 1h～step 5h below the insertion between the step 1e of the 5th embodiment action and step 2e.
The detection of the hook-shaped shape mark of step 1h:
By a plurality of different mark position detecting units 14, detection zone of given size from image serves as a mark and detects, and this zone has the specified color (rgb value of specialized range) of expression hook-type mark.
The identification of step 2h mark shape:
Kind by the detected mark of mark shape identification unit 21 identifications is recognized.Here, beginning label shown in Figure 32 and end mark are recognized.Specifically, according to mode shown in Figure 32, with detected marked region 4 five equilibriums, in area 0～3, calculate the quantity of pixel,, then be judged to be beginning label if its quantity is more in area 0 with expressive notation specified color (rgb value), otherwise, then be judged to be end mark.
Step 3h detects according to the mark corresponding relation and charges to part:
By the corresponding determination portion 22 of mark,, determine to specify which zone according to being beginning label or end mark.At first, with regard to whole beginning labels, calculate itself and the distance that is positioned at its bottom-right mark that is all over.Afterwards, this beginning label and above-mentioned distance are set up corresponding relation for minimum mark.
The detection of the characteristic quantity of step 4h indication information:
By the corresponding indication information detecting unit 15 of a plurality of not isolabelings, calculate as the characteristic quantity of indication information, the ratio of occupying such as white pixel in the indicating area.Because the white pixel proportion satisfies following relation in the general indicating area, i.e. (drawing)＜(character string)＜(photo) can be recognized these characteristic quantities according to the ultimate value that is fit to like this.
Step 5h charges to the decoration of part:
Become unit 16 by the corresponding appended drawings pictograph of a plurality of different indicating mechanisms, in passing through the detected indication information of step 3a zone, the image of rgb value that will replace with the pixel except that black with the rgb value of specified color is as additional image, and is stored in the appended drawings pictograph unit 5.
According to above-mentioned steps, can make the hook-type mark correctly set up corresponding relation, and appointed area shown in Figure 33 is decorated.
According to the 8th embodiment, then also can decorate following book class, this book class refers to not only comprise the text line that specifies one by one, but also includes the more complicated book class of literal and figure mixing drawing.
The 9th embodiment
The following describes the 9th embodiment of image synthesizer of the present invention.
Relative the 1st～the 8th embodiment, the design of the 9th embodiment is even under the situation of camera zoom, still can correctly show the part of being emphasized.
Figure 34 is the structural drawing of the 9th embodiment, and structure division identical with the 1st embodiment shown in Figure 1 in the present embodiment adopts identical label, so omit specifying them here.
The main difference point of the 9th embodiment and the 1st embodiment is: also add the zoom multiple detecting unit 23 that is used to detect camera 1 zoom multiple, and dwindle unit 24 according to the decorative image amplification that detected zoom multiple dwindles the decorative image amplification.
The course of work of the 9th embodiment image synthesizer that constitutes in a manner described according to the flowchart text of Figure 35 below.
The action of the 9th embodiment is the step 1i～step 3i below the insertion between step 1a and the step 2a in the 1st embodiment action.
Having or not of the existing indicating area of step 1i:
Additional zooming is dwindled unit 24 when reference appended drawings pictograph becomes unit 5 to form existing additional image, carries out step 2i, and when not having above-mentioned additional image, carries out step 2a.
The detection of step 2i zoom multiple:
By zoom multiple detecting unit 23,, send it to additional zooming and dwindle unit 24 by the zoom signal of control module 1000 detection cameras 1.
The amplification of step 3j decorative image is dwindled:
According to by the detected zoom multiple of step 2l, amplify or dwindle being stored in whole images of being deposited in the additional image formation department 5.
According to above-mentioned the 9th embodiment,, can correctly decorate the part that hope is emphasized like this, thereby can further enlarge the amplitude of demonstration even, still can amplify additional image and dwindle according to the zoom multiple owing to carry out under the situation of zoom at camera.
The 10th embodiment
The following describes the 10th embodiment of image synthesizer of the present invention.
What the 1st～9 embodiment represented is following example, promptly with color or underscore to pen, the specified zones of a plurality of indicating mechanisms such as mark be set decorate.The design of the 10th embodiment is not show in addition with the painted appointed area of specified color.
Figure 36 is the structural drawing of the 10th embodiment, adopts identical label with identical structure division embodiment illustrated in fig. 1 in the present embodiment, so omit specifying them here.
The main difference point of the 10th embodiment and the 1st embodiment is: add painted appointed area delete cells 25, it is used to detect the painted included zone of specified color, deletes the demonstration of this regional information.
The course of work of above-mentioned the 10th embodiment image synthesizer is described below.
Painted appointed area deletion portion 25 continuous sweep images, will have the regulation rgb value close (such as, near the label 8) pixel is provided with identical mark as identical appointed area.Then, be relatively set with the above group of pixels of specified quantity of same tag, all replace being provided with the color of the pixel in markd same group with specified color (rgb value).
According to above-mentioned the 10th embodiment, because the information with the painted appointed area of specified color is not shown in the display unit, when the applying colour with regulation of being a teacher was recorded in problem answers on the textbook or comment section as notes, the hearer can not see unnecessary information.
The 11st embodiment
The following describes the 11st embodiment of image synthesizer of the present invention.
The 1st～10 embodiment at situation be meant since only with the regulation indicatory device instruction class, form, synthetic and show the image that this indicatory device is decorated or emphasized, can demonstrate simply efficiently like this, and the 11st embodiment has also considered to enlarge the educational system that good efficiencies is arranged.
Figure 37 is the structural drawing of the 11st embodiment, and the structure division that present embodiment is identical with the 1st embodiment shown in Figure 1 adopts identical label, so omit specifying them here.
The main difference point of the 11st embodiment and the 1st embodiment is: also be added with the following corresponding document of browsing and form updating block 26, they can preserve the image that is synthesized by visual synthesis unit 5 by the mode that the browser in the Internet shows.In addition, label 27 expression is subjected to the server of homepage management, and it is connected with a plurality of terminals by network etc.
The following describes the course of work of the image synthesizer of above-mentioned the 11st embodiment.
Below the teacher of described example explanation school class hour adopt the situation of present embodiment image synthesizer saying.Control module 1000 is preserved such as preserving by the specified key of pushing the keyboard that is connected with control module 1000 by visual synthesis unit 5 synthetic images to the storer filling information of memory image.Or also can adopt according to the mode identical with the 3rd embodiment, the image of in such as the video of camera 1, superpose and be called " image is preserved ", and with etc. it is indicated.So teacher can be stored in the system the useful image of student saying in the image that forms class hour.Then, browsing corresponding document formation/updating block 26 is GIF or jpeg format with the image transform of being preserved, relative server 27, and forming or upgrade can this html file as a reference.Thus, the student can be from the above-mentioned teaching materials data of reading outside school.
If implement present embodiment 11 according to above-mentioned steps, because the composite image that forms logins on the homepage of network, like this can be by terminal from participating in the teaching of schools such as university outside school, or reuse the teaching materials data, teacher can realize providing report in addition
*(report) the efficient education support system of problem etc.
The 12nd embodiment
The following describes the 12nd embodiment of image synthesizer of the present invention.
The 1st～11 embodiment is meant at situation owing to only indicate the actual information that is recorded in the book class etc. in modes such as pens, and show corresponding synthetic additional image with this feature with stacked system, can realize efficient demo system like this, the design of the 12nd embodiment is, obtain a plurality of actual objects simply, as the additional image that is used to synthesize, can will process it, equipment such as facsimile recorder or televisor are given in the image transfer after synthesizing.
Figure 38 is the structural drawing of the 12nd embodiment, and identical with the 1st embodiment shown in Figure 1 in the present embodiment structure division adopts identical label, so omit specifying them here.
The main difference point of the 12nd embodiment and the 1st embodiment is: show that with input monoblock type display 28 replaces display unit 8, present embodiment comprises input position detecting unit 29, be used for detecting the input position of aforementioned display device 28, actual object retrieval unit 30, it is according at least camera 1 being set to the mode that at least a portion in the display part of display 28 is taken, and extraction can be placed the profile of the actual object on display 28 display parts, decorative image forms unit 31, the image of extracting objects out by actual object retrieval unit 30 by processing carries out, and is formed for decorating or emphasizes, the additional image that is shown in the display ' is used to store the additional image storage unit 32 of formed additional image; Decoration functions selected cell 33, it is used for selecting the display packing of formed additional image at display; And image transfer receiving element 34, be used to receive following image, maybe this image transfer to be given in facsimile recorder or the televisor, described image is that actual object on the combining display 28 and the displayed image in the aforementioned display device 28 obtain.In addition, control module 1000 is made of storer such as ROM and CPU, in this storer, have with by the corresponding deal with data of aforementioned display device 28 inputs.
The following describes the course of work of present embodiment.
Figure 39 is the process flow diagram of action of the image synthesizer of the 12nd embodiment.Figure 40 is for showing an example of the scope that monoblock type display and camera are taken by input in the present embodiment.In order more clearly to describe the action of present embodiment, example described herein is meant in the celebration that adds company ceremonially, is receiving the image that synthesizes the information of the gift in token of gratitude on the people of wrist-watch, and is sending it occasion of facsimile recorder to.
Action step to present embodiment is described below.
The setting of step 1j actual object:
Intending with being the actual object of information by being located in the zone that input shows that the camera 1 above the monoblock type display 28 takes, being provided with.As shown in figure 40, in the example described herein, the wrist-watch of getting from a side who sends out carry information is set on display 28, and the company that enters is determined the name card that the back of attaching troops to a unit is received from company.Here, when the input face of display 28 adopts ultrasonic surface acoustic wave mode or induction material,, still unlikelyly judge in display 28 to have input information mistakenly even under the situation of placing harder objuct bodies such as wrist-watch.In addition,, adopt the material of pressure sensitive or opposing film mode, can not occur mistake equally and judge if this object is lighter.Control by control part 1000 whether input is arranged in the display 28.
Step 2j takes out actual object:
As shown in figure 41, the function that preferably will select by decoration functions selected cell 33 as icon display in display 28.When pushing actual object extraction icon 401, the actual object of intending obtaining becomes to become the pattern of selection.By the pen input, surround the actual object (being wrist-watch and name card) of intending taking-up here with a closed curve.Control module 1000 receives the final signal of pen input, at first obtains image in the shooting area by camera 1, starts actual object retrieval unit 30 afterwards, serves as that actual object is taken out on the basis with the image that is obtained.Here, by pushing beginning and finishing of a pen input that input icon 411 is realized.Actual object retrieval unit 30, takes out wrist-watch and name card separately respectively according to automatically a closed curve being separated (being 2) here with the corresponding quantity of the quantity of object according to mode shown in Figure 42.The back will be described in detail said method.In addition, if pen is input as ultrasonic surface acoustic wave mode, the material that then finger, or rubber etc. are soft, when pressure sensitive or opposing membrane type, this harder material of intermediary that described material also can be common ball pen also can pass through the finger input.
Step 3j selects decorative mode:
Also can consider to have multiple decorative mode, but here, describe with " background ", " edge ", " freedom " these 3 kinds of patterns." background " pattern is whole viewing areas of display 28, and " edge " pattern is the inboard along above-mentioned viewing area, and " freedom " pattern is the corresponding decorative image of any local expression that is contacting with display 28 with pen etc.Figure 43 ecbatic, from it is to select the wrist-watch image as decorative image from the diminished image 422 of extracting actual object out, and select to carry out obtaining with " edge " pattern corresponding buttons 421-a with pen, also promptly represent control part 1000 according to " edge " patterns, dwindle along the inside edge of display 28 viewing areas and wrist-watch image 422 images that form.
The input of step 4j information:
Intend sending to the other side's information with an input mode input.Such as input information shown in Figure 44.This input is carried out in the following manner, promptly will show with the display of input face contact position by pen to be transformed to specified color (such as black).
Step 5j composite image transmits:
As shown in figure 44, during " transmission " button 402 of in pushing display 28, showing, control module 1000 at first starts visual synthesis unit 7, the pictorial data that will be 1 that captures, be positioned at the actual object on the display 28 by camera, carry out composite image with data that are shown in the decorative image in the display 28 or information data and handle, and save as preservation such as bitmap format.Then, be data layout and transmit the corresponding data layout of equipment of data by image transfer receiving element 34 with the image transform of above-mentioned preservation, and transmit composite image to it.Such as when facsimile recorder transmits data, can be the sweep length form with image transform.
In addition, extract unit 30 out by actual object and handle the above-mentioned pictorial data that is positioned at the actual object on the display 28 that captures by camera 1, send visual synthesis unit 7 afterwards to, thus in visual synthesis unit 7 with synthetic by the data of the above-mentioned decorative image of storage unit 32 output etc.
In addition, except above-mentioned synthetic method, also can adopt following manner.
This is a kind of, takes actual object on the display 28 as it is by camera 1, and display 28 decorative image or the information that show.In this case, the composite image that also camera 1 can be provided directly sends image transfer receiving element 34 to.In addition, different with aforesaid synthetic method, at this moment images such as the decorative image that shows of display 28 or information is second-rate.
Specifically describe below among the above-mentioned steps 2j and extract the method that unit 30 takes out actual object on the display 28 out with actual object.
Figure 45 represents the concrete structure figure of actual object retrieval unit 30.The image storage unit of the image that the label 35 expression storage cameras 1 among Figure 45 are taken; Label 36 expression profile style storage unit, it carries out discrete processes and storage to the closed curve of input display 28 as the object profile candidate point of depositing in the image in the image storage unit 35; Label 37 expression profile sample deformation unit are used for according to certain rule profile style storage unit 36 all profile candidate points being moved; Label 38 expression profile styles intersection judging units, be used for whether having crossover phenomenon to judge to the closed curve that above-mentioned profile candidate point is connected to form, label 39 expression profile division unit, be used for when having detected intersection, profile candidate point being categorized into a plurality of groups by above-mentioned intersection judging unit 38; Label 40 expression profile candidate point formation/cancellation unit are used for adding new profile candidate point judging by above-mentioned intersection judging unit 38 not under the intersection situation; Or cancel above-mentioned profile candidate point, label 41 expressions are used to judge whether profile takes out the extraction that the finishes judging unit that finishes.
The course of work of the actual object retrieval unit 30 that constitutes in a manner described below with reference to flowchart text shown in Figure 46.Image storage unit 35 is made of common RAM, and the image that camera 1 is taken carries out digitized processing, and gives storage.According to represent that such as 8 bits the mode of its brightness stores the pixel data in the image of digitized processing.Actual object is described below extracts the operation program of unit 30 out.
The initial stage configuration of step 2j-1 profile candidate point:
Be input to n point of the closed curve (profile style) in the display 1 with constituting with an input mode by abovementioned steps 2j, be stored in profile style storage unit 36 as initial profile candidate point vi (xi (0), yi (0)) (i=1,2 ..., n).Label i represents to connect the profile candidate point order of connection of profile closed curve that candidate point becomes (profile style).Above-mentioned profile style storage unit 36 is made of common RAM.
The distortion of step 2j-2 skeleton pattern:
By profile style deformation unit 37 position of whole profile candidate points is moved 1 time.Thus, the closed curve distortion that profile candidate point is connected to form.In addition, this closed curve is to connect profile candidate point by the predetermined order of connection to form.
Realize the distortion of profile sample promptly along following direction each profile candidate point being moved by following manner, this direction instigates that predefined energy-Esnake reaches minimum in the profile sample.The energy of this definition will be explained hereinafter.
Such as, if each profile candidate point moves in specialized range, above-mentioned candidate point is moved to make Esnake (vi) reach minimum position, also can be to each profile candidate point vi (xi, yi) (i=1,2 ... n) calculate Esnake (steepest decline vector (the Esnake/ xi vi),- Esnake/ yi), by following mathematical expression above-mentioned candidate point is moved.
xi(t+1)＝xi(t)-Kx(?Esnake/xi)
yi(t+1)＝yi(t)-Ky(Esnake/yi) (1)
But, t (i=1,2 ... n) represent the mobile number of times of each point.In addition, Kx＞0, Ky＞0 is the constant number of the amount of movement of control profile candidate point.Move can be according to along profile one by one the 1st time of each profile candidate point, or with each point independently of one another side by side mode carry out.But (vi) under the situation of Zeng Jiaing, above-mentioned candidate point does not move at energy-Esnake.At this moment, sign
*(flag) (vi) (i==1, for the profile candidate point that does not move, F (vi)=0 for F.(vi), can adopt each energy term sum as the energy-Esnake in the skeleton pattern by following formulate.In addition, can adopt various ways to understand according to the feature of object.
(1) Espline of the flatness of expression profile sample:
The moving direction that makes the result of (2) formula reach the profile candidate point of minimum value is the direction that the profile style is shunk.Here, vi, vi-1, the i among the vi+1, i-1, i-1 add respectively alphabetical v.Above-mentioned situation is applicable to following mathematical formulae too.
(2) with the suitable Earea of area around the enclosed region of profile style:
But, xn+1=x1, yn+1=y1.The profile candidate point moving direction that makes (3) formula reach minimum value is corresponding to the direction vertical with the profile style.Adopt Erea, can take out the profile of the object that is concave shape.Here, xi, the i among the xi+1, i+1 add respectively alphabetical x.In addition, yi, the i among the yi+1, i+1 add respectively alphabetical y.Above-mentioned situation is equally applicable to following mathematical formulae.
(3) distance between profile candidate point is averaged the Edist of processing:
But dav represents the distance between profile candidate point.(4) image brightness l (the vi) Eedge that increases of gradient:
Make the result of (5) formula reach the direction of the profile candidate point moving direction of minimum value for the increase of brightness step value, promptly object is towards the direction of outline portion.
(5) image brightness value Eintens:
The result who makes (6) formula is that the brightness of Wntens＞0 o'clock reduces (deepening) direction for the profile candidate point moving direction of minimum value, and the direction of the degree increase (brightening) of Wintens＞0 o'clock.In addition, the Wsp1 in the formula of (2)-(6), Wsp2, Warea, Wdist, Wedge, Wintens＞0 is respectively the main coefficient of each energy term.
Make the profile style produce distortion, make (2)-(6) in energy term sum reach minimum value, then initial profile begins to shrink, and for the outline portion of object, the profile candidate point that each energy term is caused produces mobile vector to be stopped to move with balance mode.With the profile candidate point of this moment according to the regulation polygon that forms the profile taking-up that is linked in sequence as object.
The intersection of step 2j-3 profile style is judged:
Whether two total different combination results are intersected in the closed curve (polygon) that the order of connection connects into profile candidate point according to the rules by 38 pairs of judgements of profile style intersection judging unit.But connect except two the situation.The judgement that intersects is such as carrying out in the following manner.If line segment vivi+1 and line segment vjvj+1 have intersection point, then there are the real number p (0≤p≤1) that satisfies following equation, q (0≤q≤1).
p(vi+1-vi)+vi＝q(vj+1-vj)+vj (7)
(7) formula is about p, the simultaneous equations of q, and it has the determinant det that calculates by following formula is 0 o'clock separating, this moment, line segment vivi+1 only intersected at 1 point with line segment vjvj+1.(but when det=0, can produce the line segment vivi+1 situation consistent with line segment vivj+ 1, according in the determinant calculating front profile candidate point consistent intersection of judging in the case whether.)
det＝(xi-xi+1)(yj+1-yj)-(xj+1-xj)(yi-yi+1) (8)
Therefore, if in det ≠ 0 o'clock, the p that calculates according to following calculation formula, q satisfies 0≤p≤1, the relation of 0≤q≤1 judges that then the polygon (skeleton pattern) that profile candidate point is connected to form according to the regulation order of connection produces intersection, carries out step step 4a, except above-mentioned situation, then carry out step 5a.
p＝((yj+1-yj)(xi-xj)+(xj-xj+1)(yi-yj))/det
q＝((yi+1-yi)(xi-xj)+(xi-xi+1)(yi-yj))/det (9)
The division of step 2j-4 profile style:
By skeleton pattern division unit 39 skeleton pattern is split into a plurality ofly, returns step 2a.The profile style is split in the profile candidate point punishment of the line segment that constitutes intersection point.Figure 47 is illustrated in the example of the typical cross that produces under the situation of the energy employing Earea in the profile style.Earea get on the occasion of or negative value, by following mode the profile style is split into 2 in this example, promptly, connect profile candidate point vi and vj+1 respectively, vj and vi+1 by making the indeclinable mode of its symbol.Therefore, the order of connection be v1 ..., vi, vj+1 ..., vn} with vi+1 ..., the profile candidate point group of vj} forms independently profile style respectively in the mode of new division.Intersect though produce in many places simultaneously, be split into two step repeatedly, can split into a plurality of profile styles.
The judgement of the formation/deletion of step 2j-5 profile candidate point:
Form/cancel by profile candidate point that unit 40 forms new profile candidate point or with cancellation.Such as, can form profile candidate point in the following cases or delete it.When the distance between the profile candidate point of phase satisfies | during vi+1-vi|＞DTH, 2 vi produce new discrete point between the vi+1.DTH is the ultimate range between the predetermined profile candidate point.If have formed discrete point, Gflag=1 then is not if having above-mentioned discrete point, then Gflag=0.In addition, the discrete point vi of COs θ＞θ TH (θ is the angle between vivi-1 and the vivi+1) relation is satisfied in deletion.θ TH is the threshold value of the cusp of judgement predetermined profile style.If the discrete point of deletion is arranged, then Dflag=1.If do not have this discrete point, then Dflag=0.By the additional profile candidate point that forms, replenish the quantity of each the object profile candidate point that reduces by division, thereby can correctly take out the profile of a plurality of objects.If in addition according to the deletion step, the profile candidate point of position beyond the profile then can avoid taking out mistakenly profile in the object that deletion terminates in.
Step 2j-6 takes out the judgement that finishes:
At whole profile candidate points ( i that is not moved; F (vi)=0) when the formation of new profile candidate point or deletion (Gflag=0 and Gflag=0) do not take place yet, finishes the taking-up of profiles by the taking-up judging unit 41 that finishes.Except that above-mentioned situation, return step 2a.
In the manner described above, implement the 12nd embodiment with the sequence of operation that step 1～step 5 and step 2j-1～step 2j-6 describe, the a plurality of actual objects that fit to place on the display, by the closed curve that only provides to comprise these actual objects, itself produces the situation of intersecting along with the distortion of this closed curve in detection, it is split into a plurality of, thereby take out these curves separately, therefore can form the composite image of actual object and hypothesis object simply.Even under the more situation of formed composite image, still can alleviate the burden that the user takes out actual object in addition.
In addition, above-mentioned steps 1j～step 4j can be according to said sequence, such as, the information among the first input step 4j is deposited into actual object in the computing machine afterwards again, can be by its combination in any be synthesized image, thus form decorative image.Self-evident in addition, also can carry out above-mentioned steps 1j～step 4j repeatedly, thereby can synthesize image according to random order.But, in decorative image or after being shown in the display by the information that pen is imported, when taking out the actual object that newly is positioned on this display, only when carrying out the input of closed curve with pen, during obtaining image by camera 1, to comprise by subregion in the viewing area of the display 28 of the closed curve of pen input be transformed to regulation color (such as, white or black).Thus, can under the situation that does not influence the hypothesis object, only take out actual object.
Have, self-evident, present embodiment is easy to realize following expansion again, and is promptly synthetic by being connected with digital camera with the snap photography photo, adds acoustic information by being connected with microphone.
The 13rd embodiment
The following describes the 13rd embodiment to image synthesizer of the present invention.
The situation of the 12nd embodiment explanation is meant to be used under the situation of an input information, the button that is called " pen " by pushing, the user is with in the following instruction input system, and this instruction is used to distinguish to be to have imported information, has still imported the closed curve that is used to select actual object.The design of the 13rd embodiment is, alleviating the burden of importing to said system, and the user need not push under the situation of selector button, following interface is provided, the pen or the erasing rubber of the reality that this interface will generally be used, or but small-sized style such as facsimile recorder is as the three-dimensional icon of its function of intuitivism apprehension, thus composite image more simply.At this moment, the design of present embodiment is, even promptly be shown in the display 28 at the hypothesis object, and has under the situation with recognizable a plurality of actual object same colors, and whatsoever the actual object of sample still can stably be distinguished it.
Figure 48 is the structural drawing of the 13rd embodiment, and in the present embodiment, the structure division identical with the 12nd embodiment shown in Figure 38 adopts identical label, so omit specifying them here.
The main difference point of the 13rd embodiment and the 12nd embodiment is: in the 12nd embodiment, and additional three-dimensional icon registration unit 42 and three-dimensional icon discrimination unit 43.Above-mentioned three-dimensional icon registration unit 42 is used for registering the pen of importing to system and waits actual object or three-dimensional icon; Above-mentioned three-dimensional icon discrimination unit 43 is used for having under the input information situation at display, distinguishes the input mode of this input information.
Below only by the structure division different, to the course of work of the image synthesizer of the 13rd embodiment that constitutes in the manner described above with the 12nd embodiment.
The action of three-dimensional icon registration unit 42 at first, is described.The user starts three-dimensional icon registration unit 42 by following manner, promptly before composite image, pushes by decoration functions selected cell 33 and is shown in icon in the display 28.When three-dimensional icon registration unit 42 started, the function list with systems such as " literal input ", " deletions " was shown in the display 1.The user takes actual objects such as the ball pen that generally uses, erasable rubber with camera 1, and its characteristic quantity is registered in the above-mentioned complete list.Above-mentioned complete list is preserved as file with text formatting, when three-dimensional icon register 42 starts, can show its information in display 28.As characteristic quantity, storage has respectively and the corresponding frequency distribution of rgb value.In addition, when using camera, be preferably under the state of the actual use of object it is taken.In addition, also can be when product export, additional special-purpose pen, erasable rubber, and the three-dimensional icon of facsimile recorder etc., and the storage function corresponding, and needn't set by the user.
The following describes the action of three-dimensional icon discrimination unit 43.Whenever to display 28 input informations the time, three-dimensional icon distinguishes that portion 43 just starts.Whether control part 1000 controls have input information and positioning index thereof in display 28.The input position index that this solid icon discrimination unit 43 at first receives the display 28 from control module 1000, corresponding in this position display and stereographic map target size, the zone of specified color (as white) and given size (as the four directions square of 120 pixels) is arranged, obtain image by camera 1.Then, in the image that is obtained, only the rgb value that aforementioned areas is detected each pixel forms frequency and distributes, and judges whether to use the three-dimensional icon of following object, and the frequency in the three-dimensional icon registration unit 42 of being registered in of this icon distributes higher with similarity.Above-mentioned similarity is each the differential absolute value sum during frequency distributes.Consequently, if be judged as pen, then the motion track as the pen of literal input is shown in the display 28.If be judged as the mini-icon of facsimile recorder in addition, then transmit composite image.But, adopting the occasion of facsimile recorder icon etc., if the synthetic zone of image is wider than at the visual angle of camera, then can be by above-mentioned icon being placed this part, and be not subjected to the influence of composite image.
According to above-mentioned steps, by only detecting the characteristic quantity of actual object, can under the situation of the influence that is not subjected to displayed image, correctly distinguish any three-dimensional icon, can stably use the three-dimensional icon of registration like this, synthesize thereby can carry out image by operation more intuitively.
According to above-mentioned the 13rd embodiment, owing to show the zone of specified color and size at the input position of display, obtain image afterwards again, only color detection is carried out in this zone, like this can be under the situation that does not influence displayed image, only detect the characteristic quantity of actual object, even because hypothesis object in being shown in display comprises under the situation with recognizable a plurality of actual object same colors, still can correctly distinguish any actual object, thereby can stably use the three-dimensional icon of being registered, can operate more intuitively that to carry out image synthetic.
The 14th embodiment
The 14th embodiment that the following describes image synthesizer of the present invention describes.
The 12nd embodiment is at the occasion with input information the time, and text color is that the situation of black is illustrated.General under the situation of pen input system, the user can be selected the form of the color liked by menu.Such as, transmit the other side when be monochromatic facsimile recorder at composite image, when input characters in bright image, the color of pen is a black, when visual, the pen of white can form clearly visual darker.The design of the 14th embodiment is the brightness according to image, automatically changes the color of pen, thereby the burden of the style change input further in the mitigation system can be synthesized more visual in addition.
Figure 49 represents the structural drawing of the 14th embodiment.Structure division identical with the 12nd embodiment shown in Figure 38 in the present embodiment adopts identical label, so omit specifying them here.
The main difference point of the 14th embodiment and the 12nd embodiment is: additional displayed image brightness calculation unit 44 in the 12nd embodiment, and pen input color converting unit 45.Above-mentioned displayed image brightness calculation unit 44 is used to calculate the brightness of displayed image, above-mentioned pen input color converting unit 45 is used for the brightness that basis is calculated by above-mentioned displayed image brightness calculation unit 44, changes the color of pen input.
Only just different with the 12nd embodiment below displayed image brightness calculation unit 44 and pen input color converting unit 45 illustrate the 14th embodiment image synthesizer that constitutes in the manner described above.
When display 28 being carried out the pen input, start displayed image brightness calculation unit 44, calculate the mean flow rate of whole displayed image.Judge whether to carry out the pen input by the method among the 13rd embodiment.The mean flow rate that pen input color converting unit 45 is calculated with reference to displayed image brightness calculation unit 44, above-mentioned mean flow rate in 256 grades 180 when above, the color of determining the pen input is a black, and in the time of beyond the above-mentioned situation, the color of determining the pen input is a white.Thus, during input characters, the color of pen is a black in brighter image, and darker when visual, the color of pen becomes white automatically, like this user can not recognize select pen input color situation under, synthetic literal wherein is more visual.
According to above-mentioned the 14th embodiment,, can synthesize more clearly image of input characters like this owing to change the color that pen is imported according to the brightness of displayed image.
The 15th embodiment
The 15th embodiment that the following describes image synthesizer of the present invention describes.
What the 12nd embodiment described is to change the size of the image that takes out and the decorative image of color.In the 14th embodiment, change the color of pen input in addition, thereby the Word message that synthesizes wherein is more visual according to the brightness in the displayed image.The design of the 15th embodiment is to change the color or the brightness of displayed image according to color that is positioned over the actual object on the display 1 or brightness, thereby can synthesize more clearly image.
Figure 50 is the structural drawing of the 15th embodiment.With the identical structure division of the 12nd embodiment shown in Figure 38, adopt identical label, in the present embodiment so omit specifying here to them.
The main difference point of the 15th embodiment and the 12nd embodiment is: additional displayed image amending unit 46,46 is used for according to the brightness of actual object or the brightness or the color of color change displayed image in the 15th embodiment.
Below just different displayed image amending units 46 with the 12nd embodiment, the course of work of the 15th embodiment image synthesizer that constitutes is described in a manner described.
At visual end of synthesis, and push startup displayed image amending unit 46 when transmitting button.At first, this displayed image amending unit 46 is by starting actual object retrieval unit 30, will have rectangle with camera 1 shooting area same size as the initial profile style, thereby the actual object that takes out on the display is whole.Afterwards, above-mentioned displayed image amending unit 46 calculates the mean flow rate of the whole objects that take out.At last, according to this mean flow rate, change the brightness of the displayed image in the display 28.When actual object is brighter (under the situation more than the mean flow rate), by also make displayed image brighten (improving 20%) such as the brightness that makes each pixel value can integral body form clearly composite image.
According to above-mentioned the 15th embodiment, the color or the brightness that change displayed image accordingly according to the color or the brightness of actual object on the display, thus can synthesize more clearly image.
But, also can realize action same as described above in the following manner, promptly make following magnetic recording medium or optical recording media, record following program in the medium, this program is used for all or part of step (or handling action) of each step (or each mechanism) of describing in computing machine is implemented in the various embodiments described above any one.
In addition, though unloading device respectively of the present invention is extracted the unit out for actual object in the above-described embodiments, and be to be described, but the present invention is not limited to this, also can adopt following image synthesizer at being used to import the occasion that shows the monoblock type display.
That is, image synthesizer at this moment comprises: photographic units such as camera, be used to take display photos, or the surface and/or the object of the book class of many information such as illustration etc.; Closed curve testing agency, be used to detect closed curve information, described closed curve surrounds by the information in a plurality of photos of above-mentioned photographic unit shooting or the illustration etc., or taking-up object candidate in a plurality of object, that can constitute a plurality of candidate illustrations of image taking-up object; Unloading device respectively takes out the picture information of object candidate according to above-mentioned closed curve information of measuring and above-mentioned illustration etc., takes out the image of object candidate from a plurality of illustrations of above-mentioned envelope curve etc., takes out images such as these illustrations respectively; The image combination mechanism, it carries out image to other images such as information and synthesizes by the above-mentioned images such as illustration that take out respectively.Thus, can take and go up shown information and/or a plurality of object in the predetermined surface, can provide to constitute and surround the closed curve that image takes out a plurality of taking-up object candidates of object candidate, can the closed curve information that be provided be detected, picture information according to above-mentioned closed curve information of measuring and above-mentioned taking-up object candidate, can be from the image of above-mentioned a plurality of taking-up object candidates of surrounding, take out the image that these take out the object candidate respectively, can utilize the above-mentioned image that takes out respectively to carry out image and synthesize.
According to said structure, identical with above-mentioned situation, even there are a plurality of images to take out under the situation of object, compared with the prior art, can bring into play following effect, promptly further alleviate the homework burden that is used to indicate these taking-up objects.Therefore, compared with the prior art, can carry out the appointment of indicating area more easily.
Perhaps, also can adopt following image synthesizer.
At this moment image synthesizer comprises: photographic unit is used for taking to display photos illustration, the face of information such as character string; Closed curve information testing agency is used for detecting the closed curve that surrounds a plurality of denoted object information that can constitute denoted object in a plurality of above-mentioned information of taking with above-mentioned photographic unit; Unloading device respectively, this respectively unloading device be used for picture information according to above-mentioned detected closed curve and denoted object information, from a plurality of denoted object presentation of information of above-mentioned encirclement, take out the image of these denoted object information respectively; The indication information detecting unit is used to detect above-mentioned image region and/or its image feature amount of taking out respectively; The appended drawings pictograph becomes the unit, is used for according to above-mentioned detected image region and/or image feature amount, forms the image that is additional to above-mentioned denoted object information; Additional image storage unit is used to store the additional image of above-mentioned formation; Image synthesising part, the image and the above-mentioned formed additional image that are used for denoted object information that above-mentioned photographic unit is obtained synthesize.Said structure also can be used among the conversion embodiment of the 8th image synthesizer that embodiment describes.Promptly as shown in figure 31, under the situation of taking out set that object is the polygon figure and two photos, according to the described mode of the 8th embodiment, indicate each object respectively, and a closed curve that surrounds above-mentioned two kinds of objects is provided.The structure of unloading device is same as described above respectively.
According to said structure, identical with above-mentioned situation, even there are a plurality of images to take out under the situation of object, compared with the prior art, can bring into play following effect, promptly refer to further alleviate the homework burden that is used to indicate these taking-up objects.
In addition, image synthesizer of the present invention in the above-described embodiments, be to extract the input of unit out and show that the situation of monoblock type display is described at being used to have actual object, but image synthesizer of the present invention is this situation that is not limited to, it also can adopt following image synthesizer.
This image synthesizer comprises that input shows the monoblock type display; Photographic unit is used to take at least a portion of the display unit of aforementioned display device; The indicating positions detecting unit is used to detect indication and is positioned over the indicating positions information that the actual object on the aforementioned display device is used, and the actual object unloading device is used for from the image of the above-mentioned actual object of image taking-up of above-mentioned photographic unit shooting; The appended drawings pictograph becomes the unit, is used for forming the additional image that is shown in aforementioned display device from the above-mentioned image that takes out; Additional image storage unit is used to store the additional image of above-mentioned formation; The display packing selected cell is used for being chosen in the display packing of the additional image of above-mentioned formation at display; The image synthesis unit; Be used for display packing, the image of synthetic above-mentioned additional image and above-mentioned actual object according to above-mentioned selection.Thus, can be according to the mode that does not have in the prior art, performance can simply form actual object and the effect of supposing the object composite image down.
Implement the 1st embodiment in the manner described above, because the people who demonstrates only indicates the hope in the information of being write self to emphasize part with indicator stem, automatically take out the zone or the feature of this part, the suitable decorative image that superposes, thus needn't use shades of colour respectively with substitute mode.In addition, indicating positions conversion trailing simply by pen etc., if near the end of instruction class, owing to can provide frame, post, date etc., maybe can be by its indicating positions at the message part of having decorated, deletion is decorated, and above-mentioned decoration is brightened, even not forming under the situation of demonstration page in advance, still can obtain to demonstrate efficiently like this.
Therefore, have decoration such as to carry out becoming the characteristic quantity more easily or advantage of processing such as emphasize according to the zone of image.
In addition, according to the 2nd embodiment, owing to can wait the multiple mark that provides by the identification pen, and the conversion trailing, the replaceable like this pen with multiple color is saved the equal time of charging to, and can successfully demonstrate.
According to the 3rd embodiment, owing to can show existing decorative image with the complete list form by stacked system, can indicate these visual modes to duplicate by indicator stem, like this, even under the situation that adopts many book classes, in the book class, repeatedly write under the identical character string situation need not, still can successfully demonstrate.
According to the 4th embodiment, because by with the part decorative image being template and carry out template between the continuous frame relatively, but the moving parameter of calculated description class, make decorative image produce distortion, even be like this under the book class moves in the presentation process the situation, still can correctly decorate the part that hope is emphasized, the user can not note realizing demonstration under the situation that the book class moves.
According to the 5th embodiment, owing to if establish the placement mark, promptly decorate, and if remove mark, i.e. the visual and understandable operation that deletion is decorated, so whatsoever the people all can demonstrate efficiently.
According to the 6th embodiment, owing to charge to the degree of tilt of part or book class by marker detection is set, can reduce removable parameter and can infer quantity, and because more synthetic and the corresponding additional image of moving of book class, the later and not harmony sensation that causes of the prompting that more can reduce composite image.
According to the 7th embodiment, because the increase and decrease of the quantity of mark is detected, thereby can distinguish the situation that mark is set and remove under the situation of mark, and, more can demonstrate especially efficiently owing to can form and this situation corresponding effects sound.
According to the 8th embodiment, corresponding by confirming the shape of a plurality of marks with this affirmation situation, also can decorate the complicated book class that both pictures and texts are excellent, thereby can further improve the effect of demonstration.
According to the 9th embodiment, dwindle decorative image owing to can amplify according to the zoom ratio of camera, even like this under the situation of camera zoom, still can correctly decorate the part of emphasizing, can further enlarge the scope of demonstration.
According to the 10th embodiment,, do not wish that the part that allows spectators see is hidden thereby can make owing to can from image, this coloured part be deleted by only painted to not wishing to be undertaken by the part of demonstration such as e-Pointer.
According to the 11st embodiment, because the composite image that registration forms on can the homepage in the Internet, can reuse teaching materials by terminating machine participating in the teaching of schools such as university outside school like this, teacher can provide the report problem in addition, thereby can realize education support system efficiently.
According to the 12nd embodiment, owing to can place on the display by a plurality of actual objects that hope is synthetic, a closed curve that includes only these actual objects can be provided, what detection produced along with the distortion of closed curve self intersects, it is split into a plurality of, these curves can be taken out separately like this, thereby actual object and the composite image of supposing object can be formed simply.
According to the 13rd embodiment, owing to only distinguish and use color in the assigned position detection stereographic map target corresponding with the display input position, like this can be under the situation that does not influence displayed image, distinguish that correctly any three-dimensional icon carries out, thereby can stably use the three-dimensional icon of being registered, can carry out image by operation more intuitively and synthesize.
According to the 14th embodiment,, can synthesize more clearly image of its input characters like this owing to can change the color of pen input according to displayed image brightness.
According to the 15th embodiment, because the color or the brightness that can change displayed image according to the color or the brightness of actual object on the display can be synthesized more clearly image like this.
Claims (28)
1. image synthesizer is characterized in that it comprises:
Given photographic unit;
Indicating positions testing agency, this indicating positions testing agency are used for detecting the indication information position that provides on the face of display message and detecting from by the captured image of photographic unit;
Denoted object information testing agency is used for detecting corresponding with above-mentioned indicating positions testing agency detected indicating positions, and is shown in above-mentioned the characteristic quantity of going up regional and/or its denoted object information of denoted object information;
The appended drawings pictograph becomes mechanism, is used for forming the additional image that is attached on the denoted object presentation of information according to above-mentioned zone and/or above-mentioned characteristic quantity;
The image combination mechanism, the image of the above-mentioned denoted object information that it obtains above-mentioned photographic unit synthesizes with the additional image of above-mentioned formation.
2. image synthesizer according to claim 1 is characterized in that comprising:
Indicating positions out of Memory addition method determining unit is used for determining the synthetic method and/or the display packing of above-mentioned additional image according to above-mentioned detected indicating positions;
Above-mentioned visual combination mechanism is carrying out above-mentionedly when synthetic, adopts the definite result who is drawn by above-mentioned information addition method determining unit.
3. image synthesizer according to claim 1 is characterized in that described additional image is for decorating and/or emphasize the image of described denoted object presentation of information.
4. image synthesizer according to claim 1 is characterized in that comprising:
Indicating mechanism is used to indicate the denoted object with one or more above-mentioned indication informations;
Described indicating positions testing agency is the above-mentioned indication information by drawing the image of taking from above-mentioned photographic unit also, judges the kind of indication information;
Above-mentioned appended drawings pictograph becomes mechanism also to adopt the above-mentioned indication information kind of judging, and forms above-mentioned additional image.
5. according to claim 1 or 4 described image synthesizers, it is characterized in that it comprises:
Be used to store the additional image storage unit of the additional image of above-mentioned formation;
Existing additional visual copied cells, with the above-mentioned additional image of being deposited in the described additional visual storage part, synthesize with the image that obtains by above-mentioned photographic unit, and show in the complete list mode, synthetic and show by this and show in the complete list mode and the above-mentioned additional image selected at above-mentioned indicating positions.
6. according to the described image synthesizer of claim 1,4 or 5, it is characterized in that comprising:
Moving parameter is inferred the unit, is used to infer the face that shows above-mentioned information and moves the back position;
Additional visual deformation unit, it makes above-mentioned additional anamorphose according to above-mentioned moving parameter of inferring.
7. according to claim 1,4,5 or 6 described image synthesizers is characterized in that:
Described indicating mechanism comprises a plurality of indicating devices;
Above-mentioned indicating positions detects in above-mentioned a plurality of indicating devices each in described indicating positions testing agency;
Described denoted object information detecting unit is carried out above-mentioned detection in above-mentioned a plurality of indicating devices each;
Above-mentioned appended drawings pictograph becomes mechanism to form above-mentioned additional image in above-mentioned a plurality of indicating devices each.
8. image synthesizer according to claim 7 is characterized in that at least one indicating device in described a plurality of indicating device is that indicating device is used in following being provided with, and is used for indicating above-mentioned denoted object by the mode that is arranged on the face that shows above-mentioned information.
9. image synthesizer according to claim 8 is characterized in that:
Described denoted object information testing agency is according to the above-mentioned position that is provided with that is provided with indicating device, infer in the zone of above-mentioned denoted object information, the inclination angle of above-mentioned relatively photographic unit coordinate system, by this inclination angle of inferring, calculate above-mentioned denoted object information area and/or denoted object information characteristics amount;
Described image synthesizer is provided with the moving parameter computing unit, is used for the inclination angle of inferring out by above-mentioned, infers the parallel moving parameter of the face that shows above-mentioned information.
10. according to claim 7 or 9 described image synthesizers, it is characterized in that it comprises:
Be provided with indicating device and increase and decrease testing agency, be used to detect the above-mentioned increase and decrease that is provided with indicating device quantity that is arranged on the face that shows above-mentioned information;
The voice data storage unit is used to store and the above-mentioned corresponding voice data of increase and decrease that is provided with the quantity of indicating device;
Loudspeaker is used for according to the above-mentioned increase and decrease of using indicating device quantity, the voice data in the output tut data storage cell of being provided with.
11., it is characterized in that according to the described image synthesizer of claim 7,9 or 10:
Described indicating mechanism comprises difform indicating device;
Described image synthesizer comprises:
The corresponding definite mechanism of indicating device is used for making between the above-mentioned different indicating device and setting up corresponding relation according to given combination benchmark.
12., it is characterized in that according to any one described image synthesizer of claim 1～11:
Described photographic unit is a camera;
Described image synthesizer comprises:
Zoom multiple detecting unit is used to detect the zoom ratio of above-mentioned camera;
The unit is dwindled in additional zooming, is used for zoom ratio according to above-mentioned detection and above-mentioned additional image is amplified dwindles.
13. according to any one described image synthesizer of claim 1～12, it is characterized in that it comprises painted appointed area delete cells, use the color different transposing to show given color region on the face of above-mentioned information with above-mentioned given color.
14. according to any one the described image synthesizer in the claim 1～13, it is characterized in that it comprises only unit of browser corresponding document formation/renewal, preserving the synthetic image of above-mentioned visual combination mechanism by the form that the browser in the Internet shows.
15. an image synthesizer is characterized in that it comprises:
Given photographic unit;
Closed curve information testing agency, be used to detect closed curve information, described closed curve surrounds following a plurality of taking-up object candidates, and these a plurality of extraction object candidates can constitute by above-mentioned photographic unit takes and be shown in information and/or a plurality of object candidates interior of articles, that image takes out on given;
Respectively unloading device is used for the picture information according to above-mentioned detected closed curve information and above-mentioned taking-up object information candidate, from a plurality of taking-up object candidate images of described encirclement, take out the corresponding image that takes out the object candidate respectively;
The image combination mechanism is used for carrying out image by the above-mentioned image that takes out respectively and synthesizes.
16. an image synthesizer is characterized in that it comprises:
Given photographic unit;
Closed curve information testing agency is used to detect closed curve information, described closed curve surround by in the above-mentioned photographic unit photographing information, can constitute a plurality of denoted object information of denoted object;
Unloading device is used for the picture information according to above-mentioned detected closed curve information and denoted object respectively, takes out the image of corresponding denoted object information from a plurality of denoted object presentation of information of above-mentioned encirclement respectively;
The indication information detecting unit is used to detect above-mentioned image region and/or image feature amount of taking out respectively;
The appended drawings pictograph becomes the unit, is used for according to above-mentioned detected image region and/or image feature amount, forms the additional image on the image that is additional to above-mentioned denoted object information;
The image combination mechanism is used for the image of denoted object information that above-mentioned photographic unit is drawn, synthesizes with the additional image of above-mentioned formation.
17. an image synthesizer is characterized in that it comprises:
Input shows the monoblock type display;
Photographic unit, this photographic unit are used at least a portion of aforementioned display device display part is taken;
Closed curve information testing agency is used to detect closed curve information, and described closed curve surrounds following a plurality of object, and the image that these objects constitute in a plurality of actual objects that place on the described display takes out the object candidate;
Unloading device respectively is used for the picture information of a plurality of objects of the above-mentioned encirclement of taking according to above-mentioned detected closed curve information and above-mentioned photographic unit, from the image of a plurality of objects that these surrounded, takes out the image of corresponding object respectively;
The appended drawings pictograph becomes the unit, is used for forming the additional image that is shown in aforementioned display device from the above-mentioned image that takes out respectively;
The display packing selected cell is used for selecting the display packing of the additional image of above-mentioned formation at display;
The image combination mechanism is used for the display packing according to above-mentioned selection, the image of synthetic above-mentioned additional image and above-mentioned actual object.
18. an image synthesizer is characterized in that it comprises:
Input shows the monoblock type display;
Camera, at least a portion that is used for taking the aforementioned display device display part is taken;
Closed curve information testing agency is used to detect closed curve information, and described closed curve surrounds following a plurality of object, and the image that these objects constitute in a plurality of actual objects of putting on the above display takes out the object candidate;
Unloading device respectively is used for the picture information according to a plurality of objects of the above-mentioned encirclement of above-mentioned detected closed curve information and above-mentioned camera, from the image of a plurality of objects of these encirclements, takes out the image of corresponding object respectively;
The appended drawings pictograph becomes the unit, is used for forming the additional image that is shown in aforementioned display device from the above-mentioned image that takes out respectively;
The display packing selected cell is used for selecting the display packing of the additional image of above-mentioned formation at display;
Control module is used for the display packing according to above-mentioned selection, is shown in the above-mentioned additional image in the aforementioned display device and is placed actual object on the aforementioned display device by camera.
19. an image synthesizer is characterized in that it comprises:
Input shows the monoblock type display;
Photographic unit is used at least a portion of aforementioned display device display part is taken;
The indicating positions detecting unit is used to detect the indicating positions information that indication places the actual object on the aforementioned display device to use;
The actual object unloading device is used for according to above-mentioned detected indicating positions information, takes out the image of above-mentioned actual object from the image that above-mentioned photographic unit is taken;
The appended drawings pictograph becomes the unit, is used for the image from above-mentioned taking-up, forms the additional image that is shown in the aforementioned display device;
The display packing selected cell is used for selecting the display packing of above-mentioned formed additional image at display;
The image combination mechanism is used for the display packing according to above-mentioned selection, the image of synthetic above-mentioned additional image and above-mentioned actual object.
20., it is characterized in that above-mentioned unloading device respectively comprises according to any one described image synthesizer of claim 15～17;
Image storage unit is used to store the image that above-mentioned photographic unit is taken;
The skeleton pattern storage unit is used to store above-mentioned closed curve information as the candidate profile;
The skeleton pattern deformation unit is used for making according to certain rule being stored in the candidate profile that above-mentioned skeleton pattern storage part deposited and deforming;
Skeleton pattern intersection detecting unit is used to detect the intersection whether above-mentioned candidate profile is arranged;
Skeleton pattern division unit is used for being split into the candidate profile of being deposited in the above-mentioned skeleton pattern storage part a plurality of when above-mentioned intersection detecting unit judgement has intersection;
Whether the taking-up judging unit that finishes is used for according to above-mentioned division result, judge that profile takes out to finish;
After above-mentioned profile taking-up finishes, take out the image that profile surrounded that forms by above-mentioned division.
21., it is characterized in that it comprises according to claim 17 or 19 described image synthesizers:
Three-dimensional icon registration unit is used for registering the characteristic quantity and the function thereof of actual object by to the aforementioned display device input;
Three-dimensional icon discrimination unit is used for when aforementioned display device has input, distinguishes the actual object that is used for this input by described characteristic quantity.
22., it is characterized in that it comprises according to claim 17 or 19 described image synthesizers:
Displayed image brightness calculation unit, the brightness that is used to calculate the aforementioned display device displayed image;
Pen input color converting unit, the brightness that is used for calculating according to above-mentioned displayed image brightness calculation unit changes the color of pen input.
23. according to claim 17 or 19 described image synthesizers, it is characterized in that also additional following displayed image amending unit, it changes the brightness or the color of displayed image according to the brightness or the color that place actual object on the aforementioned display device.
24. medium, these medium are characterised in that and are used to write down following program that this program is used for realizing at computing machine all or part of body function of each described mechanism in the claim 1～23.
25. an image synthesizing method is characterized in that it comprises the steps:
By the assigned position in the indication information indicated number information faces;
Shooting is shown in information and the above-mentioned indication information on above-mentioned;
According to this shooting results, detect indicating positions by above-mentioned indication information indication;
To according to above-mentioned indicating positions, detect and be shown in above-mentioned zone and/or the characteristic quantity of going up the information of denoted object;
According to the zone and/or the characteristic quantity of above-mentioned denoted object information, form the additional image that is additional on the above-mentioned denoted object presentation of information;
The image of synthetic above-mentioned denoted object information and the additional image of above-mentioned formation.
26. method according to claim 25 is characterized in that when synthetic above-mentioned image, determines the synthetic method method and/or the display packing of above-mentioned additional image according to above-mentioned indicating positions, determines the synthetic above-mentioned image of thing as a result.
27. an image synthesizing method is characterized in that it comprises the steps:
Shooting is shown in information and/or a plurality of object on the predetermined surface;
The closed curve of following a plurality of taking-up object candidates is provided, and described a plurality of taking-up object candidates can constitute the described captured information and/or the candidate of the extraction of the image in a plurality of actual object object;
The above-mentioned closed curve information that provides is provided;
According to the closed curve of above-mentioned detection and the picture information of taking-up object candidate, from a plurality of taking-up object candidate images of above-mentioned encirclement, extract out respectively and get the image of the taking-up object candidate of answering;
By the above-mentioned image that takes out respectively, composite image.
28. medium is characterized in that the following program of this media recording, described program is used for realizing all or part of step in each step in the claim 25～27 at computing machine.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN97125957A CN1186991A (en) | 1996-11-01 | 1997-11-01 | Image synthetic device, image synthetic method and medium used thereof |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP291,436/96 | 1996-11-01 | ||
| JP211,039/97 | 1997-08-05 | ||
| JP236,992/97 | 1997-09-02 | ||
| CN97125957A CN1186991A (en) | 1996-11-01 | 1997-11-01 | Image synthetic device, image synthetic method and medium used thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN1186991A true CN1186991A (en) | 1998-07-08 |
Family
ID=5177492
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN97125957A Pending CN1186991A (en) | 1996-11-01 | 1997-11-01 | Image synthetic device, image synthetic method and medium used thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1186991A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100413320C (en) * | 2003-05-29 | 2008-08-20 | 佳能株式会社 | Image taking apparatus |
| CN100452834C (en) * | 2003-05-30 | 2009-01-14 | 佳能株式会社 | Photographing device and method for obtaining photographic image having image vibration correction |
| CN100452835C (en) * | 2003-05-29 | 2009-01-14 | 佳能株式会社 | Image processing apparatus, image taking apparatus and program |
-
1997
- 1997-11-01 CN CN97125957A patent/CN1186991A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100413320C (en) * | 2003-05-29 | 2008-08-20 | 佳能株式会社 | Image taking apparatus |
| CN100452835C (en) * | 2003-05-29 | 2009-01-14 | 佳能株式会社 | Image processing apparatus, image taking apparatus and program |
| CN100452834C (en) * | 2003-05-30 | 2009-01-14 | 佳能株式会社 | Photographing device and method for obtaining photographic image having image vibration correction |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1214614C (en) | Image processing method, image processing device and recording medium | |
| CN1158618C (en) | Data processing apparatus | |
| CN100346352C (en) | Image display apparatus and short film generation apparatus | |
| CN1197351C (en) | Image synthesizing device, recording medium, and program | |
| CN1290311C (en) | Image processing device and method for aligning position between pages of book image data | |
| CN1172734C (en) | Image capture apparatus and method | |
| CN1261811C (en) | Photograph picture printer and printing method, program and printing medium unit | |
| CN1305006C (en) | Method and system for profviding promated information to image processing apparatus | |
| CN1115649C (en) | Image output device | |
| CN1271505C (en) | Image processing apparatus, control method therefor, and program | |
| CN1643555A (en) | Navigation e-course | |
| CN1647130A (en) | E-learning course editor | |
| CN1196855A (en) | Printing apparatus and printing system | |
| CN1186936C (en) | Image communication terminal | |
| CN1842126A (en) | Information processing apparatus, image forming apparatus and method, and storage medium therefor | |
| CN1910577A (en) | Image file list display device | |
| CN1940912A (en) | Document production system, document production method, program, and storage medium | |
| CN1383532A (en) | Creation of image designation file and reproduction of image using same | |
| CN1647133A (en) | E-learning course structure | |
| CN1866191A (en) | Data processing setting apparatus, data processing setting method | |
| CN1620094A (en) | Image processing apparatus and method for converting image data to predetermined format | |
| CN1174344A (en) | Image processing device | |
| CN1190750A (en) | Image input device and method thereof | |
| CN1867940A (en) | Imaging apparatus and image processing method therefor | |
| CN1967541A (en) | Information processing device, information processing method, program, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| REG | Reference to a national code |
Ref country code: HK Ref legal event code: WD Ref document number: 1010929 Country of ref document: HK |