JP2008086799A - Information processing apparatus and information processing program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To easily enhance the throughput of processing a predetermined object to be processed. <P>SOLUTION: Accumulated information data D67 including processing technique executed on a moving image to be processed to extract an object designation area for designating an object in a moving image and technique to be an evaluation value thereof are accumulated for a plurality of users in an information accumulating part 53. Any one of technique and practice of area extraction of enlightenment object users and one included in the accumulated information data D67 are compared with each other by a presented information selection part 54. The accumulated information data D67 are selected corresponding to the comparison result from a plurality of accumulated information data by the presented information selection part 54 to present the processing technique included in the accumulated information data D67 by an information presenting part 55. Thus, the improvement of processing technique of the enlightenment objective users themselves can be accelerated by the processing technique presented to the enlightenment objective users, thereby easily enhancing the throughput of processing the predetermined object to be processed. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an information processing apparatus and an information processing program, and is particularly suitable for application when a user performs processing on a predetermined processing target.

  Conventionally, as a process performed by a user on a predetermined processing target, a process of hitting a ball to be processed with a bat in baseball batting practice, or a display target of a part of the moving image from the moving image to be processed ( Hereinafter, there are various processes such as a process for extracting an area for designating an object), a process for extracting the outline of an object from a moving image to be processed, and the like.

  By the way, in order to improve the processing capability of the user when performing such processing, a method of hitting a ball with a bat and an area for designating an object from a moving image (hereinafter referred to as an object designation area) are extracted. Search for instructors with high processing capabilities for region extraction methods and contour extraction methods that extract the contours of objects from moving images (hereinafter, these striking methods, region extraction methods, and contour extraction methods are collectively referred to as processing methods). A troublesome method of requesting guidance has been taken, and there has been a problem that it is difficult to easily improve the processing capability of the user himself.

  The present invention has been made in view of the above points, and an object of the present invention is to propose an information processing apparatus and an information processing program that can easily improve the processing capability of a process performed on a predetermined processing target.

  In order to solve such a problem, in the present invention, region extraction which is a processing method of processing for extracting an object designation region for designating an object in the moving image performed on the moving image to be processed by the user. Accumulated information including technique and skill as an evaluation value for the processing is accumulated in the accumulating means for a plurality of users, and one of the region extraction technique and skill of a specific user is accumulated in the accumulating means, and accumulation accumulated in the accumulating means Compare with one included in the information, select the stored information from the multiple stored information stored in the storage means by the information selection means according to the comparison result by the comparison means, and select by the information selection means by the presentation means The region extraction technique and skill included in the stored information are presented to a specific user. Therefore, improvement of the area extraction method of the specific user can be promoted by the area extraction method and skill presented to the specific user.

  In the present invention, the contour extraction method that is a processing method for extracting the contour of the object in the moving image performed on the moving image to be processed by the user, and the skill that becomes the evaluation value for the processing are also obtained. The stored information is stored in the storage means for a plurality of users, and the comparison means compares either one of the contour extraction method and skill of the specific user with one included in the stored information stored in the storage means, A contour extracting method for selecting stored information from a plurality of stored information stored in the storing means by the selecting means according to a comparison result by the comparing means, and including the outline information included in the stored information selected by the information selecting means by the presenting means, and The skill is presented to a specific user. Therefore, improvement of the contour extraction method of the specific user can be promoted by the contour extraction method and skill presented to the specific user.

  According to the present invention, an area extraction method serving as a processing technique for extracting an object designation area for designating an object in a moving image performed on a moving image to be processed by a user, and the process Accumulated information including skill as an evaluation value is accumulated in the accumulating means for a plurality of users, and is included in the accumulated information accumulated in the accumulating means and either one of the region extraction method and skill of a specific user by the comparing means. Is selected from the plurality of stored information stored in the storage means by the information selection means according to the comparison result by the comparison means, and the storage information selected by the information selection means by the presentation means is selected. By presenting the region extraction method and skill to be included to a specific user, the processing method presented to the specific user can be processed by the specific user himself / herself. Can prompt improvement techniques, thus it is possible to realize an information processing apparatus and information processing program may easily improve the processing capacity of the processing performed for a given processed. Further, according to the present invention, a contour extraction method that is a processing method for extracting a contour of an object in the moving image performed on the moving image to be processed by the user, and a skill that becomes an evaluation value for the processing The storage means for storing a plurality of users in the storage means, comparing one of the contour extraction method and skill of the specific user by the comparison means with one included in the storage information stored in the storage means, Contour extraction method for selecting stored information from a plurality of stored information stored in the storing means by the information selecting means according to the comparison result by the comparing means and including the stored information selected by the information selecting means by the presenting means And by presenting the skill to the specific user, the contour extraction method presented to the specific user and the contour extraction method of the specific user based on the skill Can prompt on, thus it is possible to realize an information processing apparatus and information processing program may easily improve the processing capacity of the processing performed for a given processed.

  Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings.

(1) First Embodiment In FIG. 1, reference numeral 1 denotes an information processing apparatus according to the first embodiment as a whole, and baseball batting practice performed by individual users (the ball to be processed is a bat. Each time the batting moving image data D1 generated by capturing an image of a hitting method) is captured by one video camera (not shown), the acquired batting moving image data D1 is accumulated.

  Further, every time the information processing apparatus 1 takes in the batting moving image data D1, the user who has performed batting practice at that time from the already accumulated batting moving image data D1 (hereinafter referred to as an enlightened user). By selecting and presenting batting moving image data D1 that is thought to be helpful for improving the hitting method (that is, the processing method for the processing target of the enlightenment target user), It is made to encourage enlightenment.

  In this case, the information processing apparatus 1 includes an information input unit 2, a processing tendency information extraction unit 3, an information storage unit 4, a presentation information selection unit 5, and an information presentation unit 6. Software according to the first enlightenment promotion program that performs various processes executed in the information extraction unit 3, the information storage unit 4, the presentation information selection unit 5, and the information presentation unit 6 Realize.

  That is, the information processing apparatus 1 enters from the start step of the first enlightenment promotion processing procedure RT1 according to the first enlightenment promotion program as shown in FIG. 2, and proceeds to the subsequent step SP1.

  In step SP <b> 1, the information processing apparatus 1 takes in batting moving image data D <b> 1 generated by capturing an image of the user's enlightenment user's batting practice to the information input unit 2.

  At this time, as shown in FIG. 3, the information processing apparatus 1 uses the information input unit 2 via the predetermined operation unit (not shown) and the evaluation target user's name and the evaluation value for the enlightenment target user's batting method. The user information S1 of the batting rate (for example, batting rate (result) of the enlightenment user up to that point in the baseball pennant race) is input.

  Thereby, the information processing apparatus 1 processes the input information including the name and batting rate of the user to be enlightened acquired by the information input unit 2 and the batting moving image data D1 from the information input unit 2 as the input information data D2 illustrated in FIG. The data is sent to the trend information extraction unit 3, and the process proceeds to the subsequent step SP2.

  Here, as shown in FIG. 5, the batting moving image 10 based on the batting moving image data D1 is an image of a user to be enlightened (hereinafter, this is represented by a plurality of temporally continuous frame images 10A,..., 10N,. (Referred to as a user image) from the state in which 11 is held in the batter box until the ball 13 is hit with the bat 12 in a two-dimensional plane.

  The batting moving image 10 includes a plurality of joints such as a waist, a shoulder, an elbow, and a knee, a top of the head and both hands, a ball 13 and a bat 12 in each frame image 10A,..., 10N,. Each of the grips 12A and the tip 12B is preliminarily provided with a mark 14 made of a predetermined color circle or the like.

  Therefore, in step SP2, the information processing apparatus 1 performs predetermined image processing on the batting moving image data D1 included in the input information data D2 by the processing tendency information extracting unit 3, and the position of each mark 14 in the batting moving image 10. Thus, the rotation angle of the waist and shoulder from the state in which the user image 11 is held in the batter box to the moment of hitting the ball 13 with the bat 12 is detected.

  Further, as shown in FIG. 6, the information processing apparatus 1 uses the processing tendency information extraction unit 3 to process the batting moving image 10 with a bat 12 among a plurality of frame images 10A,..., 10N,. A frame image 10N that captures the moment of hitting the ball 13 (hereinafter referred to as a frame image at impact) 10N is detected, and a reference virtual straight line that connects the toes of both feet of the user image 11 in the detected frame image 10N at impact. Draw SKL1 (this reference virtual straight line SKL1 corresponds to the ground).

  Then, the information processing apparatus 1 draws the course detection virtual straight line CKL1 passing through the mark 14A on the ball 13 in parallel with the reference virtual straight line SKL1 in the impact-time frame image 10N by the processing tendency information extracting unit 3, and the reference virtual straight line SKL1. And the shortest distance D1 between the course detection virtual straight line CKL1 (that is, the distance between the reference virtual straight line SKL1 and the course detection virtual straight line CKL1 along the perpendicular SL1 perpendicular to both the reference virtual straight line SKL1 and the course detection virtual straight line CKL1). ) Is detected as the height of the ball from the ground (hereinafter referred to as a ball course) at the moment when the enlightenment user actually hits the ball with the bat (that is, the moment of impact).

  In addition, the information processing apparatus 1 causes the processing tendency information extraction unit 3 to perform a first height difference detection virtual that passes through the mark 14B on the grip 12A of the bat 12 in parallel with the reference virtual straight line SKL1 in the impact frame image 10N. A straight line WKL1 and a second vertical difference detection virtual line WKL2 passing through the mark 14C on the tip 12B of the bat 12 in parallel with the reference virtual straight line SKL1 are drawn, and the first and second vertical difference detection virtual lines are drawn. The shortest distance D2 between WKL1 and WKL2 (that is, the first and second height difference detection virtual references WKL1 and the second height difference detection virtual reference line WKL1 perpendicular to both the first and second height difference detection virtual lines WKL1 and WKL2) The distance between WKL2) is the difference in height between the grip and tip of the bat at the moment when the enlightened user actually hits the ball with the bat. Hereinafter, it detects this as is called butt height difference).

  In this way, the information processing apparatus 1 uses the processing tendency information extraction unit 3 to perform a hip from the state in which the enlightenment target user holds the batter box in the batter box to the moment of hitting the ball with the bat, as shown in FIG. If the rotation angle of the shoulder, the ball course, and the bat height difference are detected, these are set as processing tendency information indicating how the enlightening user hits the ball with the bat.

  Then, the information processing apparatus 1 stores the processing trend information extracted from the batting moving image 10 by the processing trend information extraction unit 3 as the processing trend information data D3, and stores the processing trend information data D3 and the input information data D2 in association with each other. The information is sent to the information storage unit 4 as information data D4, and the processing tendency information data D3 is sent to the presentation information selection unit 5 as it is, and then the process proceeds to subsequent steps SP3 and SP4.

  In step SP3, the information processing apparatus 1 stores the stored information data D4 together with the input information data D2 and the processing trend information data D3 as shown in FIG. 8, for example, by the information storage unit 4, and proceeds to step SP5. .

  In step SP4, the information processing apparatus 1 causes the presentation information selection unit 5 to execute a ball course (hereinafter referred to as a reference ball course for comparison) and a bat which are included in the processing tendency information data D3 in parallel with the process in step SP3. Except for the value of the height difference (hereinafter referred to as a reference bat height difference for comparison) and the accumulated information data D4 of the enlightenment user stored in step SP3 in the information accumulation unit 4, all other information already accumulated A ball course (hereinafter referred to as past ball course) and a bat height difference (hereinafter referred to as past bat) included in the accumulated information data (hereinafter referred to as past accumulated information data) D4 as the processing tendency information data D3. Compared with the value of the height difference).

  As a result, the information processing apparatus 1 causes the presentation information selection unit 5 to select the reference ball course value for comparison (the reference in the frame image 10N at impact described above with reference to FIG. 6) from the past accumulated information data D4 as shown in FIG. Value of the reference ball bat height difference for comparison, including past ball course information indicating a value within a predetermined course threshold range SH1 centering on the virtual straight line SKL1 and the course detection virtual straight line CKL1). A value within a predetermined height difference threshold range SH2 centered on (the value of the shortest distance D2 between the first and second height difference virtual lines WKL1 and WKL2 in the impact-time frame image 10N described above with reference to FIG. 6). The past accumulated information data D4 including the past bat height difference information shown is selected.

  Incidentally, a pair of hatched circles D1 and D2 shown in FIG. 9 indicate the value of the reference ball course for comparison and the value of the difference in reference bat height for comparison, which are processing tendency information for the enlightenment target user. Each of the triangle mark, square mark, and the like indicates a past ball course value and a past bat height difference value included as processing tendency information in one past accumulated information data D4.

  Next, the information processing apparatus 1 uses the presentation information selection unit 5 to select the past accumulated information data D4 from the past accumulated information data D4 selected using the comparison reference ball course value and the comparison reference bat height difference value. The past accumulated information data D4 including the best batting rate (that is, the highest evaluation value) as a part of the input information data D2 is selected by comparing the batting information included in.

  In this way, the information processing apparatus 1 uses the presentation information selection unit 5 to select the enlightenment user's batting method from all the past stored information data D4 that has already been stored in the information storage unit 4, as shown in FIG. The past accumulated information data D4 of the user who practiced batting with a batting method similar to the batting method of the enlightenment target user is selected using the reference ball course for comparison of processing tendency information and the reference batting height difference for comparison as the limiting criteria. (That is, after limiting the number of past accumulation information data D4 to be selected), the past accumulation of the user with the best batting ratio using the batting average included in the selected past accumulation information data D4 as a selection criterion. Information data D4 is finally selected.

  As a result, the information processing apparatus 1 causes the presentation information selection unit 5 to perform the batting moving image data D1 included as the input information data D2 in the past storage information data D4 finally selected from the information storage unit 4 as shown in FIG. The batting information is read as presentation information data D5, and the read presentation information data D5 is sent to the information presentation unit 6 and the process proceeds to step SP5.

  In step SP5, the information processing apparatus 1 outputs the batting moving image and batting information based on the presentation information data D5 by the information presentation unit 6 via a monitor and a speaker (not shown) provided in the information presentation unit 6. After presenting to the enlightenment target user, the process proceeds to step SP6, and the first enlightenment promotion processing procedure RT1 is terminated.

  In this way, the information processing apparatus 1 reproduces and presents a batting moving image of another user whose batting rate is similar to that of the enlightenment target user, although the batting method is similar to that of the enlightenment target user. It is made to be able to find a different part between the target user's batting method and another user's batting method as an improved part in the enlightenment target user's batting method, and thus improve the imitated part imitating the other user's batting method. Yes.

  Incidentally, in the case of the first embodiment, the information processing apparatus 1 receives the presentation information addition command C1 via a predetermined operation unit in a state where the presentation information is presented to the enlightenment target user. Is input to the information input unit 2, the additional command C <b> 1 is sent from the information input unit 2 to the presentation information selection unit 5 via the processing trend information extraction unit 3.

  Then, the information processing apparatus 1 reads out information on the rotation angles of the waist and shoulders included as the processing tendency information data D3 in the past storage information data D4 finally selected from the information storage unit 4 by the presentation information selection unit 5, The read information on the rotation angle of the waist and shoulder is sent to the information presentation unit 6 as additional presentation information data D6 together with information on the rotation angle of the waist and shoulder included in the processing tendency information data D3 of the enlightenment target user.

  Thereby, the information processing apparatus 1 outputs the information on the rotation angle of the waist and the shoulder based on the additional presentation information data D6 through the monitor and the speaker by the information presentation unit 6 and presents the information to the user to be enlightened, and thus the user to be enlightened. In addition, it is possible to find different portions between the hitting method of the user and the hitting method of other users not only from the batting moving image but also from the difference in the numerical values of the rotation angles of the waist and the shoulder.

  In the above configuration, the information processing apparatus 1 takes in the batting moving image data D1 generated by capturing an image of the user's enlightenment user's batting practice externally, and inputs the information to the information input unit 2 at this time. It is set as input information data D2 together with the information on the batting average of the enlightened user.

  Then, the information processing apparatus 1 extracts processing tendency information for the enlightening target user's batting method from the batting moving image 10 based on the batting moving image data D1, and processes the processing tendency information data D3 including the extracted processing tendency information. The information is stored in the information storage unit 4 as the stored information data D4 together with the data D1.

  At this time, the information processing apparatus 1 compares the processing trend information data D3 of the enlightenment target user with the processing trend information data D3 included in the past storage information data D4 already stored in the information storage unit 4 to determine the past From the accumulated information data D4, the past accumulated information data D4 including the batting moving image data D1 generated by imaging another user's batting method similar to the enlightenment target user's batting method is selected.

  Next, the information processing apparatus 1 compares the batting information included in the selected past accumulated information data D4, finally selects the past accumulated information data D4 of the user having the best batting rate, and the selected past accumulated The batting moving image based on the batting moving image data D1 included in the information data D4 is presented to the enlightenment target user as the presentation information.

  Accordingly, the information processing apparatus 1 does not particularly require a leader with excellent processing capability, and encourages the enlightening target user to enlighten the improvement location in his own striking method using the presented information, and the enlightening target user's striking method. It is possible to make the user to be enlightened to find an improved part in his own batting method and to improve the imitated part by imitating the other user's batting method. .

  In addition, when the presentation information addition instruction C1 is input while presenting the presentation information to the enlightenment target user, the information processing apparatus 1 processes the past accumulated information data D4 that is finally selected in response thereto. The information on the hip and shoulder rotation angles included as the trend information is presented to the enlightenment target user as additional presentation information together with the information on the hip and shoulder rotation angles included in the processing trend information data D3 of the enlightenment target user.

  Therefore, the information processing apparatus 1 also encourages the enlightenment target user to enlighten the improvement location in his / her batting method even by the additional presentation information, and shows a different location between the enlightenment target user's batting method and another user's batting method. In addition to letting the image be found visually, the difference in the numerical value of the rotation angle of the waist and shoulders allows the user to be enlightened to accurately find it as an improvement location in his own striking method, and other improvements can be found It can be improved by imitating the user's typing method.

  According to the above configuration, the enlightenment user extracted from the batting moving image 10 includes the batting moving image 10 generated by imaging the enlightening target user's batting practice and the batting rate information of the enlightenment target user. The stored information data D4 is stored in the information storage unit 4 together with the processing trend information for the batting method, and the processing trend information for the enlightenment target user's batting method and the past accumulated information data D4 already stored in the information storage unit 4 After comparing the processing trend information included and selecting the past stored information data D4 including the batting method of another user similar to the enlightenment target user's batting method as the batting moving image from the past accumulated information data D4, By comparing the batting information included in the selected past accumulated information data D4, the past accumulated information data of the user having the best batting ratio is compared. Data D4 is finally selected, and the batting moving image included in the finally selected past accumulated information data D4 is presented to the enlightenment target user as the presentation information. Encourage enlightenment of improvement points in the hitting method of the user and make the target user to find the difference between the hitting method of the user targeted for enlightenment and the hitting method of other users as an improvement point in the own hitting method Thus, it is possible to realize an information processing apparatus that can imitate the improved portion by imitating another user's hitting method and thus easily improve the processing capability of hitting a ball to be processed.

  In the first embodiment described above, the processing tendency information data D3 of the enlightenment target user is compared with the processing tendency information data D3 included in the past accumulation information data D4 already accumulated in the information accumulation unit 4. After selecting past stored information data D4 including batting moving image data D1 generated by imaging another user's hitting method similar to the enlightenment target user's hitting method from the past stored information data D4 As described above, the batting information included in the selected past accumulated information data D4 is compared, and the past accumulated information data D4 of the user having the best batting rate is finally selected. Not limited to this, the processing trend information data D3 of the enlightenment target user and the processing trend information included in the past accumulated information data D4 already accumulated in the information accumulation unit 4 Past accumulated information including batting moving image data D1 generated by imaging another user's batting method similar to the enlightenment user's batting method from the past accumulated information data D4 by comparing with the data D3 The data D4 may be selected and a batting moving image based on the batting moving image data D1 included in the selected one or more past accumulated information data D4 may be presented to the enlightenment target user as the presentation information.

  In this way, batting video images of a plurality of users having different batting rates can be sequentially presented as the presentation information to the enlightenment target user, so that the enlightenment target user himself / herself is more than the case of the first embodiment described above. It is possible to find more improvements in the hitting method.

  Further, the processing trend information data D3 of the enlightenment target user and the processing trend information data D3 included in the past storage information data D4 already stored in the information storage unit 4 are compared, and a plurality of past storage information data D4 are compared. By selecting the final past accumulation information data D4, it is possible to reduce the processing load at the time of selection as compared with the first embodiment described above.

  In the first embodiment described above, the case where the user's enlightenment target user's batting moving image is presented as the presentation information has been described. However, the present invention is not limited to this, and the past accumulated information data D4 includes past accumulated information data D4 of the enlightenment target user. When the past accumulated information data D4 of the enlightenment target user is selected, batting based on the batting moving image data D1 included in the accumulated information data D4 A moving image may be presented to the enlightenment target user as presentation information. In this case, for example, if the batting rate of the past batting method is better than the current batting method of the enlightenment target user, the improvement point in the current batting method is compared with the batting method when the past batting rate was good. It can be easily found.

  Further, in the above-described first embodiment, the case where all the past accumulated information data D4 is used when selecting the presentation information to be presented to the enlightenment target user has been described. However, the present invention is not limited to this. When the presentation history of the presentation information for each enlightenment target user is accumulated and the presentation information to be presented to the enlightenment target user is selected, the past accumulation information data D4 used for the past presentation is selected based on the presentation history. Other past accumulated information data D4 excluded may be used.

  In this way, it is possible to prevent the presentation information previously presented to the enlightenment target user from being presented again, and to present new presentation information, thereby enabling the enlightenment target user to improve the location in the striking method from a new viewpoint. Encourage enlightenment. Incidentally, when selecting the presentation information to be presented to the enlightenment target user, the past accumulated information data D4 used for presenting the presentation information is not used for the selection of the subsequent presentation information regardless of the user to be presented. Such processing can also be realized by forcing restrictions.

  Furthermore, in the first embodiment described above, the case where presentation information is selected using the selection conditions described above with reference to FIG. 10 has been described. However, the present invention is not limited to this, and as shown in FIG. One of various selection conditions, or various selection information shown in FIG. 12 and the selection conditions described above with reference to FIG. 10 are combined to selectively use one or more selection conditions to select presentation information. May be.

  Here, the various selection conditions shown in FIG. 12 will be described in detail. When using the first selection condition, the information processing apparatus 1 first determines the value of the reference ball course for comparison and all of the values by the presentation information selection unit 5. After selecting the past accumulated information data D4 including the past ball course information indicating the value in the course threshold range SH1 by comparing with the past ball course value included in the past accumulated information data D4, the selected past accumulated The past storage information data finally selected by comparing past batting information included in the past accumulation information data D4 from the information data D4 and finally selecting the past accumulation information data D4 including the best batting rate. The batting moving image included in D4 is presented to the enlightenment target user.

  In this case, the information processing apparatus 1 presents the batting method having the best batting rate to the enlightening target user from among a plurality of hitting methods in which a ball of a ball course that is substantially the same as the ball hit by the enlightening target user is presented. It is possible to enlighten the user to be enlightened about the improvement points in his own batting method.

  In addition, when using the second selection condition, the information processing apparatus 1 uses the presentation information selection unit 5 to store the reference ball course value for comparison included in the processing tendency information data D3 of the enlightenment target user and the information storage unit 4. Comparing the values of past ball courses included in the accumulated past accumulated information data D4 and comparing information of batting rates (hereinafter referred to as past batting rates) included in the past accumulated information data D4. The past accumulated information data D4 including the past ball course information including the past ball course information indicating the values in the course threshold range SH1 and including a value equal to or larger than a predetermined threshold set in advance is selected.

  Then, the information processing apparatus 1 uses the presentation information selection unit 5 to compare the value of the past bat height difference included in the selected past accumulated information data D4 with the value of the reference bat height difference for comparison. Past accumulated information data D4 including past bat height difference information that indicates a value outside the height difference threshold range SH2 from the past accumulated information data D4 and has the largest difference from the reference bat height difference value for comparison. Finally, the batting moving image included in the past selected information data D4 finally selected is presented to the enlightenment target user.

  In this case, the information processing apparatus 1 enlightens a striking method with the most different bat swinging method from among a plurality of striking methods that hit a ball of the same ball course as the ball hit by the enlightenment target user and have a certain hit rate. It can be presented to the target user, and the enlightenment target user can be enlightened about the improvement points in his batting method.

  Furthermore, when using the third selection condition, the information processing apparatus 1 uses the presentation information selection unit 5 to store the reference ball course value for comparison included in the processing tendency information data D3 of the enlightenment target user and the information storage unit 4. A value in the course threshold range SH1 is compared by comparing the past ball course value included in the accumulated past accumulated information data D4 and comparing the past hit rate information included in the past accumulated information data D4. The past accumulated information data D4 including the past ball course information to be displayed and including the past batting average having a value equal to or larger than a predetermined threshold set in advance is selected.

  Then, the information processing apparatus 1 finally selects, for example, one past accumulated information data D4 at random from the selected past accumulated information data D4 by the presentation information selection unit 5, and the past past selected The batting moving image included in the accumulated information data D4 is presented to the enlightenment target user.

  In this case, the information processing apparatus 1 hits the enlightenment target user with a batting method that is randomly selected from a plurality of batting methods that hit a ball of almost the same ball course as the enlightenment target user. By presenting, it is possible to enlighten the enlightened user in anticipation to some degree of chance of an improvement in his batting method.

  Furthermore, when using the fourth selection condition, the information processing apparatus 1 uses the presentation information selection unit 5 to compare the reference ball course for comparison and the reference bat height difference value included in the processing tendency information data D3 of the enlightenment target user. The past ball course information indicating the value within the course threshold range SH1 by comparing the past ball course and the past bat height difference value included in the past accumulated information data D4 already accumulated in the information accumulation unit 4 The past accumulated information data D4 including the past bat height difference information including and indicating the value within the height difference threshold range SH2 is selected.

  Then, the information processing apparatus 1 compares the past batting information included in the past accumulated information data D4 selected by the presentation information selection unit 5 with the past accumulated information data D4 including the worst batting rate. Is finally selected and the batting moving image included in the finally selected past accumulated information data D4 is presented to the enlightenment target user.

  In this case, the information processing apparatus 1 presents the enlightenment target user with the batting method having the worst batting rate from a plurality of batting methods similar to the enlightenment target user's batting method. Enlighten improvement points. By the way, if the fourth selection condition is used, the enlightened user can be reconfirmed by a teacher on the other hand by the presentation of the finally selected hitting method.

  Further, when the fifth selection condition is used, the information processing apparatus 1 stores information on the batting rate of the enlightening target user (hereinafter referred to as a reference batting rate for comparison), for example, in the processing trend information data D3 of the enlightening target user. In addition, by the presentation information selection unit 5, the reference ball course for comparison, the reference bat height difference for comparison and the reference batting rate for comparison included in the processing tendency information data D <b> 3 of the enlightenment target user, and the information storage unit 4 have already been stored. The past ball course information indicating values in the course threshold range SH1 by comparing the past ball course, the past bat height difference and the past batting value included in the past accumulated information data D4, and the height difference threshold range The past accumulated information data including both the past bat height difference indicating the value in SH2 and the past batting value indicating a value within a predetermined batting threshold threshold range centering on the reference batting value for comparison. To select the data D4.

  Then, the information processing apparatus 1 uses the presentation information selection unit 5 to compare the past batting information included in the selected past accumulated information data D4 with the past accumulated information data D4 including the best batting rate. Is finally selected and the batting moving image included in the finally selected past accumulated information data D4 is presented to the enlightenment target user.

  In this case, the information processing apparatus 1 presents a batting method having the best batting rate to the enlightening target user among a plurality of batting methods that are similar to the enlightening target user's batting method and have almost the same ability (that is, batting rate). Since the difference between the presented striking method and the striking method of the enlightenment target user is slight, the improvement target user can be easily enlightened with the enlightening target user.

  Further, when using the sixth selection condition, the information processing apparatus 1 randomly selects, for example, one piece of past accumulated information from the past accumulated information data D4 already accumulated in the information accumulating unit 4 by the presentation information selecting unit 5. The data D4 is selected, and the batting moving image included in the selected past accumulated information data D4 is presented to the enlightenment target user.

  In this case, the information processing apparatus 1 presents the randomly selected striking method to the enlightenment target user so that the enlightenment target user is fully enlightened with the expectation of the improvement in his / her striking method entirely. Can do.

  Incidentally, in the information processing apparatus 1, when the above-described fifth selection condition is used, even if the batting information is not stored in the processing tendency information data D <b> 3 of the enlightenment target user, the presentation information selection unit 5 performs the information accumulation unit. The final selection of the stored information data D4 can also be realized by using batting information included in all the stored information data D4 stored in 4 (including the stored information data D4 of the enlightenment target user). it can.

  In addition, when using batting information in each of the selection conditions described above, the batting average below the predetermined threshold or the batting average of the enlightenment target user is not required, even if the batting average is not specified as the minimum and maximum batting ratios or batting ratios higher than the predetermined threshold. Good or bad batting rate, batting rate with a value greater than a predetermined threshold from the batting rate of the user to be enlightened, batting rate separated from the batting rate of the enlightenment user with a predetermined first threshold and less than the second threshold, and further the user to be enlightened The past stored information data D4 can be selected even under conditions such as batting rate that is substantially the same as (similar to) batting rate.

  Further, as selection conditions used for selection of the stored information data D4, selection conditions described above with reference to FIG. 10 and selection conditions obtained by exchanging a part of the first to sixth selection conditions described above with reference to FIG. Various selection conditions can be used in addition to the selection conditions using the rotation angle.

  In addition to this, in the information processing apparatus 1, the limited reference ball course, the bat height difference, and the batting rate are individually used under the selection conditions described above with reference to FIGS. 10 and 12. For example, a square root of the sum of squares is calculated using at least two reference bat height differences for comparison and a reference batting rate for comparison, and a predetermined threshold space and a past ball course based on the calculation result in the Euclidean space, Similarly, the past accumulated information data D4 may be limited by comparing the result of calculating the square root of the sum of squares using at least two of the past bat height difference and the past batting rate.

  Further, the information processing apparatus 1 calculates, for example, the sum of absolute differences using at least two reference ball courses for comparison, a reference bat height difference for comparison, a reference batting rate for comparison, and the like. A comparison between a predetermined threshold space as a reference and a result of calculating a sum of absolute differences using at least two or more of the past ball course, a past bat height difference, a past hit rate, and the like, and the past accumulated information data D4 You may make it limit.

  Furthermore, in the information processing apparatus 1, a predetermined reference threshold range SH1, a height difference threshold range SH2, a batting threshold threshold range, and the like centered on a comparative reference ball course for comparison, a reference bat height difference for comparison, a reference batting ratio for comparison, and the like. At least two or more may be integrated, and the accumulated product space obtained may be compared with at least two or more of the past ball course, past bat height difference, past batting rate, etc. to limit the past accumulated information data D4. .

  Similarly, in the information processing apparatus 1, the selection reference butt height difference and batting rate are individually used under the selection conditions described above with reference to FIGS. 10 and 12, but the selection reference comparison reference butt height difference and comparison reference are also used. For example, the square root of the sum of squares is calculated using at least two batting rates and the like, and a predetermined threshold space based on the calculation result in the Euclidean space, the past bat height difference, the past batting rate, etc. are similarly at least two or more. The final past stored information data D4 may be selected by comparing the result of calculating the square root of the sum of squares using.

  Further, the information processing apparatus 1 calculates, for example, a sum of absolute differences using at least two or more comparison reference bat height differences and comparison reference batting rates as selection criteria, and a predetermined threshold value based on the obtained calculation result. Similarly, the final past accumulated information data D4 may be selected by comparing the space and the result of calculating the sum of absolute differences using at least two or more past bat height differences and past batting rates.

  Furthermore, in the information processing apparatus 1, at least two or more of a predetermined height difference threshold range SH2 and a batting threshold threshold range centered on the reference bat height difference for comparison and the reference batting ratio for comparison are obtained. The final past accumulated information data D4 may be selected by comparing the product space with at least two of the past bat height difference and past batting rate as well.

  Further, in the above-described first embodiment, the case where the information storage unit 4 stores the storage information data D4 including the input information data D2 and the processing tendency information data D3 has been described. Not limited to this, at least the input information data D2 may be stored in the information storage unit 4 as stored information data. In this case, each time the presentation information is selected, the input information data D2 of the enlightenment target user and What is necessary is just to extract process tendency information from accumulation | storage information data (namely, input information data D2).

  Furthermore, in 1st Embodiment mentioned above, the processing method performed with respect to a process target (ball) by the enlightenment object user in the series of processes shown in the 1st enlightenment promotion process procedure RT1 mentioned above about FIG. 2 is represented. As the information, the case of using the batting moving image 10 generated by capturing the state of the batting practice with one video camera has been described. However, the present invention is not limited to this, and the batting practice by the user to be enlightened Using a batting moving image composed of 3D moving images generated by taking two video cameras to capture the situation of the enlightenment user during a baseball game or a baseball game So as to use a plurality of two-dimensional and / or three-dimensional moving images obtained by imaging a user's enlightenment target in a plurality of angles. And it may be.

  Incidentally, if a batting moving image composed of such a three-dimensional moving image is used, processing tendency information (for example, a ball) is obtained by processing the batting moving image three-dimensionally. As a course, a lower inner angle and a higher outer angle) can be extracted. If the batting moving image composed of such a three-dimensional moving image and the selection conditions described above with reference to FIG. 10 and the first to fifth selection conditions described above with reference to FIG. It is possible to present almost the same batting method as the batting method.

  Furthermore, in the above-described first embodiment, the case where the enlightenment target user is encouraged to be enlightened about the improvement method of the batting method in the baseball batting to improve the processing capability has been described. Not only this but enlightenment of the improvement part of the processing technique in various other processing which uses a ball as a processing target like golf, tennis, etc. with respect to a user for enlightenment, and aims at improvement of processing capacity Even in these various processes, it is possible to obtain the same effects as those of the first embodiment described above. By the way, when encouraging enlightenment of the improvement part of the processing method in various other processes using the ball as a processing target such as golf or tennis for the enlightening target user, processing as an evaluation value The score, handicap, winning percentage, etc. according to the score may be used.

(2) Second Embodiment In FIG. 13, reference numeral 50 denotes an information processing apparatus according to the second embodiment as a whole, which is extracted from a moving image for object extraction according to a region extraction operation performed by each user. Each time an area extraction process for extracting an object specification area for specifying a target object is executed, a series of area extraction processing screens displayed by appropriately changing display contents during the area extraction process are extracted. Is stored as area extraction history screen data representing the process of (that is, the user's area extraction method for extracting the object designated area from the object extraction moving image to be processed).

  Each time the information processing apparatus 50 executes the region extraction process, the user who has performed the region extraction operation at that time from the region extraction history screen data that has already been accumulated (hereinafter referred to as an enlightened user). By selecting and presenting region extraction history screen data that would help to improve the region extraction method (that is, the processing method for the processing target of the user to be enlightened), It is designed to promote awareness of improvements.

  In this case, the information processing apparatus 50 includes a region extraction unit 51, a processing tendency information extraction unit 52, an information storage unit 53, a presentation information selection unit 54, and an information presentation unit 55. According to the second enlightenment promotion program, the information extraction unit 52, the information storage unit 53, the presentation information selection unit 54, and the information presentation unit 55 perform various processes to be performed to enlighten the user to be enlightened about the improvement location of his area extraction method. Realized in software.

  That is, as shown in FIG. 14, the information processing apparatus 50 proceeds to the subsequent region extraction processing routine SRT51 after entering from the start step of the second enlightenment promotion processing procedure RT50 according to the second enlightenment promotion program.

  As shown in FIG. 15, the information processing apparatus 50 includes an image input circuit 60, an image recording circuit 61, a motion vector detection recording circuit 62, a setting information recording circuit 63, a propagation region determination circuit 64, a user interface circuit 65, a contour. The region extraction processing routine SRT51 is executed by the region extraction unit 51 including the / region conversion circuit 66, the region generation / recording circuit 67, and the region output circuit 68.

  At this time, as shown in FIG. 16 and FIG. 17, the information processing apparatus 50 enters from the start step of the region extraction processing routine SRT51 and proceeds to the next step SP51, and the object extraction moving image supplied from the outside in the step SP51. The image data D50 is taken into the image input circuit 60 of the region extraction unit 51.

  Here, as shown in FIG. 18, the object extraction moving image 70 based on the object extraction moving image data D50 includes a plurality of frame images (hereinafter referred to as regions) including the object 71 to be extracted. 70A to 70G (referred to as extraction frame images).

  At this time, the information processing apparatus 50 sends the object extraction moving image data D50 taken into the image input circuit 60 to the image recording circuit 61 in units of frame image data (hereinafter referred to as region extraction frame image data) D51. The area extraction frame image data D51 constituting the object extraction moving image data D50 is sequentially read out from the image recording circuit 61 and sent to the motion vector detection recording circuit 62.

  Then, the information processing apparatus 50 causes the motion vector detection processing circuit 62 to use a motion vector for each predetermined unit block such as a macro block in the plurality of region extraction frame image data D51 (for example, for each predetermined unit block in the past and (Bidirectional motion vectors between adjacent region extraction frame images 70A to 70G,... In the future) and the detected motion vectors for each region extraction frame image data D51 are respectively detected as region extraction frame images. Recording is performed in association with the identification information of the data D51, and the process proceeds to step SP52.

  In step SP52, the information processing apparatus 50 sends the region extraction processing screen data D52 from the user interface circuit 65 to the information presenting unit 55, thereby performing region extraction processing on a monitor (not shown) provided in the information presenting unit 55. An area extraction processing screen (not shown) having an instruction selection area, an image display area of an object extraction moving image, and the like is displayed based on the screen data D52.

  In this state, the information processing apparatus 50 waits for input of various extraction processing instructions C50 for performing the extraction processing of the object designated area on the area extraction processing screen by the enlightenment target user. When the extraction processing instruction C50 is input, it is fetched into the user interface circuit 65, and the process proceeds to step SP53.

  In step SP53, the information processing apparatus 50 uses the user interface circuit 65 to extract a plurality of area extraction frame images 70A to 70G in which the extraction processing instruction C50 input by the enlightenment target user constitutes the object extraction moving image 70. In order to designate the outline of the object 71 that is the basis of the object designated area from among the above, for example, one area extraction frame image 70A,..., Or 70G is arbitrarily set as a work frame image for outline designation. It is determined whether it is a frame setting command.

  If an affirmative result is obtained in step SP53, this indicates that the extraction processing instruction C50 input by the enlightenment target user is a work frame setting instruction. At this time, the information processing apparatus 50 proceeds to step SP54.

  In step SP54, the information processing apparatus 50 reads the object extraction moving image data D50 from the image recording circuit 61 by the user interface circuit 65 in units of area extraction frame image data D51, and the read area extraction frame image data D51. It is combined with the area extraction processing screen data D52 and sent to the information presentation unit 55.

  As a result, the information processing apparatus 50 displays the region extraction frame images 70A to 70G, for example, for each predetermined number of frames in the image display area in the region extraction processing screen in the information presentation unit 55 as shown in FIG. The target user visually recognizes the object extraction moving image 70 while comparing the region extraction frame images 70A to 70G with a predetermined number of frames.

  As a result, the information processing apparatus 50 causes the enlightenment user to select one area extraction frame image for specifying the contour of the object 71 from among the plurality of area extraction frame images 70A to 70G on the area extraction processing screen. When 70D is arbitrarily selected according to the ease of designating the contour, the identification information of the selected region extraction frame image 70D is used as work frame setting information from the user interface circuit 65 to the setting information recording circuit 63. The one region extraction frame image 70D selected by the capture and recording is set as a work frame image for contour specification, and the process returns to step SP52.

  On the other hand, if a negative result is obtained in step SP53 described above, this indicates that the extraction processing instruction C50 input by the enlightenment target user is an instruction other than the work frame setting instruction. The processing device 50 moves to step SP55.

  In step SP55, the information processing apparatus 50 uses the user interface circuit 65 to arbitrarily extract any time-continuous instruction C50 input by the enlightenment target user based on the contour specified in the work frame image 70D. It is determined whether or not it is a correction mode setting command for setting, as a correction mode, a method for correcting the object designated areas generated in the frame extraction region images 70A to 70G having the number of frames.

  If a positive result is obtained in step SP55, this indicates that the extraction processing instruction C50 input by the enlightenment target user is a correction mode setting instruction, and at this time, the information processing apparatus 50 proceeds to step SP56.

  In step SP56, the information processing apparatus 50 captures, as mode setting information, information indicating addition or deletion arbitrarily selected as a method for correcting the object designated area by the enlightenment target user from the user interface circuit 65 to the setting information recording circuit 63 and records it. Thus, the addition or deletion selected by the enlightenment target user is set to the correction mode for the object designation area, and the process returns to step SP52.

  If a negative result is obtained in step SP55 described above, this indicates that the extraction processing instruction C50 input by the enlightenment target user is an instruction other than the work frame setting instruction and the correction mode setting instruction. When this happens, the information processing apparatus 50 proceeds to step SP57.

  In step SP57, the information processing apparatus 50 extracts a region by which the user interface circuit 65 causes the extraction processing instruction C50 input by the enlightenment target user to propagate the generation based on the generation of the object designation region for the work frame image 70D. Other frame image 70A to 70C, 70E to 70G,..., And other areas for propagating the correction based on the correction to the object designation area generated for any of the area extraction frame images 70A to 70G,. It is determined whether the command is a propagation range setting command for setting region extraction frame images 70A to 70C, 70E to 70G,.

  If a positive result is obtained in step SP57, this indicates that the extraction processing instruction C50 input by the enlightenment target user is a propagation range setting instruction, and the information processing apparatus 50 proceeds to step SP58 at this time. .

  In step SP58, the information processing apparatus 50 reads a plurality of area extraction frame image data D51 constituting the object extraction moving image data D50 from the image recording circuit 61 by the user interface circuit 65, and reads the read area extraction frames. By combining the image data D51 with the area extraction processing screen data D52 and sending it to the information presentation unit 55, a predetermined frame is displayed in the image display area in the area extraction processing screen, for example, in response to an image switching request of the enlightenment target user. Several region extraction frame images 70A to 70G,... Are displayed and made visible to the enlightenment target user.

  In this state, for example, as shown in FIG. 19, the information processing apparatus 50 extracts one or a plurality of areas for creating and propagating an object designation area or for correcting and propagating an object designation area on the area extraction processing screen by the enlightenment target user. When the frame images 70B to 70F are selected, the identification information and the like of the selected region extraction frame images 70B to 70F are captured from the user interface circuit 65 to the setting information recording circuit 63 and recorded as propagation range setting information.

  Thereby, the information processing apparatus 50 sets one or a plurality of continuous region extraction frame images 70B to 70F selected by the enlightenment target user to the region extraction frame images 70B to 70F in the propagation range, and then proceeds to step SP52. Return.

  Incidentally, when a propagation range setting command is input before the generation of the object designation area for the work frame image 70D, the information processing apparatus 50 selects one or a plurality of area extraction frame images 70A to 70G,. Are set in the region extraction frame images 70A to 70G,... Of the propagation range in which the generation of the object designated region is propagated (hereinafter referred to as the generation propagation range).

  The information processing apparatus 50 then propagates the generation propagation range to propagate the modification of the object designation region until a propagation range setting command is input after the generation of the object designation region for the work frame image 70D (hereinafter, this is corrected). When a propagation range setting command is input after the generation of the object specification area, one or a plurality of area extraction frames newly selected at that time are generated separately from the generation propagation range. The images 70A to 70G,... Are set as the region image frame data D70A to 70G,.

  However, the information processing apparatus 50 selects the region extraction frame images 70A to 70G,... Beyond the generation propagation range (that is, the past and future in time than the generation propagation range) when setting the correction propagation range. For the selected region extraction frame images 70A to 70G,..., A warning sound is output via the information presentation unit 55 and / or the region extraction is performed because no object designation region is generated. An error message is displayed on the processing screen to notify the enlightened user that the selection is invalid.

  Furthermore, if a negative result is obtained in step SP57 described above, this means that the extraction processing command C50 input by the enlightenment target user is a command other than the work frame setting command, the correction mode setting command, and the propagation range setting command. In this case, the information processing apparatus 50 proceeds to step SP59.

  In step SP59, the information processing apparatus 50 determines whether or not the extraction processing command C50 input by the user to be enlightened by the user interface circuit 65 is a contour specifying command for specifying the contour of the object 71 in the work frame image 70D. Judging.

  If an affirmative result is obtained in step SP59, this means that the extraction processing command C50 input by the enlightenment target user is a process corresponding to at least the work frame setting command and the propagation range setting command for the generation propagation range (step SP54). In addition, the information processing apparatus 50 proceeds to step SP60. At this time, the information processing apparatus 50 proceeds to step SP60.

  In step SP60, the information processing apparatus 50 uses the user interface circuit 65 to extract from the image recording circuit 61, for example, frame image data D51 for extracting the region of the generated propagation range and a region that is one frame past and future in time from the generated propagation range. The frame image data D51 is read out, and the read area extraction frame image data D51 is combined with the area extraction processing screen data D52 and sent to the information presentation unit 55.

  As a result, as shown in FIG. 20, the information processing apparatus 50 causes the information presentation unit 55 to generate a generation propagation range in the image display area in the area extraction processing screen and the region extraction frame images 70A to 70G before and after the generation propagation range. Is displayed.

  In this state, the information processing apparatus 50 obtains this result when the enlightenment user specifies and arbitrarily traces the outline of the object 71 in the work frame image 70D on the area extraction processing screen via a mouse or the like. An input contour signal S50 corresponding to the input contour 73 (that is, the trace traced by the enlightenment user) is taken into the user interface circuit 65.

  The information processing apparatus 50 samples the input contour signal S50 at a predetermined sampling interval by the user interface circuit 65 and converts it into digital data, thereby forming a plurality of input contour forming points corresponding to the input contour signal S50. (Represented by coordinates in the work frame image 70D) is generated, and the generated set data of the plurality of input contour forming points is sent to the contour / region converting circuit 66 as input contour forming point group data D53.

  The information processing apparatus 50 generates an input contour interpolation line corresponding to the input contour 73 by interpolating between input contour forming points based on the input contour forming point group data D53 by the contour / region converting circuit 66, and An object designation reference corresponding to an object designation area (hereinafter referred to as an object designation reference area) for designating the object 71 in the work frame image 70D by painting the area surrounded by the input contour interpolation line with a predetermined color. Area data D54 is generated, and the generated object designation reference area data D54 is sent to the propagation area determination circuit 64 and the area generation recording circuit 67, and the process proceeds to step SP61.

  In step SP61, the information processing apparatus 50 reads out the work frame setting information and the propagation range setting information from the setting information recording circuit 63 by the propagation region determination circuit 64, and also sets the work frame setting information and the propagation range setting information (that is, for region extraction). Based on the identification information of the frame image data D51), motion vectors of predetermined unit blocks in all the region extraction frame images (including work frame images) 70B to 70F in the generated propagation range are read from the motion vector detection recording circuit 62.

  Then, the information processing apparatus 50 operates within the generation propagation range for all the predetermined unit blocks related to the object designation reference region based on the motion vector read from the motion vector detection recording circuit 62 by the propagation region determination circuit 64. The movement destination positions for the other region extraction frame images 70B, 70C and 70E, 70F excluding the frame image 70B are detected.

  As a result, the information processing apparatus 50 causes the propagation area determination circuit 64 to generate the movement destination position of the detected predetermined unit block based on the object designation reference area and generate other object designation areas. Propagation region information to be propagated to the region extraction frame images 70B, 70C and 70E, 70F is transmitted to the region generation / recording circuit 67 as propagation region information data D55.

  Further, the information processing apparatus 50 uses the region generation / recording circuit 67 to generate all the predetermined unit blocks related to the object designation reference region based on the propagation region information data D55, respectively, for each region extraction frame image 70B, 70C of the generated propagation range. , 70E and 70F, the object designation reference area is propagated to the individual area extraction frame images 70B, 70C and 70E and 70F, respectively, and the individual area extraction frame images 70B and 70C are respectively transmitted. , And 70E and 70F, respectively, an object designation area for designating the object 71 (hereinafter referred to as an object designation propagation area).

  When the information processing apparatus 50 generates an object designated propagation area by the area generation / recording circuit 67 as shown in FIG. 21, the change of the object 71 in the area extraction frame images 70B to 70F in the generation propagation range (that is, Regardless of the temporal movement of the object 71 in the generation propagation range, the predetermined unit block 75 related to the object designation reference area 74 is simply moved according to the motion vector.

  At this time, if the predetermined unit block 75 is simply moved, the predetermined unit blocks 75 moved with respect to the individual region extraction frame images 70B, 70C and 70E, 70F are separated from each other in the object designated propagation region. A hole 76 in which filling with a predetermined color is interrupted may occur.

  For this reason, the information processing apparatus 50 uses the area generation / recording circuit 67 to move the predetermined unit blocks 75 in the object designation reference area 74 according to the motion vectors, and then performs expansion and image processing on the predetermined unit blocks 75. By applying the reduction process, the hole 76 is almost closed and an object designated propagation area is generated.

  In this way, when the information processing apparatus 50 generates the object designation propagation area for each of the area extraction frame images 70B, 70C, 70E, and 70F in the generation propagation range, the area generation recording circuit 67 causes the object designation reference area and each object to be generated. The designated propagation region is recorded in association with the identification information of the region extraction frame image data D51 for the generated propagation range, and the object designated reference region and each object designated propagation region are stored in the object designated region data D56 from the region creation recording circuit 67. To the user interface circuit 65.

  Then, the information processing apparatus 50 uses the user interface circuit 65 to, for example, generate the generation propagation range region extraction frame image data D51 from the image recording circuit 61 and the region extraction frame that is one frame past and future in time from the generation propagation range. Image data D51 is read.

  At this time, the information processing apparatus 50 generates designated area presentation image data by combining the area extraction frame image data D51 of the generation propagation range with the object designated area data D56 by the user interface circuit 65, and the designated area. The presentation image data and the remaining region extraction frame image data D51 are combined with the region extraction processing screen data D52 and sent to the information presentation unit 55.

  As a result, the information processing apparatus 50 adds the object designation reference area 74 to the work frame image 70D based on the designated area presentation image data in the image display area in the area extraction processing screen in the information presentation section 55 as shown in FIG. In addition to displaying in an overlapping manner, the object designated propagation regions 77A to 77D corresponding to the other region extraction frame images 70B, 70C, 70E, and 70F for the generated propagation range are displayed in a superimposed manner, and the regions before and after the generated propagation range are extracted. By displaying the frame images 70A and 70G for use, the object designated area generation result is presented to the enlightenment target user, and the process returns to step SP52.

  If a negative result is obtained in step SP59 described above, this means that the extraction processing command C50 input by the enlightenment target user is a command other than the work frame setting command, the correction mode setting command, the propagation range setting command, and the contour specifying command. In this case, the information processing apparatus 50 proceeds to step SP62.

  In step SP62, the information processing apparatus 50 determines whether the extraction processing instruction C50 input by the user to be enlightened by the user interface circuit 65 is an area correction instruction for correcting the object designation reference area 75 and the object designation propagation areas 77A to 77D. Judge whether or not.

  If an affirmative result is obtained in step SP62, this means that the extraction processing command C50 input by the enlightenment target user is processed according to the work frame setting command, the correction mode setting command, the propagation range setting command, and the contour specifying command. (The processing described above in step SP54, step SP56, step SP58, step SP60 and step SP61) has already been executed, and represents an area correction command input. At this time, the information processing apparatus 50 proceeds to step SP63. Move.

  Here, the information processing apparatus 50 has the holes generated in the state in which the predetermined unit blocks 75 relating to the object designation reference area 74 are simply moved according to the motion vectors in the object designation propagation areas 77A to 77D generated by the area generation recording circuit 67. If 76 is relatively small, the hole 76 can be closed by subsequent expansion and contraction processes.

  However, if the hole 76 is relatively large, the information processing apparatus 50 cannot close the hole 76 even if the predetermined unit block 75 after the movement is expanded and contracted, and the object designated propagation areas 77A to 77D. In FIG. 22, the hole 76 remains.

  Further, when the information processing apparatus 50 generates the object designation propagation area by the area generation / recording circuit 67, it is also apparent from FIG. 21 by simply moving the predetermined unit block 75 related to the object designation reference area 74 according to the motion vector. In this way, the original arrangement of the predetermined unit blocks 75 varies depending on the movement destination, and as a result, as shown in FIG. , This is referred to as a protruding portion) 78 and a recessed portion (not shown) may be generated inside the object 71.

  The protrusions 78 and the like generated in the object designated propagation areas 77A to 77D are moved to the other object designated propagation areas 77A to 77D by moving the predetermined unit block relating to the object designated propagation areas 77A to 77D in which the protrusions 78 are produced. May be generated in the object designated propagation areas 77A to 77D.

  For this reason, in step SP63, the information processing apparatus 50 sends the area extraction processing screen data D52 obtained by synthesizing the latest designated area presentation image data at that time from the user interface circuit 65 to the information presentation section 55. For example, the region extraction processing screen described above with reference to FIG. 22 is displayed.

  In this state, the information processing apparatus 50, as shown in FIGS. 23A and 23B, provides one object designation reference area 74 or object designation propagation area 77A to 77A to be corrected on the area extraction processing screen by the enlightenment target user. 77D is specified, and the correction location (hole 76, protruding portion 78, etc.) of the object specification reference region 74 or the object specification propagation regions 77A to 77D to be corrected is traced around the correction location via a mouse or the like. When the frames 79A and 79B are formed, the identification information of the area extraction frame image data D51 corresponding to the object designation reference area 74 or the object designation propagation areas 77A to 77D to be corrected, and the frames 79A and 79B are displayed. When a correction location instruction signal S51 including the corresponding frame signal is input, Taken into over The interface circuit 65.

  Incidentally, at this time, the information processing apparatus 50 displays the generation propagation range and the region extraction frame images (including work frame images) 70A to 70G before and after the generation propagation range in the image display region in the region extraction processing screen. Thus, it is possible to relatively easily analogize the protruding portion 78 with respect to the object designated propagation regions 77A to 77D from the shape of the object designated reference region 74 and the shape of the object 71 in the region extraction frame images 70A and 70G before and after the generation propagation range. So that it can be identified.

  The information processing apparatus 50 uses the user interface circuit 65 to sample the frame signal included in the correction location instruction signal S51 at a predetermined sampling interval and convert it into digital data, thereby to obtain a plurality of frame formation points (corresponding to the frame signal). Region extraction frame images 70B to 70F) are generated, and the generated set data of a plurality of frame formation points (hereinafter referred to as frame formation point group data) is used as the correction location instruction signal S51. Along with the included identification information, it is sent to the contour / region conversion circuit 66 as correction location instruction data D57.

  In addition, the information processing apparatus 50 interpolates between the frame formation points based on the frame formation point group data obtained based on the correction location instruction data D57 by the contour / region conversion circuit 66, thereby corresponding to the frames 79A and 79B. Propagation region determination circuit that generates an interpolation line and uses the correction location indication region data that represents the region surrounded by the frame interpolation line as the correction location indication region and the identification information included in the correction location indication data D51. 64 and the area generation recording circuit 67.

  The information processing apparatus 50 reads the propagation range setting information from the setting information recording circuit 63 by the propagation region determination circuit 64 and moves based on the propagation range setting information (that is, the identification information of the region extraction frame image data D51). The motion vectors of predetermined unit blocks in all the region extraction frame images (including work frame images) 70B to 70F in the corrected propagation range are read from the vector detection recording circuit 62.

  Then, the information processing apparatus 50 corrects all the predetermined unit blocks in the correction location indication area within the correction propagation range based on the motion vector read from the motion vector detection recording circuit 62 by the propagation area determination circuit 64. The movement destination position is detected with respect to the other region extraction frame images 70B to 70F excluding the region extraction frame images 70B to 70F corresponding to the target object specification reference region 74 or the object specification propagation regions 77A to 77D.

  As a result, the information processing apparatus 50 causes the propagation area determination circuit 64 to modify the detected movement destination position of the predetermined unit block to the object specification reference area 74 or the object specification propagation areas 77A to 77D to be corrected. The information is transmitted to the area generation / recording circuit 67 as propagation area information to be propagated to the other object designation reference area 74 or the object designation propagation areas 77A to 77D.

  Furthermore, the information processing apparatus 50 reads out the correction mode setting information indicating the correction mode set at that time from the setting information recording circuit 63 by the area generation recording circuit 67 and also stores the already-stored object designation reference area 74 or Of the object designation propagation areas 77A to 77D, the object designation reference area 74 or the object designation propagation areas 77A to 77D to be modified corresponding to the identification information included in the modification instruction data D58 is selected and read.

  Then, the information processing apparatus 50 retrieves the correction location instruction area data included in the correction instruction data D58 by using the area generation recording circuit 67, and sets the correction location instruction area based on the correction location instruction area data as the object designation reference area 74 to be corrected. Or it overlaps with the object designated propagation areas 77A to 77D.

  In this state, if the correction mode at that time is deleted based on the correction mode setting information by the area generation recording circuit 67, the information processing apparatus 50, for example, as shown in FIG. , The portion 77AX that overlaps with the correction location indication region 79AX is deleted, thereby obtaining the object designated propagation region 77AY that has been corrected by shaving the protruding portion 78.

  If the correction mode at that time is added based on the correction mode setting information by the area generation recording circuit 67, the information processing apparatus 50 corrects the object in the object designated propagation area 77B, for example, as shown in FIG. By adding a filled region of a predetermined color to a location 77BX that overlaps the location indication region 79BX, an object designated propagation region 77BY that is corrected by closing the hole 76 is obtained.

  Then, the information processing apparatus 50 uses the area generation / recording circuit 67 to determine all the predetermined unit blocks (predetermined unit blocks that have been newly painted or canceled by the correction) based on the propagation area information. The correction in the object designation reference area 74 or the object designation propagation areas 77A to 77D to be corrected is performed by moving the correction propagation range to the movement destination position with respect to the other area extraction frame images 70B to 70F. Alternatively, it is propagated to the object designated propagation areas 77A to 77D.

  In this way, the information processing apparatus 50 responds to a correction request for one object specification reference area 74 or object specification propagation areas 77A to 77D to be corrected, and the object specification reference area 74 or object specification propagation areas 77A to 77A to be corrected. 77D and other object designation reference area 74 or object designation propagation areas 77A to 77D can be corrected together.

  In other words, the information processing apparatus 50, if a protruding portion 78 or the like occurs in any of the object specified propagation regions 77A to 77D among the plurality of object specified propagation regions 77A to 77D, the object specified propagation region in which the protruding portion 78 or the like has occurred. Since protruding portions may also occur in the other object designated propagation areas 77A to 77D generated based on 77A to 77D, any one of the plurality of object designated propagation areas 77A to 77D is selected. The other object designated propagation areas 77A to 77D can be easily corrected to reflect the correction by simply requesting the correction to 77D to 77D.

  Then, the information processing apparatus 50 converts the new object designation reference area 74 or object designation propagation areas 77A to 77D obtained by the area generation / recording circuit 67 to the object designation reference area 74 or object designation propagation area 77A before modification. The object designation reference area 74 and the object designation propagation areas 77A to 77D that are recorded and held are updated by overwriting and recording to 77D.

  The information processing apparatus 50 sends the updated object designation reference area 74 and object designation propagation areas 77A to 77D to the user interface circuit 65 again as object designation area data D59 by the area generation recording circuit 67.

  Then, the information processing apparatus 50 reads the generation propagation range and the region extraction frame image data D51 before and after the generation propagation range from the image recording circuit 61 by the user interface circuit 65, and uses the region extraction frame image data D51 of the generation propagation range as the object designation region. The designated area presentation image data is generated by combining with the data D59, and the designated area presentation image data and the remaining area extraction frame image data D51 are combined with the area extraction processing screen data D52 to generate the information presentation section 55. To send.

  As a result, the information processing apparatus 50 displays the generation propagation range and the extraction frame frames 70A to 70B before and after the generation propagation range in the image display area in the area extraction processing screen as shown in FIG. The corrected object designation reference area 74A and the object designation propagation areas 77AX, 77BX, 77CX, 77DX corresponding to the area extraction frame images (including the work frame images) 70B to 70F of the generated propagation range, or still modified The object designation reference area 74 or the object designation propagation areas 77A to 77D that are not displayed are superimposed and displayed, and the process returns to step SP52.

  In this way, after generating the object designation reference area 74 and the object designation propagation areas 77A to 77D, the information processing apparatus 50 appropriately sets the modification propagation range and the modification mode, and each time a modification location is designated, In accordance with the instruction, the corrected portions of the object designation reference area 74 or the object designation propagation areas 77A to 77D are corrected and presented, and the object designation reference area 74 and the object designation propagation areas 77A to 77D that the enlightenment target user is satisfied with accuracy, etc. Can be generated.

  In addition to this, if a negative result is obtained in step SP62 described above, this means that the extraction processing command C50 input by the enlightenment target user is a work frame setting command, a correction mode setting command, a propagation range setting command, a contour specifying command. The information processing apparatus 50 moves to step SP64 at this time.

  In step SP64, the information processing apparatus 50 determines whether the extraction process instruction C50 input by the enlightenment target user by the user interface circuit 65 fills the area surrounded by the input contour interpolation line to be the object designation reference area 74, Alternatively, it is determined whether or not it is an area inversion command for switching whether to fill the outside of the input contour interpolation line to be an object designation reference area.

  If an affirmative result is obtained in step SP64, this means that the extraction processing command C50 input by the enlightenment target user is processed according to at least a work frame setting command, a propagation range setting command, and a contour specifying command (step SP54, This represents that the area inversion command has been input after the processing described above in step SP58, step SP60 and step SP61) has already been executed. At this time, the information processing apparatus 50 proceeds to step SP65.

  In step SP65, the information processing apparatus 50 sends an area inversion command from the user interface circuit 65 to the setting information recording circuit 63.

  For example, in the initial state, the information processing apparatus 50 is set to the interpolation line inner area mode in which the area surrounded by the input contour interpolation line is filled and used as the object designation reference area 74. Is input to the setting information recording circuit 63, and the contents of the designated area setting information for setting the form of the object designated area are changed to fill the outside of the input contour interpolation line. Change the setting to the non-interpolation line area mode that is used as the object specification reference area.

  On the other hand, when an area inversion command is input in the out-of-interpolation area mode, the information processing apparatus 50 takes the area inversion command into the setting information recording circuit 63 and changes the contents of the designated area setting information to perform interpolation. Change the setting to in-line area mode.

  When the setting information recording circuit 63 switches the inter-interpolation line area mode to the inter-interpolation line area mode, the information processing apparatus 50 notifies the area generation recording circuit 67 of this.

  When the information processing apparatus 50 switches from the interpolation line inner area mode to the interpolation line outer area mode, the area generation recording circuit 67 causes the object designation reference area 74 and the object designation propagation areas 77A to 77D that have already been recorded and held. An object designating area (hereinafter referred to as this) that fills the outer side (that is, the area that becomes the background of the object 71 excluding the object designating reference area 74 and the object designating propagation areas 77A to 77D in the area extracting frame images 70B to 70F) with a predetermined color. The object designation reference inversion area is referred to as the object designation reference inversion area, and the object designation propagation inversion area is designated to correspond to the object designation propagation area.

  When the information processing apparatus 50 generates the object designation reference inversion area and each object designation propagation inversion area, the area generation recording circuit 67 converts the object designation reference inversion area and each object designation propagation inversion area into the object designation reference area 74 and each of the object designation reference inversion areas. The object designated propagation areas 77A to 77D are overwritten and recorded.

  Also, the information processing apparatus 50 sends the object designation reference inversion area and each object designation propagation inversion area to the user interface circuit 65 as object designation area data D60 by the area generation recording circuit 67.

  The information processing apparatus 50 uses the user interface circuit 65 to read the generation propagation range and the frame image data D51 for region extraction before and after the image generation circuit 61 from the image recording circuit 61, and use the region extraction frame image data D51 for the generation propagation range as object designation region data. The designated area presentation image data is generated by combining with D60, and the designated area presentation image data and the remaining area extraction frame image data D51 are combined with the area extraction processing screen data D52 to be sent to the information presentation unit 55. Send it out.

  As a result, the information processing apparatus 50 displays the generated propagation range and the preceding and following extraction frame images 70A to 70B in the image display area in the area extraction processing screen in the information presentation unit 55 as shown in FIG. Then, the object designation reference inversion area 80 and the object designation propagation inversion areas 81A to 81D respectively corresponding to the area extraction frame images (including work frame images) 70B to 70F of the generation propagation range are displayed in an overlapping manner, and the process returns to step SP52. .

  Incidentally, when the information processing apparatus 50 switches from the interpolation line outside area mode to the interpolation line inside area mode, the area generation recording circuit 67 causes the object designation reference inversion area 80 and each object designation propagation inversion area 81A already recorded and held. To 81D (that is, an area that overlaps the object designation reference inversion area 80 and the object designation propagation inversion areas 81A to 81D in the area extraction frame images 70B to 70F) with a predetermined color. And each object designated propagation area 77A thru / or 77D is generated.

  In this case, the information processing apparatus 50 presents the area extraction processing screen described above with reference to FIG. 22 or FIG. 25 to the enlightenment target user and returns to step SP52.

  In this way, the information processing apparatus 50 performs the processing of step SP52 to step SP65 described above sequentially in accordance with the extraction processing command C50 input by the enlightenment target user, and thus the accuracy that can be convinced to the enlightenment target user by himself / herself. The object specification area can be extracted with.

  If a negative result is obtained in step SP64, this means that the object designated area changed in accordance with the movement of the object 71 in the area extracting frame images 70B to 70F that are temporally continuous from the object extracting moving image 70 is obtained. This means that the process end command for ending the region extraction process is input as the extraction process command C50 by the enlightenment target user because the extraction is performed with an accuracy that can be understood by the enlightenment target user. Moves to step SP66.

  In step SP66, the information processing apparatus 50 performs the object designation reference area 74 and the object designation propagation areas 77A to 77D finally recorded after one generation or subsequent correction by the area generation recording circuit 67, or the object designation reference inversion. By outputting the area 80 and the object designated propagation inversion areas 81A to 81D as object designated area data D61 to the outside through the area extraction circuit 68, for example, in an object extracting device (not shown), based on the object designated area data D61. Then, the process proceeds to step SP67 (FIG. 14) so as to extract the object 71 from the object extraction moving image data D50.

  In step SP67, the information processing apparatus 50 uses the enlightenment target user's name of the enlightenment target user input via a predetermined operation unit (not shown) and the skill user who becomes the evaluation value for the area extraction method of the enlightenment target user. The information S55 is taken into the user interface circuit 65.

  Here, the skill of the user to be enlightened is determined using a moving image for trial of region extraction operation (hereinafter referred to as a moving image for region extraction trial) generated by a computer or the like according to a predetermined image generation program. The result of the region extraction operation periodically performed by the enlightenment target user is used each time.

  In this case, the region extraction trial moving image includes a plurality of frame images (hereinafter referred to as trial frame images) including an object (hereinafter referred to as a region extraction trial object) whose region can be continuously specified in time. The contour of the region extraction trial object can be recognized almost accurately by image processing using a general image processing application program executed by a computer or the like.

  Therefore, the skill of the user to be enlightened is that the region extraction operation of the object designated region for the region extraction trial object in the plurality of trial frame images is performed using the region extraction trial moving image in substantially the same manner as the region extraction processing routine SRT51 described above. When performed on a trial basis, for example, the shape of the object designated area is compared with the contour of the actual area extraction trial object by image processing, for example, with a preset accuracy (an error amount within a preset threshold). The determination is made quantitatively by using the reciprocal of the time required until the object specified area is extracted (that is, the time required for the area specifying trial process for extracting the object specified area on a trial basis).

  By the way, the skill of the user to be enlightened can be determined that the skill is high if the object designated area is experimentally extracted with a predetermined accuracy in a relatively short time. In this case, the time required for the area designation trial process The value increases due to the short of.

  The skill of the user to be enlightened can be determined to be low if the object designated area is extracted on a trial basis with a predetermined accuracy over a relatively long time. In this case, it is necessary for the area designation trial process. The value decreases as the time spent increases.

  The information processing apparatus 50 reads the object moving image data D51 from the image recording circuit 61 by the user interface circuit 65 when the user information S55 including the skill of the enlightenment user is taken into the user interface circuit 65.

  Further, the information processing apparatus 50 appropriately changes the display contents while executing the above-described region extraction processing routine SRT51 (that is, the region extraction processing using the object extraction moving image) on the user interface circuit 65 to change the information presentation unit. A series of area extraction processing screens displayed at 55 are recorded as area extraction history screen data representing the history of the area extraction operation together with information such as time required for the area extraction processing.

  Accordingly, as shown in FIG. 27, the information processing apparatus 50 uses the user interface circuit 65 to provide the name and skill of the enlightenment target user included in the user information S55, the moving image data D50 for object extraction, the area extraction history screen data, The input information consisting of is sent as input information data D65 to the processing tendency information extraction unit 52 (FIG. 13), and the process proceeds to step SP68.

  In step SP68, the information processing apparatus 50 causes the processing tendency information extraction unit 52 to execute a predetermined image for each of the region extraction frame image data D51 constituting the object extraction moving image data D50 included in the input information data D65. By performing the processing, the ratio between the sum of the frequency components of the predetermined unit block and the sum of the frequency components of a predetermined unit block or higher among the frequency components of the predetermined unit block in each region extraction frame image data D51 is calculated. The average value of these ratios for all the region extraction frame image data D51 is calculated as the high-frequency component ratio.

  Further, the information processing apparatus 50 performs individual image extraction by applying predetermined image processing to all the image data D51 for area extraction constituting the moving image data D50 for object extraction by the processing tendency information extraction unit 52. In the frame image data D51, the minimum value is subtracted from the maximum value of each luminance, and the average value of the subtraction results for all the region extraction frame image data D51 obtained as a result is calculated as the luminance value dynamic range.

  Further, the information processing apparatus 50 performs predetermined image processing on the area extraction history screen data included in the input information data D65 by the processing tendency information extraction unit 52, so that the user 71 is enlightened by the object 71 in the work frame image 70D. Detecting the contour drawing time when a contour is specified, and dividing the contour drawing time by the time required for region extraction processing excluding the contour drawing time (hereinafter referred to as the “drawing line exclusion processing time”) The division result obtained by the above is calculated as the ratio of the drawn line and drawn line removal processing time.

  In addition, the information processing apparatus 50 uses the input contour formation point obtained by the processing tendency information extraction unit 52 to specify the contour of the object 71 in the work frame image 70D by the enlightenment target user. The drawing speed between adjacent input contour forming points is calculated sequentially based on the predetermined sampling interval for generating points and the distance between adjacent input contour forming points, and the average value of the drawing speed between the input contour forming points is calculated as an object. It is calculated as an average drawing speed when 71 contours are designated.

  Then, the information processing apparatus 50 uses the processing tendency information extraction unit 52 to change the high-frequency component ratio and the luminance value dynamic range of the picture in the object extraction moving image 70 as shown in FIG. Image feature information indicating whether the image is an image), and the ratio of strokes and stroke exclusion processing time and the average stroke speed as region extraction history information that specifically represents the background of the region extraction operation. The information is processing trend information indicating how the object designation area is extracted from what kind of object extraction moving image 70 by the enlightenment target user.

  Accordingly, the information processing apparatus 50 uses the processing trend information extraction unit 52 as the processing trend information data D66 as the processing trend information extracted from the object extraction moving image data D50 and the region extraction history screen data. The input information data D65 is associated with each other and transmitted as the accumulated information data D67 to the information accumulating unit 53, and the processing tendency information data D66 is directly transmitted to the presentation information selecting unit 54. Then, the process proceeds to the subsequent steps SP69 and SP70.

  In step SP69, the information processing apparatus 50 stores the stored information data D67 together with, for example, the input information data D65 and the processing tendency information data D66 by the information storage unit 53, and proceeds to step SP71.

  In step SP70, the information processing apparatus 50 causes the presentation information selection unit 54 to execute a luminance value dynamic range (hereinafter referred to as a reference for comparison) as image feature information included in the processing tendency information data D66 in parallel with the processing in step SP69. Brightness value dynamic range) and average drawing speed (hereinafter referred to as a reference average drawing speed for comparison) as region extraction history information, and the enlightenment user stored in step SP69 in the information storage unit 53 Luminance value dynamic range (hereinafter referred to as past luminance value dynamic range) and average included as processing tendency information data D66 in all other past accumulated information data D67 already accumulated except for accumulated information data D67 The value of the drawing speed (hereinafter referred to as the past average drawing speed) is compared.

  As a result, the information processing apparatus 50 causes the presentation information selection unit 54 to perform a predetermined dynamic range centered on the value of the comparison reference luminance value dynamic range from the past accumulated information data D67 as in the case described above with reference to FIG. Past that includes past luminance value dynamic range information indicating a value within the threshold range and past average drawing speed information indicating a value within a predetermined drawing speed threshold range centered on the reference average drawing speed value for comparison The stored information data D67 is selected.

  Next, the information processing apparatus 50 uses the presentation information selection unit 54 to select the past stored information data D67 from the past stored information data D67 selected using the comparison brightness value dynamic range value and the comparison reference average drawing speed value. The past accumulated information data D67 including the highest skill (that is, the highest evaluation value) as a part of the input information data D65 is selected by comparing pieces of skill information included in D67.

  In this way, the information processing apparatus 50 extracts the region of the enlightenment target user from all the past stored information data D67 that has already been stored in the information storage unit 53 by the presentation information selection unit 54 as shown in FIG. The past of the user who extracted the object specified region by the region extraction method similar to the region extraction method of the enlightenment user using the comparative brightness value dynamic range of the processing trend information for the method and the average drawing speed for comparison as the limiting criteria After selecting the accumulated information data D67 (that is, after limiting the number of past accumulated information data D67 to be selected), the skills included in the selected past accumulated information data D67 are used as selection criteria. The past accumulated information data D67 of the highest user is finally selected.

  As a result, the information processing apparatus 50 causes the presentation information selection unit 54 to display the area extraction history screen data included as the input information data D65 from the information storage unit 53 in the finally selected past storage information data D67, as shown in FIG. The skill information is read as presentation information data D68, and the read presentation information data D68 is sent to the information presentation unit 55, and the process proceeds to step SP71.

  In step SP71, the information processing apparatus 50 presents a series of area extraction processing screens and skill information based on the presentation information data D68 to the enlightenment target user by the information presenting unit 55, and then proceeds to step SP72 to perform the second enlightenment promotion. The processing procedure RT50 is terminated.

  In this way, the information processing apparatus 50 uses an area extraction method similar to the enlightenment target user (for example, an object extraction moving image having a color tone similar to the color tone of the object extraction moving image 70 used by the enlightenment target user to extract the object designation area). Using the image, it is the most important in the extraction process of the object specification area, and the method of specifying the contour of the object that is the basis of the object specification area is similar), from among a plurality of users who extracted the object specification area, As a region extraction method for the user with the highest skill level, a series of region extraction processing screens (including process details and moving images for object extraction) are reproduced and presented according to the time lapse of the region extraction operation actually performed by the user. To do.

  As a result, the information processing apparatus 50 is configured so that the region extraction method of the enlightenment user and the region extraction method of another user are different from each other (for example, the most important method of specifying the contour, the generation propagation range and the correction propagation in the region extraction operation). The setting method of the range etc.) can be found as an improved part in the area extraction method of the enlightenment target user, and thus the improved part can be imitated to improve the area extraction method of other users.

  Incidentally, in the case of the second embodiment, the information processing apparatus 50 receives the presentation information addition command C51 via a predetermined operation unit while presenting the presentation information to the enlightenment target user. Is added to the user interface circuit 65 of the region extraction unit 51, and the additional command C51 is sent from the user interface circuit 65 to the presentation information selection unit 54 via the processing tendency information extraction unit 52.

  Then, the information processing apparatus 50 extracts the high-frequency component ratio as the image feature information included as the processing tendency information data D66 from the information storage unit 53 by the presentation information selection unit 54 as the processing trend information data D66, and region extraction. The information of the drawn line and drawn line removal processing time ratio as the background information is read, and the read high frequency component ratio and drawn line and drawn line exclusion processing time ratio are set to the high frequency component ratio and drawn line included in the processing trend information data D66 of the enlightenment target user. And it is sent to the information presentation part 55 as additional presentation information data D69 with a drawing line exclusion process time ratio.

  Thereby, the information processing apparatus 50 outputs the information of the high frequency component ratio based on the additional presentation information data D69 and the line drawing and line drawing exclusion processing time ratio through the monitor and the speaker by the information presentation unit 55 to the enlightenment target user. Presenting the information to the target user and thus showing different areas between the user's area extraction method and other users' area extraction methods as well as a series of area extraction processing screens, as well as high-frequency component ratios, line drawing, and line drawing exclusion processing It is made to be able to be found from the difference in the numerical value of the time ratio.

  In other words, the information processing apparatus 50 determines how the pattern (complexity) of the image of the object extraction moving image used by another user for the object specified region extraction process differs from the enlightenment target user, and the contour of the object in the region extraction operation. It is made to be able to judge the difference such as how much importance is given to the designation as a numerical value.

  In the above configuration, the information processing apparatus 50 causes the enlightenment target user to perform an area extraction operation for extracting the object designated area from the object extraction moving image 70, and appropriately displays the contents during the area extraction process corresponding to the area extraction operation. A series of region extraction processing screens presented by changing the above are used as region extraction history screen data representing the history of the region extraction operation, the region extraction history screen data, and the object extraction moving image data D50 used for the region extraction processing. The skill information for the region extraction method input by the enlightenment target user is referred to as input information data D65.

  Then, the information processing apparatus 50 extracts the object designation region from what kind of moving image by the enlightenment user from the object extracting moving image 70 based on the object extracting moving image data D50 and the region extraction history screen data. The processing tendency information for the enlightenment target user's region extraction method is extracted, and the processing tendency information data D66 including the extracted processing tendency information is stored in the information storage unit 53 as the stored information data D67 together with the input information data D65.

  At this time, the information processing apparatus 50 compares the processing trend information data D66 of the enlightenment target user with the processing trend information data D66 included in the past storage information data D67 already stored in the information storage unit 53, thereby comparing the past. From the accumulated information data D67, the past accumulated information data D67 including the object extraction moving image data D50 representing the area extraction method of another user similar to the area extraction method of the enlightenment user and the area extraction history screen data are selected. .

  Next, the information processing apparatus 50 compares the pieces of skill information included in the selected past stored information data D67, finally selects the past stored information data D67 of the user having the highest skill, and selects the selected past stored information. The area extraction history screen data included in the information data D67 (that is, a series of area extraction process screens presented during the area extraction process) is presented to the enlightenment target user as presentation information.

  Therefore, the information processing apparatus 50 does not particularly require an instructor with excellent processing capability as in the first embodiment described above. Encourage enlightenment and allow the user to be enlightened to find a different location between the region extraction method of the user targeted for enlightenment and the region extraction method of other users, as well as the improved portion Can be improved by imitating the region extraction method of other users.

  In addition, when the presentation information addition command C51 is input while presenting the presentation information to the enlightenment target user, the information processing apparatus 50 processes the past accumulated information data D67 that is finally selected in response thereto. Information on the high-frequency component ratio included in the trend information and the ratio of the drawn line and line-excluded processing time are additionally presented together with the information on the high-frequency component ratio and the drawn line and drawn-line excluded processing time ratio included in the processing trend information data D66 of the enlightenment target user. Information was presented to enlightened users.

  Therefore, the information processing apparatus 50 also encourages the enlightenment target user to enlighten the improvement location in his / her area extraction method also by the additional presentation information, and identifies different locations between the enlightenment target user's area extraction method and other users' area extraction methods. In addition to visually locating a series of area extraction screens that were presented during area extraction processing, it is important to specify the high-frequency component ratio for the object extraction moving image and the outline of the object during area extraction processing. It is possible to make the user to be enlightened exactly as an improvement point in his area extraction method even as a difference between the drawing line representing degree and the line exclusion processing time ratio as a numerical value, and to improve the other user's area extraction method It can be imitated and improved.

  In addition to this, the information processing apparatus 50 executes the region extraction processing routine SRT51 described above with reference to FIGS. 16 and 17 during the region extraction processing for extracting the object designated region, and thereby includes a plurality of regions constituting the object extraction moving image 70. Among the extraction frame images 70A to 70G,..., One work frame image 70D that actually specifies the contour of the object 71 is selected, and a plurality of region extraction frames in the generation propagation range that propagates the generation of the object specification region are propagated. The images 70B, 70C, 70E, and 70F are selected.

  When the contour of the object 71 in the work frame image 70D is traced and designated, the information processing apparatus 50 generates an object designation reference area 74 for the work frame image 70D based on the input contour line obtained as a result. At the same time, the predetermined unit block related to the object designation reference region 74 is moved to the movement position in each region extraction frame image 70B, 70C, 70E, 70F in the generation propagation range, and each region extraction frame in the generation propagation range. Object designation propagation areas 77A to 77D for the images 70B, 70C, 70E, and 70F are generated.

  Therefore, the information processing apparatus 50 does not specify the contours of the objects 71 in the plurality of region extraction frame images 70B to 70F constituting the object extraction moving image 70, and any one region extraction frame image ( By simply designating the outline of the object 71 in the work frame image 70D, it is possible to easily extract the object designating areas that respectively designate the objects 71 in the plurality of area extracting frame images 70B to 70F.

  In addition, when the information processing apparatus 50 sets a correction propagation range and is instructed to correct any one of the object specification reference areas 74 or the object specification propagation areas 77A to 77D to be corrected, the information processing apparatus 50 changes the correction target object. In order to propagate from the designated reference area 74 or the object designated propagation areas 77A to 77D to the other object designated reference areas 74 or the object designated propagation areas 77A to 77D within the modified propagation range, a plurality of objects can be designated with as few operations as possible to the enlightenment target user. The extraction accuracy of the reference area 74 and the object designated propagation areas 77A to 77D can be easily improved.

  According to the above configuration, a series of area extraction processing screens displayed when the user to be enlightened performs an area extraction operation for extracting an object designated area from the object extraction moving image 70, and the object extraction moving image. 70 and input information consisting of information on the skill of the user to be enlightened is extracted from the series of region extraction processing screens and the moving image 70 for object extraction, together with processing trend information for the region extraction method of the user to be enlightened, and accumulated information Data D67 is stored in the information storage unit 53, and the processing tendency information for the region extraction method of the enlightenment target user is compared with the processing tendency information included in the past storage information data D67 already stored in the information storage unit 53. Then, from the past accumulated information data D67, other users similar to the region extraction method of the enlightenment target user After selecting the past accumulation information data D67 including the area extraction method as the object extraction moving image and the series of area extraction processing screens, the skill information included in the selected past accumulation information data D67 is compared with each other. The user selects the past accumulated information data D67 of the highest user and finally presents a series of area extraction processing screens included in the finally selected past accumulated information data D67 as the presentation information to the enlightenment target user. As a result, the enlightenment user is enlightened with the improvement of the area extraction method of his / her area extraction method based on the presented information, and the area extraction method of the user to be enlightened and the area extraction method of another user are identified as different areas of the enlightenment user. Make it possible to find an improvement point in your area extraction method, and the other user's area Can be improved to mimic the extraction procedure, thus the processing capabilities of the processing of the object extracting moving image 70 to be processed to extract the object specified area can be realized an information processing apparatus capable of easily improved.

  In the second embodiment described above, the processing tendency information data D65 of the enlightenment target user is compared with the processing tendency information data D65 included in the past accumulation information data D67 already accumulated in the information accumulation unit 53. Thus, from the past accumulated information data D67, the past accumulated information data including the object extraction moving image data D50 representing the area extracting method of another user similar to the area extracting method of the enlightenment target user and the area extracting history screen data. After selecting D67, the case where the skill information included in the selected past accumulated information data D67 is compared and the past accumulated information data D67 of the user with the highest skill is finally selected is described. However, the present invention is not limited to this, and the processing tendency information data D65 of the user to be enlightened and the information storage unit 53 By comparing the processing trend information data D65 included in the accumulated past accumulated information data D67, the area extracting method of other users similar to the area extracting method of the enlightenment user from the past accumulated information data D67. Is selected past accumulated information data D67 including object extraction moving image data D50 and area extraction history screen data, and a series of area extraction processing screens included in the selected one or more past accumulated information data D67 is presented. You may make it show to a user for enlightenment as information.

  In this way, it is possible to present the background of the region extraction process of a plurality of users with different skills to the enlightenment target user as the presentation information, and thus to the enlightenment target user than in the case of the second embodiment described above. You can find more improvements in your area extraction method.

  Further, the processing trend information data D65 of the enlightenment target user is compared with the processing trend information data D65 included in the past storage information data D67 already stored in the information storage unit 53, and a plurality of past storage information data D67 are compared. By selecting the final past accumulation information data D67, it is possible to reduce the processing load at the time of selection as compared with the second embodiment described above.

  In the second embodiment described above, a case has been described in which a series of region extraction processing screens in the region extraction processing of other users is presented to the enlightenment target user as presentation information. The past stored information data D67 of the user to be enlightened is included in the past stored information data D67, and when the past stored information data D67 of the user to be enlightened is selected, it is included in the stored information data D67. A series of region extraction processing screens in the past region extraction processing may be presented to the enlightenment target user as presentation information. In this case, for example, if the past region extraction method has a higher skill than the current region extraction method of the user to be enlightened, the improved region in the current region extraction method is the region extraction method when the past skill is high. It can be easily found in comparison with.

  Further, in the above-described second embodiment, when the presentation information to be presented to the enlightenment target user is selected, all past accumulated information data D67 is used. However, the present invention is not limited to this. When the presentation history of the presentation information for each enlightenment target user is accumulated and the presentation information to be presented to the enlightenment target user is selected, the past accumulation information data D67 used for the past presentation is selected based on the presentation history. Other past accumulated information data D67 excluded may be used.

  In this way, it is possible to prevent the presentation information previously presented to the enlightenment target user from being presented again and to present new presentation information, thereby improving the area extraction method from a new viewpoint to the enlightenment target user. Can be enlightened. Incidentally, when selecting the presentation information to be presented to the enlightenment target user, the past accumulated information data D67 used for presenting the presentation information is not used for the selection of the subsequent presentation information regardless of the user to be presented. Such processing can also be realized by forcing restrictions.

  Furthermore, in the second embodiment described above, the case where presentation information is selected using the selection conditions described above with reference to FIG. 29 has been described, but the present invention is not limited to this, and as shown in FIG. Any one of various selection conditions, or various selection information shown in FIG. 31 and the selection conditions described above with reference to FIG. 29 are combined to selectively use one or more selection conditions to select presentation information. May be.

  Here, the various selection conditions shown in FIG. 31 will be described in detail. When the information processing apparatus 50 first uses the first selection condition, the presentation information selection unit 54 uses the comparison reference luminance value dynamic range value, After selecting past accumulated information data D67 including past luminance value dynamic range information indicating values within the dynamic range threshold range by comparing with past luminance value dynamic range values included in all past accumulated information data D67 From the selected past stored information data D67, the pieces of skill information included in the past stored information data D67 are compared with each other, and finally the past stored information data D67 including the best skill is finally selected. A series of area designating screens included in the selected past accumulated information data D67 are presented to the enlightenment target user.

  In this case, the information processing apparatus 50 extracts a plurality of object designation regions using the object extraction moving image 70 having a color tone similar to that of the object extraction moving image 70 used for extraction of the object designation region by the enlightenment target user. The region extraction method having the highest skill can be presented to the enlightenment target user from among the region extraction methods, and the enlightenment target user can be enlightened about the improvement location in his area extraction method.

  Further, when the second selection condition is used, the information processing apparatus 50 causes the presentation information selection unit 54 to use the reference luminance value dynamic range value for comparison included in the processing tendency information data D66 of the enlightenment target user and the information storage unit 53. Are compared with the values of the past luminance value dynamic range included in the past stored information data D67 already stored in the past, and information on skills (hereinafter referred to as past skills) included in the past stored information data D67. Are selected, the past accumulated information data D67 including the past luminance value dynamic range information indicating a value within the dynamic range threshold range and including the past skill having a value equal to or larger than a predetermined threshold value set in advance is selected.

  Then, the information processing device 50 compares the value of the past average drawing speed included in the selected past accumulated information data D67 with the value of the reference average drawing speed for comparison by using the presentation information selection unit 54, thereby selecting the selection. In the past accumulated information data D67, the past accumulated information data D67 indicating information outside the drawing speed threshold value range and including the information of the past average drawing speed that has the largest difference from the reference average drawing speed value for comparison is finalized. A series of area designating screens included in the past accumulated information data D67 finally selected is presented to the enlightenment target user.

  In this case, the information processing apparatus 50 extracts the object designation region using the object extraction moving image 70 having a color tone similar to that of the object extraction moving image 70 used for extraction of the object designation region by the enlightenment target user, and From among a plurality of region extraction methods with a certain level of skill, the region extraction method (that is, a series of region specification processing screens) in which the method of specifying the contour of the object is the most different is presented to the enlightenment target user. Encourage people to improve their area extraction methods.

  Further, when using the third selection condition, the information processing apparatus 50 causes the presentation information selection unit 54 to use the reference reference dynamic value dynamic range value included in the processing tendency information data D66 of the enlightenment target user and the information storage unit 53. The dynamic range threshold value range is obtained by comparing the past luminance value dynamic range value included in the past accumulated information data D67 already accumulated in the past information and comparing the past skill information included in the past accumulated information data D67. The past accumulated information data D67 including information of the past luminance value dynamic range indicating the value within the range and including a past skill having a value equal to or larger than a predetermined threshold value set in advance is selected.

  Then, the information processing apparatus 50 finally selects, for example, one past accumulated information data D67 at random from the selected past accumulated information data D67 by the presentation information selection unit 54, and the past selected past A series of area designation processing screens included in the accumulated information data D67 are presented to the enlightenment target user.

  In this case, the information processing apparatus 50 extracts the object designation region using the object extraction moving image 70 having a color tone similar to that of the object extraction moving image 70 used for extraction of the object designation region by the enlightenment target user, and By presenting a region extraction method (that is, a series of region specification processing screens) randomly selected from a plurality of region extraction methods with a certain level of skill to the user to be enlightened, the region extraction method to the user to be enlightened It is possible to raise enlightenment by expecting the improvement part in to some extent contingency.

  Further, when using the fourth selection condition, the information processing apparatus 50 causes the presentation information selection unit 54 to determine the comparison reference luminance value dynamic range and comparison reference average drawing speed included in the processing tendency information data D66 of the enlightenment target user. Past luminance indicating a value within the dynamic range threshold value range by comparing the value with the past luminance value dynamic range and past average drawing speed value included in the past accumulated information data D67 already accumulated in the information accumulation unit 53 The past accumulated information data D67 including information on the value of the dynamic range and including information on the past average drawing speed indicating a value within the drawing speed threshold value range is selected.

  Then, the information processing apparatus 50 compares the past skill information included in the past accumulated information data D67 selected by the presentation information selection unit 54 with the past accumulated information data D67 including the lowest skill. Is finally selected, and a series of area designation processing screens included in the finally selected past accumulated information data D67 are presented to the enlightenment target user.

  In this case, the information processing apparatus 50 extracts a plurality of object designation regions using the object extraction moving image 70 having a color tone similar to that of the object extraction moving image 70 used for extraction of the object designation region by the enlightenment target user. By encouraging users to be enlightened by showing the region extraction methods with the lowest skills (ie, a series of area specification processing screens) from among the region extraction methods of the region, Can do. Incidentally, by using the fourth selection condition, it is possible to cause the user to be enlightened to reconfirm a good part of his / her region extraction method by presenting the finally selected region extraction method.

  Further, when the fifth selection condition is used, the information processing apparatus 50 stores information on the skill of the user to be enlightened (hereinafter referred to as a reference skill for comparison) in the processing tendency information data D66 of the user to be enlightened, for example. In addition, by the presentation information selection unit 54, the comparison reference brightness value dynamic range, the comparison reference average drawing speed and the comparison reference skill value included in the processing tendency information data D 66 of the enlightenment target user, and the information storage unit 53 Past luminance value dynamic range information indicating a value within the dynamic range threshold range by comparing the past luminance value dynamic range, the past average drawing speed, and the past skill value included in the past accumulated information data D67 that has already been accumulated. And a predetermined average skill threshold value centered on the value of the reference average skill for comparison and the past average drawing speed indicating a value within the drawing speed threshold range. Selecting a past accumulated information data D67 containing both a past skill indicating the value of 囲内.

  Then, the information processing apparatus 50 compares the past skill information included in the past accumulated information data D67 selected by the presentation information selection unit 54 with the past accumulated information data D67 including the highest skill. Is finally selected, and a series of area designation processing screens included in the finally selected past accumulated information data D67 are presented to the enlightenment target user.

  In this case, the information processing apparatus 50 extracts the object designation region using the object extraction moving image 70 having a color tone similar to that of the object extraction moving image 70 used for extraction of the object designation region by the enlightenment target user, and The region extraction method and enlightenment presented by presenting to the target user the region extraction method (ie, a series of region specification processing screens) with the highest skill among multiple region extraction methods that have almost the same ability (ie, skill) Since the difference from the target user's area extraction method is slight, it is possible to easily enlighten the user to be enlightened about the improvement in his / her area extraction method.

  Furthermore, when using the sixth selection condition, the information processing apparatus 50 randomly selects, for example, one piece of past accumulated information from the past accumulated information data D67 already accumulated in the information accumulating unit 53 by the presentation information selecting unit 54. The data D67 is selected, and a series of area designation processing screens included in the selected past accumulated information data D67 are presented to the enlightenment target user.

  In this case, the information processing apparatus 50 presents a randomly selected region extraction method (that is, a series of region designation processing screens) to the enlightenment target user, so that the enlightenment target user can improve the area extraction method. Can be enlightened with full expectation of chance.

  Incidentally, in the information processing apparatus 50, when the above-described fifth selection condition is used, the presentation information selection unit 54 causes the information accumulation unit to store the skill information in the processing tendency information data D66 of the enlightenment target user. The final selection of the stored information data D67 may be realized by using the skill information included in all the stored information data D67 stored in 53 (including the stored information data D67 of the enlightenment target user). it can.

  In addition, when using skill information in each of the selection conditions described above, even if the minimum and maximum skills are not defined, and the skills are not less than a predetermined threshold, the skills below the predetermined threshold or the skills of the user to be enlightened High or low skill, skill with a value that is greater than or equal to a predetermined threshold from the skill of the user to be enlightened, skill that is more than a predetermined first threshold and less than or equal to the second threshold from the skill of the user to be enlightened, and further the user to be enlightened The past stored information data D67 can be selected even under conditions such as a skill that is substantially the same as (similar to) the skill.

  Furthermore, as selection conditions used for selection of the stored information data D67, selection conditions obtained by replacing a part of the selection conditions described above with reference to FIG. 29 and the first to sixth selection conditions described above with reference to FIG. Alternatively, various other selection conditions can be used, such as a selection condition using a correction propagation range and a state of specifying a correction portion.

  In addition to this, the information processing apparatus 50 uses the limited reference luminance value dynamic range for comparison, the reference average drawing speed for comparison, and the reference skill for comparison individually under the selection conditions described above with reference to FIGS. However, for example, the square root of the sum of squares is calculated using at least two or more of the limited reference comparative luminance value dynamic range, comparative reference average drawing speed, comparative reference skill, etc., and the calculation result in the Euclidean space The past accumulated information is compared with the result of calculating the square root of the sum of squares using at least two of the predetermined threshold space with reference to the past, the dynamic value of the past luminance value, the past average drawing speed, the past skill, etc. The data D67 may be limited.

  Further, the information processing apparatus 50 calculates, for example, the sum of absolute differences by using at least two or more of the limited reference comparative luminance value dynamic range, the comparative reference average drawing speed, the comparative reference skill, and the like. Past accumulation by comparing a predetermined threshold space based on the result with the result of calculating the sum of absolute differences using at least two of the past, such as past luminance value dynamic range, past average drawing speed, and past skill. The information data D67 may be limited.

  Further, in the information processing apparatus 50, a predetermined reference standard luminance value dynamic range for comparison, a reference dynamic average drawing speed for comparison, a predetermined dynamic range threshold range centered on a reference standard skill for comparison, a drawing speed threshold value range, a skill threshold range, etc. The past product information D67 is limited by comparing at least two of the product space obtained and the past luminance value dynamic range, past average drawing speed, past skill, etc. May be.

  Similarly, in the information processing apparatus 50, the average drawing speed and skill of the selection criterion are individually used under the selection conditions described above with reference to FIGS. 29 and 31, respectively. For example, the square root of the sum of squares is calculated by using at least two skills, etc., and a predetermined threshold space based on the calculation result in the Euclidean space, the past average drawing speed, the past skills, etc. are similarly at least two or more. The final past accumulated information data D67 may be selected by comparing with the result of calculating the square root of the sum of squares using.

  In the information processing apparatus 50, for example, a difference absolute value sum is calculated using at least two or more selection reference average drawing speed and comparison reference skill, and a predetermined threshold value based on the obtained calculation result. The final past accumulated information data D67 may be selected by comparing the space and the result of calculating the sum of absolute differences using at least two similarly, such as the past average drawing speed and the past skill.

  Further, the information processing apparatus 50 integrates at least two or more of a predetermined drawing speed threshold range and a skill threshold range centered on a comparison reference average drawing speed and a comparison reference skill, etc. The final past accumulated information data D67 may be selected by comparing the space with at least two of the past average drawing speed and past skill similarly.

  Further, in the above-described second embodiment, the case where the information storage unit 53 stores the storage information data D67 including the input information data D65 and the processing tendency information data D66 has been described. Not limited to this, at least the input information data D65 may be stored in the information storage unit 53 as stored information data. In this case, each time the presentation information is selected, the input information data D65 of the user to be enlightened and What is necessary is just to extract process tendency information from accumulation | storage information data (namely, input information data D65). When the enlightenment target user and other users extract the object designation area from the same object extraction moving image 70, the area designation history screen data and skill information may be used as the input information data D.

  Furthermore, in the second embodiment described above, when the region designation processing is performed, various extraction processing instructions C50 described in the region extraction processing routine SRT51 described above with reference to FIGS. 16 to 17 can be input. However, the present invention is not limited to this, and in addition to these various extraction processing instructions C50, other various instructions such as so-called “undo” that return to the previous processing are also used for extraction processing. It may be possible to input as a command.

  Furthermore, in the second embodiment described above, a series of region extraction processing screens as the selected region extraction method are reproduced for the enlightenment target user in accordance with the time lapse of the region extraction operation actually performed. However, the present invention is not limited to this, and information indicating a temporal display order for a series of area designation processing screens is recorded in advance, and a change request is made to the enlightenment target user. Accordingly, the individual region extraction processing screens may be sequentially switched and presented.

(3) Third Embodiment In FIG. 32, 100 indicates an information processing apparatus according to the third embodiment as a whole, and allows a plurality of users to try a contour extraction operation on an object according to a predetermined image generation program. A contour extraction operation is attempted on the contour of an object (hereinafter referred to as a trial object in the following) in the generated moving image (hereinafter referred to as a contour extraction trial moving image). Accumulate trial results.

  Further, when performing the contour extraction process for extracting the contour of the object to be extracted from the object extraction moving image in accordance with the contour extraction operation actually performed by the user, the information processing apparatus 100 performs the user during the contour extraction process. A series of contour extraction processing screens displayed by appropriately changing display contents according to various commands input by the contour extraction process (that is, a user contour extraction method for extracting an object contour from a moving image for object contour) ) Representing contour extraction history screen data.

  When the contour extraction operation is performed by each user, the information processing apparatus 100 includes the contour extraction history screen data accumulated by the contour extraction operation already performed by another user prior to the contour extraction operation. Depending on the trial result, select the contour extraction history screen data that will help to improve the contour extraction method of the user who performs the contour extraction operation at that time (hereinafter referred to as the enlightenment user). By presenting it, the user to be enlightened is encouraged to improve his / her contour extraction method.

  In practice, the information processing apparatus 100 includes a contour generation unit 101, a processing tendency information extraction unit 102, an information storage unit 103, a presentation information selection unit 104, and an information presentation unit 105.

  As shown in FIG. 33, the contour generation unit 101 includes a moving image input circuit 110, a moving image recording circuit 111, a user interface circuit 112, a conversion circuit 113, a contour estimation generation circuit 114, a contour recording circuit 115, a contour line, An output circuit 116 and a skill determination circuit 117 are included.

  The information processing apparatus 100 first has a skill indicating how accurately each user specifies the contour of the object to be extracted in the object extraction moving image (this skill is an evaluation value of the contour extraction method). In order to estimate in advance what kind of tendency the user has when designating the contour, the contour of the trial object in the contour extraction trial moving image that is different from the object to be extracted is tried on a trial basis. A contour extraction operation (hereinafter referred to as a contour extraction trial operation) is performed, and a contour extraction trial process corresponding to the contour extraction trial operation is executed.

  Here, the information processing apparatus 100 performs various processes for executing the contour extraction trial process in the contour generation unit 101, the processing trend information extraction unit 102, the information storage unit 103, the presentation information selection unit 104, and the information presentation unit 105. It is realized by software according to the contour extraction trial program.

  That is, as shown in FIG. 34, the information processing apparatus 100 enters from the start step of the contour extraction trial processing procedure RT100 according to the contour extraction trial program, moves to the subsequent step SP101, and shifts to the trial mode.

  In step SP101, the information processing apparatus 100 acquires user information S100 including a user name and a user ID input via a predetermined operation unit (not shown) by the user interface circuit 112 of the contour generation unit 101, and next The skill determination processing routine SRT200 is moved to.

  At this time, as shown in FIG. 35, the information processing apparatus 100 enters from the start step of the skill determination processing routine SRT200 and proceeds to step SP201.

  In step SP201, the information processing apparatus 100 takes the contour extraction trial moving image data D100 supplied from the outside into the moving image input circuit 110 of the contour generation unit 101, and forms the contour extraction trial moving image data D100. Data (hereinafter referred to as trial frame image data) is recorded in the moving image recording circuit 111 in units of D100A.

  Here, as shown in FIG. 36, the contour extraction trial moving image 120 based on the contour extraction trial moving image data D100 includes a plurality of trial frame images TF1 to TF1 including trial objects TJ1 to TJ7. This is composed of TF7 (corresponding to trial frame image data D100A), and the trial objects TJ1 to TJ7 move while gradually changing their shapes as time passes, and an image using a general image processing application program By executing the processing, the contour lines indicating the contours of the trial objects TJ1 to TJ7 (hereinafter, referred to as measurement reference contour lines) ROL1 to ROL7 are generated accurately.

  Then, the information processing apparatus 100 sends the contour extraction trial processing screen data D101 from the user interface circuit 112 to the information presenting unit 105 (FIG. 32), and then on a monitor (not shown) provided in the information presenting unit 105. Based on the contour extraction trial processing screen data D101, a contour extraction trial processing screen (not shown) having an image display area or the like of the contour extraction trial moving image 120 is displayed.

  In addition, the information processing apparatus 100 responds to a request from the head trial frame image data (hereinafter referred to as “trial head frame image data”) D100A input by the user via the operation unit in response to a request from the user interface circuit 112. Thus, the trial first frame image data D100A is selected and read from the plurality of trial frame image data D100A constituting the contour extraction trial moving image data D100 from the moving image recording circuit 111, and the trial first frame image data D100A is read out. Is combined with the contour extraction trial processing screen data D101 and sent to the information presentation unit 105 (FIG. 32).

  Thereby, the information processing apparatus 100 displays the trial first frame image TF1 based on the trial first frame image data D100A in the image display area in the contour extraction trial processing screen in the information presenting unit 105, and thus the trial first frame image. The user visually recognizes the shape of the trial object TJ1 in TF1.

  In this state, the information processing apparatus 100 is designated by the user by arbitrarily tracing the contour of the trial object TJ1 in the trial first frame image TF1 on the contour extraction trial processing screen via the operation unit such as a mouse. Then, a trial head input contour signal S101 corresponding to the input contour obtained as a result (hereinafter referred to as a trial head input contour) is taken into the user interface circuit 112 and sent to the conversion circuit 113.

  The information processing apparatus 100 uses the conversion circuit 113 to sample the trial head input contour signal S101 at a predetermined sampling interval and convert it into digital data, whereby a plurality of trial heads corresponding to the trial head input contour signal S101 is obtained. An input contour forming point is generated, and the generated set data of a plurality of trial head input contour forming points is sent to the contour guess generation circuit 114 as trial head input contour forming point group data D102, and the process proceeds to the next step SP202.

  In step SP202, the information processing apparatus 100 responds to a request from the last trial frame image data (hereinafter, specifically referred to as trial last frame image data) D100A input by the user via the operation unit. The user interface circuit 112 selects and reads out the trial last frame image data D100A from the plurality of trial frame image data D100A constituting the contour extraction trial moving image data D100 from the moving image recording circuit 111, and performs the trial use. The last frame image data D100A is combined with the contour extraction trial processing screen data D101 and sent to the information presentation unit 105, whereby the information presentation unit 105 displays the last image for trial in the image display area in the contour extraction trial processing screen. For trial based on tail frame image data D100A Displays trailing frame image TF7, thus is visually shape the trial object TJ7 of the in trial last frame image TF7 user.

  In this state, the information processing apparatus 100 is designated by the user by tracing the contour of the trial object TJ7 in the final trial frame image TF7 on the contour extraction trial processing screen via the operation unit such as a mouse. Then, the trial tail input contour signal S102 corresponding to the input contour obtained as a result (hereinafter referred to as trial tail input contour) is taken into the user interface circuit 112 and sent to the conversion circuit 113.

  Then, the information processing apparatus 100 uses the conversion circuit 113 to sample the trial tail input contour signal S102 at a predetermined sampling interval and convert it into digital data, so that a plurality of information corresponding to the trial tail input contour signal S102 is obtained. The trial final input contour forming point is generated, and the generated set data of the trial final input contour forming points is sent to the contour estimation generating circuit 114 as the trial final input contour forming point group data D103, and the next is estimated. The process proceeds to the estimated contour line generation processing routine SRT300.

  As shown in FIG. 37, the information processing apparatus 100 enters from the start step of the estimated contour line generation processing routine SRT300 and moves to the next step SP301.

  Here, since the trial objects TJ1 to TJ7 are moved while gradually changing their shapes in the trial frame images TF1 to TF7 that are temporally continuous (FIG. 36), the trial heads as shown in FIG. When the input contour line StTL and the trial tail input contour line EnTL are shown on the same frame image, the positions of the trial head input contour formation points StTP1 to StTP20 and the trial tail input contour formation points EnTP1 to EnIT24 are different from each other.

  In the trial head input contour StTL and the trial tail input contour EnTL, the sampling intervals for generating the trial head input contour forming points StTP1 to StTP20 and the trial tail input contour forming points EnTP1 to EnTP24 are the same. Further, since the drawing speed when the user traces the trial objects TJ1 and TJ7 through the mouse or the like and the size and shape of the outlines of the trial objects TJ1 and TJ7 are different, the trial head input contour forming points StTP1 to StTP1 The total number of the StTP 20 and the trial last input contour forming points EnTP1 to EnTP24 is different.

  Therefore, in step SP301, the information processing apparatus 100 constructs the trial head input contour StTL by the contour guess generation circuit 114 based on the trial head input contour formation point group data D102 and the trial tail input contour formation point group data D103. The total number of trial leading input contour forming points StTP1 to StTP20 (hereinafter referred to as the number of trial leading forming points) and the total number of trial trailing input contour forming points EnTP1 to EnTP24 constituting the trial trailing input contour line EnTL (hereinafter referred to as the following points). This is referred to as the number of trial formation points).

  As a result, the information processing apparatus 100 causes the contour estimation generation circuit 114 to use the trial head input contour formation points StTP1 to StTP20 having the trial head formation points having a smaller number of the trial head formation points and trial tail formation points compared with each other. In the configured trial head input contour StTL, the total length of the trial head input contour StTL is calculated from the distance between the trial head input contour forming points StTP1 to StTP20 adjacent to each other.

  Then, the information processing apparatus 100 divides the calculated total length by the number of trial end formation points with a large number by the contour estimation generation circuit 114, thereby forming a new contour forming this on the trial head input contour StTL. A generation interval for generating a point (hereinafter referred to as a new contour forming point) is obtained.

  As a result, as shown in FIG. 39, the information processing apparatus 100 uses the contour estimation generation circuit 114 to sequentially generate new contour formation points NSTP1 to NSTP24 for each generation interval NK on the trial head input contour StTL. The total number of new contour forming points NSTP1 to NSTP24 constituting the input contour StTL is adjusted to the number of trial final tail forming points, and the process proceeds to step SP302.

  In step SP302, the information processing apparatus 100 causes the contour estimation generation circuit 114 to perform the center of gravity StTC (coordinate value) of the trial head input contour StTL and the center of gravity of the trial last input contour EnTL, as shown in FIG. As shown in FIG. 40B, for example, the trial head input contour StTL is moved from one centroid StTC to the other centroid EnTC by the centroid moving distance L between the centroids StTC and EnTC. The center of gravity StTC and EnTC are made to coincide with each other by being moved, and the trial start input contour StTL and the trial end input contour EnTL are overlapped.

  In this state, the information processing apparatus 100, as shown in FIG. 41, uses the contour estimation generation circuit 114 to select an arbitrary new contour among the plurality of new contour formation points NSTP1 to NSTP24 constituting the trial head input contour StTL. After selecting the formation point NSTP1, the trial end input contour formation point EnTP1 located at the shortest distance from the selected new contour formation point NSTP1 is searched, and the new contour formation point NSTP1 and the trial end input having the shortest distance relationship are searched. The distance between contour lines Da1 between the contour forming point EnTP1 and the contour forming point EnTP1 is calculated.

  In this way, the information processing apparatus 100 searches the trial end input contour formation points EnTP2 to EnTP24, which are at the shortest distances from the remaining new contour formation points NSTP2 to NSTP24, respectively, by the contour estimation generation circuit 114. Similarly, after calculating the distances between contour lines Da2 to Da24, the starting end input contour forming point EnTP1 and the new contour forming point NSTP1 having the shortest distance between contour lines (here, distance between contour lines Da1) are set as starting points. The pair SPP1 is determined and the process proceeds to the next step SP303.

  In step SP303, the information processing apparatus 100 causes the contour estimation generation circuit 114 to start from the starting point pair SPP1 as shown in FIG. 42A, and in the trial head input contour StTL, for example, in the counterclockwise direction indicated by the arrow ArwS1 In the new contour formation points NSTP2 to NSTP24 (hereinafter referred to as the reference direction), the trial end in the counterclockwise direction indicated by the arrow ArwO1 (hereinafter referred to as the forward direction) on the trial final input contour EnTL. By associating the tail input contour forming points EnTP2 to EnTP24 in order, the new contour forming point NSTP3 and the trial last input contour forming between the new contour forming point NSTP2 and the trial last input contour forming point StTP2 that are associated in this order. The distance between the points StTP3,... Da2 or is calculated as ODa24.

  Further, as shown in FIG. 42 (B), the information processing apparatus 100 uses the starting point pair SPP1 as a starting point to generate new contour forming points NSTP2 to NSTP24 in the reference direction in the trial head input contour StTL as shown in FIG. The trial tail input contour forming points EnTP24 to EnTP2 in the clockwise direction indicated by the arrow ArwR1 (hereinafter referred to as the reverse direction) on the trial tail input contour line EnTL are associated with each other in this order. The distances between the new contour forming point NSTP2 and the trial last input contour forming point StTP24, between the new contour forming point NSTP3 and the trial head input contour forming point StTP23,... Are calculated as reverse pair distances RDA2 to RDA24, respectively.

  Then, the information processing apparatus 100 calculates the sum of the forward pair-to-pair distances O Da2 to O Da24 and the sum of the reverse pair-to-pair distances R Da2 to R Da24 by the contour estimation generation circuit 114, and compares the calculated sums.

  Considering the association between the new contour forming points NSTP1 to NSTP24 and the trial last input contour forming points EnTP1 to EnTP24, the new contour forming points NSTP1 to NSTP24 are the trial first frame image TF1 and the trial last frame image TF7. If they are almost correctly associated with the previous trial tail contour forming points EnTP1 to EnTP24 that have moved through the plurality of trial frame images TF2 to TF6, the new contour forming points NSTP1 to NSTP24 and the trial tail contours that are associated with each other The sum of the forward pair-to-pair distances Oda2 to Oda24 between the formation points EnTP1 to EnTP24 or the reverse pair-to-pair distances RDA2 to RDA24 is relatively small.

  On the other hand, the new trial contour formation points EnTP1 to which the new contour formation points NSTP1 to NSTP24 have moved through the plurality of trial frame images TF2 to TF6 between the trial first frame image TF1 and the trial last frame image TF7. If they are associated with other trial end contour forming points EnTP1 to EnTP24 that are not correctly associated with EnTP24 but are associated with different trial final contour forming points EnTP1 to EnTP24, the positions of these associated new contour forming points NSTP1 to NSTP24 and trial tail contour forming points EnTP1 to EnTP24 Since the relationship is different from the original one, the total sum of the forward pair-to-pair distances Oda2 to Oda24 or the reverse pair-to-pair distances RDA2 to RDA24 becomes relatively large.

  Accordingly, the information processing apparatus 100 uses the contour estimation generation circuit 114 to associate one of the sums of the forward pair-to-pair distances Oda2 to Oda24 or the reverse pair-to-pair distances RDA2 to Rda24 with a smaller sum (for example, the reference direction and the order (Association with the rotation direction) is selected by assuming that the new contour formation points NSTP2 to NSTP24 are substantially correct associations with the previous trial tail input contour formation points EnTP2 to EnTP24 to which they have moved, Control goes to the next step SP304.

  In step SP304, the information processing apparatus 100 causes the contour estimation generation circuit 114 to use the trial first frame image TF1 among the plurality of trial frame images TF1 to TF7 constituting the contour extraction trial moving image 120 as shown in FIG. Are divided by the total number of trial frame images TF2 to TF6 excluding the trial final frame image TF7 (hereinafter referred to as the trial intermediate frame image) TF2 to TF6, respectively. As a result, the point formation intervals DDa2, DDa3, DDa4,... Are obtained on the virtual line between the association points connecting the new contour formation points NSTP2 to NSTP24 and the trial last input contour formation points EnTP2 to EnTP24 that are sequentially associated.

  Then, the information processing apparatus 100 corresponds to the total number of trial intermediate frame images TF2 to TF6 for each point formation interval DDa2, DDa3, DDa4,... A number of trial estimation contour forming points IPa2 to IPe2, IPa3 to IPe3, IPa4 to IPe4,... Are generated.

  The information processing apparatus 100 also divides the starting point pair distance O Da1 between the new contour forming point NSTP1 and the trial last input contour forming point EnTP1 by the total number of the trial intermediate frame images TF2 to TF6 for the starting point pair SPP1. Thus, the point formation interval DDa1 is obtained on the virtual line between the starting points connecting the new contour forming point NSTP1 and the trial last input contour forming point EnTP1, and corresponds to the total number of the trial intermediate frame images TF2 to TF6 on the virtual line between the starting points. A number of trial estimated contour forming points IPa1 to IPe1 are generated, and the process proceeds to the next step SP305.

  In step SP305, the information processing apparatus 100 causes the contour estimation generation circuit 114 to create new contour formation points among the trial estimation contour formation points IPa1 to IPe1, IPa2 to IPe2,. The trial estimated contour forming points IPa1 to IPa24, IPb1 to IPb24, IPc1 to IPc24, IPd1 to IPd24 and IPe1 to IPe24 in the same order from NSTP1 to NSTP24 are respectively interpolated for the trial intermediate frame images TF2 to TF6. Trial guess contours ITLA1 to ITLA5 are generated.

  Then, the information processing apparatus 100 calculates the center of gravity (coordinate value) of each trial estimated contour line ITLA1 to ITLA5 by the contour line estimation generation circuit 114.

  Here, the center of gravity StTC of the trial head input contour StTL is moved by the center of gravity moving distance L1 (FIG. 40A) from the trial head frame image TF1 to the trial tail frame image TF7, and the trial tail tail. It is estimated that the position (coordinate value) of the center of gravity EnTC of the trial last input contour line EnTL in the frame image TF7 has been reached.

  Therefore, as shown in FIG. 44, the information processing apparatus 100 divides the center-of-gravity moving distance L1 by the total number of trial intermediate frame images F2 to F6 by the contour estimation generation circuit 114, thereby obtaining the trial head input contour StTL. On the virtual line between centroids connecting the centroid StTC and the centroid EnTC of the trial last input contour line EnTL, the moving positions in the trial intermediate frame images F2 to F6 with respect to the centroid StTC of the trial head input contour line StTL (that is, for each centroid interval TK) TO1 to TO5 (coordinate values) are calculated.

  The information processing apparatus 100 uses the contour guess generation circuit 114 to maintain the trial guess contours ITLA1 to ITLA5 in the order of the trial center input contour StTL from the center StTC of the trial last input contour EnTL. The center of gravity of each of the trial estimated contours ITLA1 to ITLA5 is sequentially matched with the estimated center of gravity positions TO1 to TO5 on the virtual line between the center of gravity (that is, the center of gravity of the trial estimated contour ITLA1 is the center of gravity estimated position TO1). These trial guess contours ITLA1 to ITLA5 are associated with the trial intermediate frame images TF2 to TF6, respectively.

  In addition, the information processing apparatus 100 uses the contour estimation generation circuit 114 to generate a plurality of trial estimation contour forming points IPa1 to IPa24, IPb1 to IPb24,..., IPe1 to IPe24 (the trial estimation contours ITLA1 to ITLA5). The trial estimated contour forming point group data consisting of the set data of the corresponding intermediate frame images TF2 to TF6 for trial) is set as trial leading input contour forming point group data D102 and trial tail input contour forming point group data D103. At the same time, the trial object outline extraction data D104 is sent to the outline recording circuit 115 and recorded, and then the estimated outline generation process routine SRT300 is terminated and the process proceeds to step SP203 (FIG. 35) of the skill determination process routine RT200.

  In this way, the information processing apparatus 100 performs the trial object in the trial first frame image TF1 and the trial last frame image TF7 among the plurality of trial frame images TF1 to TF7 constituting the contour extraction trial moving image 120. The contours of the objects TJ2 to TJ6 in the trial intermediate frame images TF2 to TF6 are obtained from the trial head input contour StTL and trial tail input contour EnTL obtained by tracing and specifying the contours of TJ1 and TJ7. The trial estimated contour lines TLA1 to TLA5 for extracting the data can be estimated and generated.

  Incidentally, the trial head input contour formation points (new contour formation points NSTP1 to NSTP24) and trial tail input contour formation points EnTP1 to EnTP24 are generated in order along the direction in which the user traces the trial object TJ7.

  Therefore, when the new contour forming points NSTP1 to NSTP24 and the trial final contour forming points EnTP1 to EnTP24 are simply associated according to the generation order, the trial leading input contour StTL and the trial final input contour EnTL are drawn with each other. In the reverse direction (that is, the direction traced by the trial objects TJ1 and TJ7 is reversed), the trial estimated contour lines TLA1 to TLA5 between the trial head input contour StTL and the trial last input contour EnTL are once reversed. To be generated (ie flipped inside out).

  However, in the information processing apparatus 100, as described above, by selecting one of the associations with the smaller sum of the forward pair-to-pair distances Oda2 to Oda24 or the reverse pair-to-pair distances RDA2 to RDA24, the trial objects TJ1 and TJ7 are traced. Regardless of the direction, the new contour forming points NSTP2 to NSTP24 and the trial tail contour forming points EnTP1 to EnTP24 can be associated with each other by preventing the trial estimated contours ITLA1 to ITLA5 from being inverted. .

  In step SP203, the information processing apparatus 100 reads the trial object contour extraction data D104 from the contour recording circuit 115 by the user interface circuit 112, and also reads all the trial frame image data D100A from the moving image recording circuit 111. The trial extracted contour presentation image data is generated by combining the trial frame image data D100A with the trial object contour extraction data D104, and the trial extracted contour presentation image data is combined with the contour extraction trial processing screen data D101. It is sent to the skill determination circuit 117 and the information presentation unit 105.

  Thus, as shown in FIG. 45, the information processing apparatus 100 causes the information presentation unit 105 to display trial start input contour lines StTL corresponding to the trial frame images TF1 to TF7 in the image display area in the contour extraction trial processing screen. And the trial final input contour line EnTL and the trial estimated contour lines TLA1 to TLA5 are displayed in an overlapping manner so as to be visually observed by the user.

  In addition, the information processing apparatus 100 causes the skill determination circuit 117 to correspond to the trial head input contour StTL, trial guess contours TLA1 to TLA5, and trial tail input contour EnTL based on the screen data D101 for contour extraction trial processing. The average error amount of the measurement reference contour lines ROL1 to ROL7 in the trial first frame image TF1, the trial intermediate frame images TF2 to TF6, and the trial last frame image TF7 is calculated, and the process proceeds to the next step SP204.

  Here, for example, the average error amount between the measurement reference contour line ROL1 and the trial head input contour line StTL is an average of errors between the respective parts of the measurement reference contour line ROL1 and the corresponding parts of the trial head input contour line StTL. This represents the average deviation of the trial head input contour StTL from the measurement reference contour ROL1 over the entire circumference.

  In step SP204, the information processing apparatus 100 causes the skill determination circuit 117 to reduce the average error amount to a predetermined threshold value or less in all of the trial first frame image TF1, the trial intermediate frame images TF2 to TF6, and the trial last frame image TF7. Determine whether it has been reached.

  If a negative result is obtained in step SP204, this means that the average error amount is predetermined in at least one of the trial first frame image TF1, the trial intermediate frame images TF2 to TF6, and the trial last frame image TF7. In this case, the information processing apparatus 100 proceeds to step SP205.

  In step SP <b> 205, the information processing apparatus 100 generates input contour request data D <b> 105 by the skill determination circuit 117, and sends this to the user interface circuit 112.

  Thus, the information processing apparatus 100 causes the user interface circuit 112 to notify the user who is performing the contour extraction trial operation to an arbitrary trial intermediate frame among the plurality of trial intermediate frame images TF2 to TF6 via the contour extraction trial processing screen. A request is made to designate the contours of the trial objects TJ2 to TJ6 in the images TF2 to TF6.

  Then, the information processing apparatus 100 reads the trial intermediate frame image data D100A from the moving image recording circuit 111 through the user interface circuit 112, combines it with the contour extraction trial processing screen data D101, and sends it to the information presentation unit 105. As a result, the information presentation unit 105 displays the trial intermediate frame images TF2 to TF6 based on the trial intermediate frame image data D100A in the image display area of the contour extraction trial processing screen and allows the user to visually check the information.

  In this state, the information processing apparatus 100 allows the user to select one trial intermediate frame image TF2, arbitrarily selected for contour specification from the trial intermediate frame images TF2 to TF6 via the operation unit, or the like. A trial object TJ2,..., Or TJ6 in TF6 is traced and designated.

  As a result, the information processing apparatus 100 allows the trial object TJ4 in the trial intermediate frame image TF4 selected by the user to be arbitrarily traced and designated, thereby adding an additional input contour line (hereinafter referred to as trial addition input). When a trial additional input contour line signal S103 corresponding to a contour line) is input, it is taken into the user interface circuit 112 and the process returns to the estimated contour generation processing routine SRT300.

  In this case, when the trial object TJ4 in the trial intermediate frame image TF4 is traced and specified, the information processing apparatus 100 uses the conversion circuit 113 to obtain the additional input contour signal S103 obtained as a result, at a predetermined sampling interval. Are sampled and converted to digital data to generate a plurality of additional input contour forming points corresponding to the additional input contour signal S103, and the set data of the generated plurality of additional input contour forming points is formed as an additional input contour. The point cloud data D106 is sent to the contour estimation generation circuit 114.

  Then, the information processing apparatus 100 reads the trial object contour extraction data D104 recorded in the contour recording circuit 115 from the contour recording circuit 115 by the contour estimation generation circuit 114, and adds the trial additional input contour line and the trial object contour extraction data. The estimated contour generation process described above is performed using the trial start input contour StTL and the trial final input contour EnTL included in D104.

  Accordingly, the information processing apparatus 100 causes the contour estimation generation circuit 114 to use the trial head frame image TF2 between the trial head frame image TF1 and the trial middle frame image TF4 from the trial head input contour StTL and the trial additional input contour. And trial estimated contour lines TLB1 and TLB2 for extracting the contours of the objects TJ2 and TJ3 in TF3 are newly estimated and generated.

  In addition, the information processing apparatus 100 uses the contour estimation generation circuit 114 to perform the trial intermediate frame image between the trial additional input contour line and the trial final input contour EnTL and the trial intermediate frame image TF4 and the trial final frame image TF7. Trial estimation contour lines TLB4 and TLB5 for extracting the contours of the objects TJ5 and TJ6 in TF5 and TF6 are newly estimated and generated.

  In this way, the information processing apparatus 100 adds trials by selecting the trial intermediate frame images TF2 to TF6 and designating the outlines of the objects TJ2 to TJ6 until a positive result is obtained in step SP204. In addition to obtaining the input contour line, a new trial is performed from the trial additional input contour line and the input contour lines before and after it (trial initial input contour line StTL, trial last input contour line EnTL, or other trial additional input contour lines). By reestimating and generating the estimated contour line, the average error amount is reduced, and the new trial object contour extraction data D104 thus generated is recorded in the contour line recording circuit 115 and updated.

  At this time, the information processing apparatus 100 reads the new trial object contour extraction data D104 from the contour recording circuit 115 by the user interface circuit 112 every time a new trial estimation contour is generated, and the new trial object. The contour extraction data D104 and the trial frame image data D100A are combined to generate trial extraction contour presentation image data, and the trial extraction contour presentation image data is combined with the contour extraction trial processing screen data D101 to determine the skill. 117 and the information presentation unit 105.

  Thus, the information processing apparatus 100 causes the information presentation unit 105 to display the trial head input contour StTL and the trial final input contour corresponding to the trial frame images TF1 to TF7 in the image display area in the contour extraction trial processing screen. The line EnTL and the newly generated trial estimation contour line are displayed in an overlapping manner so as to be visually observed by the user.

  On the other hand, if a positive result is obtained in step SP204, this means that the trial first frame image TF1, the trial intermediate frame images TF2 to TF6, and the trial last frame image TF7 (that is, all the trial frame images TF1 to TF1 to TF7). TF7) indicates that the average error amount has reached a predetermined threshold value or less. At this time, the information processing apparatus 100 proceeds to the next step SP206.

  In step SP206, the information processing apparatus 100 causes the skill determination circuit 117 to cause the average error amount to be less than or equal to the threshold value in each of the trial first frame image TF1, the trial intermediate frame images TF2 to TF6, and the trial last frame image TF7. The total number of trial frame images (hereinafter referred to as input frame images) designated by tracing the contours of the trial objects TJ1 to TJ7 is compared with a predetermined predetermined frame image reference number.

  Here, the user who has a low skill of the contour extraction trial operation, the trial first frame image TF1, the trial intermediate frame images TF2 to TF6, and the trial last frame image are repeated many times until the average error amount reaches a predetermined threshold value or less. Since it is required to specify the contours of the trial objects TJ1 to TJ7 in TF7, the total number of input frame images tends to increase.

  On the other hand, a user who has a high skill in the contour extraction trial operation repeatedly shows the contours of the trial objects TJ1 to TJ7 in the trial first frame image TF1, the trial intermediate frame images TF2 to TF6, and the trial final frame image TF7. Even if not specified, the average error amount reaches a predetermined threshold value or less, so the total number of input frame images tends to decrease.

  Accordingly, when the total number of input frame images is smaller than the frame image reference number, the information processing apparatus 100 determines that the skill (that is, the evaluation value) of the user who performed the contour extraction trial operation at this time is high, When the total number of input frame images is larger than the frame image reference number, it is determined that the skill (that is, the evaluation value) of the user who performed the contour extraction trial operation at this time is low, and then the determination result is determined based on the input frame image. The skill data D107 is sent to the user interface circuit 112 together with the total number to finish the skill determination processing routine SRT200, and the process proceeds to the next step SP102 (FIG. 34).

  In step SP102, the information processing apparatus 100 uses the user interface circuit 112 to display a series of contour extraction trial processing screens displayed by appropriately changing the display contents during the skill determination processing. Information such as the time required for the operation (hereinafter referred to as work time) is used as contour extraction history screen data (hereinafter referred to as contour extraction trial history screen data) as shown in FIG. The input information consisting of the contour extraction trial history screen data, the skill data D107, the contour extraction trial moving image data D100, and the user information S100 is sent as input information data D108 to the processing trend information extraction unit 102 to be next processed. The process proceeds to step SP103.

  In step SP103, the information processing apparatus 100 performs predetermined image processing on the contour extraction trial moving image data D100 included in the input information data D108 by the processing tendency information extraction unit 102, thereby the contour extraction trial moving image data. Image feature information consisting of average color component histograms and edge component ratios for individual or all trial frame image data D100A is extracted from D100.

  In addition, the information processing apparatus 100 performs predetermined image processing on the contour extraction trial history screen data included in the input information data D108 by the processing trend information extraction unit 102, thereby reducing the work time required for the contour extraction trial operation. The contour drawing time when the contours of the trial objects TJ1 to TJ7 in the input frame image are designated, and the trial objects TJ1 and TJ7 in the trial first frame image TF1 and the trial last frame image TF7 are designated once. After that, the number of times that the trial object in the input frame image is designated again (hereinafter referred to as the number of corrections) and the previous and subsequent trial frame images TF1 to TF7 are determined on the monitor to determine the input frame image. The number of times of display indicating how many times it is displayed is extracted as contour extraction history information.

  In this way, the information processing apparatus 100 causes the processing trend information extraction unit 102 to use the user to extract image feature information and contour extraction history information extracted from input information, as shown in FIG. The processing trend information indicates how the contours of the trial objects TJ1 to TJ7 are extracted from the image 120.

  The information processing apparatus 100 uses the processing trend information extraction unit 102 as processing trend information extracted from the input information as processing trend information data, associates the processing trend information data with the input information data D108, and stores the information as accumulated information data. After being sent to the information storage unit 103 as D109, the process proceeds to the next step SP104.

  Accordingly, in step SP104, the information processing apparatus 100 causes the information storage unit 103 to obtain the total number of input frame images included in the stored information data D109 of a plurality of users as the skill data D107 of the input information as shown in FIG. Arranged in ascending order, the accumulated information data D109 of the high skill user and the accumulated information data D109 of the low skill user based on the frame image reference number Bor1 are stored in a state of being divided into a database, and the process proceeds to the next step SP105. The contour extraction trial processing procedure RT100 is terminated.

  In this way, the information processing apparatus 100 has a skill with respect to the user's contour extraction operation based on the result of the contour extraction trial operation before the contour extraction operation is performed on the object extraction moving image including the object to be extracted. And the contour extraction tendency (that is, the tendency represented by the processing tendency information) are estimated and stored in the information storage unit 103 as the stored information data D109.

  Incidentally, in the information processing apparatus 100, even if a user who once performed a contour extraction trial operation does not perform a contour extraction operation for an object to be extracted for a predetermined period or longer, the contour extraction trial operation is performed again. The skill for the contour extraction operation and the estimation result of the contour extraction tendency are updated so that the user's skill can be always properly grasped.

  Next, when the contour extraction operation is performed on the object extraction moving image by the enlightenment target user who performed the contour extraction trial operation, the information processing apparatus 100 performs another contour extraction operation on the enlightenment target user. Presents a series of contour extraction processing screens.

  In this case, the information processing apparatus 100 performs various processes for executing the information presentation process in the contour generation unit 101, the processing tendency information extraction unit 102, the information storage unit 103, the presentation information selection unit 104, and the information presentation unit 105. It is realized by software according to the information presentation program.

  That is, as shown in FIG. 49, the information processing apparatus 100 enters from the start step of the information presentation processing procedure RT101 according to the information presentation processing program, moves to the subsequent step SP110, and shifts to the information presentation mode.

  In step SP110, the information processing apparatus 100 captures the object extraction moving image data D200 supplied from the outside into the moving image input circuit 110 of the contour generation unit 101, and sets the frame image data ( This is hereinafter referred to as contour extraction frame image data) and recorded in the moving image recording circuit 111 in units of D200A.

  Here, as shown in FIG. 50, the object extraction moving image 200 based on the object extraction moving image data D200 includes a plurality of contour extraction frame images OF1 to OF1 including objects to be extracted OJ1 to OJn. The object is composed of OFn, and the objects OJ1 to OJn in the contour extracting frame images OF1 to OFn move while gradually changing their shapes as time passes.

  Then, the information processing apparatus 100 sequentially reads a plurality of contour extracting frame image data D200A constituting the object extracting moving image data D200 from the moving image recording circuit 111 by the user interface circuit 112, and sends them to the information presenting unit 105. By displaying the object extraction moving image 200 composed of the contour extraction frame images OF1 to OFn that are temporally continuous on the monitor provided in the information presenting unit 105 and allowing the user to be enlightened to visually observe the object extraction moving image. After confirming the contents of the image 200 and the outlines of the objects to be extracted OJ1 to OJn, the process proceeds to the following step SP111.

  In step SP111, the information processing apparatus 100 loads the user information S100 including the user name and the user ID input by the enlightenment target user via the operation unit (not illustrated) into the user interface circuit 112 of the contour generation unit 101, This is sent to the presentation information selection unit 104 via the processing tendency information extraction unit 102, and the process proceeds to the subsequent step SP112.

  In step SP112, the information processing apparatus 100 causes the presentation information selection unit 104 to read out the stored information data D109 of the user to be enlightened from the information storage unit 103 based on the user information S100 (user name and user ID), and proceeds to the next step SP113. Move.

  In step SP113, the information processing apparatus 100 causes the presentation information selection unit 104 to use contour extraction history information included as processing tendency information data in the accumulated information data D109 of the enlightenment target user (hereinafter referred to as comparison reference extraction history information). And processing trend information data in all other stored information data (hereinafter referred to as past stored information data) D109 that has already been stored except for the stored information data D109 of the enlightenment user stored in the information storage unit 103 Contour extraction history information (hereinafter referred to as past extraction history information) included as (hereinafter referred to as past processing trend information data) is compared.

  In practice, the information processing apparatus 100 uses the presentation information selection unit 104 to compare the work time included in the reference extraction history information for comparison (hereinafter referred to as “reference work time for comparison”) and the contour line drawing time (hereinafter referred to as “comparison”). Working time included in the past extraction history information, the number of corrections (hereinafter referred to as the reference number of corrections for comparison), the number of times of display (hereinafter referred to as the number of times of reference display for comparison) (Hereinafter referred to as past work time), contour drawing time (hereinafter referred to as past drawing time), correction count (hereinafter referred to as past correction count) and display count (hereinafter referred to as past display) The number of times).

  In this state, the information processing apparatus 100 causes the presentation information selection unit 104 to select a past work time indicating a value within a predetermined work time threshold range centered on the value of the reference work time for comparison from the past accumulated information data D109. A past drawing time indicating a value within a predetermined drawing time threshold range centered on a value of a reference drawing time for comparison, and a value within a predetermined correction frequency threshold range centered on a value of a reference correction number for comparison Selection is made by selecting past accumulated information data D109 including past correction counts and past display counts indicating values within a predetermined display count threshold range centered on the reference display count value for comparison as past extraction history information. Continue to step SP114 by limiting the number of target past accumulated information data D109 to the past accumulated information data D109 of the user of the contour extraction method similar to the enlightenment target user and the contour extraction method. That.

  In step SP114, the information processing apparatus 100 determines, based on the skill data D107 included in the accumulated information data D109 of the enlightenment target user, the skill of the enlightenment user (based on the frame image reference number Bor1) by the presentation information selection unit 104. Judge whether the skill is low.

  If an affirmative result is obtained in step SP114, this means that the enlightenment target user Y1 is determined to be a user having a low skill with respect to the contour extraction operation based on the result of the contour extraction trial operation, as shown in FIG. In this case, the information processing apparatus 100 proceeds to the next step SP115.

  In step SP115, the information processing apparatus 100 uses the presentation information selection unit 104 to finalize the past stored information data D109 of the user Y2 that has been determined to have the highest skill by the skill determination process from the past stored information data D109 selected in step SP113. To choose.

  Thereby, the information processing apparatus 100 is based on the user ID included as the user information S100 in the past accumulated information data D109 of the user Y2 with the highest skill finally selected from the information accumulation unit 103 by the presentation information selection unit 104. Contour extraction history screen data D111 composed of a series of contour extraction processing screen data in the contour extraction operation for the object extraction moving image 200 performed in the past by the user Y2 having the highest skill, and the user Y2 having the highest skill. The skill information included in the past accumulated information data D109 as the skill data D107 is read as the presentation information data D110, the read presentation information data D110 is sent to the information presentation unit 105, and the process proceeds to the subsequent step SP116.

  Here, a series of contour extraction processing screens based on the contour extraction history screen data D111 are displayed on the monitor of the information presentation unit 105 when a contour extraction operation is performed by the user in the past, and objects corresponding to the contour extraction operation are displayed. A series of steps for extracting the contours of the extraction target objects OJ1 to OJn, such as how to display the contour extraction frame images OF1 to OFn of the extraction moving image 200 and how to specify the extraction target objects OJ1 to OJn. Represents the background.

  In step SP116, the information processing apparatus 100 causes the information presentation unit 105 to perform a series of contour extraction processing screens based on the contour extraction history screen data D111 of the user Y2 having the highest skill based on the presentation information data D110, and the user Y2 The skill information is output via a monitor and a speaker (not shown) provided in the information presentation unit 105 and presented to the enlightenment target user. Then, the process proceeds to step SP118 to end the information presentation processing procedure RT101.

  On the other hand, if a negative result is obtained in step SP114, this means that the enlightenment target user Y3 is determined to be a highly skilled user based on the result of the contour extraction trial operation, as shown in FIG. At this time, the information processing apparatus 100 moves to step SP117.

  In step SP117, the information processing apparatus 100 finally selects the past stored information data D109 of the user Y4 determined to have the lowest skill by the skill determination process from the past stored information data D109 selected in step SP113.

  Thereby, the information processing apparatus 100 is based on the user ID included as the user information S100 in the past accumulated information data D109 of the user Y4 with the lowest skill finally selected from the information accumulation unit 103 by the presentation information selection unit 104. Contour extraction history screen data D111 consisting of a series of contour extraction processing screen data at the time of contour extraction operation for the object extraction moving image 200 performed in the past by the user Y4 having the lowest skill, and the user having the lowest skill The information on the skill included as the skill data D107 in the past accumulated information data D109 of Y4 is read as the presentation information data D110, the read presentation information data D110 is sent to the information presentation unit 105, and the process proceeds to step SP116.

  In this case, in step SP116, the information processing apparatus 100 causes the information presentation unit 105 to perform a series of contour extraction processing screens based on the contour extraction history screen data D111 of the user Y4 having the lowest skill based on the presentation information data D110 and the user Y4. After the information of the skill is output through the monitor and the speaker and presented to the enlightenment target user, the process proceeds to step SP118 and the information presentation processing procedure RT101 is terminated.

  In this way, as shown in FIG. 52, the information processing apparatus 100 is the most among a plurality of users who have a contour extraction method similar to the contour extraction method of the enlightenment target user Y1 with respect to the enlightenment target user Y1 with low skill. By presenting a series of contour extraction processing screens based on the contour extraction history screen data D111 of the user Y2 with high skill as the presentation information, the contour extraction method of the user Y2 with the highest skill (that is, the background of the contour extraction operation) is obtained. Based on this, the user to be enlightened is made aware of points to be noted in his / her contour extraction operation, points to be imitated in order to improve it, and the like so as to promote the improvement of the contour extraction operation.

  On the other hand, the information processing apparatus 100 gives the outline of the user Y4 with the lowest skill among the plurality of users of the outline extraction method similar to the outline extraction method of the education target user Y3 to the education target user Y3 with high skill. By presenting a series of contour extraction processing screens based on the extraction history screen data D111 as presentation information, enlightenment on the other hand based on the contour extraction method of the user Y4 having the lowest skill (that is, the background of the contour extraction operation) The target user Y3 is prevented from imitating the contour extraction method of the user Y4 having the lowest skill, which is similar to the contour extraction method, and the improvement of the contour extraction operation is promoted.

  The information processing apparatus 100 presents the object extraction moving image 200 to the enlightenment target user in advance when presenting such presentation information to the enlightenment target user. Therefore, it is possible to collate with the contour extraction method of other users, and thus it is possible to prompt the enlightening target user to improve the contour extraction operation more appropriately.

  Subsequently, after presenting the presentation information to the enlightenment target user, the information processing apparatus 100 performs contour extraction processing according to the contour extraction operation performed on the object extraction moving image 200 performed by the enlightenment target user.

  At this time, the information processing apparatus 100 performs various processes for executing the contour extraction process in the contour generation unit 101, the processing tendency information extraction unit 102, the information storage unit 103, the presentation information selection unit 104, and the information presentation unit 105. The software is realized in accordance with the contour extraction processing program.

  That is, as shown in FIG. 53, the information processing apparatus 100 enters from the start step of the contour extraction processing procedure RT102 according to the contour extraction processing program, proceeds to the subsequent step SP130, and shifts from the information presentation mode to the contour extraction processing mode.

  In step SP130, the information processing apparatus 100 sends the contour extraction processing screen data D120 from the user interface circuit 112 to the information presenting unit 105 (FIG. 32), and the contour information is displayed on the monitor provided in the information presenting unit 105. Based on the screen data D120, a contour extraction processing screen (not shown) having an image display area of the object extraction moving image 200 is displayed.

  In addition, the information processing apparatus 100 responds to a request from the head trial frame image data (hereinafter referred to as contour extraction head frame image data) D200A input by the user via the operation unit in response to a request from the user interface circuit. 112 selects and reads out the contour extraction first frame image data D200A from among the plurality of contour extraction frame image data D200A constituting the object extraction moving image data D200 from the moving image recording circuit 111; The image data D200A is combined with the contour extraction screen data D120 and sent to the information presentation unit 105.

  As a result, the information processing apparatus 100 causes the information presentation unit 105 to display the contour extraction first frame image OF1 based on the contour extraction first frame image data D200A in the image display area in the contour extraction processing screen, and thus the contour extraction first frame. The user visually recognizes the shape of the object OJ1 in the frame image OF1.

  In this state, as illustrated in FIG. 54, the information processing apparatus 100 allows the enlightenment user to arbitrarily specify the contour of the object OJ1 in the contour extraction first frame image OF1 on the contour extraction processing screen via the operation unit such as a mouse. Are specified, the leading input contour signal S110 corresponding to the input contour line obtained as a result (hereinafter referred to as the leading input contour line in particular) is taken into the user interface circuit 112 and converted into the conversion circuit 113. To send.

  The information processing apparatus 100 uses the conversion circuit 113 to sample the head input contour signal S110 at a predetermined sampling interval and convert it into digital data, thereby forming a plurality of head input contours corresponding to the head input contour signal S110. A point is generated, and the generated set data of the plurality of head input contour forming points is sent to the contour estimation generating circuit 114 as head input contour forming point group data D121, and the process proceeds to the next step SP131.

  In step SP131, the information processing apparatus 100 responds to a request from the last contour extraction frame image data (hereinafter, referred to as contour extraction last frame image data) D200A input by the user via the operation unit. Then, the user interface circuit 112 selects and reads out the contour extracting last frame image data D200A from the plurality of contour extracting frame image data D200A constituting the object extracting moving image data D200 from the moving image recording circuit 111, The contour extraction last frame image data D200A is combined with the contour extraction processing screen data D120 and sent to the information presentation unit 105.

  As a result, the information processing apparatus 100 displays the contour extraction tail frame image OFn based on the contour extraction tail frame image data D200A in the image display area in the contour extraction processing screen in the information presentation unit 105, and thus contour extraction. The user visually recognizes the shape of the object OJn in the final frame image OFn.

  In this state, the information processing apparatus 100 is designated by the user to be enlightened by arbitrarily tracing the contour of the object OJn in the last frame image OFn for contour extraction on the contour extraction processing screen via the operation unit such as a mouse. Then, the last input contour signal S111 corresponding to the input contour line obtained as a result (hereinafter referred to as the last tail input contour line) is taken into the user interface circuit 112 and sent to the conversion circuit 113.

  Then, the information processing apparatus 100 uses the conversion circuit 113 to sample the last input contour signal S111 at a predetermined sampling interval and convert it to digital data, so that a plurality of last input contour signals S111 corresponding to the last input contour signal S111 are obtained. A tail input contour forming point is generated, and the set data of the plurality of last input contour forming points thus generated is sent to the contour estimation generating circuit 114 as the last input contour forming point group data D122, and the process proceeds to the next step SP132.

  In step SP132, the information processing apparatus 100 causes the contour generation unit 101 to execute the same processing as that of the estimated contour generation processing routine SRT300 described above with reference to FIG. 37, so that the first input contour StOL and the last input contour EnOL , All the contour extraction frame images between the contour extraction first frame image OF1 and the contour extraction last frame image OFn (hereinafter referred to as contour extraction intermediate frame images) OF2 through OFn-1 through objects OJ2 through OFn-1. An estimated contour line for extracting the contour of OJn-1 is estimated and generated. Incidentally, the estimated contour line is generated by the contour generation unit 101 as follows.

  That is, the contour generation unit 101 uses the contour estimation generation circuit 114 to calculate the total number of leading input contour forming points constituting the leading input contour StOL (hereinafter referred to as the number of leading forming points) and the last input contour line. The total number of a plurality of last input contour forming points constituting EnOL (hereinafter referred to as the last tail forming point number) is compared, and a small number of head input contour lines StOL composed of head input contour forming points are compared. The total length of the leading input contour StOL is calculated from the distance between the leading input contour forming points adjacent to each other.

  Then, the contour generation unit 101 divides the calculated total length by the large number of last formation points by the contour estimation generation circuit 114, so that a plurality of new new contours constituting the top input contour StOL are formed. A generation interval for generating formation points is obtained, and new contour formation points are sequentially generated at each generation interval, so that the total number of new contour formation points constituting the leading input contour line StOL is matched with the number of last formation points.

  Next, the contour generation unit 101 calculates the centroid StOC (coordinate value) of the head input contour StOL and the centroid EnOC (coordinate value) of the last input contour EnOL by the contour estimation generation circuit 114, and FIG. ) And (B), the center of gravity StOC and EnOC are made to coincide with each other, and the leading input contour StOL and the trailing input contour EnOL are overlapped.

  In this state, as shown in FIG. 56, the contour generation unit 101 uses the contour estimation generation circuit 114 to form the last input contour formation having the shortest distance relationship with each of the new contour formation points NSOP1 to NSOPn. Inter-contour line distances Db1, Db2, Db3,..., Dbn between the points EnOP1 to EnOPn are calculated, and among the calculated inter-contour line distances Db1, Db2, Db3,. The last input contour formation point EnOP1 and the new contour formation point NSOP1 which are in the relationship of distance (here, distance between contour lines Db1) are determined as the starting point pair SPP2.

  Subsequently, the contour generation unit 101 uses the contour estimation generation circuit 114 as shown in FIG. 57A to start from the starting point pair SPP2 and in the counterclockwise direction indicated by the arrow ArwS2, for example, in the head input contour StOL. By associating the new contour forming points NSOP1 to NSOPn in the reference direction with the last input contour forming points EnOP1 to EnOPn in the forward direction which is the counterclockwise direction indicated by the arrow ArwO2 on the last input contour line EnOL, respectively. The forward paired distances ODb2 to ODbn between the new contour forming point NSOP2 and the last input contour forming point EnOP2, the new contour forming point NSOP3 and the last input contour forming point EnOP3,.

  Further, the information processing apparatus 100 causes the contour estimation generation circuit 114 to generate new contour formation points NSOP1 to NSOPn in the reference direction from the starting pair SPP2 as the starting point, as shown in FIG. By associating the last input contour forming points EnOP1 to EnOPn in the reverse direction which is the clockwise direction indicated by the arrow ArwS2 on the last input contour line EnOL in order, respectively, the associated new contour forming point NSOP2 and the last input The distances RDb2 to RDbn between the counterclockwise pairs of the contour forming points EnOPn, the new contour forming point NSOP3 and the last input contour forming point EnOPn-1, and so on are calculated.

  Next, the contour generation unit 101 calculates the sum of the forward pair-to-pair distances ODb2 to ODbn and the sum of the reverse pair-to-pair distances RDb2 to RDbn by the contour estimation generation circuit 114, and then compares the calculated sums. Thus, one of the associations having a small sum (for example, association between the reference direction and the forward direction) is selected.

  Then, as shown in FIG. 58, the contour generation unit 101 uses the contour estimation generation circuit 114 to set the distance between the origin points ODb1, the distance between the forward pairs ODb2, ODb3,... The new contour forming points NSOP1 and the last input contour forming points EnOP1 that are the starting point pairs by dividing by the total number of −1, the virtual lines between the starting points connecting the last input contour forming points EnOP1, and the new contour forming points NSOP2 to NSOPn and the tails associated with each other in order The point formation intervals DDb1, DDb2, DDb3,... Are obtained on the virtual lines between the association points connecting the input contour formation points EnOP2 to EnOPn, and the point formation intervals on the virtual lines between the start points and the virtual lines between the association points. DDb1, DDb2, DDb3,..., Estimated contour forming points OIPa1 to OIPn1, OIPa2 to OIPn2, OIPa3 to OIPn3, ... to generate.

  The contour generation unit 101 uses the contour estimation generation circuit 114 to form a new contour among the estimated contour formation points OIPa1 to OIPn1, OIPa2 to OIPn2, OIPa3 to OIPn3,. By interpolating the estimated contour forming points OIPa1 to OIPan, the OIPb1 to OIPbn, the OIPc1 to OIPcn,. Estimated contour lines OLA1 to OLAn-2 are generated.

  Then, the contour generation unit 101 calculates the centroids (coordinate values) of the estimated contour lines OLA1 to OLAn-2 by the contour guess generation circuit 114.

  Further, the contour generation unit 101 uses the contour estimation generation circuit 114 to calculate the center-of-gravity moving distance L2 (FIG. 55) between the center of gravity StOC of the leading input contour StOL and the center of gravity EnOC of the last input contour EnOL. By dividing by the total number of the frame images OF2 to OFn−1, the contour extracting intermediate frame images OF2 to OFn− with respect to the center of gravity StOC of the head input contour StOL on the centroid virtual line connecting the centroids StOC and EnOC to each other. 1 is calculated (that is, the estimated center-of-gravity position).

  Then, the contour generation unit 101 causes the contour estimation generation circuit 114 to convert the estimated contours OLA1 to OLAn-2 from the center of gravity StOC of the leading input contour StOL to the center of gravity of the last input contour EnOL while maintaining the order. The estimated contour lines OLA1 to OLAn-2 are respectively contoured by moving in the direction of EnOC, and sequentially aligning the centroids of the estimated contour lines OLA1 to OLAn-2 with the estimated centroid positions on the virtual line between the centroids. Corresponding to the extraction intermediate frame images OF2 to OFn-1.

  In this way, the information processing apparatus 100 reads the head input contour line obtained by tracing and designating the contours of the objects OJ1 and OJn in the contour extraction first frame image OF1 and the contour extraction last frame image OFn. Estimated contour lines OLA1 to OLAn-2 for extracting the objects OJ2 to OJn-1 in the respective contour extraction intermediate frame images F2 to Fn-1 are estimated and generated from the StOL and the last input contour line EnOL.

  Then, the information processing apparatus 100 causes the contour estimation generation circuit 114 to use a plurality of estimated contour forming points OIPa1 to OIPan, OIPb1 to OIPbn, OIPc1 to OIPcn,... (Corresponding contours) constituting the estimated contours OLA1 to OLAn-2. The estimated contour forming point cloud data consisting of the set data of the extraction intermediate frame images OF2 to OFn-1) together with the leading input contour forming point cloud data D121 and the last input contour forming point cloud data D122 The contour extraction data D123 is sent to and recorded on the contour recording circuit 115, and then the process proceeds to step SP133.

  In step SP133, the information processing apparatus 100 reads out the object contour extraction data D123 from the contour recording circuit 115 by the user interface circuit 112, and also reads out all the contour extraction frame image data D200A from the moving image recording circuit 111. The extracted contour presentation image data is generated by combining the extraction frame image data D200A with the object contour extraction data D123, and the extracted contour presentation image data is combined with the contour extraction processing screen data D120 to the information presentation unit 105. Send it out.

  As a result, the information processing apparatus 100, as shown in FIG. 59, displays the head input contour lines StOL corresponding to the contour extraction frame images OF1 to OFn in the image display area in the contour extraction processing screen in the information presentation unit 105, respectively. The estimated contour lines OLA1 to OLAn-2 and the last input contour line EnOL are displayed in a superimposed manner so that the user to be enlightened can visually check them, and then the process proceeds to step SP134.

  In step SP134, the information processing apparatus 100 determines whether or not the user interface circuit 112 has input a process end command to end the contour extraction process by the enlightenment target user.

  If a negative result is obtained in this step SP134, this means that the processing end command has not been input by the enlightenment target user who visually confirmed the estimated contour lines OLA1 to OLAn-2 via the contour extraction processing screen, that is, the contour This means that the contours of the objects OJ2 to OJn-1 in the extraction intermediate frame images OF2 to OFn-1 are not extracted with sufficient accuracy that can be understood by the enlightenment target user, and the contour extraction operation continues. When this happens, the information processing apparatus 100 proceeds to the following step SP135.

  In step SP135, the information processing apparatus 100 causes the user interface circuit 112 to record a moving image in response to a presentation command requesting presentation of the contour extraction intermediate frame images OF2 to OFn-1 for contour specification input by the enlightenment target user. By reading out the contour extraction frame image data D200A corresponding to the contour extraction intermediate frame images OF2 to OFn-1 from the circuit 111, combining it with the contour extraction processing screen data D120 and sending it to the information presentation unit 105, The information presenting unit 105 displays the contour extraction intermediate frame images OF2 to OFn-1 in the image display area in the contour extraction processing screen to allow the user to be enlightened to visually check.

  In this way, the information processing apparatus 100 newly outlines the objects OJ2 to OJn-1 while visually comparing the plurality of contour extraction intermediate frame images OF2 to OFn-1 to the enlightenment target user. Extraction intermediate frame images OF2 to OFn-1 are selected.

  As a result, as shown in FIG. 60, the information processing apparatus 100 selects, for example, the contour extraction intermediate frame image OF12 by the enlightenment target user, and arbitrarily traces the contour of the object OJ12 in the contour extraction intermediate frame image OF12. When the additional input contour signal S120 corresponding to the additional input contour line (hereinafter, referred to as an additional input contour line) AL1 obtained as described above is taken into the user interface circuit 112, the process returns to step SP133.

  In this case, the information processing apparatus 100 corresponds to the additional input contour signal S120 by sampling the additional input contour signal S120 at a predetermined sampling interval and converting it into digital data by the conversion circuit 113 in step SP133. A plurality of additional input contour formation points are generated, and the generated set data of the additional input contour formation points is sent to the contour estimation generation circuit 114 as additional input contour formation point group data D124.

  Then, the information processing apparatus 100 reads out the object contour extraction data D123 from the contour recording circuit 115 by the contour guess generation circuit 114, and forms leading input contour formation point group data D121 and tail input contour formation from the object contour extraction data D123. Point cloud data D122 is taken out.

  Here, the information processing apparatus 100 uses the contour guess generation circuit 114 to start with the head input contour StOL corresponding to the head input contour formation point cloud data D121 and the additional input contour corresponding to the additional input contour formation point cloud data D124. Estimated contour lines OLB1 to OLB10 for extracting the contours of the objects OJ2 to OJ11 in the contour extracting intermediate frame images OF2 to OF11 between the contour extracting head frame image OF1 and the contour extracting intermediate frame image OF12 from AL1 are newly added. To guess and generate.

  Further, the information processing apparatus 100 uses the contour estimation generation circuit 114 to generate the contour extraction intermediate frame image OF12 and the contour from the additional input contour AL1 and the tail input contour EnOL corresponding to the tail input contour formation point group data D122. Estimated contour lines OLB12 to OLBn-2 for extracting the contours of the objects OJ13 to OJn-1 in the contour extracting intermediate frame images OF13 to OFn-1 between the extraction last frame images OFn are newly estimated and generated. To do.

  Then, the information processing apparatus 100 generates a plurality of estimated contour formation point group data respectively constituting the estimated contour lines OLB1 to OLB10 and OLB12 to OLBn-2 by the contour estimation generation circuit 114, and the estimated contour formation point group data. The first input contour formation point group data D121, the last input contour formation point group data D122, and the additional input contour formation point group data D124 are sent to the contour line recording circuit 115 as new object contour extraction data D123. Update by recording.

  Thus, the information processing apparatus 100 reads out new object contour extraction data D123 from the contour recording circuit 115 by the user interface circuit 112, and also reads out frame extraction frame image data D200A from the moving image recording circuit 111 to extract the contour. The extracted contour presentation image data is generated by combining the frame image data D200A with the new object contour extraction data D123, and the extracted contour presentation image data is combined with the contour extraction processing screen data D120 to generate the information presentation unit 105. To send.

  As a result, the information processing apparatus 100 causes the information presentation unit 105 to display the head input contour StOL and the tail input contour EnOL respectively corresponding to the contour extraction frame images OF1 to OFn in the image display area in the contour extraction processing screen. And the additional input contour line AL1 and the new estimated contour lines OLB1 to OLB10 and OLB12 to OLBn-2 are displayed so as to be visually observed by the user.

  In this state, if a negative result is obtained again in step SP134, for example, the information processing apparatus 100 proceeds to step SP135 described above and similarly selects the contour extraction frame images OF1 to OFn for specifying the contour.

  Then, the information processing apparatus 100 newly selects the contour extraction intermediate frame image OF22 by the enlightenment target user (FIG. 60), and arbitrarily traces the object OJ22 in the contour extraction intermediate frame image OF22, thereby adding additional input contours. When the line signal S121 is obtained, it is taken into the user interface circuit 112 and the process returns to step SP132.

  In this case, in step SP132, the information processing apparatus 100 uses the conversion circuit 113 to sample the additional input contour signal S121 at a predetermined sampling interval and convert it into digital data, which corresponds to the additional input contour signal S121. A plurality of additional input contour forming points to be generated is generated, and the generated set data of the additional input contour forming points is sent to the contour estimation generating circuit 114 as additional input contour forming point group data D125.

  Then, the information processing apparatus 100 reads the object contour extraction data D123 from the contour recording circuit 115 by the contour guess generation circuit 114, and forms additional input contour formation point cloud data D124 and tail input contour formation from the object contour extraction data D123. Point cloud data D122 is taken out.

  Here, the information processing apparatus 100 uses the contour estimation generation circuit 114 to first add the additional input contour AL1 corresponding to the additional input contour formation point cloud data D124 and the additional input contour corresponding to the additional input contour formation point cloud data D125. Presumed contour lines OLC12 to OLC20 for extracting the contours of the objects OJ13 to OJ21 in the contour extracting intermediate frame images OF13 to OF21 between the contour extracting intermediate frame image OF12 and the contour extracting intermediate frame image OF22 are estimated from AL2. Re-create it.

  In addition, the information processing apparatus 100 uses the contour estimation generation circuit 114 to generate the contour extraction intermediate frame image OF22 from the additional input contour AL2 and the tail input contour EnOL corresponding to the tail input contour formation point group data D122. Re-estimating the estimated contour lines OLC22 to OLCn-2 for extracting the contours of the objects OJ23 to OJn-1 in the contour extracting intermediate frame images OF23 to OFn-1 between the contour extracting last frame images OFn To generate.

  Then, the information processing apparatus 100 newly generates a plurality of estimated contour forming point group data respectively constituting the estimated contours OLB1 to OLB10, OLC12 to OLC20, and OLC22 to OLCn-2 by the contour estimation generating circuit 114, The estimated contour forming point group data, the head input contour forming point group data D121, the tail input contour forming point group data D122, and the additional input contour forming point group data D124 and D125 are contoured as new object contour extraction data D123. It is updated by sending it to the line recording circuit 115 and recording it.

  Thus, the information processing apparatus 100 reads out new object contour extraction data D123 from the contour recording circuit 115 by the user interface circuit 112, and also reads out frame extraction frame image data D200A from the moving image recording circuit 111 to extract the contour. The extracted contour presentation image data is generated by combining the frame image data D200A with the new object contour extraction data D123, and the extracted contour presentation image data is combined with the contour extraction processing screen data D120 to generate the information presentation unit 105. To send.

  As a result, the information processing apparatus 100 causes the information presentation unit 105 to display the head input contour StOL and the tail input contour EnOL respectively corresponding to the contour extraction frame images OF1 to OFn in the image display area in the contour extraction processing screen. The additional input contour lines AL1 and AL2 and the estimated contour lines OLB1 to OLB10, OLC12 to OLC20, and OLC22 to OLCn-2 are displayed in an overlapping manner so that the user can visually observe them.

  In this way, the information processing apparatus 100 repeats the processing of step SP135-step SP132-step SP133-step SP134 until a positive result is obtained in step SP134.

  Therefore, the information processing apparatus 1 generates the estimated contour line once by the enlightenment target user specifying the contours of the objects OJ1 to OJn, but when the contours of the objects OJ1 to OJn are newly specified, Each time the objects OJ1 to OJn are re-estimated and corrected for the estimated contour lines for extracting the contours of the objects OJ2 to OJn-1 in the contour extraction frame images OF2 to OFn-1 in accordance with the contour designation results. It is possible to extract the outline of the user with the accuracy that the enlightenment target user agrees with.

  On the other hand, if an affirmative result is obtained in step SP134, this indicates that the contours of the objects OJ2 to OJn-1 in the contour extraction intermediate frame images OF2 to OFn-1 can be extracted with an accuracy that the enlightenment target user agrees with. This indicates that the process end command for ending the contour extraction process has been input by the enlightenment target user. At this time, the information processing apparatus 100 takes the process end command into the user interface circuit 112 and moves to step SP136. .

  In step SP136, the information processing apparatus 100 sends a processing end command from the user interface circuit 112 to the contour line recording circuit 115 via the conversion circuit 113 and the contour line estimation generation circuit 114 in order, so that the contour line recording circuit 115 performs the processing. The first input contour StOL, the last input contour EnOL, the additional input contours AL1 and AL2 corresponding to the latest object contour extraction data D123 recorded at this time, the estimated contours OLB1 to OLB10, OLC12 to OLC12 to OLC OLC20 and OLC22 to OLCn-2 are contour lines finally obtained by extracting the contours of the objects OJ1 to OJn (hereinafter referred to as final contour lines).

  Then, the information processing apparatus 100 sends the final contour line as final contour data D126 to the object extraction device (not shown) via the contour output circuit 116 by the contour recording circuit 115, so that the object extraction device finally performs the final processing. Using the contour lines, the objects OJ1 to OJn are extracted from the plurality of contour extraction frame images OF1 to OFn constituting the object extraction moving image 200.

  In addition, the information processing apparatus 100 appropriately changes the display contents while performing the above-described contour extraction processing procedure RT102 (that is, the contour extraction processing using the object extraction moving image 200) on the user interface circuit 112 to present information. A series of contour extraction processing screens displayed by the unit 105 is recorded as contour extraction history screen data D111 representing the history of the contour extraction operation.

  Therefore, the information processing apparatus 100 associates the user ID of the enlightenment target user with the contour extraction history screen data D111 by the user interface circuit 112, and sends this to the information storage unit 103 via the processing trend information extraction unit 102. By storing the information in the information storage unit 103, when the contour extraction operation is performed by another enlightenment target user, the contour extraction history screen data D111 can be used as the presentation information, and the process proceeds to the next step SP137 and described above. The contour extraction processing procedure RT102 is finished.

  In this way, as shown in FIG. 61, the information processing apparatus 100 satisfies the enlightenment user with the outlines of the objects OJ1 to OJn in the plurality of outline extraction frame images OF1 to OFn constituting the object extraction moving image 200. It can be extracted as ideal final contour lines LS1 to LSn that have been shifted according to the movement of the objects OJ1 to OJn.

  In the above configuration, in the trial mode, the information processing apparatus 100 applies to the contours of the trial objects TJ1 to TJ7 in the plurality of trial frame images TF1 to TF7 constituting the contour extraction trial moving image 120 to the enlightenment target user. The contour extraction trial operation is performed, the skill of the contour extraction technique for the enlightenment user is determined based on the result of the contour extraction trial process according to the contour extraction trial operation, and skill data D107 indicating the determination result is extracted from the contour extraction Input information data D108 together with contour extraction trial history screen data consisting of a series of contour extraction trial processing screens displayed by appropriately changing display contents during trial processing, contour extraction trial moving image data D100, and the like.

  In addition, the information processing apparatus 100 uses the contour extraction trial history screen data and the contour extraction trial moving image data D100 included in the input information data D108 to determine from the contour extraction trial moving image 120 how the object T Thru | or the process tendency information with respect to the outline extraction method of the said enlightenment user showing whether the outline of TJ7 is extracted is extracted, and the extracted process tendency information is information as the accumulated information data D109 together with the input information data D108 as the process tendency information data Store in the storage unit 103.

  In the information presentation mode prior to the contour extraction processing mode, the information processing apparatus 100 displays the processing tendency information data included in the stored information data D109 of the enlightenment target user and the past stored information data D109 already stored in the information storage unit 103. Are compared with the processing trend information data included in the past information information D109 of other users of the contour extraction method similar to the contour extraction method of the enlightenment target user from the past storage information data D109.

  Next, the information processing apparatus 100 performs a series of contour extraction processing presented to the user of the skill according to the skill of the user to be enlightened based on the skill information included in the selected past accumulated information data D109 during the contour extraction process. The contour extraction history screen data 111 composed of a screen is finally selected and presented to the user to be enlightened as presentation information data D110 together with information on the skill of the user.

  Therefore, the information processing apparatus 100 does not particularly require guidance from a leader with excellent processing capability, and uses the contour extraction method of the user to be enlightened based on the contour extraction method of other users with different skills. Points to be noted can be noticed prior to the execution of the contour extraction operation on the object extraction moving image 200, and the enhancement of the contour extraction method of the enlightenment target user can be promoted.

  In addition, in the information presentation mode, the information processing apparatus 100 presents the object extraction moving image 200 used for the contour extraction operation continuously performed by the enlightenment target user in addition to the presentation information data D110 to the enlightenment target user. The contents of the information and the contents of the moving image for object extraction 200 can be visually checked, and thus the outlines of the objects OJ1 to OJn are extracted from the moving image for object extraction 200, for example, efficiently. It can be easily noticed at that time and the user to be enlightened can be further urged to improve his contour extraction technique more appropriately.

  According to the above configuration, the skill of the contour extraction method is determined by performing the contour extraction trial operation for extracting the contours of the trial objects TJ1 to TJ7 from the contour extraction trial moving image 120 in the enlightenment target user in the trial mode, Processing for the enlightenment target user's contour extraction technique, in which the skill information is extracted from a series of contour extraction trial processing screens and contour extraction trial moving images 120 displayed by appropriately changing display contents during the contour extraction trial processing. The information is stored in the information storage unit 103 as the stored information data D109 together with the trend information, and the processing trend information included in the stored information data D109 of the enlightenment user in the information presentation mode prior to the contour extraction processing mode is already stored in the information storage unit 103. Contour extraction of the enlightenment target user by comparing the processing tendency information included in the accumulated past accumulated information data D109. A user having a skill corresponding to the skill of the user to be enlightened based on the skill information included in the selected past accumulated information data D109, while selecting past accumulated information data D109 of another user similar to the technique of contour extraction By selecting a series of screens for contour extraction processing presented at the time of the contour extraction processing and presenting them together with information on the skill of the user to the enlightenment user as presentation information data D110, the skill Prior to the execution of the contour extraction operation for the object extraction moving image 200, the user to be enlightened is made aware of the points to be noted in the contour extraction operation based on the contour extraction method of other users with different It is possible to promote improvement of the contour extraction method of the enlightenment target user, and thus the object extraction moving image 2 to be processed. The processing capabilities of the processing of extracting the contour of the object OJ1 to OJn 0 can be easily improved.

  In the third embodiment described above, an object extraction is performed on the enlightenment target user after presenting a series of contour extraction processing screens representing the history of the contour extraction operation performed by other users in the past to the enlightenment target user. The case where the contour extraction operation is performed on the contours of the objects OJ1 to OJn in the moving image 200 has been described, but the present invention is not limited to this, and as shown in FIG. An image display area 149A for displaying a series of contour extraction processing screens 145 representing the background of the contour extraction operation performed by another user, and a series of contour extraction processing according to the contour extraction operation performed by the enlightenment target user The processing screen 150 having the contour extraction area 149B for displaying the screen 146 is displayed on the information presentation unit 105, and the enlightenment target user is displayed. Together the contour extraction operations performed I may be presented a series of contour extraction processing screen 145 at the time of contour extraction operation by the user's past.

  In the above-described third embodiment, in the trial mode, the skill of each user is determined according to the total number of input frame images based on a preset frame image reference number Bor1 (FIG. 48). However, the present invention is not limited to this. In the trial mode, as shown in FIG. 63, the accumulated information data D109 of each user is arranged in ascending order of the total number of input frame images, and the number of all users is almost halved. 64. The skill of each user is determined by the threshold Bor2 divided into two, or as shown in FIG. 64, the accumulated information data D109 of each user is arranged in ascending order of the total number of input frame images, and the number of users with high or low skill is limited to a predetermined number. The skill of each user may be determined based on such a threshold Bor3. In this case, the skill of the user can be determined according to the tendency of the total number of input frame images for each user.

  Further, in the third embodiment described above, in the information presentation mode, the past accumulated information data D109 of the user of the contour extraction method similar to the contour extraction method of the enlightenment target user is selected (limited) from the past accumulated information data D109. However, the present invention is not limited to this, and the name of the object extracted by the contour extraction trial operation and / or the contour extraction operation performed by each user is stored in the past accumulated information data D109. In the information presentation mode, the enlightenment user is made to input the name of an object (for example, star shape or human upper body) in the object extraction moving image, and the past accumulated information data D109 including information on the name of the object is selected. (Limited) or image features included as processing trend information in the accumulated information data D109 of the enlightenment target user The object is the same as or similar to the object having the contour extracted by the enlightenment target user (or similar moving image for object extraction) It is also possible to select (limit) the user's past accumulated information data D109 from which the contour of the (object) is extracted.

  In this case, the contour extraction operation is performed for the enlightenment target user on the object extraction moving image that is the same as or similar to the object from which the contour is to be extracted, or the object extraction moving image used for extracting the outline. In addition, since a series of contour extraction processing screens representing the contour extraction methods of other users can be presented, it is possible to prompt the enlightening target user to improve their contour extraction method more appropriately.

  Furthermore, in the third embodiment described above, when the skill of the enlightenment target user Y1 (FIG. 51) is low in the information presentation mode, the past accumulated information data of the user Y2 with the highest skill among the past accumulated information data D109. When D109 is finally selected and the skill of the enlightenment target user Y3 is high, the case where the past accumulated information data D109 of the user Y4 having the lowest skill is finally selected from the past accumulated information data D109 will be described. However, the present invention is not limited to this, and as shown in FIG. 65, when the skill of the enlightenment target user Y5 is low in the information presentation mode, the skill of the enlightenment target user Y5 is selected from the past accumulated information data D109. The past accumulated information data D109 of the user Y6 who has the highest skill in the fixed range W is finally selected, and the skill of the user Y7 to be enlightened is high If I may be finally selected in the past accumulated information data D109 of the awareness target user Y7 of lowest skill within a certain range W relative to the skill user Y8 from the past accumulated information data D109.

  In this case, a series of contour extraction processing screens when the user's skill selected for presenting the contour extraction method to the enlightenment user is too high or too low and the contour extraction operation is performed by the user is the enlightenment user. Therefore, it is possible to prevent difficulty in use in order to promote improvement of the contour extraction method.

  Further, in the third embodiment described above, the result of the contour extraction trial operation of the enlightenment target user is stored in the information storage unit 103 as the stored information data D109 in the trial mode, and the stored information data D109 is stored in the information presentation mode. However, the present invention is not limited to this, and the object extraction moving image already performed by the enlightenment target user in the contour extraction processing mode has been described. Based on the result of the contour extraction operation for the contour of the object in the image, the skill and contour extraction tendency (that is, the tendency represented by the processing trend information) for the contour extraction operation of the user to be enlightened is determined and stored information data D109 is stored in the information storage unit 103, and the enlightenment target user again responds to the object extraction moving image. Te information presentation mode for performing contour extraction operation, may be selected contour extraction history screen data D111 of other users in accordance with the stored information data D 109.

  Further, in the above-described third embodiment, a case is described in which an estimated contour is estimated and generated from an input contour obtained by tracing the contour of an object via an operation unit such as a mouse. However, the present invention is not limited to this, and the estimated contour line is estimated from a designated area in which the area inside the contour of the object is filled to designate the object, a designated area in which the background of the object is filled to designate the object, and the like. May be generated.

  Furthermore, in the above-described third embodiment, when extracting the contour of an object from a moving image, first and last contour extracting frame images and trial frame images from a plurality of frame images constituting the moving image. However, the present invention is not limited to this, and when extracting the contour of an object from a moving image, two frame images are first arbitrarily selected from a plurality of frame images constituting the moving image. You may make it select.

(4) Other Embodiments In the first to third embodiments described above, the information processing apparatus according to the present invention is applied to the information processing apparatuses 1, 50, and 100 described above with reference to FIGS. However, the present invention is not limited to this, such as a personal computer, an image processing device, an information processing device in which the region extraction unit 51 and the contour generation unit 101 are separated from the above information processing devices 50 and 100, and the like. In addition, the present invention can be widely applied to various other information processing apparatuses.

  In the first to third embodiments described above, the information processing program according to the present invention is the first and second enlightenment promotion programs, contour extraction trial programs, information presentation programs, and contours described above with reference to FIGS. The first and second enlightenment promotion processing procedures RT1 and RT50 described above with reference to FIGS. 2 and 14 are executed according to the first and second enlightenment promotion programs, and the contour extraction trial program and information are applied to the extraction process program. The case where the contour extraction trial processing procedure RT100, the information presentation processing procedure RT101 and the contour extraction processing procedure RT102 described above with reference to FIGS. 34, 49 and 53 are executed according to the presentation program and the contour extraction processing program has been described. The invention is not limited to this, and the first and second enlightenment promotion programs By installing the program, the contour extraction trial program, the information presentation program, and the contour extraction processing program in the information processing apparatus 1, 50, 100 using a wired and wireless communication medium such as a local area network, the Internet, and digital satellite broadcasting. The first and second enlightenment promotion processing procedures RT1 and RT50, the contour extraction trial processing procedure RT100, the information presentation processing procedure RT101 and the contour extraction processing procedure RT102 may be executed, or the first and second enlightenment promotion procedures. By installing a program storage medium in which a program, contour extraction trial program, information presentation program, and contour extraction processing program are stored in the information processing apparatuses 1, 50, 100, the first and second enlightenment promotion processing procedures RT1 and RT50, Contour extraction trial processing procedure RT1 0, may be executing the information presentation processing procedure RT101 and contour extraction processing procedure RT102.

  Incidentally, the first and second enlightenment promotion programs RT1 and RT50, the contour extraction trial processing procedure RT100, the information presentation processing procedure RT101 and the contour extraction processing procedure RT102 described above, As a program storage medium for installing the contour extraction trial program, the information presentation program, and the contour extraction processing program in the information processing apparatuses 1, 50, 100 and making them executable, for example, a flexible disk, a CD-ROM (Compact Disc) -Not only package media such as Read Only Memory (DVD) and DVD (Digital Versatile Disc), but also first and second enlightenment promotion programs, contour extraction trial programs, information presentation programs and contour extraction processing programs temporarily or permanently With stored semiconductor memory, magnetic disk, etc. It may be represented. Means for storing the first and second enlightenment promotion programs, contour extraction trial programs, information presentation programs, and contour extraction processing programs in these program storage media include wired and wireless such as local area networks, the Internet, and digital satellite broadcasting. A communication medium may be used, and data may be stored via various communication interfaces such as a router and a modem.

  Furthermore, in the first to third embodiments described above, as a storage means for storing storage information including a processing method of processing performed on a processing target by a user and evaluation values for the processing for a plurality of users, FIG. Although the case where the information storage units 4, 53, and 103 described above with reference to FIGS. 1 to 65 are applied has been described, the present invention is not limited to this, and the processing method of processing performed on the processing target by the user and If storage information including evaluation values for the processing can be stored for a plurality of users, various other storage means such as a hard disk drive and an external recording device outside the information processing apparatus 1, 50, 100 are widely applied. can do.

  Furthermore, in the first to third embodiments described above, as comparing means for comparing any one of the processing method and evaluation value of a specific user with one included in the accumulated information accumulated in the accumulating means. 1 to 65, the case where the presentation information selection units 5, 54, 104 described above are applied has been described. However, the present invention is not limited to this, and the processing method of a specific user (that is, a user to be enlightened) and If any one of the evaluation values can be compared with one included in the accumulated information accumulated in the accumulating means, like a dedicated comparison circuit different from the presentation information selection units 5, 54, 104, etc. Various other comparison means can be widely applied.

  Furthermore, in the first to third embodiments described above, as information selection means for selecting stored information according to the comparison result by the comparison means from among a plurality of pieces of storage information stored in the storage means, FIG. Although the case where the presentation information selection units 5, 54, and 104 described above with reference to FIG. 65 are applied has been described, the present invention is not limited to this, and a comparison unit is selected from a plurality of storage information stored in the storage unit. If the accumulated information can be selected in accordance with the comparison result of, the presentation information selecting unit 5, 54, 104 can select one of the processing method and evaluation value of the specific user and the accumulated information accumulated in the accumulating means. Various other information selection means can be widely applied, such as a dedicated information selection circuit excluding the function of comparing one included.

  Furthermore, in the first to third embodiments described above, the monitor and speaker described above with reference to FIGS. 1 to 65 are used as the presenting means for presenting the processing method included in the stored information selected by the information selecting means to a specific user. However, the present invention is not limited to this, and the processing method included in the accumulated information selected by the information selection means is presented to a specific user. If possible, various other presentation means can be widely applied, such as an external display device outside the display unit or the information processing devices 1, 50, 100.

  Furthermore, in the first to third embodiments described above, FIG. 13 shows image selection means for selecting one frame image for designating the contour of an object from among a plurality of frame images constituting a moving image. Although the case where the operation unit such as a mouse (not shown) described above with reference to FIG. 31 is applied has been described, the present invention is not limited thereto, such as a pointing device such as a joystick, a stylus pen, a touch panel, a keyboard, etc. Various other image selection means can be widely applied.

  Furthermore, in the first to third embodiments described above, FIG. 13 shows image setting means for setting a plurality of frame images for extracting an object designated area from a plurality of frame images constituting a moving image. Although the case where the operation unit such as a mouse (not shown) described above with reference to FIG. 31 is applied has been described, the present invention is not limited thereto, such as a pointing device such as a joystick, a stylus pen, a touch panel, a keyboard, etc. Various other image setting means can be widely applied.

  Furthermore, in the first to third embodiments described above, the motion vector detection recording circuit 62 described above with reference to FIGS. 13 to 31 is applied as the motion vector detection means for detecting the motion vector of the object in the moving image. However, the present invention is not limited to this, and various other motion vector detection means such as a motion vector detection circuit having only a motion vector detection function can be widely applied.

  Further, in the first to third embodiments described above, FIGS. 13 to 31 are described as contour designating means for designating the contour of an object in one frame image selected via the image selecting means. However, the present invention is not limited to this, and various other contour designating means such as a pointing device such as a joystick, a stylus pen, and a touch panel are used. Can be widely applied.

  Further, in the first to third embodiments described above, a plurality of images set by the image setting unit based on the motion vector detected by the motion vector detecting unit and the contour specified by the contour specifying unit. Although the case where the region extracting unit 51 described above with reference to FIGS. 13 to 31 is applied as the specified region extracting means for extracting the object specified region for the frame image of the present invention has been described, the present invention is not limited to this, and the information processing Various other designated area extracting means can be widely applied, such as an external area extracting apparatus separated from the apparatus 50.

  Furthermore, in the first to third embodiments described above, as input histories by the image selection means, the image setting means, and the contour designation means, which are processing techniques included in the storage information stored in the storage means, FIG. 13 to FIG. Although the case where the region extraction history screen data composed of the series of region extraction processing screens described above is applied to the case 31 has been described, the present invention is not limited to this, and the input history representing the background of the region extraction method as character information As described above, various other input histories can be widely applied.

  Further, in the first to third embodiments described above, for selecting at least two first and second frame images for designating the contour of an object from among a plurality of frame images constituting a moving image. The case where an operation unit such as a mouse (not shown) described above with reference to FIGS. 32 to 65 is applied as the image selection means has been described, but the present invention is not limited to this, and a pointing device such as a joystick, stylus pen, touch panel, or the like. Various other image selection means such as a keyboard and a keyboard can be widely applied.

  Furthermore, in the first to third embodiments described above, FIG. 32 shows contour designating means for designating the contours of the objects in the first and second frame images selected via the image selecting means. The operation unit such as a mouse (not shown) described above with reference to FIG. 65 has been described. However, the present invention is not limited to this, and various other types of pointing devices such as a joystick, a stylus pen, and a touch panel can be used. The contour designating means can be widely applied.

  Furthermore, in the first to third embodiments described above, when another frame image exists between the first and second frame images, the first and second frame images are included in the first and second frame images via the contour specifying means. The contour lines described above with reference to FIGS. 32 to 65 as contour estimation means for estimating the contours of objects in other frame images from the first and second contour designation results obtained by designating the contours of the objects. Although the case where the inference generation circuit 114 is applied has been described, the present invention is not limited to this, and when there is another frame image between the first and second frame images, the second operation is performed via the contour specifying means. Objects in other frame images from the first and second contour designation results obtained by designating the contours of the objects in the first and second frame images, respectively. If it is possible to infer the contour, CPU as such (Central Processing Unit) or a microprocessor, it is possible to widely apply various other outline estimating means.

  Further, in the first to third embodiments described above, FIGS. 32 to 65 are described as input histories by the image selection unit and the contour specification unit, which are processing methods included in the storage information stored in the storage unit. Although the case where the contour extraction history screen data D111 composed of a series of contour extraction processing screens is applied has been described, the present invention is not limited to this, such as an input history that represents the history of the contour extraction method as character information. In addition, various other input histories can be widely applied.

It is a block diagram which shows 1st Embodiment of the circuit structure of the information processing apparatus by this invention. It is a flowchart which shows a 1st enlightenment promotion processing procedure. It is a basic diagram which shows the structure of input information. It is a basic diagram which shows input information data. It is a basic diagram which shows the structure of a batting moving image. It is a basic diagram with which it uses for description of the detection of the height difference with the course of a ball | bowl, and the grip and front-end | tip of a bat. It is a basic diagram which shows the structure of process tendency information. It is an approximate line figure used for explanation of storage of accumulation information data. It is an approximate line figure used for explanation of limitation of accumulation information data. It is a basic diagram which shows the selection conditions for selecting presentation information. It is a basic diagram which shows the structure of presentation information. It is a basic diagram which shows the selection conditions of the presentation information by other embodiment. It is a block diagram which shows the circuit structure of the information processing apparatus by 2nd Embodiment. It is a flowchart which shows a 2nd enlightenment promotion processing procedure. It is a block diagram which shows the circuit structure of an area | region extraction part. It is a flowchart which shows an area | region extraction process routine (1). It is a flowchart which shows an area | region extraction process routine (2). It is a basic diagram which shows the structure of the moving image for object extraction. It is a basic diagram with which it uses for description of the setting of a work frame image and a propagation range. It is a basic diagram with which it uses for description of designation | designated of the outline of the object in a work frame image. It is a basic diagram with which it uses for description of the production | generation of an object designation | designated propagation area. It is a basic diagram with which it uses for description of the production | generation of the object designation | designated area | region in a propagation range. It is a basic diagram with which it uses for description of the instruction | indication of the correction location with respect to an object designation | designated area | region. It is an approximate line figure used for explanation of amendment of an object specification field. It is a basic diagram with which it uses for description of presentation of the corrected object designation | designated area | region. It is a basic diagram with which it uses for description of the object designated area | region which reversed the area | region. It is a basic diagram which shows the structure of input information. It is a basic diagram which shows the structure of process tendency information. It is a basic diagram which shows the selection conditions for selecting presentation information. It is a basic diagram which shows the structure of presentation information. It is a basic diagram which shows the selection conditions of the presentation information by other embodiment. It is a block diagram which shows the circuit structure of the information processing apparatus by 3rd Embodiment. It is a block diagram which shows the circuit structure of an outline production | generation part. It is a flowchart which shows a contour extraction trial processing procedure. It is a flowchart which shows a skill determination processing routine. It is a basic diagram which shows the structure of the moving image for an outline extraction trial. It is a flowchart which shows a presumed outline generation process routine. It is a basic diagram with which it uses for description of a trial head input outline formation point and a trial last input outline formation point. It is a basic diagram with which it uses for description of the production | generation of the new outline formation point which newly comprises a trial head input outline. It is a basic diagram with which it uses for description at the time of making the gravity center of a trial head input outline and a trial last input outline match. It is a basic diagram with which it uses for description of determination of a starting point pair. It is a basic diagram with which it uses for description of matching of a forward direction and a reverse direction. It is an approximate line figure used for explanation of generation of a trial guess outline. It is a basic diagram with which it uses for description of presumption of the gravity center position in each frame image for trial. It is an approximate line figure used for explanation of a presentation result of a trial head input outline, a trial guess outline, and a trial last input outline. It is a basic diagram which shows the structure of input information. It is a basic diagram which shows the structure of process tendency information. It is a basic diagram with which it uses for description of database-ization of accumulation | storage information data. It is a flowchart which shows an information presentation process procedure. It is a basic diagram which shows the structure of the moving image for object extraction. It is an approximate line figure used for explanation of selection of accumulation information data. It is a basic diagram which shows the structure of presentation information. It is a flowchart which shows an outline extraction process procedure. It is a basic diagram with which it uses for description of the production | generation of a head input outline and a tail input outline. It is a basic diagram with which it uses for description at the time of making the gravity center of a head input outline and a tail input outline match. It is a basic diagram with which it uses for description of determination of a starting point pair. It is a basic diagram with which it uses for description of matching of a forward direction and a reverse direction. It is a basic diagram with which it uses for description of the production | generation of a presumed outline. It is a basic diagram which shows the production | generation result of the estimation outline with respect to the intermediate | middle frame image for outline extraction. It is a basic diagram with which it uses for description of the production | generation of the presumed outline based on an additional input outline. It is an approximate line figure used for explanation of a final outline. It is an approximate line figure used for explanation of presentation of a screen for outline extraction processing by other embodiments. It is a basic diagram with which it uses for description of determination (1) of the skill of the user by other embodiment. It is a basic diagram with which it uses for description of determination (2) of the skill of the user by other embodiment. It is a basic diagram with which it uses for description of selection of the accumulation | storage information data by other embodiment.

Explanation of symbols

  1, 50, 100 ... Information processing device, 2 ... Information input unit, 3, 52, 102 ... Processing trend information extraction unit, 4, 53, 103 ... Information storage unit, 5, 54, 104 ... Presentation Information selection unit, 6, 55, 105... Information presentation unit, 51... Region extraction unit, 62... Motion vector detection recording circuit, 114. 70A to 70G... Region extraction frame image, 71 and 120... Contour extraction trial moving image, TF1 to TF7. Trial frame image, TJ1 to TJ7... Trial object, OJ1 to OJn. ... contour generation unit, 74A ... object specification reference area, 77A to 77D, 77AX to 77DX ... object specification propagation area, 80 ... object specification reference area Area, 81A to 81D... Object designated propagation reversal area, D1 .. Batting moving image data, D2, D65... Input information data, D3, D66... Processing trend information data, D4, D67, D109. D5, D68, D110 ... presentation information data, D50, D200 ... moving image data for object extraction, D51 ... frame image data for region extraction, D52 ... screen data for region extraction processing, D100 ... outline extraction trial Moving image data, D100A: Trial frame image data, D200A: Contour extraction frame image data, D108: Skill data, D111: Contour extraction history screen data, S1, S55: User information, OF1 to OFn ... frame image for contour extraction, StOL ... top input contour line, EnOL ... Last input contour line, OLA1 to OLAn-2, OLB1 to OLB10, OLC12 to OLC20, OLC22 to OLCn-2d .... Estimated contour, SH1 ... Course threshold range, SH2 ... Height difference threshold range, RT1 ... No. 1 enlightenment promotion processing procedure, RT50 ... 2nd enlightenment promotion processing procedure RT101 ... information presentation processing procedure, RT102 ... contour extraction processing procedure.

Claims (6)

A region extraction method that is a processing method for extracting an object designation region for specifying an object in the moving image performed on the moving image to be processed by the user, and a skill that is an evaluation value for the processing Storage means for storing storage information including a plurality of users;
Comparison means for comparing one of the region extraction method and the skill of a specific user with the one included in the accumulated information accumulated in the accumulation means,
Information selecting means for selecting the stored information from the plurality of stored information stored in the storing means according to the comparison result by the comparing means;
An information processing apparatus comprising: the region extraction method included in the accumulated information selected by the information selection means; and a presentation means for presenting the skill to the specific user. Image selecting means for selecting one frame image for designating the contour of the object from a plurality of frame images constituting the moving image;
Image setting means for setting a plurality of the frame images for extraction of the object designation region from the plurality of frame images constituting the moving image;
Motion vector detecting means for detecting a motion vector of the object in the moving image;
Contour designating means for designating the contour of the object in the one frame image selected via the image selecting means;
The object designating region for the plurality of frame images set by the image setting unit based on the motion vector detected by the motion vector detecting unit and the contour specified by the contour specifying unit. A designated area extracting means for extracting
The storage means is
The information processing apparatus according to claim 1, wherein the storage information is stored using the input history by the image selection unit, the image setting unit, and the contour specifying unit as the processing technique. A plurality of users can store accumulated information including a contour extraction method as a processing method for extracting a contour of an object in the moving image performed on a moving image to be processed by the user and a skill as an evaluation value for the processing. Accumulation means for accumulating; and
Comparison means for comparing any one of the contour extraction method and the skill of the specific user with the one included in the accumulated information accumulated in the accumulation means,
Information selecting means for selecting the stored information from the plurality of stored information stored in the storing means according to the comparison result by the comparing means;
An information processing apparatus comprising: the contour extraction method included in the accumulated information selected by the information selection means; and a presentation means for presenting the skill to the specific user. Image selecting means for selecting at least two first and second frame images for designating the contour of the object from among a plurality of frame images constituting the moving image;
Contour designating means for designating each of the contours of the object in the first and second frame images selected via the image selecting means;
When there is another frame image between the first and second frame images, the contour of the object in the first and second frame images is designated via the contour designating means, respectively. Contour estimation means for estimating the contour of the object in the other frame image from the first and second contour designation results obtained,
The storage means is
Accumulating the accumulated information using the input history by the image selecting means and the contour designating means as the processing technique,
The selection means is:
The stored information including a skill that is more than a predetermined threshold away from the skill of the specific user is selected from a plurality of the stored information stored in the storage means according to the comparison result. The information processing apparatus according to claim 3. On the computer,
A region extraction method that is a processing method for extracting an object designation region for specifying an object in the moving image performed on the moving image to be processed by the user, and a skill that is an evaluation value for the processing An accumulation step for accumulating the accumulated information for a plurality of users;
A comparison step of comparing any one of the region extraction method and the skill of the specific user with the one included in the accumulation information accumulated in the accumulation step;
An information selection step for selecting the accumulated information according to the comparison result obtained in the comparison step from the plurality of accumulated information accumulated in the accumulation step;
An information processing program for executing the region extraction method included in the accumulated information selected in the information selection step and a presentation step of presenting the skill to the specific user. On the computer,
A plurality of users can store accumulated information including a contour extraction method as a processing method for extracting a contour of an object in the moving image performed on a moving image to be processed by the user and a skill as an evaluation value for the processing. An accumulation step for accumulating, and
A comparison step of comparing either one of the contour extraction method and the skill of the specific user with the one included in the accumulation information accumulated in the accumulation step;
An information selection step for selecting the accumulated information according to the comparison result obtained in the comparison step from the plurality of accumulated information accumulated in the accumulation step;
An information processing program for executing the contour extraction method included in the accumulated information selected in the information selection step and a presentation step of presenting the skill to the specific user.

Images