CN114602173A - Human body image clearing method and system in real-person game - Google Patents

Human body image clearing method and system in real-person game Download PDF

Info

Publication number
CN114602173A
CN114602173A CN202210519018.7A CN202210519018A CN114602173A CN 114602173 A CN114602173 A CN 114602173A CN 202210519018 A CN202210519018 A CN 202210519018A CN 114602173 A CN114602173 A CN 114602173A
Authority
CN
China
Prior art keywords
human body
label
marking
line
body image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202210519018.7A
Other languages
Chinese (zh)
Other versions
CN114602173B (en
Inventor
袁炜
沈辉
孙宏熙
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shanghai Intelligence Visual Electronics Co ltd
Original Assignee
Shanghai Intelligence Visual Electronics Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shanghai Intelligence Visual Electronics Co ltd filed Critical Shanghai Intelligence Visual Electronics Co ltd
Priority to CN202210519018.7A priority Critical patent/CN114602173B/en
Publication of CN114602173A publication Critical patent/CN114602173A/en
Application granted granted Critical
Publication of CN114602173B publication Critical patent/CN114602173B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/52Controlling the output signals based on the game progress involving aspects of the displayed game scene
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/50Controlling the output signals based on the game progress
    • A63F13/53Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game
    • A63F13/537Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen
    • A63F13/5372Controlling the output signals based on the game progress involving additional visual information provided to the game scene, e.g. by overlay to simulate a head-up display [HUD] or displaying a laser sight in a shooting game using indicators, e.g. showing the condition of a game character on screen for tagging characters, objects or locations in the game scene, e.g. displaying a circle under the character controlled by the player
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F13/00Video games, i.e. games using an electronically generated display having two or more dimensions
    • A63F13/80Special adaptations for executing a specific game genre or game mode
    • A63F13/825Fostering virtual characters
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/20Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/60Methods for processing data by generating or executing the game program
    • A63F2300/66Methods for processing data by generating or executing the game program for rendering three dimensional images
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/80Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game specially adapted for executing a specific type of game
    • A63F2300/8082Virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Physics & Mathematics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Architecture (AREA)
  • Optics & Photonics (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The invention discloses a method and a system for clearing human body images in a real-person game, wherein the method comprises the following steps: acquiring a human body image and an interception line; scanning the human body image, wherein a plurality of parallel scanning lines pass through the human body image part on the clearing side of the intercepting line during scanning; identifying a plurality of marking line segments of each scanning line overlapped with the human body image, and marking the marking line segments with part labels at least corresponding to a human body part area; and identifying the human body part area needing to be removed for removal according to the part label of the marking line segment. The invention can judge the human body part of the human body image on the clearing side of the intercepting line under the condition of various complex actions of the human body, and reasonably clear the human body image on the basis of the judgment to meet the plot requirements of real-person games and the like, and has simple operation.

Description

Human body image clearing method and system in real-person game
Technical Field
The invention belongs to the technical field of image processing, and particularly relates to a human body image clearing method and system in a real-person game.
Background
The motion sensing game is popular, the prior art can only obtain the motion parameters of the human body by shooting the actual human body, and adjust the motion and the action of the virtual character displayed in the game picture according to the motion parameters, if the shot actual human body is directly displayed in the game picture to replace the virtual character, a user can see that the real image and the real action of the user are well integrated with the game plot, and the interest and the achievement of the game are greatly improved.
In a traditional game, the human body posture, the action scale and the like of a virtual character are controlled by game software to meet the plot requirement of a game picture, and after a real human body image is placed in the game picture, because the activity and the action of the real human body are not controlled by the game software in reality, the human body and human body bearing props in the game picture cannot be well matched, the visual effect which does not meet the plot requirement or discomfort of the game picture appears, and meanwhile, a user cannot realize or keep the human body posture with high difficulty. For example, if a user fights while riding on a horse in a game screen, the user is fatigued if the user keeps a posture of straddling and riding on the horse in reality, and therefore, the lower half of the human body is cut off in the game screen, only the upper half is displayed, for example, the lower half of the waist is cut off, the region corresponding to the waist is covered with a saddle, and the region below the saddle where the lower limbs of the human body should be displayed is replaced with props or covered with gowns.
However, in this case, since the range of movement of the upper limbs of the human body is large, if the upper limbs of the user are required to move above the waist cutting line, the constraint feeling is too strong, and meanwhile, in the actual game, the upper limbs of the human body may also need to complete the game actions such as hitting props, and too strict constraint may result in failure to complete the game, so that the determination of the human body part on the part of the human body image on the clearing side of the cutting line is required, and the determination of the human body part which needs to be cleared and/or reserved is required, and due to the complexity of the human body movement, how to perform such determination at present is short of mature technology.
Disclosure of Invention
The present invention provides a method and a system for removing a human body image in a real-person game, which can determine a human body part of a human body image on a removed side of a capturing line, and determine a human body part to be removed and/or to be reserved, so as to meet the requirements of the real-person game.
The invention discloses a human body image clearing method in a real-person game, which comprises the following steps:
acquiring a human body image and an interception line;
scanning the human body image, wherein a plurality of parallel scanning lines pass through the human body image part on the clearing side of the intercepting line during scanning; identifying a plurality of marking line segments of each scanning line overlapped with the human body image, and marking the marking line segments with part labels at least corresponding to a human body part area;
and identifying the human body part area needing to be removed for removing according to the part label of the marked line segment.
The human body image clearing method in the real-person game identifies the human body part area needing to be cleared and clears the human body part area, and comprises the following steps of:
And obtaining a corresponding part label C according to the human body part area needing to be cleared, setting the part label C as a clearing part label, setting other part labels of the non-part label C as reserved part labels, and clearing the human body image area where the marking line segment marked with the clearing part label is located.
The method for clearing the human body image in the real-person game is used for clearing the human body image area where the mark line segment marked with the clearing part label is located, and comprises the following steps of:
and clearing the human body image area where the marking line segment only marked with the clearing part label is located, and reserving the human body image area where the marking line segment simultaneously marked with the clearing part label and the reserved part label is located.
When the human body image area where the mark line segments are located is cleared, if no space exists between two adjacent mark line segments, the human body image area covered by the plurality of mark line segments is the human body part area needing to be cleared; if a distance exists between two adjacent marking line segments, the human body image area covered by the plurality of marking line segments and the human body image area between two adjacent marking line segments are the human body part area needing to be removed.
In the method for clearing human body images in the real-person game, the scanning of the human body images refers to line-by-line horizontal scanning of the human body images.
In the method for clearing human body images in the real-person game, the human body part area comprises one or more of a human body trunk part, a human body left arm part, a human body right arm part, a human body left leg part and a human body right leg part.
The human body image clearing method in the real-person game comprises the following steps of:
step a, generating human body part lines of a human body image according to human body characteristic points:
generating a part line of the left arm part of the human body according to at least two characteristic points of the left arm of the human body;
and/or generating a part line of the part of the right arm of the human body according to at least two characteristic points of the right arm of the human body;
and/or generating a part line of the left leg part of the human body according to at least two characteristic points of the left leg of the human body;
and/or generating a part line of the right leg part of the human body according to at least two characteristic points of the right leg of the human body;
and/or generating part lines of the human body trunk part according to at least two characteristic points of the human body trunk, or generating part lines of the human body trunk part according to a vertical central line of the human body;
B, marking a part label according to the intersection condition of the marked line segment and the line of the human body part:
when the marking line segment is intersected with the line of the part of the left arm of the human body, marking a left arm label on the marking line segment;
when the marking line segment is intersected with the line of the part of the right arm of the human body, marking a right arm label on the marking line segment;
when the marking line segment is intersected with the line of the part of the left leg of the human body, marking a left leg label on the marking line segment;
when the marking line segment is intersected with the line of the part of the right leg of the human body, marking a right leg label on the marking line segment;
when the marking line segment is intersected with the position line of the human body position, the marking line segment is marked with a body label.
The human body image clearing method in the real-person game comprises the following steps of:
marking a position label according to the length and/or position of the marking line segment; the part label is a left arm label, a right arm label, a left leg label, a right leg label or a trunk label.
The invention discloses a human body image clearing system in a real-person game in a second aspect, which comprises an acquisition module, a scanning module, an identification module and a clearing module;
the acquisition module is used for acquiring a human body image and an interception line;
The scanning module is used for scanning the human body image, and a plurality of parallel scanning lines pass through the human body image part on the clearing side of the intercepting line during scanning;
the identification module is used for identifying a plurality of marking line segments overlapped by each scanning line and the human body image, and marking the marking line segments with part labels at least corresponding to a human body part area;
and the clearing module is used for identifying the human body part area needing to be cleared for clearing according to the part label of the marked line segment.
The human body image clearing system in the real person game identifies the human body part area needing to be cleared and clears the human body part area, and comprises the following steps of:
and obtaining a corresponding part label C according to the human body part area needing to be cleared, setting the part label C as a clearing part label, setting other part labels of the non-part label C as remaining part labels, and clearing the human body image area where the marking line segment marked with the clearing part label is located.
The human body image clearing system in the real-person game clears the human body image area where the mark line segment marked with the clearing part label is located, and comprises the following steps of:
and clearing the human body image area where the marking line segment only marked with the clearing part label is positioned, and reserving the human body image area where the marking line segment simultaneously marked with the clearing part label and the reserved part label is positioned.
Compared with the prior art, the invention has the following advantages: the invention can judge the human body part of the human body image on the clearing side of the intercepting line under the condition of various complex actions of the human body, and reasonably clear the human body image on the basis of the judgment to meet the plot requirements of real-person games and the like, and has simple operation.
The technical solution of the present invention is further described in detail by the accompanying drawings and embodiments.
Drawings
FIG. 1 is a flowchart of a method of example 1 of the present invention.
FIG. 2 is a schematic diagram of labeled line segments corresponding to regions of various parts of a human body.
Fig. 3 is a schematic diagram of a marked line segment when the left leg part and the left arm part intersect.
FIG. 4 is a schematic diagram of a part line, a scan line, a mark line segment and a part label.
FIG. 5 is a schematic view of the upper limbs and other parts of the horse riding game without intersecting below the line of intercept.
FIG. 6 is a first schematic diagram of the intersection of the upper limbs and other parts under the intercepting line in the horse riding game.
FIG. 7 is a second schematic diagram of the intersection of the upper limbs and other parts of the horse riding game below the line of capture.
Fig. 8 is a system block diagram of embodiment 2 of the present invention.
Detailed Description
Example 1
As shown in fig. 1, a method for removing human body images in a real-person game includes the following steps:
Step 1, acquiring a human body image and an interception line;
as shown in fig. 5, in real operation, a camera above the television can be used to capture a human body image, and the human body image and the game picture are synthesized, so that a user can observe the synthesized effect of the human body image and the game picture on the television screen;
the capture line is obtained based on the human body bearing prop in the game picture, for example, a user fights by riding a horse in the game picture, only the part above the waist of the human body is displayed in the game picture, the area corresponding to the waist is shielded by a saddle, the area below the saddle where the lower limbs of the human body should be displayed is replaced by prop legs or shielded by a robe, and the like, at this time, the capture line can be obtained based on the saddle, and the human body image area below the capture line is removed (such as deleted, shielded and the like) so as not to be displayed in the game picture, and in the embodiment, the top line of the saddle is used as the capture line.
Step 2, scanning the human body image, wherein a plurality of parallel scanning lines pass through the human body image part on the clearing side of the intercepting line during scanning;
step 3, identifying a plurality of marking line segments overlapped by each scanning line and the human body image, and marking the marking line segments with part labels at least corresponding to a human body part area;
And 4, identifying the human body part area needing to be removed according to the part label of the marked line segment for removing.
Because of the complexity of human body actions and human body structures (for example, the human body parts may intersect with each other, the edge outlines of the human body parts are irregular curves), and the interference of the clothing diversity on the human body outlines, it is extremely difficult to accurately identify the human body parts and whether the parts intersect with each other based on the plane image by means of the prior art;
as shown in fig. 2, according to the human body structure characteristics, the overlapping portion of a scanning line and a single human body part (such as the trunk, the upper limbs, the lower limbs, etc.) must be a marking line segment, the overlapping portion of a scanning line and a plurality of non-intersecting human body parts is usually a plurality of non-continuous marking line segments, and the specific part region of the human body and whether the specific part region intersects with the specific part region can be simply and accurately obtained by the marking line segment corresponding to the specific part label; the marking line segment refers to a continuous area overlapped with the human body image on the scanning line;
for example, when the scanning line crosses the upper half of the human body and the left arm of the human body is splayed, a marking line segment overlapping with the trunk part of the human body and a marking line segment overlapping with the left arm of the human body are provided, corresponding part labels can be marked on the marking line segment according to requirements, when the scanning line crosses the upper half of the human body but the left arm of the human body and the trunk are crossed and the crossed part is just positioned on the scanning line, only one marking line segment exists at the moment, the marking line segment can only mark the trunk label or the left arm label or mark both the trunk label and the left arm label, and when the same marking line segment comprises more than 2 part labels, the human body part is crossed;
During actual operation, the part of the human body image, which is positioned at the clearing side of the intercepting line, is scanned through the plurality of parallel scanning lines, a plurality of marking line segments overlapped with the human body image of each scanning line are identified, part labels corresponding to the marking line segments are marked, corresponding human body part areas, such as a trunk, upper limbs and lower limbs, can be accurately and conveniently identified, and corresponding operation is carried out according to the plot requirement whether the corresponding human body part areas need to be cleared at the clearing side of the intercepting line in a game, such as the upper limbs in the embodiment, which need to be reserved at the clearing side of the intercepting line. It should be noted that the clearing includes various ways such as deleting, blocking, etc., and aims to prevent the corresponding human body from being displayed in the game picture.
The parallel scanning lines can be selected in various ways, such as horizontal lines, which is beneficial to convenient operation based on GPU and the like, and because a user is upright in most cases, the human body part areas needing to be removed, such as the trunk and the lower limbs, are more convenient to obtain based on the horizontal lines, such as the scanning lines parallel to the intercepting lines, which is beneficial to that the human body part marking line segment on each scanning line is positioned at the removing side of the intercepting line, so that the relative position relation between different parts of the human body part marking line segment and the intercepting line is not required to be calculated during removing, and accurate human body image removing areas, such as lines vertical to the joint connecting lines of the human body part areas (such as elbow joint points and wrist joint point connecting lines) are obtained, which is beneficial to that the human body part areas which move flexibly, such as the upper limbs, can be selected according to actual needs, and the purpose of the scanning lines is according to the characteristics of the human body structure, and obtaining corresponding human body part areas by obtaining mutually separated mark line segments on the scanning lines and marking corresponding part labels.
It should be noted that, the plurality of marking line segments overlapped with the human body image of each scanning line may only mark part labels for the marking line segments corresponding to a certain human body part region, for example, obtain the marking line segments to be retained, such as upper limb marking line segments, and retain the upper limb marking line segments when clearing, or may mark part labels for the marking line segments corresponding to a plurality of human body part regions, for example, obtain both the marking line segments to be retained and the marking line segments to be cleared, and may be specifically selected according to actual needs.
It should be noted that, identifying a plurality of mark line segments overlapping with the human body image on the part mark line is a common technique in the art, such as identification based on transparency characteristics of pixels on the part mark line, or identification based on intersection points of the part mark line and the human body contour line, and the like.
Referring to fig. 5, further, according to a part tag corresponding to a human body part area to be removed, a plurality of marked line segments marked with the part tag are obtained, and if there is no space between two adjacent marked line segments, a human body image area covered by the plurality of marked line segments is a human body part area to be removed; if a distance exists between two adjacent marking line segments, the human body image area covered by the plurality of marking line segments and the human body image area between two adjacent marking line segments are human body part areas which need to be removed. It should be noted that, if the human body image area covered by the mark line segment or the human body image area between two adjacent mark line segments is located on both sides of the intercept line, the clear operation may be performed only on the human body image portion on the clear side of the intercept line.
Furthermore, a corresponding part label C is obtained according to the human body part area needing to be cleared, the part label C is set as a clearing part label, other part labels of the non-part label C are set as reserved part labels, and the human body image area where the marking line segment marked with the clearing part label is located is cleared, so that the specific human body part of the part, located on the clearing side of the intercepting line, of the human body image can be cleared to meet the plot requirements of a game.
As shown in fig. 6, in a preferred embodiment of the present invention, when a human body image area where a mark line segment marked with a clear part label is located is cleared: and clearing the human body image area where the marking line segment only marked with the clearing part label is located, and reserving the human body image area where the marking line segment simultaneously marked with the clearing part label and the reserved part label is located.
Because of the complexity of human body motion, the human body part area needing to be removed and the human body part area not needing to be removed may intersect at the removal side of the intercepting line, at this time, part of the marking line segment marked with the removal part label is also marked with the remaining part label, as shown in fig. 3 (the marking line segment is provided with two labels of a left leg part label and a left arm part label), if all the marking line segments marked with the removal part label (such as the lower limb part) are completely removed, the part of the human body part area (such as a part of the hand of the upper limb) which does not need to be removed and intersects with the lower limb (such as the thigh) is also removed together, and an undesirable visual effect occurs, so the marking line segment marked with the removal part label and the remaining part label is not removed, and because the intersection part area of different part areas of the human body is small, for example, the intersection of the hand and the thigh, the upper limb and the hand which are complete in the human body can appear in the game picture, the thigh only has a small area which is intersected with the hand, such as a piece of cloth on trousers, and as most of the area of the human body part which needs to be cleaned is cleaned, the user cannot easily realize that the area is a part of the human body, the visual effect is acceptable, furthermore, a prompt can be given under the condition, and the user can return to the regular posture under the condition of not interrupting the game.
As shown in fig. 7, in another preferred embodiment of this embodiment, when one or more mark line segments mark both a clear part label and a reserved part label, the human body image area where the mark line segment marked with the clear part label and the mark line segment marked with the reserved part label are located is cleared, that is, the human body part corresponding to the clear part label and the human body part corresponding to the reserved part label are both cleared on the clearing side of the capturing line.
Because of the complexity of the human body action, the human body part area needing to be removed and the human body part area not needing to be removed may intersect at the removal side of the intercepting line, at this time, part of the marking line segment marked with the remaining part label will also be marked with the removing part label (as shown in fig. 3, the marking line segment has two labels of a left leg part label and a left arm part label), if all the marking line segments marked with the remaining part label (such as an upper limb part) are not removed, the human body part area (such as a part of a thigh) needing to be removed intersecting with the upper limb (such as a hand) will not be removed, and the visual effect such as a small piece of cloth on trousers behind the user's hand will appear in the game picture, so at this time, the human body part corresponding to the removing part label and the human body part corresponding to the remaining part label can also be removed at the removing side of the intercepting line, the user is forced to return to the regular posture as soon as possible by the vivid visual effect and the combination of the prompts.
It should be noted that, in the area blocked by the human body blocking tool, such as the part of the human body blocked by the saddle below the top line of the saddle in this example, no matter whether the parts of the human body cross, the visual effect is not affected by the elimination of the human body part, only when the human body part area (such as upper limb) needs to be eliminated and the human body part area (such as trunk or lower limb) does not need to be eliminated, when the human body parts are intersected below the line of the top end of the saddle and outside the area shielded by the saddle, the problem of clearing accuracy of the human body part area of the intersected part needs to be considered, because the moving range of the human body trunk and the lower limbs is far smaller than that of the upper limbs, the trunk and the lower limbs intersect outside the area shielded by the saddle, indicating that the body's activity is already in an irregular and uncomfortable posture, which is not always durable, the 2 embodiments described above provide further preferred treatments.
It should be understood by those skilled in the art that the above-mentioned erasing is to identify the erased image region of the human body by the erasing portion tag, and the same erasing may also identify the image region of the human body to be erased by the remaining portion tag, and then further obtain the image region of the human body to be erased, and the scheme of identifying the remaining portion tag to finally obtain the image region of the human body to be erased is equivalent to the technical scheme of identifying the erased image region of the human body by the erasing portion tag, and therefore is within the protection scope of the present invention.
The human body part area generally comprises one or more of a human body trunk part, a human body left arm part, a human body right arm part, a human body left leg part and a human body right leg part, and the specific use of the human body part areas can be determined according to the situation; in this embodiment, the human body trunk part, the human body left leg part, and the human body right leg part are used as the human body part regions to be removed, and the human body left arm part and the human body right arm part are used as the human body part regions to be reserved.
It should be noted that there are many methods for labeling the marking position of the marking line segment, and a simple, effective and high-precision marking method is provided herein, and as shown in fig. 4, the method specifically includes the following steps:
step a, generating human body part lines of a human body image according to human body characteristic points:
generating a part line of the left arm part of the human body according to at least two feature points of the axillary or shoulder feature points, the elbow feature points, the wrist feature points and the hand feature points of the left half body of the human body; for example, the axillary or shoulder feature points, the elbow feature points, the wrist feature points and the hand feature points of the left half of the human body are sequentially connected to generate a left arm line of the human body;
and/or generating a part line of the right arm part of the human body according to at least two feature points of the axillary or shoulder feature points, the elbow feature points, the wrist feature points and the hand feature points of the right half body of the human body; for example, the axillary or shoulder characteristic points, the elbow characteristic points, the wrist characteristic points and the hand characteristic points of the right half body of the human body are sequentially connected to generate a right arm line of the human body;
And/or generating a part line of the left leg part of the human body according to at least two characteristic points of the crotch characteristic point, the knee characteristic point, the ankle characteristic point and the foot characteristic point of the left half part of the human body; for example, a crotch characteristic point, a knee characteristic point, an ankle characteristic point and a foot characteristic point of the left half of the human body are sequentially connected to generate a left leg line of the human body;
and/or generating a part line of the right leg part of the human body according to at least two characteristic points of the crotch characteristic point, the knee characteristic point, the ankle characteristic point and the foot characteristic point of the right half part of the human body; for example, a crotch characteristic point, a knee characteristic point, an ankle characteristic point and a foot characteristic point of the right half of the human body are connected in sequence to generate a human right leg line;
and/or generating a part line of the human body trunk part according to the characteristic points of the throat nodes and the characteristic points of the crotch parts of the human body, for example, connecting the two characteristic points of the crotch parts of the human body to obtain a middle point, and then connecting the characteristic points of the throat nodes and the middle point to form a human body trunk line, or taking a vertical human body central line which is higher than the characteristic points of the crotch parts of the human body and lower than the characteristic points of the head parts of the human body as the human body trunk line;
b, marking a part label according to the intersection condition of the marking line segment and the human body part line:
When the marked line segment is intersected with the line of the left arm of the human body, marking a left arm label on the marked line segment;
when the marked line segment is intersected with the line of the right arm of the human body, marking a right arm label on the marked line segment;
when the marked line segment is intersected with the line of the left leg of the human body, marking a left leg label on the marked line segment;
when the marking line segment is intersected with the line of the right leg of the human body, marking a right leg label on the marking line segment;
and when the marking line segment is intersected with the human body line segment, marking a body label on the marking line segment.
It should be noted that, in the step a, the human body left arm line, the human body right arm line, the human body left leg line, the human body right leg line and the human body trunk line may all be generated, or only one or a plurality of lines may be generated according to the circumstances; furthermore, according to the human body structure characteristics, the part line completely passes through the corresponding human body part region, if the marked line segment intersects with the part line, the marked line segment and the human body part region can be determined to intersect, it should be noted that, the human body image is scanned by a plurality of parallel scanning lines passing through the human body image part on the clearing side of the intercepting line, the scanning line and the marked line segment thereon can be on one side of the intercepting line, or on both sides of the intercepting line, for example, when the scanning line and the intercepting line are parallel, the scanning line and the marked line segment thereon are both on the clearing side of the intercepting line, and when the scanning line and the intercepting line are not parallel, the scanning line and the marked line segment thereon can be on both sides of the intercepting line, for example, the part line or the corresponding human body part region may be on both sides of the intercepting line in practice, so that the obtained marked line segment may be on both sides of the intercepting line, in this case, during the clearing, the accurate clearing can be performed according to the relative positions of the different parts of the same mark line segment or the corresponding human body part region and the intercepting line, such as the clearing operation is performed only on the human body image part on the clearing side of the intercepting line;
It should be noted that the human body feature points are human body part corresponding feature points that can be obtained by image recognition, and include human body part corresponding feature points that can be obtained by image recognition or feature points obtained by conversion based on the relative position relationship between the human body part corresponding feature points and "other human body part corresponding feature points"/"points or lines on the human body image"/"points or lines on the game screen", and the like;
the method for obtaining the characteristic points corresponding to the human body part through image recognition is a common technology in the field, for example, the characteristic points corresponding to the human body part can be obtained through human body recognition software realized through a deep learning mode and the like, the characteristic points corresponding to the human body part can also be obtained through image analysis through human body recognition software realized through a deep learning mode and the like, and the characteristic points corresponding to the human body part can also be obtained through setting marking lines or markers, for example, setting marking lines on a display screen, prompting a user to enable the characteristic points corresponding to the human body part, such as a head vertex/a vertical central line of the human body, to be superposed with the corresponding marking lines based on self-perception so as to obtain the characteristic points corresponding to the human body part, or marking specific markers on a shot specific human body part and obtaining the characteristic points corresponding to the human body part through image analysis.
It should be noted that there are many methods for labeling the labeled positions of the labeled line segments, and another labeling method with a small operand is provided here, which specifically includes the following steps: marking a position label according to the length and/or the position of the marking line segment; the part label is a left arm label, a right arm label, a left leg label, a right leg label or a trunk label.
When the human body is opposite to the camera device, the widths and positions of the trunk, the arms and the legs on the shot human body plane image are different, corresponding part labels can be marked according to the lengths and/or positions of the marked line segments, for example, the widths of the trunk, the arms and the legs on the shot human body plane image are different due to the obvious difference of the thicknesses of the trunk, the arms and the legs, the part labels are marked through the length comparison among the marked line segments, for example, the longest marked line segment is marked as the trunk label, the calculation amount is small, the calculation speed is high, in addition, the human body postures are various, for example, when the arms extend obliquely, the length of the marked line segment and the thickness of the corresponding part can be caused to have errors, particularly, the arm and the leg parts with the relatively small thickness difference, the corresponding part labels can be further marked according to the position relation of the marked line segments, such as torso in the middle, arms above, legs below, etc. Further, a hand region of the upper limb of the human body can be obtained from the skin color.
Example 2
As shown in fig. 8, a system for removing a human body image in a real-person game includes an obtaining module, a scanning module, an identifying module, and a removing module;
the acquisition module is used for acquiring a human body image and an interception line;
the scanning module is used for scanning the human body image, and a plurality of parallel scanning lines pass through the human body image part on the clearing side of the intercepting line during scanning;
the identification module is used for identifying a plurality of marking line segments overlapped by each scanning line and the human body image and marking the marking line segments with part labels at least corresponding to a human body part area;
and the clearing module is used for identifying the human body part area needing to be cleared for clearing according to the part label of the marking line segment.
Further, according to the part label of the marking line segment, when the human body part area needing to be removed is identified for removal: and obtaining a corresponding part label C according to the human body part area needing to be cleared, setting the part label C as a clearing part label, setting other part labels of the non-part label C as remaining part labels, and clearing the human body image area where the marking line segment marked with the clearing part label is located.
In a preferred implementation manner of this embodiment, when the human body image area where the mark line segment marked with the clear part label is located is cleared: and clearing the human body image area where the marking line segment only marked with the clearing part label is positioned, and reserving the human body image area where the marking line segment simultaneously marked with the clearing part label and the reserved part label is positioned.
In another preferred embodiment of this embodiment, when one or more of the mark line segments is marked with both a clear part label and a reserved part label, the human body image area where the mark line segment marked with the clear part label and the mark line segment marked with the reserved part label are located is cleared, that is, the human body part corresponding to the clear part label and the human body part corresponding to the reserved part label are both cleared on the clearing side of the intercepting line.
In this embodiment, when the human body image area where the mark line segments are located is removed, if there is no space between two adjacent mark line segments, the human body image area covered by the plurality of mark line segments is the human body part area to be removed; if a space exists between two adjacent marking line segments, the human body image area covered by the plurality of marking line segments and the human body image area between two adjacent marking line segments are the human body part area needing to be cleaned.
In this embodiment, the scanning the human body image refers to performing horizontal line-by-line scanning on the human body image.
In this embodiment, the human body part region includes one or more of a human body trunk part, a human body left arm part, a human body right arm part, a human body left leg part, and a human body right leg part.
In this embodiment, the labeling the mark positions of the mark line segments includes the following steps:
step a, generating human body part lines of a human body image according to human body characteristic points:
generating a part line of the left arm part of the human body according to at least two characteristic points of the left arm of the human body;
and/or generating a part line of the part of the right arm of the human body according to at least two characteristic points of the right arm of the human body;
and/or generating a part line of the left leg part of the human body according to at least two characteristic points of the left leg of the human body;
and/or generating a part line of the right leg part of the human body according to at least two characteristic points of the right leg of the human body;
and/or generating part lines of the human body trunk part according to at least two characteristic points of the human body trunk, or generating part lines of the human body trunk part according to a vertical central line of the human body;
b, marking a part label according to the intersection condition of the marking line segment and the human body part line:
When the marking line segment is intersected with the line of the part of the left arm part of the human body, marking a left arm label on the marking line segment;
when the marking line segment is intersected with the line of the part of the right arm of the human body, marking a right arm label on the marking line segment;
when the marking line segment is intersected with the line of the part of the left leg of the human body, marking a left leg label on the marking line segment;
when the marking line segment is intersected with the line of the part of the right leg of the human body, marking a right leg label on the marking line segment;
when the marking line segment is intersected with the position line of the human body position, the marking line segment is marked with a body label.
In another implementation manner of this embodiment, the labeling the mark portion of the mark line segment includes the following steps: marking a position label according to the length and/or the position of the marking line segment; the part label is a left arm label, a right arm label, a left leg label, a right leg label or a trunk label.
It should be noted that the technical principle of embodiment 2 is the same as that of embodiment 1, and if there is a place where the implementation of embodiment 2 is unclear, please refer to embodiment 1.
The above description is only a preferred embodiment of the present invention, and is not intended to limit the present invention, and all simple modifications, changes and equivalent structural changes made to the above embodiment according to the technical spirit of the present invention still fall within the protection scope of the technical solution of the present invention. The scope of the invention is to be determined by the claims and their equivalents.

Claims (11)

1. A human body image clearing method in a real-person game is characterized in that: the method comprises the following steps:
acquiring a human body image and an intercepting line;
scanning the human body image, wherein a plurality of parallel scanning lines pass through the human body image part on the clearing side of the intercepting line during scanning;
identifying a plurality of marking line segments of each scanning line overlapped with the human body image, and marking the marking line segments with part labels at least corresponding to a human body part area;
and identifying the human body part area needing to be removed for removal according to the part label of the marking line segment.
2. The method for removing a human body image in a real-person game as claimed in claim 1, wherein said identifying a region of a human body part to be removed for removal comprises the steps of:
and obtaining a corresponding part label C according to the human body part area needing to be cleared, setting the part label C as a clearing part label, setting other part labels of the non-part label C as remaining part labels, and clearing the human body image area where the marking line segment marked with the clearing part label is located.
3. The method for removing a human body image in a real-person game as claimed in claim 2, wherein said removing a human body image area in which a mark segment marked with a removed part label is located comprises the steps of:
And clearing the human body image area where the marking line segment only marked with the clearing part label is located, and reserving the human body image area where the marking line segment simultaneously marked with the clearing part label and the reserved part label is located.
4. A method for removing human body image in real person game according to claim 2 or 3, characterized in that when removing the human body image area where the mark line segment is located, if there is no space between two adjacent mark line segments, the human body image area covered by the plurality of mark line segments is the human body part area to be removed; if a distance exists between two adjacent marking line segments, the human body image area covered by the plurality of marking line segments and the human body image area between two adjacent marking line segments are the human body part area needing to be removed.
5. The method for removing a human body image in a real human game as claimed in claim 1, wherein said scanning the human body image is a horizontal scanning of the human body image line by line.
6. A method for removing a human body image in a real-person game according to claim 1, wherein: the human body part area comprises one or more of a human body trunk part, a human body left arm part, a human body right arm part, a human body left leg part and a human body right leg part.
7. A method for removing a human body image in a real person game according to claim 1, wherein: the marking of the mark line segment mark position label comprises the following steps:
step a, generating human body part lines of a human body image according to human body characteristic points:
generating a part line of the left arm part of the human body according to at least two characteristic points of the left arm of the human body;
and/or generating a part line of the part of the right arm of the human body according to at least two characteristic points of the right arm of the human body;
and/or generating a part line of the left leg part of the human body according to at least two characteristic points of the left leg of the human body;
and/or generating a part line of the right leg part of the human body according to at least two characteristic points of the right leg of the human body;
and/or generating part lines of the human body trunk part according to at least two characteristic points of the human body trunk, or generating part lines of the human body trunk part according to a vertical central line of the human body;
b, marking a part label according to the intersection condition of the marking line segment and the human body part line:
when the marking line segment is intersected with the line of the part of the left arm of the human body, marking a left arm label on the marking line segment;
when the marking line segment is intersected with the line of the part of the right arm of the human body, marking a right arm label on the marking line segment;
When the marking line segment is intersected with the line of the left leg part of the human body, marking a left leg label on the marking line segment;
when the marking line segment is intersected with the line of the part of the right leg of the human body, marking a right leg label on the marking line segment;
and when the marking line segment is intersected with the part line of the human body part, marking a trunk label on the marking line segment.
8. A method for removing a human body image in a real person game according to claim 1, wherein: the marking of the mark line segment mark position label comprises the following steps:
marking a position label according to the length and/or the position of the marking line segment; the part label is a left arm label, a right arm label, a left leg label, a right leg label or a trunk label.
9. A human body image clearing system in a real person game is characterized in that: the device comprises an acquisition module, a scanning module, an identification module and a clearing module;
the acquisition module is used for acquiring a human body image and an interception line;
the scanning module is used for scanning the human body image, and a plurality of parallel scanning lines pass through the human body image part on the clearing side of the intercepting line during scanning;
the identification module is used for identifying a plurality of marking line segments overlapped by each scanning line and the human body image and marking the marking line segments with part labels at least corresponding to a human body part area;
And the clearing module is used for identifying the human body part area needing to be cleared for clearing according to the part label of the marked line segment.
10. A system for removing body images in a real person game as claimed in claim 9, wherein said identifying the body part area to be removed for removal comprises the steps of:
and obtaining a corresponding part label C according to the human body part area needing to be cleared, setting the part label C as a clearing part label, setting other part labels of the non-part label C as remaining part labels, and clearing the human body image area where the marking line segment marked with the clearing part label is located.
11. The human body image removing system in a real-person game as claimed in claim 10, wherein said removing the human body image area where the mark segment marked with the removing part label is located comprises the steps of:
and clearing the human body image area where the marking line segment only marked with the clearing part label is positioned, and reserving the human body image area where the marking line segment simultaneously marked with the clearing part label and the reserved part label is positioned.
CN202210519018.7A 2022-05-13 2022-05-13 Human body image clearing method and system in real-person game Active CN114602173B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210519018.7A CN114602173B (en) 2022-05-13 2022-05-13 Human body image clearing method and system in real-person game

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210519018.7A CN114602173B (en) 2022-05-13 2022-05-13 Human body image clearing method and system in real-person game

Publications (2)

Publication Number Publication Date
CN114602173A true CN114602173A (en) 2022-06-10
CN114602173B CN114602173B (en) 2022-08-05

Family

ID=81870541

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210519018.7A Active CN114602173B (en) 2022-05-13 2022-05-13 Human body image clearing method and system in real-person game

Country Status (1)

Country Link
CN (1) CN114602173B (en)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102179048A (en) * 2011-02-28 2011-09-14 武汉市高德电气有限公司 Method for implementing realistic game based on movement decomposition and behavior analysis
US20110234581A1 (en) * 2010-03-28 2011-09-29 AR (ES) Technologies Ltd. Methods and systems for three-dimensional rendering of a virtual augmented replica of a product image merged with a model image of a human-body feature
CN104167016A (en) * 2014-06-16 2014-11-26 西安工业大学 Three-dimensional motion reconstruction method based on RGB color and depth image
CN108198159A (en) * 2017-12-28 2018-06-22 努比亚技术有限公司 A kind of image processing method, mobile terminal and computer readable storage medium
CN109727254A (en) * 2018-11-27 2019-05-07 深圳市华讯方舟太赫兹科技有限公司 Body scans image processing method, equipment and computer readable storage medium
CN112668676A (en) * 2020-12-12 2021-04-16 浙江大华技术股份有限公司 Package security inspection image processing method, electronic device and storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110234581A1 (en) * 2010-03-28 2011-09-29 AR (ES) Technologies Ltd. Methods and systems for three-dimensional rendering of a virtual augmented replica of a product image merged with a model image of a human-body feature
CN102179048A (en) * 2011-02-28 2011-09-14 武汉市高德电气有限公司 Method for implementing realistic game based on movement decomposition and behavior analysis
CN104167016A (en) * 2014-06-16 2014-11-26 西安工业大学 Three-dimensional motion reconstruction method based on RGB color and depth image
CN108198159A (en) * 2017-12-28 2018-06-22 努比亚技术有限公司 A kind of image processing method, mobile terminal and computer readable storage medium
CN109727254A (en) * 2018-11-27 2019-05-07 深圳市华讯方舟太赫兹科技有限公司 Body scans image processing method, equipment and computer readable storage medium
CN112668676A (en) * 2020-12-12 2021-04-16 浙江大华技术股份有限公司 Package security inspection image processing method, electronic device and storage medium

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
DAE-EUN HYUN,AND ETC: "Modeling and deformation of arms and legs based on ellipsoidal sweeping", 《11TH PACIFIC CONFERENCE ONCOMPUTER GRAPHICS AND APPLICATIONS, 2003. PROCEEDINGS》 *
王发明等: "三位人体姿态估计研究综述", 《计算机工程与应用》 *

Also Published As

Publication number Publication date
CN114602173B (en) 2022-08-05

Similar Documents

Publication Publication Date Title
US9898651B2 (en) Upper-body skeleton extraction from depth maps
US7162082B2 (en) Method and apparatus for performing a clean background subtraction
US7704157B2 (en) Golf swing-measuring system
CN101246602A (en) Human body posture reconstruction method based on geometry backbone
JP2014530047A (en) Apparatus and method for analyzing golf swing
CN110210284A (en) A kind of human body attitude behavior intelligent Evaluation method
JPWO2016151691A1 (en) Image processing apparatus, image processing system, image processing method, and program
AU2008263720A1 (en) Method and system to assist in the training of high-level sportsmen, in particular professional tennis players
KR20090105031A (en) Golf clinic system using image processing method and application method thereof
Jiang et al. Automatic body feature extraction from front and side images
KR20090084035A (en) A real time motion recognizing method
KR102136620B1 (en) Methode and apparatus of displaying clothes patterns
CN114307117B (en) Standing long jump result measuring method and device based on video
US11885611B2 (en) Detection device, processing device, equipment, detection method, and detection program
Klein et al. A markeless augmented reality tracking for enhancing the user interaction during virtual rehabilitation
CN109843101A (en) Clothes, system and method for training
CN114602173B (en) Human body image clearing method and system in real-person game
CN106644090A (en) Method and system of application deportment testing based on kinect
WO2018207388A1 (en) Program, device and method relating to motion capture
Nakamura et al. Tankendo motion estimation system with robustness against differences in color and size between users' clothes using 4-color markers with elastic belts
CN111968723A (en) Kinect-based upper limb active rehabilitation training method
CN111368853A (en) Label construction method, system, device and storage medium
JP2018113054A (en) Image processing device, image processing method, and program
JP2019197278A (en) Image processing apparatus, method of controlling image processing apparatus, and program
CN116309712B (en) Functional motion analysis system and method based on depth camera

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant