KR101005599B1 - System and method for interactive image process, and interactive image-processing apparatus - Google Patents

Abstract

PURPOSE: A system and a method for an interactive image process, and an interactive image-processing apparatus are provided to acquire an interactive image through the synthesis of an actual object image with an interactive object image. CONSTITUTION: An actual object detection unit(110) detects outer coordinate values or outlines of an actual object image from an image sequence of an image signal. An interactive image generator(130) generates an image of an interactive object. If there is the motion of the actual object image, the interactive image generating unit generates an interactive image. An image synthesis unit(150) synthesizes the image signal with the interactive image. A display unit(300) displays the synthesized image.

Description

INTERACTIVE IMAGE PROCESSING SYSTEM AND METHOD, AND INTERACTIVE IMAGE PROCESSING DEVICE {SYSTEM AND METHOD FOR INTERACTIVE IMAGE PROCESS, AND INTERACTIVE IMAGE-PROCESSING APPARATUS}

The present invention relates to an interactive image processing system and method, and an interactive image processing apparatus.

Recently, with the development of image technology and computer graphic technology, various images showing nonlinear and unexpected reactions attract people and the demand for such images is increasing.

Interactive image processing can be used for various exhibitions, presentations, advertisements, entertainment, education, etc., and relates to non-linear image processing in response to the movement of an object. It is a kind of system or method for reproducing an image which is obtained through the digital signal processing and the computer processing according to the operation of the object through digital signal processing and computer processing.

Interactive image processing communicates with the user and shows image results that change depending on the situation, which is a means of providing fun with curiosity and mystery.

Korean Patent Laid-Open Publication No. 2005-52676 discloses an apparatus for implementing a real-time fluid effect video in response to a user's motion, and Korean Patent Laid-Open Publication No. 2004-88166 discloses an interactive video system using shadows. have.

The aforementioned conventional patent documents do not use a touch screen type sensor or recognize a shadow of an object and interactively react an image, but do not directly show an image of an actual object by merging it with an interactive object image.

An object of the present invention is to provide an interactive image in which an image of an actual object and an interactive object image corresponding to the object are merged and displayed.

In particular, according to an exemplary embodiment, an interactive image in which an interactive object remains coalesced, seated, or penetrated onto an actual object image and an additional interactive object reacts is provided, thereby implementing a more vibrant interactive image.

In order to achieve the above object, according to one aspect of the present invention, an image recognition device for recognizing an image including a real object in the recognition area; A video signal received from a video recognition apparatus, processed, and a video including at least one interactive object responding to a video of a real object in the processed video signal and the processed video signal are merged to generate an interactive video signal. A processing apparatus, which detects an outer line or an outer coordinate value or an outer line and a coordinate value of an actual object image by distinguishing it from the background based on the movement of the actual object in the image sequence of the received video signal based on the movement of the actual object. A real object detector for detecting and detecting the motion of the real object image having a predetermined value, and generating an interactive object image according to a pre-programmed algorithm, and when the motion of the real object image is determined, Interactive customer with outline line or outline coordinates An image processing apparatus comprising: an interactive image generating unit for generating an interactive image in which a body reacts interactively; and an image merge processing unit for merging the image signal processed by the actual object detector and the interactive image generated in the interactive image generating unit. Wow; A display device for receiving a merged image from an image processing device and displaying the merged image on a screen; We propose an interactive image processing system comprising a.

Preferably, the image recognition apparatus converts the recognized image signal into a digital image signal, and transmits it. The interactive image generating unit reacts by integrating, seating, or infiltrating the outer line or the outer coordinate value of the actual object image among the interactive images. The object image and its center or outer coordinate value are extracted. Furthermore, the above-described image processing apparatus receives a digital image signal from the image recognition apparatus and transmits the digital image signal to the real object detection unit as an image sequence, but feeds back the interactive object image extracted from the interactive image generating unit and its center or outer coordinate value to feed back the actual object. The image library may further include an image library for merging and transmitting the real object image of the image sequence transmitted to the detection unit. The real object detector processes the interactive object image merged into the real object image of the image sequence received from the image library as part of the real object image.

Preferably, in another embodiment of the present invention, the interactive image generating unit is an interactive object and the center or the outer coordinates of the interactive image reacted by coalescing, seating or penetrating the outer line or the outer coordinate value of the actual object image in the interactive image. A value or an outer coordinate value of a real object image of a point or a portion that is coalesced, settled or infiltrated or extracted is extracted, and the extracted coordinate value is fed back to the real object detector. In addition, the real object detection unit calculates a difference between the outer coordinates of the fed back real object image and the outside of the actual object image of the corresponding portion in the newly received image from the image recognition apparatus, or the outer coordinates of the fed back interactive object image. The difference between the coordinates of the real object image corresponding to and the outer edge of the real object image of the corresponding portion of the image newly received from the image recognition apparatus is calculated. Furthermore, the interactive image generating unit may secondaryly shape the interactive object that has been merged, seated or penetrated before feedback, according to a difference from the outside of the actual object image of the corresponding part in the newly received image calculated by the real object detector. In addition, the interactive image may further include an image that is reacted to generate a change in color or shade.

Further, in another embodiment of the present invention, preferably, the real object detection unit detects the boundary coordinate value or boundary line of the portion moving in the outer region of the real object image, and the boundary of the real object image having the outline The movement of the portion having the boundary within the movement and the outer area is determined. In addition, when the movement of the portion of the real object image is determined in the outer region or the outer region of the real object image, the interactive image generating portion of the portion of the real object image detected by the real object detector is moved with respect to the moving outer region and the stationary outer portion. Generate interactive images that react interactively to boundaries.

Preferably, in an embodiment according to another aspect, the above-described real object is at least an initial moving actor entering the recognition area, and includes a user, a thing, or a combination thereof. In addition, the interactive response of the above-described interactive object may be avoided, reflected, refracted, coalesced, settled or penetrated to the outside or moving outside of the real object image according to a preprogrammed algorithm, or the outside or moving outside of the real object image. , Segmentation or dispersion by collision or contact with an object, acceleration or deceleration to the outer or moving edge of the real object image, or deceleration or settling to a stationary outer edge of the real object image, or avoiding or deviating from the moving edge, or the actual object The behavior of an interactive object due to a collision or contact with a moving outside of the image, or the size, shape, or change in size and shape of an interactive object due to the approach or distance of an actual object image, or at least two or more of them.

Preferably, in another embodiment according to one aspect, the above-described image processing apparatus further comprises a background image storage unit for storing the background images of the background of the interactive image, the above-described real object detection unit The object image is extracted from the background and extracted, and the image merging processor is configured to extract the selected background image from the background images stored in the background image storage unit and the interactive image generated by the interactive image generator. Merge

Also preferably, in the embodiment according to another aspect, the above-described image recognition device is a three-dimensional image recognition device for recognizing a three-dimensional image, the real object detection unit in the image sequence of the three-dimensional image signal received from the image recognition device Based on the movement of the object, a stereoscopic real object image is used as a stereoscopic foreground to detect the outer line and / or outer coordinate values of the stereoscopic real object image by judging the motion of the actual object image having the stereoscopic outline. do.

The interactive image generating unit generates a stereoscopic interactive object image according to a preprogrammed algorithm, and when the motion of the stereoscopic real object image is determined, the stereoscopic outer line or the outer coordinate value of the actual object image is stereoscopic. An interactive object generates a stereoscopic interactive image that reacts interactively, and the image merge processor merges the stereoscopic image signal processed by the actual object detector and the stereoscopic interactive image generated by the interactive image generator.

delete

delete

delete

delete

In order to achieve the above object, according to another aspect of the invention, the first step of receiving a video signal from the image processing apparatus recognized from the image recognition apparatus for recognizing the image including the actual object in the recognition area; In the image sequence of the video signal received in the first step, the outer line or the outer coordinate value or the outer line and the coordinate value of the real object image is detected by distinguishing it from the background based on the actual object image as the foreground based on the movement of the real object. Determining a movement of an actual object image having a second step; In the image processing apparatus, according to a pre-programmed algorithm, an image including at least one or more interactive objects is generated and an outer line or an outer coordinate value of the actual object image obtained from the second step when the movement of the actual object image is determined. Generating an interactive image in which the interactive object reacts interactively with respect to the third object; A fourth step of merging the video signal processed in the second step and the interactive image generated in the third step; And a fifth step of transmitting the merged image in the fourth step to display on the screen. There is proposed an interactive image processing method comprising a.

Preferably, in the embodiment according to another aspect, in the above-described third step, the interactive object image and the center or the outside of the interactive image reacted by coalescing, seating, or penetrating the outer line or the outer coordinate value of the actual object image among the interactive images. In the first step, the coordinate value is extracted, the image signal converted into a digital signal is received from the image recognition device, and is transmitted to the image processing apparatus as an image sequence, but the interactive object image extracted in the third step and the center thereof are extracted. Or a feedback merging step of receiving feedback of the outer coordinates and merging them on the real object image of the image sequence transmitted to the image processing apparatus, and in the second step after the feedback, the real object image of the image sequence received from the feedback merging step The interactive object image merged into is processed as part of the actual object image.

Also preferably, in another embodiment of the present invention, the third step may include: an interactive object and a center or an exterior thereof reacted by coalescing, seating, or infiltrating an outer line or an outer coordinate value of an actual object image in the interactive image; The method may further include a feedback step of extracting the coordinate value or the outer coordinate value of the actual object image of the point where the coalescing, seating, or penetration reaction is performed, and feeding back the extracted coordinate value to the second step.

Furthermore, the image processing method according to the present embodiment includes: calculating a difference between an outer coordinate value of an actual object image fed back in the aforementioned feedback step and an outer portion of an actual object image of a corresponding portion in an image newly received from the image recognition apparatus; Or calculating a difference between a coordinate value of the actual object image corresponding to the outer coordinate value of the fed back interactive object image and an outline of the actual object image of the corresponding portion of the image newly received from the image recognition apparatus; And according to the difference from the outside of the actual object image of the corresponding portion in the newly received image calculated in the second 'step, the interactive object reacted by coalescing, seating, or penetrating before feedback is secondarily shaped, colored or shaded. A third 'step of generating an interactive image further comprising an image reacted to generate a change; It further comprises.

In order to achieve the above object, according to another aspect of the present invention, an image processing apparatus used in an interactive image processing system or an interactive image processing method, comprising: from an image recognition apparatus for recognizing an image including a real object in a recognition area; Based on the movement of the real object in the video sequence of the received video signal, the real object image is set as the foreground and separated from the background to detect the outer line or / and the outer coordinate value of the real object image, and the motion of the real object image having the outline is detected. A real object detector for determining and detecting; According to a pre-programmed algorithm, an image of at least one interactive object responding to the image of the real object is generated, and when the motion of the real object image is determined, the outer line or the outer coordinate value of the real object image obtained from the real object detector An interactive image generator for generating an interactive image in which an interactive object reacts interactively with respect to the interactive image; And an image merge processor configured to merge and process an image signal processed by an actual object detector and an interactive image generated by the interactive image generator.

Preferably, the interactive image generating unit extracts the interactive object image and its center or outer coordinate value that are reacted by coalescing, seating, or infiltrating the outer line or the outer coordinate value of the actual object image among the interactive images. Furthermore, the image processing apparatus receives a digital image signal from the image recognition apparatus and transmits the digital image signal to the real object detector as an image sequence, but feeds back the interactive object image extracted from the interactive image generator and its center or outer coordinate value to the real object detector. The apparatus further includes an image library for merging and transmitting the image on the actual object image of the transmitted image sequence. The real object detector processes the interactive object image merged into the real object image of the image sequence received from the image library as part of the real object image.

Also preferably, in one embodiment, the interactive image generating unit merges, mounts, or penetrates the outer line or the outer coordinate value of the actual object image among the interactive images, and the center or outer coordinate value thereof, or the combined object. In addition, the outer coordinate values of the actual object image of the spot or the part of the seating or penetration reaction are extracted, and the extracted coordinate values are fed back to the real object detection unit. In addition, the real object detection unit calculates a difference between the outer coordinates of the fed back real object image and the outside of the actual object image of the corresponding portion in the newly received image from the image recognition apparatus, or the outer coordinates of the fed back interactive object image. The difference between the coordinates of the real object image corresponding to and the outer edge of the real object image of the corresponding portion of the image newly received from the image recognition apparatus is calculated. Furthermore, the interactive image generating unit may secondaryly shape the interactive object that has been merged, seated or penetrated before feedback, according to a difference from the outside of the actual object image of the corresponding part in the newly received image calculated by the real object detector. In addition, the interactive image may further include an image that is reacted to generate a change in color or shade.

Although not explicitly mentioned as one preferred aspect of the present invention, it is apparent that embodiments according to various possible combinations of the above-mentioned technical features can be implemented.

According to the aspect of the present invention, it is possible to obtain an interactive image which displays the image of the actual object and the interactive object image in response thereto.

In particular, according to one embodiment of the present invention, the interactive object is maintained in the state of coalescing, seating or infiltrating onto the actual object image, and by obtaining an interactive image in which an additional interactive object reacts, it is possible to implement a more vibrant interactive image. It became.

It is apparent that various effects not directly mentioned in accordance with various embodiments of the present invention may be derived by those skilled in the art from various configurations according to embodiments of the present invention.

1 is a schematic block diagram of an interactive image processing system according to an embodiment of the present invention.
2 is a schematic block diagram of an image processing apparatus of an interactive image processing system according to an exemplary embodiment of the present invention.
3 is another schematic block diagram of an image processing apparatus of an interactive image processing system according to another exemplary embodiment of the present invention.
4 is a schematic flowchart of an interactive image processing method according to an exemplary embodiment of the present invention.
5 is a schematic flowchart of an interactive image processing method according to another exemplary embodiment of the present invention.
6 is a schematic flowchart of an interactive image processing method according to another embodiment of the present invention.

Embodiments of the present invention for achieving the above object are described with reference to the accompanying drawings. In describing the embodiments, the same reference numerals refer to the same configuration, and additional descriptions that may overlap or limit the meaning of the invention may be omitted in describing the embodiments of the present invention.

First, an interactive image processing system, which is one of the present inventions, will be described in detail with reference to the accompanying drawings.

1 is a schematic block diagram of an interactive image processing system according to an embodiment of the present invention, FIG. 2 is a schematic block diagram of an image processing apparatus of an interactive image processing system according to an embodiment of the present invention, and FIG. Is another schematic block diagram of an image processing apparatus of an interactive image processing system according to another embodiment of the present invention.

Referring to FIG. 1, one embodiment of an interactive image processing system includes an image recognition apparatus 200, an image processing apparatus 100, and a display apparatus 300.

The image recognition apparatus 200 of the interactive image processing system recognizes an image including a real object in the recognition area. Image recognition device 200 preferably comprises an analog or digital photographing device, such as a camera, a cam code. In the case of the analog photographing apparatus, the obtained analog signal is converted into a digital signal using a separate AD converter and transmitted to the image processing apparatus 100 or the analog signal is transmitted to the image processing apparatus 100 in the image processing apparatus 100. In the case of a digital photographing apparatus, analog information input in the apparatus is converted into a digital signal, and then stored or converted into a digital signal and transmitted to the image processing apparatus 100.

In one embodiment, the image recognition device 200 converts the recognized image signal into a digital image signal and transmits it.

In addition, the recognition area refers to an area recognized by the image recognition apparatus 200, and, for example, an area corresponding to a frame area of a captured image when photographed by a camera or a camcorder.

According to one preferred embodiment, the real object recognized by the image recognition device 200 is at least an initially moving actor entering the recognition area, and includes a user, an object, or a combination thereof. That is, it may be a person or a person who wears or equips an object as well as a moving or moving object.

Also preferably, in another embodiment, the image recognition device 200 is a stereoscopic image recognition device for recognizing a stereoscopic image. Preferably, at least two or more digital video cameras (not shown) are disposed at different positions in order to three-dimensionally recognize the actual object image. The arrangement of the at least two digital video cameras may be variously changed, for example, all of them may be spaced apart in front of the real object, or may be disposed in front of and above the real object. In addition, in order to recognize a stereoscopic image, at least one digital image camera (not shown) and a distance sensor (not shown) may also be configured. In this case, the distance sensor may detect the distance of an actual object. As long as it can be a sensor, it may be a sensor using, for example, ultrasonic waves, infrared rays, or the like, preferably an infrared sensor.

The image processing apparatus 100, 100 ′, 100 ″ of the present exemplary embodiment includes at least one interactive object that receives and processes an image signal from the image recognition apparatus 200 and responds to an image of an actual object in the processed image signal. The video signal is processed and the processed video signal is merged to generate an interactive video signal. The processing of the video signal received from the image processing apparatuses 100, 100 ', and 100 " It is to classify the background, and to detect the boundary of the separated real object image. Preferably, the processing of the received image in the image processing apparatus (100, 100 ', 100 ") may include extracting the actual object image as the foreground by removing the background as well as the outer edge of the actual object image, Alternatively, the outer edge of the actual object image may be detected without removing the background.

In the present invention, the interactive object refers to a virtual object that interacts by reacting to the movement of the real object, and the interactive image refers to an image in which the interactive object operates in response to the movement of the real object. An image including at least one or more interactive objects may be an image without a background or an image including a background. In the case of including a background, the background image itself may react interactively according to the movement of the actual object. For example, the background image may rotate to the left or right, move closer or farther away, or rotate up and down, or the background image may gradually become smaller or larger and may exhibit an interactive response. Also, preferably, the image has no background, and may be merged with the background image later.

Referring to FIG. 1, an image processing apparatus 100 of an interactive image processing system according to an exemplary embodiment includes an actual object detector 110, an interactive image generator 130, and an image merge processor 150. Referring to FIG. 2, preferably, the apparatus may further include a background image storage unit 170 according to an embodiment. Also, referring to FIG. 3, the image library 190 may be further included. have. Also, although not shown, the real object detector 110, the interactive image generator 130, and the image merger 150, and preferably the image library 190 and the background may be provided through a main controller (not shown). The image storage unit 170 is integrated control.

1 to 3, the real object detection unit 110 distinguishes the real object image from the background based on the movement of the real object in the image sequence of the received video signal and separates it from the background, and / or an outer line of the real object image. The outer coordinate value is detected and the motion of the actual object image having the outer edge is determined and detected. The detection of the real object image having an outline may preferably be performed by detecting an outside of the real object image without removing the background or extracting the real object image as a foreground by removing the background.

For example, the background and the foreground may be distinguished based on chromatic aberration of the input moving object image, or change in color and contrast, or by grasping the bit change of pixel values between neighboring frames of the input image. Can be divided into the foreground. Separating the actual object image from the background can be obtained by various methods including the above-described method. For example, it is well known in the art to distinguish the foreground from the background based on chromatic aberration or change in color and contrast of an input image or on the basis of a bit change in pixel values between neighboring frames.

In one preferred embodiment, when the image recognition device 200 recognizes a stereoscopic image of the real object, the real object detector 110 is a real object in the image sequence of the stereoscopic image signal received from the image recognition device 200 Based on the movement of the 3D real object image as a 3D foreground, it detects the outer line or the outer coordinate value or the outer line and the coordinate value of the 3D real object image separated from the background. Determine and detect movement. Detection of a real object image having a stereoscopic outline may also be to extract a real object image having a stereoscopic outline as a foreground by detecting the stereoscopic outline of the real object image without removing the background or removing the background. Here, the meaning of a stereoscopic image or a stereoscopic outline or stereoscopic dimension means that the coordinate value of the z-axis perpendicular to the plane is in addition to the plane coordinate value. The z-axis coordinate value is understood as the image depth or image distance.

1 to 3, the interactive image generating unit 130 of the image processing apparatus 100, 100 ′, 100 ″ generates an image of an interactive object according to a pre-programmed algorithm, and determines the movement of the actual object image. In this case, the interactive object reacts interactively with respect to the outer line or the outer coordinate value of the real object image obtained from the real object detector 110 and generates an interactive image. The interactive object reacts interactively with respect to the interactive object with respect to the coordinate values or the outer line substantially obtained by matching the outer line or the outer coordinate value of the actual object image into the area of the interactive object image. Generate interactive images when reacting to outer lines of real object images The interactive image generated by the unit 130 may be an image including an outline line and an interactive object, and when reacting to an outer coordinate value of an actual object image, the interactive image is an image of the interactive object itself.

According to one preferred embodiment, the interactive response of the interactive object may be avoidance, reflection, refraction, coalescing, seating or penetration of the outer or moving outline of the real object image according to a preprogrammed algorithm, or the actual It may be destruction, splitting or scattering by collision or contact with the outer or moving outer edge of the object image, or it may be acceleration or deceleration to the outer or moving outer edge of the real object image, or to a stationary outer edge of the real object image. It may be a slowing down or settling and avoidance or departure from a moving outline, or an action of an interactive object by collision or contact with a moving outline of the real object image, or the size of the interactive object by approaching or moving away from the real object image. It can be a shape, or a change in size and shape. Or a reaction by combining at least two of them.

Here, the interactive response of the interactive object refers to the response of the interactive object to the coordinate values or the outer line obtained by matching the outer line or the outer coordinate value of the actual object image into the area of the interactive object image.

Further, according to one preferred embodiment, in the case of obtaining an interactive image that recognizes a stereoscopic image of a real object and reacts in three dimensions, the interactive image generating unit 130, according to a pre-programmed algorithm, the image of the three-dimensional interactive object When the movement of the three-dimensional real object image is determined, the three-dimensional interactive image of the three-dimensional interactive object reacts interactively to the outer line or the outer coordinate value of the real object image.

1 to 3, the image merge processor 150 merges the image signal processed by the real object detector 110 and the interactive image generated by the interactive image generator 130. Since the image signal processing in the real object detection unit 110 refers to the detection of the outside of the real object image, as described above, the detected real object image is preferably a real object image without background removal or a real object with background removed. It may be an image. When the real object image detected by the real object detector 110 is an image without background removal, only the interactive image generated by the image merge processor 150 is processed by the real object detector 110 and merged onto the detected image. When the interactive image generated by the interactive image generating unit 130 reacts to the outer line of the real object image, the interactive image including the outer line and the interactive object is placed on the image processed by the real object detecting unit 110. Are merged. Meanwhile, when the interactive image generated by the interactive image generator 130 reacts to the outer coordinate values of the actual object image, the image of the interactive object itself is merged onto the image processed by the real object detector 110. The image processed by the real object detector 110 may be an image including the detected outer line at the time when the outer line of the real object image is detected in the process.

According to this configuration, it is possible to display not only interactive objects but also actual object images on the screen.

According to an exemplary embodiment, when the image recognition apparatus 200 recognizes a stereoscopic image and generates an interactive image in which the real object detection unit 110 detects the stereoscopic outline of the real object and reacts in three dimensions, the image merge processing unit ( 150 merges the stereoscopic image signal processed by the real object detector 110 and the stereoscopic interactive image generated by the interactive image generator 130.

Referring to FIG. 1, the display apparatus 300 of the interactive image processing system according to an exemplary embodiment receives a merged image from the image processing apparatus 100 and displays the merged image on a screen. Preferably, the display device 300 is a projector (not shown), and the screen refers to displaying an image, and may be, for example, a film or a wall, or a floor or a ceiling. In addition, the screen is preferably a display screen such as LCD, PDP, OLED, etc., the display device 300 may be an image device for reproducing the image on the display screen. Preferably, in the case of stereoscopic image reproduction, the display apparatus 300 includes left and right projectors or left and right image projectors in the case of an LCD display screen to display a stereo image on a display screen.

2 is a schematic block diagram of an image processing apparatus of an interactive image processing system according to an exemplary embodiment of the present invention.

Referring to FIG. 2, preferably, in one embodiment, the image processing apparatus 100 ′ further includes a background image storage unit 170 storing background images that become a background of the interactive image. In addition, the real object detector 110 extracts the separated real object image from the background. That is, in the present embodiment, the background is removed from the real object detector 110 and the real object image is extracted.

In addition, in the present exemplary embodiment, the image merge processor 150 may select the background image selected from the background images stored in the background image storage unit 170 and the real object image and the interactive image generator 130 extracted by the real object detector 110. Merge the interactive images created in).

3 is another schematic block diagram of an image processing apparatus of an interactive image processing system according to another exemplary embodiment of the present invention.

Referring to FIG. 3, in another embodiment of the present invention, preferably, the interactive image generating unit 130 is integrated, seated, or penetrated with respect to an outer line or an outer coordinate value of an actual object image among the interactive images. The extracted interactive object image and its center or outer coordinate value. Here, the interactive object image, which is merged, seated, or infiltrated with the outer line or the outer coordinate value of the real object image, is an interactive object image that is interactively reacted with the outside of the real object image. An image of an interactive object representing a reaction such as coalescing, settling, or infiltrating a coordinate line or an outer line obtained by matching an outer line or an outer coordinate value into an area of an interactive object image. Preferably, the center or outer coordinate value of the interactive object image includes not only a basic basic coordinate value but also a coordinate value determined based on the outer edge of the real object image detected by the real object detector 110.

3, the image processing apparatus 100 ″ further includes an image library 190. Also, although not illustrated in FIG. 3, the image processing apparatus 100 ″ further includes the background image storage unit 170 of FIG. 2. In FIG. 3, the image library 190 receives a digital image signal from the image recognition apparatus 200 and transmits the digital image signal to the real object detector 110 as an image sequence, but extracts the interactive object image extracted from the interactive image generator 130. And the feedback of the center or the outer coordinate value thereof is fed back to the real object image of the image sequence transmitted to the real object detection unit 110 and transmitted.

The real object detector 110 processes the interactive object image merged into the real object image of the image sequence received from the image library 190 as a part of the real object image. The processing of the interactive object image as part of the real object image is to include the interactive object image merged with the real object image in the outer region of the image of the real object and to be foreground with the real object image so as to be distinguished from the background.

The image merge processor 150 merges and processes the interactive object image as a part of the actual object image and the interactive image generated by the interactive image generator 130.

According to the present exemplary embodiment, an interactive image in which an interactive object remains coalesced, seated, or penetrated onto an actual object image, and an additional interactive object reacts can be obtained.

Also, although not preferably illustrated, in one embodiment, the interactive image generating unit 130 is substantially an outer line or an outline of the actual object image matched into the interactive object domain with respect to the outside of the actual object image among the interactive images. Coordinate values are extracted from the center or the outer coordinates of the interactive object reacted by being coalesced, seated or infiltrated, and / or the outer coordinates of the actual object image of the point where coalesce, seated or infiltrated. The center or outer coordinate value of the interactive object extracted from the interactive image generating unit 130, the seated or penetrated and reacted, and / or the outer coordinate of the actual object image of the point where the coalesced, seated or penetrated is reacted. The value is fed back to the actual object detector 110.

In addition, the real object detector 110 calculates a difference between the outer coordinates of the fed back real object image and the outside of the real object image of the corresponding part of the image newly received from the image recognition apparatus 200. Alternatively, the difference between the actual object image coordinate value corresponding to the outer coordinate value of the fed back interactive object image and the outside of the actual object image of the corresponding portion in the image newly received from the image recognition apparatus 200 is calculated. This difference is caused by the rotation, movement, enlargement and reduction of the outline of the actual object image, combining with other objects, or combining them.

In the interactive image generator 130, the outer line or the outer line of the actual object image before the feedback, according to a difference from the outer side of the real object image of the corresponding part in the newly received image calculated by the real object detector 110. The interactive object is controlled to generate an image further including an interactive object that is reacted to generate a change in shape, shape, or shading of the interactive object.

According to the present embodiment, the state in which the interactive object is merged, seated, or penetrated onto the real object image is changed according to the movement of the real object image, and an interactive image in which an additional interactive object reacts can be obtained.

Further, in another embodiment of the present invention, preferably, the real object detector 110 detects a boundary coordinate value or a boundary line of a portion moving in the outer region of the real object image, and has the outer real object image. The movement of the portion and the movement of the portion having a boundary in the outer region are determined.

In the present embodiment, the interactive image generating unit 130 moves to the outer edge of the real object image detected by the real object detecting unit 110 when the movement of a part of the real object image is determined. Generate an interactive image that reacts interactively to the boundary of the moving part past the stationary outline.

2 or 3 is an image processing apparatus 100 ′, 100 ″ in an interactive image processing system according to an embodiment of the present invention, and at the same time an interactive image processing apparatus 100 according to another embodiment of the present invention. ', 100 "). In addition, reference numeral 100 in FIG. 1 also shows an interactive image processing apparatus according to another embodiment of the present invention.

1 to 3, the interactive image processing apparatus 100, 100 ′, 100 ″ according to another aspect of the present invention implements the above-described interactive image processing system or one of the interactive image processing methods described below. An image processing apparatus 100 to be used in the present invention includes an actual object detecting unit 110, an interactive image generating unit 130, and an image merging processing unit 150. Referring to Fig. 2, it is preferable to implement one embodiment. For example, the background image storage unit 170 may be further included, and preferably, referring to Fig. 3, the image library 190 may be further included. The various embodiments of the image processing apparatus 100, 100 ′, 100 ″ described in the embodiments of the interactive image processing system, which is one of the present invention, are the other of the present invention. Because the processing apparatus can be understood with reference to the description of the embodiments of the interactive even though it is not directly described as an embodiment of the (100, 100 ', 100 "), an image processing system, will be omitted the duplicate description as much as possible.

1 to 3, the real object detector 110 distinguishes a real object from a background based on a real object image based on the motion of the real object in an image sequence of a video signal received from the image recognition apparatus 200. The outer line or the outer coordinate value or the outer line and the coordinate value of the image are detected and the motion of the actual object image having the outer edge is determined and detected.

1 to 3, the interactive image generating unit 130 generates an image of an interactive object according to a pre-programmed algorithm, and when the movement of the actual object image is determined, the real object obtained from the real object detecting unit 110. An interactive image is generated in which an interactive object reacts interactively to an outer line or an outer coordinate value of an image.

1 to 3, the image merge processor 150 merges the image signal processed by the real object detector 110 and the interactive image generated by the interactive image generator 130.

Although various embodiments of the interactive stereoscopic image processing apparatus, which is one of the present invention, are not directly described, it will be apparent that the embodiments can be described and understood as the image processing apparatus in the embodiments of the interactive stereoscopic image processing system described above.

Next, an interactive image processing method according to another aspect of the present invention will be described in detail with reference to the accompanying drawings. Since the interactive image processing method according to an aspect of the present invention may be implemented in the interactive image processing system according to the above-described embodiment, a detailed description of the method will refer to an embodiment of the interactive image processing system. Non-overlapping descriptions will also be described with reference to embodiments of the interactive image processing system.

4 is a schematic flowchart of an interactive image processing method according to an embodiment of the present invention, and FIG. 5 is a schematic flowchart of an interactive image processing method according to another embodiment of the present invention.

Referring to FIG. 4, the interactive image processing method according to another embodiment of the present invention includes the following first to fifth steps (S100 to S500).

In a first step (S100), the image processing apparatus 100 receives an image signal recognized by the image recognition apparatus 200 that recognizes an image including a real object in the recognition region.

In the second step (S200), in the video sequence of the video signal received in the first step (S100) based on the movement of the real object in the foreground, the real object image is separated from the background and the outer line or the outer coordinates of the real object image Value or outline line and coordinate values are detected and the movement of the actual object image having the outline is determined and detected. The detection of the real object image having an outline may preferably be performed by detecting an outside of the real object image without removing the background or extracting the real object image as a foreground by removing the background.

In the third step S300, the image processing apparatus 100 generates an image including at least one or more interactive objects according to a pre-programmed algorithm, and when the movement of the actual object image is determined, the second step ( An interactive image in which an interactive object reacts interactively with respect to an outer line or an outer coordinate value of an actual object image obtained from S200 is generated.

In the fourth step S400, the video signal processed in the second step S200 and the interactive image generated in the third step S300 are merged.

Preferably, a selected background image among the pre-stored background images serving as the background of the above-described interactive image and the actual object image extracted in the second step S200 and the third object in the third step S300 may be generated. Merges interactive images.

In the fifth step S500, the merged image is transmitted to display on the screen the merged process in the fourth step S400.

5 is a schematic flowchart of an interactive image processing method according to another exemplary embodiment of the present invention.

Referring to FIG. 5, in an exemplary embodiment, in the above-described third step S300 ′, an outer line or an outer line of an actual object image that is substantially matched into the interactive object domain in relation to the outer side of the actual object image among the interactive images. The interactive object image and its center or outer coordinate value which are merged, seated or infiltrated with respect to the coordinate value are extracted (S330).

Referring to FIG. 5, the first step S100 ′ receives an image signal converted into a digital signal from the image recognition apparatus 200 and transmits the image signal to the image processing apparatus 100 in an image sequence, but the above-described third step S330. A feedback merging step (S130) of receiving an interactive object image extracted from the image and its center or outer coordinate value and merging the image on the actual object image of the image sequence transmitted to the image processing apparatus 100, 100 ′, 100 ″. It includes more.

Referring to FIG. 5, in a second step S200 after feedback, the interactive object image merged into the real object image of the image sequence received from the feedback merging step is processed as part of the real object image.

6 is a schematic flowchart of an interactive image processing method according to another embodiment of the present invention.

Referring to FIG. 6, in another embodiment of the present invention, the third step may include: an interactive object and a center or an interactive object reacted by coalescing, seating, or penetrating an outer line or an outer coordinate value of an actual object image in the interactive image; The method may further include a feedback step (S350) of extracting the outer coordinate value, or the outer coordinate value of the actual object image of the point where the coalescing, seating, or penetration reaction is performed, and feeding back the extracted coordinate value to the second step.

In addition, referring to FIG. 6, the image processing method according to the present embodiment includes: an outer coordinate value of an actual object image fed back in the feedback step S350 and a portion corresponding to a newly received image from the image recognition apparatus 200. The actual object of the corresponding part in the coordinate value of the real object image corresponding to the outer coordinate value of the real object image of the real object image or the newly received image from the image recognition apparatus 200 is calculated. The method may further include a second step (S1200) for calculating a difference from the outside of the image.

Further, referring to FIG. 6, according to a difference from the outside of the actual object image of the corresponding portion in the newly received image calculated in the second 'step S1200, the interactive object that is coalesced, seated, or penetrated before feedback is reacted. And a third step (S1300) of generating an interactive image further including an image that is secondarily reacted to generate a change in shape, color, or shadow.

Although specific embodiments of the interactive image processing method which is one of the present invention are not directly disclosed, the processes of the implementation of the interactive image processing system of the present invention described above are described as one of the embodiments of the interactive image processing method of the present invention. Can be understood.

In the above, the present invention has been described with reference to the preferred embodiments with reference to the accompanying drawings. The accompanying drawings and the foregoing embodiments are described by way of example to help those skilled in the art to understand the present invention. Therefore, various embodiments of the present invention can be implemented in a modified form without departing from the essential characteristics of the present invention, the foregoing embodiments are to be considered as illustrative and not restrictive. Therefore, the scope of the present invention should be interpreted according to the invention described in the appended claims rather than the above-described embodiments, and various modifications, alternatives, and equivalents described by the person skilled in the art are described above. It is obvious that it is included in the scope of the.

100, 100 ', 100 ": Image processing device or interactive image processing device
110: real object detection unit 130: interactive image generating unit
150: image merge processing unit 170: background image storage unit
190: Image library 200: Image recognition device
300: display device

Claims (11)

An image recognition device for recognizing an image including a real object in the recognition region, converting the recognized image signal into a digital image signal, and transmitting the converted image signal;
The image signal is received from the image recognition apparatus, processed, and merges the image signal with an image including at least one interactive object responsive to the image of the real object among the processed image signals to generate an interactive image signal. As an image processing apparatus,
In the image sequence of the received video signal, an outer line or an outer coordinate value or an outer line and a coordinate value of the real object image are detected by distinguishing the real object image from the background on the basis of the movement of the real object based on the foreground. A real object detector for detecting and detecting a movement of the real object image having
According to a pre-programmed algorithm, the interactive object generates an image of the interactive object, and when the movement of the real object image is determined, the interactive object mutually with respect to an outer line or an outer coordinate value of the real object image obtained from the real object detector. An interactive image generating unit for generating an interactive image that is reactively reacted, and
The image processing apparatus including an image merge processor configured to merge and process the image signal processed by the real object detector and the interactive image generated by the interactive image generator;
A display device for receiving the merged image from the image processing device and displaying the merged image on a screen; , ≪ / RTI >
The interactive image generating unit extracts the interactive object image and its center or outer coordinate value which are reacted by coalescing, seating, or penetrating the outer line or the outer coordinate value of the real object image among the interactive image.
The image processing apparatus receives the digital image signal from the image recognition apparatus and transmits the digital image signal to the real object detection unit as an image sequence, and receives the interactive object image extracted from the interactive image generating unit and its center or outer coordinate value thereof. It further comprises a video library for merging and transmitting on the real object image of the image sequence transmitted to the real object detection unit,
And the real object detection unit processes the interactive object image merged with the real object image of the image sequence received from the image library as part of a real object image.
An image recognition device for recognizing an image including a real object in the recognition area;
The image signal is received from the image recognition apparatus, processed, and merges the image signal with an image including at least one interactive object responsive to the image of the real object among the processed image signals to generate an interactive image signal. As an image processing apparatus,
In the image sequence of the received video signal, an outer line or an outer coordinate value or an outer line and a coordinate value of the real object image are detected by distinguishing the real object image from the background on the basis of the movement of the real object based on the foreground. A real object detector for detecting and detecting a movement of the real object image having
According to a pre-programmed algorithm, the interactive object generates an image of the interactive object, and when the movement of the real object image is determined, the interactive object mutually with respect to an outer line or an outer coordinate value of the real object image obtained from the real object detector. An interactive image generating unit for generating an interactive image that is reactively reacted, and
The image processing apparatus including an image merge processor configured to merge and process the image signal processed by the real object detector and the interactive image generated by the interactive image generator;
A display device for receiving the merged image from the image processing device and displaying the merged image on a screen; , ≪ / RTI >
The interactive image generating unit may integrate, settle, or penetrate the interactive object and its center or outer coordinate value, or merge, settle, or penetrate the integrated line from the interactive image to the outer line or the outer coordinate value of the real object image. Extracts the outer coordinates of the actual object image of the reacted point or part, feeds back the extracted coordinates to the real object detector,
The real object detecting unit calculates a difference between an outer coordinate value of the fed back real object image and an outer part of the real object image of a corresponding portion in the image newly received from the image recognition apparatus, or an outside of the fed back interactive object image. Calculates a difference between the coordinates of the actual object image corresponding to the coordinate value and the outside of the actual object image of the corresponding part of the image newly received from the image recognition apparatus;
The interactive image generating unit may be configured to have the interactive object responded to the merged, seated, or penetrated prior to the feedback according to a difference between the newly received image calculated by the real object detector and the outside of the real object image of the corresponding part. And an interactive image further comprising an image responsive to generate a change in shape, color or shade.
An image recognition device for recognizing an image including a real object in the recognition area;
The image signal is received from the image recognition apparatus, processed, and merges the image signal with an image including at least one interactive object responsive to the image of the real object among the processed image signals to generate an interactive image signal. As an image processing apparatus,
In the image sequence of the received video signal, an outer line or an outer coordinate value or an outer line and a coordinate value of the real object image are detected by distinguishing the real object image from the background on the basis of the movement of the real object based on the foreground. A real object detector for detecting and detecting a movement of the real object image having
According to a pre-programmed algorithm, the interactive object generates an image of the interactive object, and when the movement of the real object image is determined, the interactive object mutually with respect to an outer line or an outer coordinate value of the real object image obtained from the real object detector. An interactive image generating unit for generating an interactive image that is reactively reacted, and
The image processing apparatus including an image merge processor configured to merge and process the image signal processed by the real object detector and the interactive image generated by the interactive image generator;
A display device for receiving the merged image from the image processing device and displaying the merged image on a screen; , ≪ / RTI >
The real object detecting unit detects a boundary coordinate value or a boundary line of a portion moving in an outer region of the real object image, and moves the real object image having an outline and a portion having a boundary in the outer region. Judging
The interactive image generating unit moves the interactive object in the moving object out of the real object image detected by the real object detecting unit and passes through the stationary outside when the movement of the part of the real object image is determined. Interactive image processing system for generating an interactive image that reacts interactively to a boundary of a portion.
The method according to any one of claims 1 to 3,
The real object is at least an initial moving actor entering the recognition area, and includes a user, a thing or a combination thereof,
The interactive response of the interactive object may be avoided, reflected, refracted, coalesced, settled or penetrated into the outer or moving outer boundary of the real object image according to a pre-programmed algorithm, or collided with the outer or moving outer corner of the real object image. Or destruction, division or dispersion by contact, acceleration or deceleration to the outer or moving outer edge of the real object image, deceleration or settling to a stationary outer edge of the real object image and avoid or escape from the moving outer edge, of the real object image Motion of the interactive object due to a collision or contact with a moving outside, a change in the size, shape or size and shape of the interactive object due to an approach or distance from the actual object image, or a combination of at least two of them Interactive image processing system.
The method according to any one of claims 1 to 3,
The image processing apparatus further includes a background image storage unit for storing the background images as the background of the interactive image,
The real object detection unit extracts the separated real object image by separating it from the background,
The image merge processing unit merges the selected background image among the background images stored in the background image storage unit, the real object image extracted by the real object detection unit, and the interactive image generated by the interactive image generating unit. Interactive image processing system.
The method according to any one of claims 1 to 3,
The image recognition device is a stereoscopic image recognition device for recognizing a stereoscopic image,
The real object detecting unit separates the stereoscopic real object image from the background based on the movement of the real object in the image sequence of the stereoscopic image signal received from the image recognition apparatus and separates the background from the background of the stereoscopic real object image or Detects the outer coordinate value or the outer line and coordinate values, and detects and detects the movement of the real object image having the three-dimensional outline.
The interactive image generating unit generates a three-dimensional interactive object image according to a pre-programmed algorithm, and when the movement of the three-dimensional real object image is determined, the three-dimensional image is generated with respect to the outer line or the outer coordinate value of the real object image. Create a three-dimensional interactive image that the interactive object reacts to the three-dimensional interactive,
And the image merge processing unit merges the stereoscopic image signal processed by the real object detector and the stereoscopic interactive image generated by the interactive image generating unit.
delete A first step of receiving an image signal recognized by an image recognition apparatus that recognizes an image including a real object in the recognition region, from the image processing apparatus;
In the image sequence of the video signal received in the first step, the outer line or the outer coordinate value or the outer line and the coordinate value of the real object image are detected by distinguishing the background from the background using the real object image as the foreground based on the movement of the real object. Determining a movement of the real object image having an outline;
In the image processing apparatus, according to a pre-programmed algorithm, an image including at least one or more interactive objects is generated and an outer line of the real object image obtained from the second step when the movement of the real object image is determined. Or generating an interactive image in which the interactive object reacts interactively with respect to an outer coordinate value;
A fourth step of merging the video signal processed in the second step with the interactive image generated in the third step; And
A fifth step of transmitting the merged image in the fourth step to display on the screen; , ≪ / RTI >
In the third step, extracting the interactive object image and the center or the outer coordinate value of the interactive image, which has been merged, seated or penetrated to the outer line or the outer coordinate value of the real object image among the interactive images,
In the first step, the image signal converted into a digital signal from the image recognition device is received and transmitted to the image processing apparatus in an image sequence, wherein the interactive object image extracted in the third step and its center or outer coordinate value are extracted. A feedback merging step of receiving feedback and merging and transmitting the image sequence onto the real object image of the image sequence transmitted to the image processing apparatus;
And in the second step after the feedback, process the interactive object image merged into the real object image of the image sequence received from the feedback merging step as a part of the real object image.
A first step of receiving an image signal recognized by an image recognition apparatus that recognizes an image including a real object in the recognition region, from the image processing apparatus;
In the image sequence of the video signal received in the first step, the outer line or the outer coordinate value or the outer line and the coordinate value of the real object image are detected by distinguishing the background from the background using the real object image as the foreground based on the movement of the real object. Determining a movement of the real object image having an outline;
In the image processing apparatus, according to a pre-programmed algorithm, an image including at least one or more interactive objects is generated and an outer line of the real object image obtained from the second step when the movement of the real object image is determined. Or generating an interactive image in which the interactive object reacts interactively with respect to an outer coordinate value;
A fourth step of merging the video signal processed in the second step with the interactive image generated in the third step; And
A fifth step of transmitting the merged image in the fourth step to display on the screen; , ≪ / RTI >
In the third step, the interactive object and its center or outer coordinate value, or coalescing, seating, or responding by being merged, seated, or infiltrated with the outer line or the outer coordinate value of the real object image in the interactive image. A feedback step of extracting an outer coordinate value of the actual object image of the point or portion of the penetration response and feeding back the extracted coordinate value to the second step,
The image processing method is:
Calculates a difference between an outer coordinate value of the real object image fed back in the feedback step and an outer edge of a real object image of a corresponding portion in a newly received image from the image recognition apparatus, or an outer coordinate of the interactive object image fed back Calculating a difference between a coordinate value of the actual object image corresponding to the value and an outer edge of the actual object image of the corresponding portion of the image newly received from the image recognition apparatus; And
According to the difference with the outside of the actual object image of the corresponding part in the newly received image calculated in the second 'step, the interactive object reacted by being coalesced, seated or penetrated before the feedback is secondary in shape and color. Or a third 'step of generating an interactive image further comprising an image reacting to generate a change in shadow; Interactive image processing method characterized in that it further comprises.
An image processing apparatus used in an interactive image processing system or an interactive image processing method,
In an image sequence of a video signal received from an image recognition device that recognizes an image including a real object in a recognition area, the outer line of the real object image is distinguished from the background by using the real object image as a foreground based on the movement of the real object. A real object detector detecting an outer coordinate value or an outer line and a coordinate value and determining and detecting a motion of the real object image having an outer edge;
An outer line of the real object image obtained from the real object detection unit, when an image of at least one interactive object is generated in response to the image of the real object according to a pre-programmed algorithm and the movement of the real object image is determined Or an interactive image generating unit generating an interactive image in which the interactive object reacts interactively with respect to an outer coordinate value; And
And an image merge processor configured to merge and process the image signal processed by the real object detector and the interactive image generated by the interactive image generator.
The interactive image generating unit extracts the interactive object image and its center or outer coordinate value which are reacted by coalescing, seating, or penetrating the outer line or the outer coordinate value of the real object image among the interactive image.
The digital image signal is received from the image recognition device and transmitted to the real object detector in an image sequence, and the interactive object image and its center or outer coordinate values extracted from the interactive image generator are fed back to the real object detector. And a video library for merging and transmitting on the real object video of the video sequence.
And the real object detection unit processes the interactive object image merged with the real object image of the image sequence received from the image library as part of a real object image.
An image processing apparatus used in an interactive image processing system or an interactive image processing method,
The outer line of the real object image by dividing it from the background by using the real object image as the foreground based on the movement of the real object in the image sequence of the image signal received from the image recognition device that recognizes the image including the real object in the recognition area. Or a real object detecting unit detecting an outer coordinate value or an outer line and a coordinate value and determining and detecting a motion of the real object image having an outer edge;
An outer line of the real object image obtained from the real object detection unit, when an image of at least one interactive object is generated in response to the image of the real object according to a pre-programmed algorithm and the movement of the real object image is determined Or an interactive image generating unit generating an interactive image in which the interactive object reacts interactively with respect to an outer coordinate value; And
And an image merge processor configured to merge and process the image signal processed by the real object detector and the interactive image generated by the interactive image generator.
The interactive image generating unit is the interactive object, the center or the outer coordinate value of the interactive object, or a merged, seated or infiltrated reaction of the interactive image that is merged, seated, or penetrated to the outer line or the outer coordinate value of the real object image of the interactive image. Or extract the outer coordinate value of the real object image of the portion, feed back the extracted coordinate value to the real object detection unit,
The real object detecting unit calculates a difference between an outer coordinate value of the fed back real object image and an outer part of the real object image of a corresponding portion in the image newly received from the image recognition apparatus, or an outside of the fed back interactive object image. Calculates a difference between the coordinates of the actual object image corresponding to the coordinate value and the outside of the actual object image of the corresponding part of the image newly received from the image recognition apparatus;
The interactive image generating unit may be configured to have the interactive object responded to the merged, seated, or penetrated prior to the feedback according to a difference between the newly received image calculated by the real object detector and the outside of the real object image of the corresponding part. And an interactive image further comprising an image responsive to generate a change in shape, color, or shadow.

Images