JP2006129087A - Video image communication system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a video image communication system which can alleviate the degree of a trouble for a part that there is the trouble when a real video image is transmitted to a partner as it is, such as one's face video image, a background video image, etc., and, on the other hand, which can transmit a trouble state in detail with the video image for a necessary part to a high skill person of high trouble solution capability when a trouble of a specific device occurs, etc. <P>SOLUTION: The video image communication system includes partial deformed video image composite means which makes a partial deformation video image by combining the deformed partial video image which deforms the part of a predetermined real video image with the real video image; and transmitting means which transmits the partial deformation video image to the partner. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

The present invention relates to an information processing system capable of acquiring and presenting video / audio.

  2. Description of the Related Art Conventionally, as IP networks become high-speed and broadband (broadband communication), services that provide video communication represented by videophones are gradually appearing on IP networks. In such video communication, nonverbal information such as facial expressions and gestures of the other party can be transmitted as it is by video, which makes it easier to grasp the situation of the other party, so that there is a sense of security. Some communication is possible.

  On the other hand, video transmission is efficient not only by face and gesture, but also by conveying the trouble situation as it is to high-skilled people with high trouble-solving ability, for example, when equipment trouble occurs. Problems may be solved.

  Thus, in the future, it is expected that a service that can effectively use video with a communication partner by utilizing the characteristics of broadband communication will be popularized.

Further, there is known a method of extracting a contour line from a natural image and generating a deformed image along the contour line (see, for example, Patent Document 1). In this case, the entire screen is deformed.
JP 2000-13615 A

  However, in conventional videophones, it is good to convey the situation to the other party by video, but since the face image and background image are transmitted to the other party as they are, the real face can be seen against the other party. It is embarrassed to be displayed, or if you show the inside of the room projected as the background of the face image to the other party, it will cause a security problem, etc. All the objects that fall within the camera's shooting range will be transmitted as real images There are cases where it is difficult to

  On the other hand, for example, when a trouble occurs in a specific device, if the trouble situation can be conveyed in detail to a highly skilled person with high trouble-solving ability, the problem can be solved efficiently. There is a request that conflicts with this issue.

The present invention can reduce the degree of trouble for a part where trouble is caused when a real image such as a face image or background image is transmitted to the other party as it is, while a trouble of a specific device has occurred. It is an object of the present invention to provide a video communication system that can convey a trouble situation in detail to a highly skilled person with high trouble solving ability in a video about necessary parts.

  According to the first aspect of the present invention, there is provided a partial deformed image synthesizing means for creating a partially deformed image by combining a deformed partial image obtained by deforming a part of a predetermined real image with the real image, and the part. A video communication system characterized by having a transmission means for transmitting a target deformed video to the other party.

  According to a second aspect of the present invention, the partial deformed image synthesizing means stores a deformation target storage unit for storing an identification ID for identifying an area to be deformed or an area to be excluded from the deformed object, and the predetermined real image. From the deformed video and the non-deformed partial video, the deformation target extraction unit that outputs at least one of the deformed video and the non-deformed partial video, and the deformed video that outputs the deformed partial video subjected to the above deformation A video communication system comprising: a generating unit; and a deformed video synthesizing unit that synthesizes the non-deformed partial video and the deformed partial video and generates the combined partial deformed video. It is.

  The invention according to claim 3 has a deformation method specifying information storage unit storing information for specifying a method of deforming the partial video to be deformed, and the deformed video generation unit is configured to perform the deformation according to the method of deforming, The video communication system is a generating unit that performs deformation on the partial video to be deformed and outputs the deformed partial video on which the deformation has been performed.

According to a fourth aspect of the present invention, the predetermined real video is a video output from a camera.

According to the present invention, since the video is deformed with respect to a part that hinders the transmission of the real video such as the face image and the background video as it is to the other party, the degree of the trouble can be reduced, On the other hand, if a trouble with a specific device occurs, a necessary part is sent in real video to a highly skilled person with high trouble-solving ability. There is an effect that it can be transmitted.

  The best mode for carrying out the invention is the following examples.

  FIG. 1 is a block diagram showing a deformed communication system 100 that is Embodiment 1 of the present invention.

  The deformed communication system 100 includes a partial deformed video composition means 10, an input / output control unit 20, a communication control unit 30, a communication line 31, a video input camera CA1, a display device DP1, a speaker SP1, And a microphone MC1 for voice input.

  The partial deformed video synthesizing means 10 is a means for creating a partial deformed video by synthesizing a “deformed partial video” obtained by deforming a part of a predetermined real video with the real video. A unit 11, a deformation target extraction unit 12, a deformation method specifying information storage unit 13, a deformation video generation unit 14, and a deformation video synthesis unit 15.

  The deformation target storage unit 11 is a means for storing an identification ID for identifying an area to be deformed or an area not to be deformed. The identification ID is an ID formed of a triangle, a quadrangle, a star, a bar code, or the like. For example, when the star is an identification ID, a circle with a predetermined radius centered on the position of the star is A region that is deformed or a region that is not deformed may be used. In the above case, instead of using a circle as a region to be deformed or a region not to be deformed, other shapes such as a rectangle may be used as a region to be deformed or a region not to be deformed.

  The deformation target extraction unit 12 is a unit that separates a deformed video and a non-deformed partial video from a predetermined real video such as a video taken by the camera CA1, and outputs at least one of the deformed video and the non-deformed partial video. .

  The deformation method specifying information storage unit 13 stores information for specifying a method for deforming. The “deformation method” includes, for example, a method of applying a mosaic, a method of extracting an edge of an image and deforming the extracted edge, and a method of deforming by approximating with a line drawing.

  The deformation method specifying information uses any of a plurality of methods such as a method of applying a mosaic, a method of extracting an edge of an image and deforming the extracted edge, and a method of deforming by approximating with a line drawing. It is information that identifies A function necessary for actual deformation is stored in a memory provided in another part of the partially deformed video composition means 10, and a function corresponding to the specified deformation method is called and deformed.

  The deformation method specifying information storage unit 13 may store a function corresponding to the specified deformation method.

  The deformed image generating unit 14 is a means for outputting a “deformed partial image” 62 that has been deformed.

  The deformed video synthesizing unit 15 is a means for synthesizing the non-deformed partial video 51 and the deformed partial video 62 and generating the synthesized partial deformed video 70.

  In other words, the deformed video generating unit 14 is a means for deforming the partial video 52 to be deformed in the real video and outputting the “deformed partial video” 62 subjected to the deformation.

  The real video may be a video output from a camera or may be a video stored in a predetermined memory.

  The communication control unit 30 is a transmission unit that transmits the partial deformed video 70 created by the partial deformed video combining unit 10 to the other party.

  FIG. 2 is a diagram illustrating an example of the real video 50 input from the camera CA1 in the first embodiment.

  The input video 50 of the camera CA1 is all real video, and includes a non-deformation target identification ID 41 therein. When specifying the deformation target, instead of specifying the deformation target based on the position of the non-deformation target identification ID, such as a circle with a predetermined radius around the position of the non-deformation target identification ID, For the video on which the identification ID 41 is displayed, the deformation target may be specified by recognizing the image. In other words, for the video in which the non-deformation target identification ID 41 is displayed, for example, the inner area of the contour of the image recognized object and the background color (for example, blue) area of the PC screen are specified as the deformation target. Good.

  FIG. 3 is a diagram illustrating an example of a partial video 51 that is not deformed in the real video 50 in the first embodiment.

  In FIG. 3, a partial video 51 that is not deformed and a partial video 52 that is to be deformed are shown in the real video 50, and the partial video 52 that is to be deformed is hatched.

  FIG. 4 is a diagram illustrating an example of the deformed partial video 62 and the face portion 621 of the deformed partial video 62 in the first embodiment.

  FIG. 4A shows a deformed partial image 62, and shows the deformed partial image 62 by a broken line. FIG. 4B is a diagram showing a face portion 621 in the deformed partial video 62.

  FIG. 5 is a diagram illustrating a process of synthesizing the deformed partial video 62 and the non-deformed partial video 51 in the first embodiment.

  FIG. 6 is a diagram illustrating a partial deformed image 70 that is a result of the synthesis of the deformed partial image 62 and the non-deformed partial image 51 in the first embodiment.

  Next, the operation of the first embodiment will be described.

  In the deformation target storage unit 11, an identification ID (which can be identified as a predetermined mark, barcode, QR code, etc.) for identifying a region to be deformed (or a region to be excluded from the deformation target) is previously stored. Stored. In addition, the deformation method specifying information storage unit 13 stores in advance a method of deforming.

  As shown in FIG. 2, the video (real video) input from the camera CA <b> 1 is temporarily stored in the deformation target extraction unit 12. At the same time, the deformation target extraction unit 12 searches the deformation target storage unit 11 for a deformation target non-identification ID 41 indicating that the region should be excluded from the deformation target, and inputs the temporarily stored camera CA1. Compare with video.

  At this time, if the input video (real video 50) includes a non-deformation target identification ID 41 (for example, an asterisk) 41, a closed region (non-deformation partial video) including the non-deformation target identification ID 41 is included. 51) is cut out, and the cut out partial video 51 that is not deformed is transmitted to the deformed video synthesizing unit 15.

  The deformed video composition unit 15 temporarily stores the non-deformed partial video 51 transmitted from the deformation target extraction unit 12.

  On the other hand, the deformation target extraction unit 12 temporarily stores the remaining partial video 52 to be deformed in which the closed region (partial video 51 not deformed) including the non-deformation target identification ID 41 is cut out in the deformation video generation unit 14. To do.

  The deformed video generation unit 14 deforms a region to be deformed in the real video 50 according to the deformation method stored in the deformation method specifying information storage unit 13, and a part of the real video as a result of the deformation. The image 62 in which the partial image is deformed is transmitted to the deformed image synthesizing unit 15.

  The deformed video synthesizing unit 15 temporarily stores the deformed partial video 62 generated by the deformed video generating unit 14.

  Next, the deformed video composition unit 15 synthesizes the temporarily stored partial video 51 and the temporarily stored partial video 62 as shown in FIG. The partial deformed video 70 mixed with the generated video is generated, and the partial deformed video 70 is transmitted to the input / output control unit 20.

  The input / output control unit 20 temporarily stores the partial deformed video 70 output from the deformed video combining unit 15, displays the partial deformed video 70 on the display device DP 1, and transmits the partial deformed video 70 to the communication control unit 30.

The communication control unit 30 temporarily accumulates the partial deformed video 70 output from the input / output control unit 20 and transmits the partial deformed video 70 to the partner terminal via the communication line 31.

  FIG. 7 is a block diagram showing a deformation communication system 200 that is Embodiment 2 of the present invention.

  The deformation communication system 200 is an embodiment in which a user designates a deformation target using a mouse or the like, and is basically the same as the deformation communication system 100. However, in the deformation communication system 100, the deformation target storage unit 11 is used. The only difference from the deformation communication system 100 is that a deformation target instruction unit 80 and a pointing input device PD1 are provided instead.

  In the deformed communication system 200, the system corresponds to a case where a user designates a partial video 51 that is not deformed in the real image 50.

In the deformation communication system 200, when the partial video 52 to be deformed is extracted from the real video 50, the user does not use the deformation target non-identification ID 41 via the pointing input device PD1 without using the deformation target non-identification ID 41. Based on the input non-deformation target area designation information, the deformation target instruction unit 80 extracts the deformation target.

  FIG. 8 is a block diagram showing a deformed communication system 300 that is Embodiment 3 of the present invention.

  The deformation communication system 300 is an embodiment in which an area is designated by a predetermined mask pattern, and is basically the same as the deformation communication system 100. However, in the deformation communication system 100, the deformation target storage unit 11 and the deformation target storage unit 11 are deformed. The only difference from the deformation communication system 100 is that a deformation mask generation unit 90 is provided instead of the video composition unit 15.

  The deformation communication system 300 is an embodiment that realizes deformation image generation by a mask pattern.

  Further, when the deformed image is generated, the deformed image synthesizing unit 15 does not generate the deformed image, and the deformed mask generating unit 90 is based on the area information specified by the deformed target extracting unit 12 as shown in FIG. The deformed image generation mask pattern 91 generated by is temporarily stored in the deformed image generation unit 14, and the partially deformed image 70 is generated by the deformed image generation mask pattern 91. That is, the deformation target area is determined based on the area defined in the mask pattern 91.

According to the above-described embodiment, for example, the video is deformed with respect to a portion that has a problem when a real image such as a face image or a background image is transmitted to the other party as it is, so that the degree of the problem can be reduced. On the other hand, if a trouble with a specific device occurs, a necessary part is sent in real video to a highly skilled person with high trouble-solving ability. Video can be transmitted.

1 is a block diagram showing a deformation communication system 100 that is Embodiment 1 of the present invention. FIG. In Example 1, it is a figure which shows the example of the real image | video 50 input from camera CA1. In Example 1, it is a figure which shows the example of the partial image | video 51 which is not deformed among the real images | videos 50. FIG. In Example 1, it is a figure which shows the example of the deformed partial image | video 62 and the face part 621 of the deformed partial image | video 62. FIG. In Example 1, it is a figure which shows the process of synthesize | combining the partial image 62 deformed and the partial image 51 which is not deformed. In Example 1, it is a figure which shows the partial deformed image | video 70 which is a result of having synthesize | combined the partial image | video 62 deformed and the partial image 51 which is not deformed. It is a block diagram which shows the deformation | transformation communication system 200 which is Example 2 of this invention. It is a block diagram which shows the deformation | transformation communication system 100 which is Example 3 of this invention.

Explanation of symbols

11 ... Deformation target storage unit,
12 ... Deformation target extraction unit,
13: Deformation method specifying information storage unit,
14 ... Deformation picture generation part,
15 ... Deformed video composition unit,
CA1 ... Camera,
DP1 ... display device,
SP1 ... Speaker,
MC1 ... microphone,
20: Input / output control unit,
30: Communication control unit,
31 ... communication line,
41 ... non-deformable identification ID,
50 ... Real video,
51 ... Partial video that does not deform,
52 ... Partial video to be deformed,
62 ... Deformed partial video,
70… Partial deformed family image (composite video),
80 ... Deformation target instruction section,
90 ... Deformation mask generator,
91 ... A mask pattern for generating a deformed image.

Claims (4)

A partially deformed image synthesizing means for creating a partially deformed image by combining a deformed partial image obtained by deforming a part of a predetermined real image with the real image;
Transmitting means for transmitting the partial deformed video to the other party;
A video communication system characterized by comprising: In claim 1,
The partial deformed video composition means is:
A deformation target storage unit that stores an identification ID for identifying an area to be deformed or an area to be excluded from the deformation target;
A deformation target extraction unit that separates a deformed image and a non-deformed partial image from the predetermined real image, and outputs at least one of the deformed image and the non-deformed partial image;
A deformed image generating unit for outputting the deformed partial image subjected to the deformation;
A deformed image combining unit that combines the non-deformed partial image and the deformed partial image, and generates the combined partial deformed image;
A video communication system characterized in that the video communication system is characterized by comprising: In claim 2,
A deformation method specifying information storage unit storing information for specifying a method of deforming the partial video to be deformed;
The deformed video generating unit is a generating unit that performs deformation on the partial video to be deformed according to the deforming method and outputs the deformed partial video that has been deformed. . In claim 1,
The video communication system, wherein the predetermined real video is a video output from a camera.

Images