JP2015115723A - Video instruction method capable of superposing instruction picture on imaged moving picture, system, terminal, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video instruction method and the like for performing an instruction on video imaged in a camera in one terminal, from another terminal by using a picture without using a marker or a registered object picture.SOLUTION: A video instruction method includes: a first step of a first terminal sequentially transmitting a moving picture imaged by a camera to a second terminal; a second step of the second terminal displaying the received imaged moving picture on a display to allow a user to write an instruction still picture for the imaged moving picture; a third step of the second terminal transmitting the instruction still picture written by the user and an imaged still picture obtained by trimming the imaged moving picture as a still picture from the imaged moving picture in a predetermined range including the instruction still picture, to the first terminal; and a fourth step of the first terminal performing matching of the imaged moving picture imaged by the camera and the imaged still picture before superposing the instruction still picture on matched part of the imaged moving picture to display it on the display.

Description

  The present invention relates to a technique of online video service between terminals.

  In recent years, with the spread of terminals such as smartphones and tablets, online video services via a network have been provided between geographically distant terminals (see, for example, Non-Patent Document 1). According to this service, for example, as an application for field work, an image captured by a terminal of a field worker can be transmitted to a remote work manager in real time. On the other hand, the work manager can recognize the situation at the work site by video and can give an instruction by voice.

  FIG. 1 is a system configuration diagram of an online video service.

  According to the system of FIG. 1, a terminal such as a mobile phone or a smartphone transmits captured video data to the other terminal in a streaming manner via a network. In recent years, HD (High-Definition) class images can be taken even by portable devices such as portable terminals.

  According to FIG. 1, the terminal 1 is carried by a field worker (instructed person), and the video is photographed by a mounted camera. On the other hand, the terminal 2 is possessed by a work manager (instructor). Then, the terminal 1 transmits the video data to the terminal 2 in real time via the access network and the Internet. The terminal 2 can make the work manager visually recognize the situation of the field worker by reproducing the received video data on the display.

  However, there are many cases where the work manager cannot clearly give instructions to the field worker by voice alone. For example, it is desirable for a work manager to be able to instruct the on-site worker with the position of various equipment and operation parts on the site.

  Conventionally, a field worker sends a still image captured by a terminal that he / she owns to the work manager's terminal, and on the other hand, a still image on which the work manager superimposes instruction information is transmitted to the field worker's terminal. There is a technique for transmitting (see, for example, Non-Patent Document 2). As a result, the work manager can instruct the field worker using a still image other than sound.

  Also, augmented reality (AR) technology can be applied to specify a predetermined position on the video (see, for example, Non-Patent Documents 3 and 4). The position of the AR marker is identified by recognizing the AR marker from the video. Further, it is possible to use a markerless type / object recognition method for detecting an object appearing in the video from a large number of object images without using an AR marker.

"Skype", [online], [searched November 13, 2013], Internet <URL: http://www.skype.com/en/> Structural Planning Laboratory, “Remote Guideware”, [online], [searched on November 13, 2013], Internet <http://www4.kke.co.jp/guideware/> Fujitsu, "work support technology using AR", [online], [searched on November 13, 2013], Internet <http://jp.fujitsu.com/solutions/industry/nextvalue/technology/tec_ar.html > NTT Giken, "Equipment management business system using AR", [online], [searched on November 13, 2013], Internet <http://www.ntt.co.jp/journal/1302/files/jn201302042 .pdf> “Camera calibration and 3D reconstruction”, [online], [Search on December 10, 2013], Internet <http://opencv.jp/opencv-2svn/cpp/camera_calibration_and_3d_reconstruction.html> "3D Geometric Analysis", [online], [December 10, 2013 search], Internet <http://www.ieice-hbkb.org/files/02/02gun_02hen_03.pdf>

  However, according to the technique described in Non-Patent Document 2, it is necessary to fix the camera mounted on the terminal of the field worker. If the shooting position moves, the position may be different from that of the still image sent from the work manager, and the site worker may not be able to recognize the specified position for the dense equipment or operation part. .

  According to the techniques described in Non-Patent Documents 3 and 4, an AR marker on which a special pattern is printed is required to specify the position on the video on which the instruction image is superimposed. Pasting the AR marker in advance on the device or the operation part is extremely time-consuming.

  Further, according to the technique of the markerless type / object recognition method, it is necessary to register a large number of object images in advance. Of course, in the case where the object image and the object image are similar in shape, the wrong object image may be associated.

  Therefore, the present invention provides a video instruction method, system, terminal, and program capable of instructing an image captured from the camera of one terminal imagewise from the other terminal without using a marker or a registered object image. The purpose is to provide.

According to the present invention, in a video instruction method in a system in which a first terminal having a display and a camera and a second terminal having a display are connected via a network,
A first step in which a first terminal sequentially transmits a moving image captured by a camera to a second terminal;
A second step in which the second terminal displays the received captured moving image on a display and causes the user to write an instruction still image for the captured moving image;
The second terminal transmits the instruction still image written by the user and the captured still image obtained by trimming the captured moving image as a still image within a predetermined range including the instruction still image to the first terminal. Steps,
The first terminal includes a fourth step of matching the captured moving image captured by the camera with the captured still image, and displaying the instruction still image on the display by superimposing the instruction still image on the captured moving image of the matched portion. It is characterized by.

According to another embodiment of the video instruction method of the present invention,
For the fourth step,
Matching a captured moving image with projective transformation (perspective projection transformation) or posture transformation while calculating a projection transformation matrix or posture transformation matrix at the time of matching,
It is also preferable to display an image obtained by converting the instruction still image by the projection conversion matrix or the attitude conversion matrix so as to be superimposed on the captured moving image.

According to another embodiment of the video instruction method of the present invention,
Regarding the first step, it is also preferable that the first terminal transmits to the second terminal only a frame obtained by thinning the captured moving image by a predetermined time width.

According to another embodiment of the video instruction method of the present invention,
Regarding the first step, it is also preferable that the captured moving image transmits only an I (Intra-picture) frame, which is a reference for the motion compensation interframe prediction method, to the second terminal.

According to another embodiment of the video instruction method of the present invention,
Regarding the first step, it is also preferable that the first terminal sets the data rate of the I frame to a relatively high rate that is equal to or lower than the data rate of one GOP (Group Of Pictures).

According to another embodiment of the video instruction method of the present invention,
The captured still image is a feature amount image for matching or a resolution-compressed image for low data amount,
The instruction still image is also preferably a resolution-compressed image for a low data amount.

According to another embodiment of the video instruction method of the present invention,
The display mounted on the second terminal is a touch panel display,
About a 2nd step, it is also preferable that a 2nd terminal makes an instruction | indication still image the image drawn with the finger | toe to the user on the touch panel display.

According to another embodiment of the video instruction method of the present invention,
The second terminal is further connected to a touch pen input device that allows the user to draw the captured moving image displayed on the display,
About a 2nd step, it is also preferable that a 2nd terminal makes an instruction | indication still image the image drawn by the user with the touch pen.

According to another embodiment of the video instruction method of the present invention,
Regarding the fourth step, it is also preferable that the first terminal applies an AR (Augmented Reality) markerless type object recognition method.

According to the present invention, in a video instruction system in which a first terminal having a display and a camera and a second terminal having a display are connected via a network,
The first terminal is
Shooting moving image transmitting means for sequentially transmitting a moving image captured by the camera to the second terminal;
The captured moving image captured by the camera is matched with the captured still image received from the second terminal, and the instruction still image received from the second terminal is superimposed on the captured moving image of the matched portion on the display. Video display control means for displaying,
The second terminal
An instruction still image input means for displaying the received captured moving image on a display and causing the user to write an instruction still image for the captured moving image;
Instructed still image transmission means for transmitting an instruction still image written by a user and a captured still image obtained by trimming a captured moving image as a still image within a predetermined range including the instruction still image to the first terminal. It is characterized by.

According to the present invention, in a terminal equipped with a display and a camera,
Shooting moving image transmission means for sequentially transmitting a moving image captured by the camera to the counterpart terminal;
An instruction still image input means for displaying a captured moving image received from a counterpart terminal on a display and for allowing a user to write an instruction still image for the captured moving image;
An instruction still image transmitting means for transmitting an instruction still image written by a user and a captured still image obtained by trimming a captured moving image as a still image within a predetermined range including the instruction still image to a counterpart terminal;
Video display that matches the captured moving image captured by the camera with the captured still image received from the other party's terminal, and superimposes the indicated still image received from the other party's terminal on the matching moving image. And a control means.

According to the present invention, in a program for causing a computer installed in a terminal equipped with a display and a camera to function,
Shooting moving image transmission means for sequentially transmitting a moving image captured by the camera to the counterpart terminal;
An instruction still image input means for displaying a captured moving image received from a counterpart terminal on a display and for allowing a user to write an instruction still image for the captured moving image;
An instruction still image transmitting means for transmitting an instruction still image written by a user and a captured still image obtained by trimming a captured moving image as a still image within a predetermined range including the instruction still image to a counterpart terminal;
Video display that matches the captured moving image captured by the camera with the captured still image received from the other party's terminal, and superimposes the indicated still image received from the other party's terminal on the matching moving image. A computer is made to function as a control means.

  According to the video instruction method, system, terminal, and program of the present invention, it is possible to give an image instruction from the other terminal to the video captured by the camera of one terminal without using a marker or a registered object image. it can.

1 is a system configuration diagram of an online video service. FIG. It is a sequence diagram in the present invention. It is explanatory drawing showing the flame | frame of the picked-up moving image in this invention. It is the screen figure which displayed the image image | photographed by the 1st terminal on the display of the 2nd terminal. It is a screen figure in which the instructor has written the instruction into the second terminal. It is explanatory drawing showing an instruction | indication still image and a picked-up still image. It is a screen figure of the 1st terminal by which the instruction | indication still image was superimposed and displayed on the part of the picked-up still image. FIG. 8 is a screen diagram of the first terminal when the shooting position with respect to the shooting target object is rotated in parallel with respect to FIG. 7. FIG. 8 is a screen diagram of the first terminal when the shooting position with respect to the shooting target is projected and moved with respect to FIG. 7. It is a functional block diagram of a 1st terminal and a 2nd terminal. FIG. 3 is a functional configuration diagram of a dual-purpose terminal equipped with both functions of a transmission side and a reception side.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.

  According to the present invention, the “photographed still image” (predetermined range) that is a key for matching is automatically set for application of the AR markerless type / object recognition method.

  FIG. 2 is a sequence diagram in the present invention.

  According to FIG. 2, a terminal 1 (instructed terminal) having a display and a camera and a terminal 2 (indicating terminal) having at least a display are connected via a network. The display and camera may be preinstalled in the terminal or may be connected to the outside.

[First Step S1] The terminal 1 sequentially transmits moving images captured by the camera to the terminal 2. For example, the terminal 1 operated by a work site worker (instructed person) captures a work situation (object) as a moving image (video). Here, it is preferable that only “frames thinned out by a predetermined time width” are transmitted as the “captured moving image”. In other words, by making the moving image “a flip image”, the instructor operating the terminal 2 can easily recognize the captured moving image.

  FIG. 3 is an explanatory diagram showing a frame of a captured moving image according to the present invention.

  According to FIG. 3A, for example, in the case of Motion JPEG, the captured moving image is obtained by JPEG compression of all the frames, and is simply thinned out with a predetermined time width.

  According to FIG. 3B, for example, in the case of a motion compensation inter-frame prediction method, a plurality of frames are configured in units of GOP (Group Of Pictures). A GOP is generally composed of one I (Intra-picture) frame, a plurality of P (Predictive-picture) frames, and a B (Bidirectionally-picture) frame. According to the present invention, only an I (Intra-picture) frame is extracted as a captured moving image. That is, only a frame in which the entire image is encoded is transmitted as a flip image.

  It is also preferable to set the data rate of the I frame to a relatively high rate that is equal to or lower than the data rate of one GOP. For example, the data rate of one I frame can be made the same as the GOP data rate. Thereby, it is possible to increase the resolution of one flip image in the captured moving image, and to easily recognize the captured moving image in detail for the instructor who operates the terminal 2.

[Second Step S2] The terminal 2 displays the received captured moving image on the display and causes the user to write an “instructed still image” for the captured moving image.

  FIG. 4 is a screen diagram in which an image captured by the first terminal is displayed on the display of the second terminal.

  According to FIG. 4, on the terminal 2 possessed by the work manager (instructor), the scene situation photographed by the terminal 1 operated by the work site worker (instructed person) is displayed as a moving image (para image). Is done. In addition, a “write instruction” button is clearly shown in the upper right of the display of the terminal 2. The instructor can stop a single image as a target by pressing the “instruction writing” button while the captured moving image sequentially proceeds as a flip image.

  FIG. 5 is a screen diagram in which the instructor writes an instruction on the second terminal.

  According to FIG. 5, the display mounted on the terminal 2 is a touch panel display. Therefore, the terminal 2 can set an image drawn by a user's finger on the touch panel display as an instruction still image. Here, the user draws “← here” by inserting the key [R] portion of the keyboard.

  As another embodiment, the terminal 2 may be further connected to a touch pen input device that allows a user to draw a captured moving image displayed on a display. In this case, the terminal 2 can use the image drawn by the user with the touch pen as the designated still image.

[Third Step S3] The terminal 2 extracts the following two still images and transmits them to the terminal 1.
“Instructed still image”: Still image written by the user “Captured still image”: Still image obtained by trimming a captured moving image as a still image within a “predetermined range” including the indicated still image

  FIG. 6 is an explanatory diagram showing an instruction still image and a captured still image.

(S31) The “predetermined range” of the captured still image is automatically set to a predetermined range of, for example, a rectangular shape so as to include the instruction still image.

  As will be described later, the “photographed still image” is used as a “key image” for image matching. Therefore, the captured still image does not need to be the image itself, and may be a feature amount image for matching. The feature amount image is a feature amount calculated from a local region of the image, and is extracted from a local region such as an edge or a corner in the image, for example. Typically, for example, SIFT (Scale-Invariant Feature Transform) or SURF (Speeded Up Robust Features) is used. In addition, a binary feature amount that is excellent in calculation cost can also be used. Further, it may be a locally cut out image (patch) for performing matching by SSD (Sum of Squared Difference) or normalized cross correlation (NCC).

  Furthermore, the “photographed still image” and the “instructed still image” may be resolution-compressed images for a low data amount. These images do not need to be bitmap format images, and may be compressed images such as JPEG.

(S32) According to FIG. 5, a “command transmission” button is clearly shown in the upper right of the display of the terminal 2. After writing the instruction still image, the user presses the “instruction transmission” button, thereby transmitting “instruction still image” and “captured still image” to the instructed terminal 1.

[Fourth Step S4] The terminal 1 matches the “captured moving image” (captured preview video) captured by the camera with the “captured still image” received from the terminal 2. Since the captured moving image is constantly moving, the tracking process for matching with the captured still image is always executed. Then, the “instruction still image” is superimposed on the captured moving image of the matching portion and displayed on the display. Specifically, an AR markerless type / object recognition method is applied.

  According to FIG. 6, the “captured still image” is matched with the captured moving image while projective conversion (perspective projection conversion) or posture conversion is performed (for example, see Patent Documents 5 and 6). When matching is performed, the “projection transformation matrix” or “posture transformation matrix” is calculated. Then, an image obtained by converting the designated still image using the projection transformation matrix or the posture transformation matrix is superimposed on the captured moving image.

ｘ，ｙ：撮影静止画像におけるｘ座標及びｙ座標
ｘ'，ｙ'：マッチング先のｘ座標及びｙ座標
ｈ₁₁〜ｈ₃₃：パラメータ “Projective transformation” is obtained by further adding a projection expressing the perspective of a plane to a parallel rotational movement. For example, it is represented by the following determinant.

x, y: x-coordinate and y-coordinate in the photographed still image x ′, y ′: x-coordinate and y-coordinate of matching destination h _{11 to} h ₃₃ : parameter

Ａ：カメラの内部パラメータ
予めカメラキャリブレーションによって導出しておくことが望ましい。
しかしながら、実際の値とずれた場合であっても、最終的に姿勢行列と打ち消
し合うために、重畳表示の位置には影響しない。そのため、本発明の利用用途
の場合、一般的なカメラの値で代用することができる。
Ｒ（r11〜r33）：３次元空間内の回転を表すパラメータ
各パラメータは、オイラー角の表現によって３パラメータで表現可能である。
ｔ（t1〜t3）：３次元空間内の平行移動を表すパラメータ。
ｘ，ｙ：撮影静止画像におけるｘ座標及びｙ座標
ｘ'，ｙ'：マッチング先のｘ座標及びｙ座標 “Posture transformation” is expressed as a rigid body motion in a three-dimensional space, and is represented by a posture matrix of 6 degrees of freedom. Here, the “attitude matrix” belongs to the three-dimensional special Euclidean group SE (3) and is represented by a three-degree-of-freedom three-dimensional rotation matrix and a three-dimensional translation vector. For example, it is represented by the following determinant.

A: Camera internal parameters
It is desirable to derive in advance by camera calibration.
However, even if it deviates from the actual value, it will eventually cancel out the attitude matrix.
Therefore, the superimposed display position is not affected. Therefore, the usage of the present invention
In this case, a general camera value can be used instead.
R (r11 to r33): parameter representing rotation in the three-dimensional space
Each parameter can be expressed by three parameters by Euler angle expression.
t (t1 to t3): a parameter representing translation in a three-dimensional space.
x, y: x-coordinate and y-coordinate in the captured still image x ′, y ′: x-coordinate and y-coordinate of matching destination

  FIG. 7 is a screen diagram of the first terminal in which the instruction still image is displayed superimposed on the captured still image portion. According to FIG. 7, a portion that matches the rectangular “captured still image” can be detected in the captured moving image, and the “instruction still image” is superimposed on the portion and displayed.

  FIG. 8 is a screen diagram of the first terminal when the photographing position with respect to the photographing object is moved in parallel with respect to FIG. According to FIG. 8, even when the captured moving image is rotated in parallel, the tracking process for matching is always executed. Therefore, if a portion matching the rectangular “captured still image” can be detected in the captured moving image, the “instruction still image” can be superimposed and displayed on the portion.

  FIG. 9 is a screen diagram of the first terminal when the shooting position with respect to the shooting target is moved in a projective manner in FIG. According to FIG. 9, by using projective transformation, the instruction still image is displayed in a superimposed manner following the shooting position with respect to the shooting target.

  FIG. 10 is a functional configuration diagram of the first terminal and the second terminal.

A terminal 1 as an instructed terminal has a display 13 and a camera 14 as well as connected to a network. Further, the terminal 1 includes a captured moving image transmission unit 11 and a video display control unit 12. These functional components are realized by executing a program that causes a computer mounted on the terminal 1 to function.
The captured moving image transmission unit 11 sequentially transmits captured moving images from the camera 14 to the counterpart terminal 2 (similar to S1 in FIG. 2).
The video display control unit 12 matches the captured moving image captured by the camera 14 with the captured still image received from the counterpart terminal 2. Then, the instruction still image received from the counterpart terminal 2 is superimposed on the captured moving image of the matching part and displayed on the display 13 (similar to S4 in FIG. 2).

The terminal 2 as the instruction side terminal is connected to the network and has a touch panel display 23. The terminal 2 includes an instruction still image input unit 21 and an instruction still image transmission unit 22. These functional components are realized by executing a program that causes a computer mounted on the terminal 2 to function.
The instruction still image input unit 21 displays the received captured moving image on the touch panel display 23 and causes the user to write the instruction still image corresponding to the captured moving image (similar to S2 in FIG. 2).
The instruction still image transmission unit 22 transmits the instruction still image written to the user and the captured still image obtained by trimming the captured moving image as a still image within a predetermined range including the instruction still image to the counterpart terminal 1 (see FIG. 2 and S31 and S32).

  FIG. 11 is a functional configuration diagram of a dual-purpose terminal equipped with both functions on the transmission side and the reception side.

  According to FIG. 11, the functional components in the dual-use terminal 3 are exactly the same as the functional components of the instructed terminal 1 and the instructing terminal 2 in FIG. 9. Further, these functional components are realized by executing a program that causes a computer mounted on the terminal 3 to function.

  As described above in detail, according to the video instruction method, system, terminal, and program of the present invention, the other terminal can be used for video captured by the camera of one terminal without using a marker or a registered object image. You can give an image instruction.

  Various changes, modifications, and omissions of the above-described various embodiments of the present invention can be easily made by those skilled in the art. The above description is merely an example, and is not intended to be restrictive. The invention is limited only as defined in the following claims and the equivalents thereto.

DESCRIPTION OF SYMBOLS 1 Commanded side terminal 11 Shooting moving image transmission part 12 Image | video display control part 13 Display 14 Camera 2 Instruction side terminal 21 Instruction still image input part 22 Instruction still image transmission part 23 Touch panel display 3 Dual-use terminal

Claims (12)

In a video instruction method in a system in which a first terminal having a display and a camera and a second terminal having a display are connected via a network,
A first step in which a first terminal sequentially transmits a moving image captured by the camera to a second terminal;
A second step in which a second terminal displays the received captured moving image on the display and causes the user to write an instruction still image for the captured moving image;
A second terminal transmits an instruction still image written by the user and a captured still image obtained by trimming the captured moving image as a still image within a predetermined range including the instruction still image to the first terminal. And the steps
The first terminal matches the captured moving image captured by the camera with the captured still image, and superimposes the indicated still image on the matched captured moving image and displays the fourth image on the display. And a video instruction method. For the fourth step,
Matching the captured moving image while performing projective transformation (perspective projection transformation) or posture transformation of the photographed still image, calculating a projection transformation matrix or posture transformation matrix at the time of matching,
The video instruction method according to claim 1, wherein an image obtained by converting the instruction still image by the projection transformation matrix or the attitude transformation matrix is displayed so as to be superimposed on the captured moving image.   3. The first step according to claim 1, wherein the first terminal transmits only a frame obtained by thinning out the captured moving image by a predetermined time width to the second terminal. 4. The video instruction method described in 1.   4. The first step according to claim 3, wherein the captured moving image transmits only an I (Intra-picture) frame, which is a reference for a motion compensation inter-frame prediction method, to the second terminal. 5. Video instruction method.   5. The first terminal sets the data rate of the I frame to a relatively high rate that is equal to or lower than the data rate of one GOP (Group Of Pictures) with respect to the first step. The video instruction method described in 1. The photographed still image is a feature amount image for the matching or a resolution compressed image for a low data amount,
The video instruction method according to claim 1, wherein the instruction still image is a resolution-compressed image for a low data amount. The display mounted on the second terminal is a touch panel display,
The video according to any one of claims 1 to 6, wherein in the second step, the second terminal uses the image drawn by the finger of the user on the touch panel display as an instruction still image. Instruction method. The second terminal is further connected to a touch pen input device that allows the user to draw the captured moving image displayed on the display,
7. The video instruction method according to claim 1, wherein the second terminal uses the image drawn by the user with the touch pen as an instruction still image. 8.   9. The fourth step according to claim 1, wherein the first terminal applies an AR (Augmented Reality) markerless type / object recognition method. 10. Video instruction method. In a video instruction system in which a first terminal having a display and a camera and a second terminal having a display are connected via a network,
The first terminal is
Shooting moving image transmitting means for sequentially transmitting a moving image captured by the camera to the second terminal;
The captured moving image captured by the camera is matched with the captured still image received from the second terminal, and the instruction still image received from the second terminal is superimposed on the matching captured moving image. Video display control means for displaying on the display,
The second terminal
An instruction still image input means for displaying the received captured moving image on the display and causing the user to write an instruction still image for the captured moving image;
Instructed still image transmission means for transmitting an instruction still image written by a user and a captured still image obtained by trimming the captured moving image as a still image within a predetermined range including the instruction still image to the first terminal. A video instruction system characterized by that. In a terminal equipped with a display and a camera,
Shooting moving image transmitting means for sequentially transmitting a moving image captured by the camera to the counterpart terminal;
An instruction still image input means for displaying a captured moving image received from a counterpart terminal on the display and for allowing a user to write an instruction still image for the captured moving image;
An instruction still image transmitting means for transmitting an instruction still image written by a user and a captured still image obtained by trimming the captured moving image as a still image within a predetermined range including the instruction still image to a counterpart terminal;
The captured moving image captured by the camera is matched with the captured still image received from the counterpart terminal, and the instruction still image received from the counterpart terminal is superimposed on the matched moving image and displayed on the display. A terminal having video display control means. In a program for causing a computer mounted on a terminal equipped with a display and a camera to function,
Shooting moving image transmitting means for sequentially transmitting a moving image captured by the camera to the counterpart terminal;
An instruction still image input means for displaying a captured moving image received from a counterpart terminal on the display and for allowing a user to write an instruction still image for the captured moving image;
An instruction still image transmitting means for transmitting an instruction still image written by a user and a captured still image obtained by trimming the captured moving image as a still image within a predetermined range including the instruction still image to a counterpart terminal;
The captured moving image captured by the camera is matched with the captured still image received from the counterpart terminal, and the instruction still image received from the counterpart terminal is superimposed on the matched moving image and displayed on the display. A program for a terminal, which causes a computer to function as video display control means.

Images