JP7294667B2 - VIDEO TRANSMISSION SYSTEM, OPERATION METHOD OF VIDEO TRANSMISSION SYSTEM, AND OPERATION PROGRAM OF VIDEO TRANSMISSION SYSTEM - Google Patents

Description

The present system relates to techniques, methods, and the like for secure video transmission.

During maintenance work, remote work support using smart devices including wearable devices such as smart glasses has been put into practical use. With this remote work support, workers and supporters (supervisors) can share the work status in real time, so work can be done quickly and accurately. Many effects can be expected, such as an increase is expected.

However, if the target device for maintenance work is in a data center or office, for example, there is a risk that confidential information will be reflected in the image. In some cases, remote work support using smart devices could not be applied.

In Patent Document 1, an image captured by a mobile terminal and an image stored in advance (an image that can be distributed) are collated and compared, and parts that do not match are masked before being distributed to a remote supporter. It states that work can be carried out while ensuring security.

JP 2018-036812 A Japanese Patent Application Laid-Open No. 2005-277680 JP 2010-193227 A JP 2017-108263 A Japanese Patent Application Laid-Open No. 2010-238098

In addition, each disclosure of the above prior art documents is incorporated into this document by reference. The following analysis was made by the inventors.

As described above, by masking the image based on the image of the part that can be delivered, it is possible to deliver the image to the remote support person or the like while ensuring security.

However, with the technique disclosed in Patent Document 1, it is necessary to register images of maintenance work devices that can be distributed in advance. In addition, when performing work, it is not possible to perform work efficiently without distributing videos from various angles and sharing information. In other words, in Patent Literature 1, when many devices are to be maintained, it is necessary to register images captured from multiple angles for each model in advance, which requires a great deal of time and effort in setting up in advance. If there is an omission in registration and the image at a specific angle is not registered, the image cannot be shared with the remote supporter, and there is a danger that the work will not be able to proceed smoothly. have a nature.

In one aspect of the present invention, a video transmission system that can select a spatial area that can be distributed according to the environment in which the maintenance target exists, and contributes to security-ensured distribution by masking the area other than the selected area. , an operation method of a video transmission system, and an operation program of the video transmission system.

According to a first aspect of the present invention, there is provided a video transmission system having a mobile terminal and a wearable terminal, wherein the mobile terminal includes a position information acquisition unit for acquiring position information and a a selected area information generating unit that generates selected area information specifying a selected area in which a spatial area including an object is selected; a transmitting unit that transmits the acquired position information and the selected area information to the wearable terminal; , the wearable terminal includes a target object image acquiring unit that acquires an object image that is an image including the object, a receiving unit that receives the position information and the selected area information from the mobile terminal, and the position an intra-target image area image generation unit that generates an intra-object image area image by mapping the selected area in the target object image using information and the selected area information; An image comprising a mask generation unit that generates a mask that makes an area other than the image invisible, a synthesis unit that synthesizes the generated mask and the object image, and an output unit that outputs the synthesized image. A transmission system is provided.

According to a second aspect of the present invention, there is provided a method of operating a video transmission system having a mobile terminal and a wearable terminal, wherein the mobile terminal acquires location information; a selection area information generating step of generating selection area information specifying a selection area in which a spatial area including an object is selected with the base point as a selected area; and transmission of transmitting the acquired position information and the selection area information to a wearable terminal. wherein the wearable terminal has a step of obtaining a target object image that is a video including the target object, and a receiving step of receiving the position information and the selected area information from the portable terminal. a step of generating an area image within an object image for generating an area image within an object image by mapping the selected area within the object image using the position information and the selected area information; a mask generation step of generating a mask for making an area other than the object image intra-area image invisible; a synthesis step of synthesizing the mask and the object image; and an output step of outputting the synthesized image. A method of operating a video transmission system is provided.

According to a third aspect of the present invention, there is provided an operation program for a video transmission system having a mobile terminal and a wearable terminal, wherein the mobile terminal performs a process of acquiring location information, and performing a process of generating selected area information specifying a selected area in which the spatial area including the target object is selected, and a process of transmitting the acquired position information and the selected area information to the wearable terminal; The wearable terminal performs a process of acquiring an object image that is an image including the object, a process of receiving the position information and the selected area information from the mobile terminal, the position information, and the selected area information. a process of mapping the selected area within the object image to generate an area image within the object image, and a process of generating a mask for making the area other than the area image within the object image invisible. , a process of synthesizing the generated mask and the object image, and a process of outputting the synthesized image are provided.

This program can be recorded in a computer-readable storage medium. The storage medium can be non-transient such as semiconductor memory, hard disk, magnetic recording medium, optical recording medium, and the like. The invention can also be embodied as a computer program product.

According to each aspect of the present invention, it is possible to select a distributable spatial area according to the environment in which the maintenance target exists, and by masking the portion other than the selected area, video that contributes to security-ensured distribution. A transmission system, a method of operating a video transmission system, and an operation program for a video transmission system are provided.

1 is a block diagram showing an example of a configuration in a video transmission system of one embodiment; FIG. 1 is a diagram showing an outline of a video transmission system according to Embodiment 1; FIG. 1 is a block diagram showing an example of the configuration of a video transmission system according to Embodiment 1; FIG. FIG. 4 is a schematic diagram for explaining an example of a method of selecting a spatial region; FIG. 4 is a schematic diagram for explaining an example of a method of selecting a spatial region; 4 is a schematic diagram for explaining mask processing in the video transmission system of Embodiment 1. FIG. 4 is a flowchart for explaining an example of processing of the video transmission system of Embodiment 1; 4 is a flowchart for explaining an example of processing of the video transmission system of Embodiment 1; 2 is a block diagram showing an example of the hardware configuration of the video transmission system of Embodiment 1; FIG.

First, an overview of one embodiment will be described. It should be noted that the drawing reference numerals added to this outline are added to each element for convenience as an example to aid understanding, and the description of this outline does not intend any limitation.

FIG. 1 shows a block diagram showing an example of the configuration of a video transmission system according to one embodiment. A video transmission system 4 of one embodiment includes a mobile terminal 1 and a wearable terminal 2 . The mobile terminal 1 includes a position information acquisition unit 11 that acquires position information, and a selected region information generation unit 12 that generates information specifying a selected region in which a spatial region including an object based on the acquired position information is selected. and a transmission unit 13 that transmits the acquired position information and selected area information to the wearable terminal. The wearable terminal 2 includes an object image acquiring unit 21 that acquires an object image that is an image including the object, a receiving unit 22 that receives the position information and the selected area information from the mobile terminal 1, and the received position information. an intra-object image area image generating unit 23 for generating an intra-object image area image by mapping a selected area in the object image using information and selected area information; A mask generating unit 24 that generates a mask that makes an area other than the area image invisible, a synthesizing unit 25 that synthesizes the generated mask and the object image, and an output unit 26 that outputs the synthesized image. have.

In the video transmission system of the above-described embodiment, position information is acquired by the mobile terminal, and selection area information is generated by accepting selection of a distributable spatial area using the acquired position information as a base point. The location information and selection area information are sent to the wearable terminal. In the wearable terminal, by mapping the selection area on the image acquired by the wearable terminal, it is possible to provide the selection area within the image (area image within the target object image). By generating a mask that renders areas other than the selected area invisible and synthesizing it with the same image, only the selected area can be seen, and other areas are masked to create an invisible image. It is possible.

The video transmission system of the above-described embodiment can select a distributable area in the target object video in which the target object is captured by selecting the spatial region based on the position information acquired by the mobile terminal. . As a result, even if the direction in which the object is photographed changes in the object image and the image of the object changes, the sameness of the object can be maintained because the spatial region including the object is selected. For this reason, it is possible to share images with a remote supporter or the like without taking multiple images of the object by changing the direction in advance, and the work can proceed smoothly.

Specific embodiments will be described in more detail below with reference to the drawings. In addition, the same code|symbol is attached|subjected to the same component in each embodiment, and the description is abbreviate|omitted.

[First embodiment]
[Outline of equipment]
FIG. 2 is a diagram showing an outline of the video transmission system of this embodiment. As shown in this figure, it has a wearable terminal and a portable terminal. The mobile terminal acquires location information. A mobile terminal designates a selected area that is a spatial area that can be delivered and that includes an object. Here, as an example, a rectangular parallelepiped space area to be selected is specified by designating the length of line segments in the X-axis, Y-axis, and Z-axis directions with the mobile terminal as the origin. The information to specify is sent to the wearable terminal together with the position information as selected area information. Based on the position information and the selection area information, the wearable terminal maps the selection area within the object image captured by the wearable terminal. The mapped image is masked and synthesized with the original object image. The image to be transmitted is generated in this way. The transmitted image is received by a remote terminal or the like, and work support can be provided from a remote location while masking the image portion that poses a security problem. Note that this outline is an example, and the video transmission system of the present embodiment is not limited to this outline.

[System configuration]
FIG. 3 is a block diagram showing an example of the configuration of the video transmission system of this embodiment. As shown in this figure, the video transmission system 4 of this embodiment has a mobile terminal 1 and a wearable terminal 2 . Note that the wearable terminal 2 may be connected to the remote terminal 3 . The mobile terminal 1 has a position information acquisition section 11 , a selection area information generation section 12 and a transmission section 13 . The wearable terminal 2 includes an object image acquisition unit 21 , a reception unit 22 , an object image inner region image generation unit 23 , a mask generation unit 24 , a synthesis unit 25 , and an output unit 26 . The remote terminal 3 has a receiving section 31 , a video output section 32 , an audio input/output section 33 and a transmitting section 34 .

An example of the mobile terminal 1 is a smart phone. An example of the wearable terminal 2 is smart glasses.

The location information acquisition unit 11 acquires location information in the mobile terminal 1 . Positional information is information that specifies the position of a mobile terminal, and can be obtained by a positioning device such as GPS. Positioning may be performed using GPS, wireless LAN radio waves, short-range wireless such as Bluetooth (registered trademark) or BLE (Bluetooth Low Energy), laser, or infrared. The acquired position information is passed to the transmission unit 13 .

The location information acquisition unit 11 does not necessarily have to be built into the mobile terminal 1 . A dedicated device that can communicate with the mobile terminal 1 may be used.

Positional information in the direction of elevation may not be obtained by positioning using GPS or the like. The height may be estimated or configured to be performed.

In the portable terminal 1, the selected area information generating unit 12 generates information specifying a selected area in which a spatial area including the object is selected based on the acquired position information. “Based on the position information” means that the mobile terminal 1, which constitutes the position information acquisition unit 11 and has acquired the position information, a device connected thereto, or the like, is used as the reference point. As illustrated in FIG. 2, the position of the mobile terminal is set as the "base point" by setting the position of the mobile terminal as the origin. The “target object” refers to a device or the like that can be photographed and transmitted, and refers to a device or the like that is not masked by mask processing. A “spatial region” refers to a spatial region such as a rectangular parallelepiped shape as illustrated in FIG. The "information specifying the selected area" may be, for example, information specifying numerical values of the lengths of line segments on the x-axis/y-axis/z-axis (30 cm, 40 cm, 50 cm). In this case, in the coordinate system with the portable terminal 1 as the origin, the selected area is the inside of a 50 cm high rectangular parallelepiped with a 30 cm×40 cm rectangle as the base.

Selection of the spatial region is not limited to the rectangular parallelepiped shape as described above, and can be specified by various methods. For example, it is possible to set the space inside a cylindrical shape as shown in FIG. In this case, it can be formed by setting the length in the z-axis direction for a circle with a radius r centered at the position of the mobile terminal 1 .

Also, if you want to share not only the target but also the work space and the layout of the target, use the position of the mobile terminal 1 placed near the target as a reference point as shown in FIG. The selected area may be a spatial area whose vertices are coordinates that are sufficiently distant from the object in the x-axis, y-axis, and z-axis directions.

The selection of the spatial area can be input to the mobile terminal 1 by touch panel operation or physical button operation, and is an input means that can arbitrarily set the range of the selected area. For example, it may be performed by inputting numerical information as described above, or it may be performed by photographing an object and directly specifying the range in the image using a touch panel, pointing device, or the like.

Information input to specify the selected area is transmitted to the portable terminal 1 as selected area information via the transmission unit 13, which will be described later.

The transmitting unit 13 transmits the position information and the selected area information acquired in the mobile terminal 1 to the wearable terminal. Specifically, position information and selected area information are transmitted using short-range radio or the like. For example, the mobile terminal 1 has a beacon function that transmits a BLE signal, and the transmission unit 13 may transmit position information and selection area information to the wearable terminal 2 using this signal. The transmitted information is received by the receiving section 22 of the wearable terminal 2 .

In addition to the above configuration, the mobile terminal 1 may have a display unit (not shown) such as a display for confirming the range and numerical values in which the region is selected.

The object image acquisition unit 21 acquires an object image, which is an image including the object, in the wearable terminal 2 . "Acquisition" includes the process of shooting an image. This includes devices such as cameras and video cards. The acquired image is sent to an object image inner area image generating unit 23 and a synthesizing unit 25, which will be described later.

The receiving unit 22 receives the location information and the selected area information from the mobile terminal in the wearable terminal 2 . The received position information and selected area information are sent to the object image intra-area image generation unit 23, which will be described later.

In the wearable terminal 2, the object image inner area image generation unit 23 maps the selected area within the object image using the received position information and the selected area information to generate an object image inner area image. do. "Mapping" means placing the selected area in the object image. Specifically, a process of calculating information specifying the arrangement of the selected area in the target object image using the position information and the selected area information is executed. Using the information specifying the arrangement of the selected regions, the mask generation unit 24, which will be described later, performs processing for generating an image used for mask generation. The generated image is sent to the mask generation unit 24 .

For the above calculation, it is possible to employ a method such as a method used in an existing technology, the so-called location-based AR (Augmented Reality) (for example, the method described in Patent Document 5) to specify the position of the object in the object image. In order to use the above method, the wearable terminal 2 may have GPS, a magnetic sensor, an acceleration sensor, an orientation sensor, etc. for specifying the position and direction of the wearable terminal 2 . In order to use this method, it is assumed that the selected area faces the camera of the wearable terminal 2 directly.

FIG. 6 is a schematic diagram for explaining the mask processing of this embodiment. The object image inner area image generation unit 23 reads the object image 61, uses the received position information and selection area information, etc. to arrange the selection area 65 in the object image, and generates the object image inner area image 62. to generate

The mask generation unit 24 generates a mask for making the area other than the generated area image within the object image invisible in the wearable terminal 2 . Specifically, a mask such as the mask image 63 in FIG. 6 is generated by cutting out the region within the object image. The generated mask image is sent to the synthesizing unit 25, which will be described later, and synthesizing processing is performed to generate an image 64 in which the spatial region other than the target object is made invisible.

The synthesizing unit 25 synthesizes the generated mask and the target object image in the wearable terminal 2 . Various methods are conceivable for synthesis, and one example is a process of overlaying a masked image on each frame of the object image.

The output unit 26 outputs the synthesized video. "Output" includes not only processing to output to various devices as video, but also processing to transmit via communication.

Note that the wearable terminal 2 may have a storage unit (not shown) that provides the acquired object video, the received position information and selected area information, and other storage areas necessary for arithmetic processing.

By connecting the wearable terminal 2 and the remote terminal 3 via a network, the video transmission system 4 makes it possible to support remote work as a remote support system while ensuring security. The remote terminal 3 has a receiving section 31 , a video output section 32 , an audio input/output section 33 and a transmitting section 34 . When audio is also being received along with the video, the audio is output from the audio input/output unit 33 .

The receiving unit 31 receives video data from the output unit 26 of the wearable terminal 2 in the remote terminal 3 . The received data is sent to the video output unit 32 and displayed as video on a device such as a display. The remote terminal 3 may have a voice input/output unit 33 and a transmission unit 34 for transmitting voice such as work instructions to the worker wearing the wearable terminal 2 .

[Process flow]
7 and 8 are flowcharts for explaining an example of processing of the video transmission system 4 of this embodiment. FIG. 7 shows the process of acquiring the position information and the selected area by the portable terminal 1, transmitting them to the wearable terminal 2, and storing them in the storage area. This process flow needs to be executed only once for one object.

First, the mobile terminal 1 acquires position information (step S01). Next, the specification of the selection area is received (step S02). Next, select area information is generated (step S03). Next, position information and selected area information are transmitted (step S04). The wearable terminal 2 receives the position information and the selected area information sent from the mobile terminal 1 (step S05). The received position information and selected area information are stored in the storage area (step S06).

FIG. 8 shows the flow of processing in the wearable terminal 2 when performing work or the like while photographing an object with the wearable terminal 2 . As shown in this figure, first, the position information and selection area information stored in the storage area are called (step S11). Next, an object image is obtained (step S12). Next, based on the position information and the selected area information, an area image within the object image is generated (step S13). A mask is generated using the generated area image within the object image (step S14). The generated mask image and object image are synthesized (step S15). Next, the synthesized video is output (step S17). It is determined whether or not to end the photographing. If so, the process is completed. If the photographing is to be continued, the process returns to the object image acquisition process (step S12) to continue the process.

The above "video" corresponds to a "frame" in the case of a moving image. A series of processes may be performed for each frame of the object image. Alternatively, a predetermined number of frames may be used as a unit, and an intra-object image area image may be generated for each unit, a mask may be generated, and the images may be synthesized. Further, it is also possible to generate a region image within the target object image at predetermined time intervals, generate a mask, and synthesize the mask.

In addition, the video transmission system 4 of the present embodiment may combine the configurations of the mobile terminal 1 and the wearable terminal 2 into a single video transmission device.

[Hardware configuration]
Next, the hardware configuration of various devices that make up the video transmission system according to this embodiment will be described. FIG. 9 is a block diagram showing an example of the hardware configuration of the video transmission system 4 according to this embodiment.

The mobile terminal 1 and the wearable terminal 2 that constitute the video transmission system both have at least the configuration illustrated in FIG. For example, the mobile terminal 1 and the wearable terminal 2 are connected to each other by an internal bus 107, and include a CPU (Central Processing Unit) 101, a memory 102, an input/output interface 103, a wireless communication module 104 as communication means, and a position information acquisition module. A GPS module 105 for capturing images, a camera module 106 for capturing images, and the like.

However, the configuration shown in FIG. 9 is not intended to limit the hardware configuration of the mobile terminal 1 and wearable terminal 2 . The mobile terminal 1 and the wearable terminal 2 may include hardware (not shown). Also, the number of CPUs included in both terminals is not limited to the example in FIG. 9, and for example, multiple CPUs may be included in both terminals. For example, the mobile terminal 1 and the wearable terminal 2 may have various sensors such as an acceleration sensor, a magnetic sensor, and an orientation sensor, if necessary.

The memory 102 is a RAM (Random Access Memory), a ROM (Read Only Memory), an auxiliary storage device (such as a hard disk).

The input/output interface 103 is a means that serves as an interface for a display device and an input device (not shown). The display device is, for example, a touch panel display or the like. The input device is similarly a touch panel display or the like.

The functions of the mobile terminal 1 are realized by a position information acquisition program, a selected area information generation program, a transmission program, etc., which are processing modules. The wearable terminal 2 is implemented by an object image acquisition program, a reception program, an object image inner area image generation program, a mask generation program, a synthesis program, an output program, and the like. The processing module is implemented by the CPU 101 executing various programs stored in the memory 102, for example. Also, the program can be downloaded via a network or updated using a storage medium storing the program. Furthermore, the processing module may be realized by a semiconductor chip. In other words, it is sufficient if there is means for executing the functions performed by the processing module by some kind of hardware and/or software.

[Hardware operation]
First, a process of acquiring position information and a process of generating area selection information are executed before shooting is started. A position information acquisition program is called from the memory 102 by the CPU 101 and is put into an execution state. The program controls the GPS module to acquire position information P. Next, the selected area information generation program is executed by the CPU 101 and accepts the specification of the spatial area that can be transmitted via the input/output interface. If a selected area is selected by inputting numerical values (x, y, z) of the size of the spatial area from the touch panel display, the numerical values (x, y, z) become selected area information. Also, when a distributable spatial area displayed on the touch panel display is selected by a drag operation, etc., the actual length of the selected area (x, y, z ) is calculated by the CPU 101 and used as selected area information. Next, the CPU 101 executes the transmission program, and transmits the position information P and the selected area information (x, y, z) to the wearable terminal 2 via the wireless communication module 104 .

In the wearable terminal 2 , the CPU 101 is executing a reception program, and receives the position information P and the selected area information (x, y, z) transmitted from the mobile terminal 1 via the wireless communication module 104 . The received position information P and selected area information (x, y, z) are stored in the memory 102 .

When shooting is started, the CPU 101 executes the object image acquisition program, and controls the camera module 106 to acquire an image. The captured video (frame) may be temporarily stored in memory 102 .

Next, the CPU 101 executes the object image inner area image generation program, and reads the position information P, the selected area information (x, y, z) and the image frame stored in the memory 102 . Next, the program acquires the position information P and the selected area information (x, y, z), and if necessary, the position information of the wearable terminal 2 from the GPS module 105 of the wearable terminal 2 through arithmetic processing by the CPU 101, The selected area is placed in the frame of the object image, and the range (coordinates) within the image is obtained. Various acquisition methods are conceivable, but in the existing technology method, assuming that the selected area faces the camera, the position information P and the position information of the wearable terminal 2 are used to obtain P and the wearable terminal A rectangular plane determined by the relative distance calculated from the origin based on the horizontal viewing angle and vertical viewing angle of the camera of the camera module 106 of the wearable terminal 2 and the image size with a predetermined height as the center point It is possible to calculate the range (coordinates) of the selected area on the frame by performing the process of projecting the selected area upward. Based on the calculated range (coordinates), a range is specified on the frame and temporarily stored in the memory 102 as a region image within the object image.

Next, the mask generation program is executed on the CPU 101, and the intra-object image area image on the memory 102 is read. The program makes the area outside the object image area invisible as a mask area, and makes the area inside the object image area transparent to create a mask image. The mask image is temporarily stored on memory 102 .

Next, the synthesizing program is executed on the CPU 101, and the frame of the object image and the mask image stored in the memory 102 are read. The program overlays the mask image on the object image frame and temporarily stores the processed image on the memory 102 .

Next, the output program is executed on the CPU 101, and the overlaid video data stored in the memory 102 is transmitted by a wireless communication module or the like.
[Explanation of effect]

According to the video transmission system of this embodiment, it is possible to designate a selected spatial area as a distributable area by using position information and selection area information in order to limit the area where distribution is possible for security reasons. be. Performs a process to generate a mask based on a specified spatial region. As a result, even if the shooting distance or direction changes, it is possible to specify a deliveryable area with a single specification, and smooth remote support or the like is possible.

Some or all of the above embodiments may also be described as follows, but are not limited to the following.
[Mode 1]
This is the video transmission system according to the first viewpoint described above.
[Mode 2]
Preferably, the video transmission system according to form 1, wherein the selected area information generation unit selects the spatial area by inputting numerical information.
[Mode 3]
Preferably, the video transmission system according to form 1, wherein the selection area information generation unit selects the spatial area by specifying a range using a pointing device.
[Mode 4]
Preferably, the video transmission system according to any one of modes 1 to 3, wherein the selection area information generation unit defines the selection area as a spatial area within a rectangular parallelepiped or cube having a base point as a vertex.
[Mode 5]
5. Preferably, the video transmission system according to any one of modes 1 to 4, wherein the selection area information generation unit defines the selection area as a space area within a cylinder having a base or top as a circle centered on a base point.
[Mode 6]
The object image inner area image generation unit generates an object image inner area image for each predetermined number of frames of a moving image,
6. The video transmission system according to any one of claims 1 to 5, wherein said synthesizing unit synthesizes the same mask every predetermined number of frames.
[Mode 7]
The object image inner area image generation unit generates the object image inner area image at predetermined time intervals,
Preferably, the video transmission system according to any one of modes 1 to 5, wherein the synthesizing unit synthesizes the same mask every predetermined time.
[Mode 8]
a location information acquisition unit that acquires location information;
a selected area information generating unit that generates selected area information specifying a selected area in which a spatial area including an object based on the acquired position information is selected;
an object image acquisition unit that acquires an object image that is an image including the object;
an intra-target image area image generation unit that generates an intra-object image area image by mapping the selected area within the target object image using the received position information and the selected area information;
a mask generation unit that generates a mask that makes an area other than the area image within the object image invisible;
a synthesizing unit that synthesizes the mask and the target object image;
an output unit that outputs the synthesized video;
A video transmission device having
[Mode 9]
This is the method according to the second aspect above.
[Mode 10]
It is as described in the program related to the third viewpoint above.

1 mobile terminal 2 wearable terminal 3 remote terminal 4 image transmission system 11 position information acquisition unit 12 selected area information generation unit 13 transmission unit 21 target object image acquisition unit 22 reception unit 23 target object image inner area image generation unit 24 mask generation unit 25 synthesis unit 26 output unit 31 reception unit 32 video output unit 33 audio input/output unit 34 transmission unit 101 CPU
102 memory 103 input/output interface 104 wireless communication module 105 GPS module 106 camera module 107 internal bus

Claims (10)

A video transmission system having a mobile terminal and a wearable terminal,
The mobile terminal is
a location information acquisition unit that acquires location information;
a selected area information generating unit that generates selected area information specifying a selected area in which a spatial area including an object based on the acquired position information is selected;
a transmission unit that transmits the acquired position information and the selected area information to the wearable terminal;
has
The wearable terminal is
an object image acquisition unit that acquires an object image that is an image including the object;
a receiving unit that receives the location information and the selected area information from the mobile terminal;
an intra-target image region image generation unit that generates an intra-target image region image by mapping the selected region within the target object image using the position information and the selected region information;
a mask generation unit that generates a mask that makes an area other than the intra-object image area image invisible;
a synthesizing unit that synthesizes the generated mask and the target object image;
an output unit that outputs the synthesized video;
A video transmission system having 2. The video transmission system according to claim 1, wherein said selected area information generator selects said spatial area by inputting numerical information. 2. The video transmission system according to claim 1, wherein said selection area information generating section selects said spatial area by specifying a range using a pointing device. 4. The video transmission system according to any one of claims 1 to 3, wherein the selected area information generation unit uses a spatial area within a rectangular parallelepiped or cube with a base point as a vertex as the selected area. 5. The video transmission system according to any one of claims 1 to 4, wherein the selection area information generation unit uses, as the selection area, a space area within a cylinder having a bottom surface or top surface that is a circle centered on a base point. The object image inner area image generating unit generates the object image inner area image for each predetermined number of frames of a moving image,
6. The video transmission system according to any one of claims 1 to 5, wherein the synthesizing unit synthesizes the same mask every predetermined number of frames. The object image inner area image generation unit generates the object image inner area image at predetermined time intervals,
6. The video transmission system according to any one of claims 1 to 5, wherein the synthesizing unit synthesizes the same mask every predetermined time. a location information acquisition unit that acquires location information;
a selected area information generating unit that generates selected area information specifying a selected area in which a spatial area including an object based on the acquired position information is selected;
an object image acquisition unit that acquires an object image that is an image including the object;
an intra-target image area image generation unit that generates an intra-object image area image by mapping the selected area within the target object image using the received position information and the selected area information;
a mask generation unit that generates a mask that makes an area other than the area image within the object image invisible;
a synthesizing unit that synthesizes the mask and the target object image;
an output unit that outputs the synthesized video;
A video transmission device having A method of operating a video transmission system having a mobile terminal and a wearable terminal,
The mobile terminal is
a location information acquisition step of acquiring location information;
a selected area information generating step of generating selected area information specifying a selected area in which a spatial area including an object based on the acquired position information is selected;
a transmission step of transmitting the acquired position information and the selected area information to the wearable terminal;
has
The wearable terminal is
an object image acquisition step of acquiring an object image that is an image including the object;
a receiving step of receiving the location information and the selected area information from the mobile terminal;
an area image generation step of mapping the selected area within the object image using the position information and the selected area information to generate an area image within the object image;
a mask generation step of generating a mask for making an area other than the intra-object image area image invisible;
a synthesizing step of synthesizing the mask and the object image;
an output step for outputting the synthesized video;
A method of operating a video transmission system having An operating program for a video transmission system having a mobile terminal and a wearable terminal,
The mobile terminal is
a process of acquiring location information;
a process of generating selected area information specifying a selected area in which a spatial area including an object is selected based on the acquired position information;
a process of transmitting the acquired position information and the selected area information to the wearable terminal;
and run
The wearable terminal is
a process of acquiring an object image that is an image including the object;
a process of receiving the location information and the selected area information from the mobile terminal;
a process of mapping the selected area within the target object image using the position information and the selected area information to generate an area image within the target object image;
a process of generating a mask that makes an area other than the intra-object image area image invisible;
a process of synthesizing the generated mask and the object image;
a process of outputting the synthesized video;
An operation program of the video transmission system for executing

Images