WO2020032371A1

WO2020032371A1 - Image sharing method and device

Info

Publication number: WO2020032371A1
Application number: PCT/KR2019/006916
Authority: WO
Inventors: 김용국; 조성래; 김용진; 김준세
Original assignee: 링크플로우 주식회사
Priority date: 2018-08-09
Filing date: 2019-06-09
Publication date: 2020-02-13

Abstract

The present invention relates to an image sharing method and device. The image sharing method may comprise the steps of: connecting to a relay user device on the basis of a first communication network by a target user device; and receiving image data, which has been generated through image capturing by an image processing device, by the target user device in real time on the basis of the first communication network, wherein the image processing device and the relay user device may be connected on the basis of a second communication network.

Description

Video sharing method and device

The present invention relates to an image sharing method and apparatus. More particularly, the present invention relates to a method for sharing an image between user devices by using a relay device.

An omnidirectional imaging system refers to an imaging system capable of recording image information in all directions (360 degrees) based on a specific viewpoint. It is possible to obtain a much wider field-of-view image than a conventional imaging system, and thus, in addition to research fields such as computer vision and mobile robot, surveillance systems, virtual reality systems, and pan-tilt-zoom Applications are becoming increasingly widespread in practical applications such as cameras and video conferencing.

Various methods can be used to obtain the omnidirectional image. For example, an omnidirectional image may be generated by bonding images obtained by rotating one camera based on an optical axis satisfying a single view point. Alternatively, a method of arranging a plurality of cameras in an annular structure and combining images obtained from each camera may be used. A user may generate an omnidirectional image using various omnidirectional image processing apparatuses (or omnidirectional image processing cameras or 360 degree cameras).

The omnidirectional image processing apparatus may be utilized in various areas. For example, it can be used in areas requiring surveillance of omnidirectional video such as security / security, or it can be used to record the places visited by travelers when traveling. In addition, the omnidirectional image photographed based on the omnidirectional image processing apparatus may be edited and used as an image for sale of a product.

When the image captured by the omnidirectional image processing apparatus can be immediately confirmed through the user device, the omnidirectional image processing apparatus may be used for various purposes.

Accordingly, there is a need for a technology development for utilizing omnidirectional images in various fields through various processing of omnidirectional images generated based on omnidirectional image processing apparatuses.

An object of the present invention is to solve all the above-mentioned problems.

In addition, an object of the present invention is to transmit an image (for example, an omnidirectional image) to a target user device by using a relay device such as a user device.

In addition, an object of the present invention is to allow a user of a target user device located at a far distance to receive an image captured by the image processing device in real time to share a situation at a location of the image processing device at a long distance.

In addition, an object of the present invention is to prevent network load by minimizing unnecessary image data when sharing an image, and to prevent image disconnection.

Representative configuration of the present invention for achieving the above object is as follows.

According to an aspect of the present invention, an image sharing method includes connecting a target user device to a relay user device based on a first communication network and capturing the target user device by an image processing device based on the first communication network. And receiving the generated image data in real time, wherein the image processing apparatus and the relay user apparatus may be connected based on a second communication network.

According to another aspect of the present invention, a target user device for performing image sharing includes a communication unit implemented to receive image data and a processor operatively connected to the communication unit, wherein the processor comprises a relay user device; 1 may be configured to connect based on a communication network, and receive image data generated by an image processing apparatus in real time based on the first communication network, wherein the image processing apparatus and the relay user apparatus are provided in a second manner. The connection may be based on a communication network.

According to the present invention, an image (for example, an omnidirectional image) may be transmitted to the target user device by using a relay device such as a user device.

In addition, a user of a remotely located target user device may receive an image captured by the image processing device in real time so that the situation at the location of the image processing device may be shared remotely.

In addition, network load can be reduced by minimizing unnecessary image data when sharing images, and image breakage can be prevented.

1 is a conceptual diagram illustrating a video sharing method according to an embodiment of the present invention.

2 is a conceptual diagram illustrating a method of transmitting an image based on a user device according to an embodiment of the present invention.

3 is a conceptual diagram illustrating a method of transmitting an image based on a user device according to an embodiment of the present invention.

4 is a conceptual diagram illustrating a method of transmitting an image through a user device according to an embodiment of the present invention.

5 is a conceptual diagram illustrating a method of transmitting an image through a user device according to an embodiment of the present invention.

6 is a conceptual diagram illustrating a method of checking an image through a user device located at a far distance according to an embodiment of the present invention.

7 is a conceptual diagram illustrating a method for receiving an image of a specific field of view selected by a target user according to an embodiment of the present invention.

8 is a conceptual diagram illustrating a method of checking an image in a target user device according to an embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION The following detailed description of the invention refers to the accompanying drawings that show, by way of illustration, specific embodiments in which the invention may be practiced. These embodiments are described in sufficient detail to enable those skilled in the art to practice the invention. It is to be understood that the various embodiments of the invention are different but need not be mutually exclusive. For example, certain shapes, structures, and characteristics described herein may be implemented with changes from one embodiment to another without departing from the spirit and scope of the invention. In addition, it is to be understood that the location or arrangement of individual components within each embodiment may be changed without departing from the spirit and scope of the invention. Accordingly, the following detailed description is not to be taken in a limiting sense, and the scope of the present invention should be taken as encompassing the scope of the claims of the claims and all equivalents thereof. Like reference numerals in the drawings indicate the same or similar elements throughout the several aspects.

Hereinafter, various preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement the present invention.

Hereinafter, in the embodiment of the present invention, for convenience of explanation, it is assumed that the image processing apparatus is an omnidirectional image processing apparatus, and that an image captured by the image processing apparatus is an omnidirectional image.

However, in the image sharing method and apparatus according to the embodiment of the present invention, the image processing apparatus may include not only an omnidirectional image processing apparatus but also various types of image processing apparatuses. It may include an image of an angle of view.

In FIG. 1, a method for transmitting an image (eg, an omnidirectional image) captured by an image processing apparatus (eg, an omnidirectional image processing apparatus) to a target user device through a relay user device is disclosed. The target user device may be a device that is not directly connected to the image processing device and receives an image captured by the image processing device.

Referring to FIG. 1, a relay user may wear the image processing apparatus 100 and carry the relay user apparatus 110.

It is assumed that the image processing apparatus according to the embodiment of the present invention is a wearable image processing apparatus that may be worn by a relay user in the form of a neckband. However, not only the wearable image processing apparatus but also various other image processing apparatuses may be included in the image processing apparatus according to the embodiment of the present invention. In addition, the image processing apparatus may include not only an image processing apparatus for capturing a 360 degree image, but also an image processing apparatus for capturing an image having a lower angle of view.

For convenience of explanation, it is assumed that the relay user wears the image processing apparatus 100 and carries the relay user apparatus 110. However, the relay user wearing the image processing apparatus 100 and the relay user apparatus 110 carry the same. The users can be different.

The target user may carry the target user device 120 and receive an image captured by the image processing device 100. For convenience of description, it is assumed that one user wears the image processing apparatus 100 and carries the relay user apparatus 110, but the user and the relay user apparatus 110 wearing the omnidirectional image processing apparatus 100 are used. Carrying users may be different.

Omni-directional image data generated by the image processing apparatus 100 may be transmitted to the target user device 120 through the relay user device 110.

The target user may check the omnidirectional image of the current situation of the relay user at a distance through the target user device 120.

In FIG. 2, an image checking method based on a target user device is disclosed. The communication procedure disclosed in FIG. 2 is one example, and various other methods may be utilized to identify an image through the target user device. As described above, the image processing apparatus may include an omnidirectional image processing apparatus, and the image may include an omnidirectional image.

Referring to FIG. 2, the image processing apparatus 200 may operate.

A first communication connection may be performed between the image processing apparatus 200 and the relay user device 210. For example, the relay user device 210 may act as a router based on a function such as a hot spot. The image processing apparatus 200 may be combined with the relay user device 210 serving as a router.

The target user device 220 may be connected to the image processing device 200 from the outside based on port forwarding.

Port forwarding or port mapping is the process of forwarding a request for a combination of one Internet protocol (IP) address and port number combination to another while a packet crosses a network gateway, such as a router or firewall, in a computer network. State is a network address translation (NAT) technology.

For example, the relay user device 210 sets IP: PhoneA and port number: PhoneA for the image processing device 200, and through the port forwarding technology, the image processing device 200 and the target user device. 220 may be connected.

The target user device 220 may receive an image data transmitted through the image processing apparatus 200 by inputting an IP and a port number set by the relay user device. Alternatively, information about the IP and the port number is automatically transferred between the relay user device 210 and the target user device 220 through a separate application so that the target user device receives data generated by the image processing device without additional input. can do.

The target user device 220 may check an image captured by the image processing apparatus 200 transmitted based on a video transmission protocol such as a real-time streaming protocol (RTSP) scheme.

Port forwarding and real-time streaming protocol (RTSP) schemes are examples, and sharing of images may be performed in various ways.

That is, in the image sharing method according to the embodiment of the present invention, the target user device connects to the relay user device based on the first communication network, and the target user device is captured by the image processing device based on the first communication network. The method may include receiving the generated image data in real time, but the image processing apparatus and the relay user apparatus may be connected based on the second communication network.

In this case, the first communication network is generated based on IP and port information set by the relay user device of the target user device based on port forwarding, and the second communication network is a hot spot of the relay user device. Can be generated based on functionality.

In FIG. 3, a method of performing communication between an image processing device and a user device through at least one access point (AP) is disclosed.

Referring to FIG. 3, the image processing apparatus 300 (eg, the omnidirectional image processing apparatus) may start an operation and capture an image (eg, omnidirectional image).

AP1 310 and AP2 320 may be connected in a wireless distribution system (WDS) manner.

The image processing apparatus 300 may be connected to the AP1 310, and the user device 330 may be connected to the AP2 320.

The user device 330 may input an internal IP and a port number of the image processing device 300 in the application. When the user device inputs the internal IP and the port number of the image processing apparatus 300, the user device 330 may check the image captured by the image processing apparatus in the RTSP method. The internal IP and port number of the image processing apparatus 300 may be automatically input based on the application without additional input on the user device.

In FIG. 4, a method for reducing the size of image data to be transmitted among the image transmission methods based on a user device is disclosed. Hereinafter, it is assumed that the image processing apparatus is an omnidirectional image processing apparatus and the image is an omnidirectional image (360 degree image).

Referring to FIG. 4, a method for reducing the amount of image data transmitted in real time by providing only an image corresponding to a part of an angle of view of an omnidirectional image transmitted to a relay user device to a target user device is disclosed.

The entire image data corresponding to the entire angle of view image (eg, 360 degree image) captured by the image processing apparatus may be transmitted to the relay user apparatus directly connected to the image processing apparatus.

However, the image checked by the target user device may be an image of a part of the angle of view that the target user is interested in, not the entire angle of view image. Therefore, the image data transmitted by the relay user device may be transmitted not the entire field of view image data but only partial image data 450 for a partial field of view of interest by the target user. In this way, the burden on the communication network is reduced, and unnecessary data dropping due to the data load can be prevented.

The target user device may transmit the image information 400 of the output image currently output by the target user device to the relay user device through the application. The image information 400 may include information about an output image angle of view output by the target user device.

For example, if the target user device outputs an image corresponding to an angle of view of -30 degrees to +30 degrees based on a reference point (0 degree point) set among 360 degree images, the image information 400 is -30 degrees to ++. Information indicating a 30 degree angle of view may be included as output image angle of view information. The target user device may transmit the image information 400 to the relay user device.

The relay user device may receive the image information 400 and determine the partial image data 450 to be transmitted to the target user device based on the image information.

For example, the relay user device may further include the target user device up to the reference image area 420 determined based on the output image angle information included in the image information 400 and the peripheral image area 440 of the reference image area 420. Can be sent to.

For example, the reference image area 420 may be an image area of an angle of view of -30 degrees to 30 degrees indicated by the target user device, and the peripheral image area 440 is an image area of an angle of view of -30 degrees to +30 degrees. It may be a peripheral image area (eg, an image area of -60 degrees to -30 degrees, +30 degrees to +60 degrees) 440 extended based on the threshold.

According to an exemplary embodiment of the present invention, a threshold percentage for determining the surrounding image area may change according to the communication state / frequency of screen movement of the user. As the communication state is relatively good, the threshold percentage may be relatively increased. As the communication state is relatively good, the threshold percentage may be relatively decreased.

In addition, as the screen movement frequency of the user of the target user device is relatively increased, the threshold percentage may be relatively increased, and as the screen movement frequency of the user of the target user device is relatively small, the threshold percentage may be relatively decreased.

The original image data captured and generated by the image processing apparatus are image data of a first angle of view, the image data is image data of a second angle of view, and the first angle of view is greater than the second angle of view, and the second angle of view is the target user device. Can be determined by.

The target user device generates image information, the image information includes output image angle information indicating a second angle of view, the output image angle of view information includes information on an output image angle of view to be output from the target user device, and output image The angle of view may be determined based on the direction or absolute direction of the image processing apparatus.

In FIG. 5, a method for reducing the size of image data to be transmitted among the image transmission methods based on a user device is disclosed. Hereinafter, it is assumed that the image processing apparatus is an omnidirectional image processing apparatus and the image is an omnidirectional image (360 degree image).

Referring to FIG. 5, the image information 500 for reducing the size of the image data may include output image direction information, output image horizontal angle of view information, and output image vertical angle of view information.

The output image direction information may be determined by at least one camera among a plurality of cameras implemented in the image processing apparatus as information on the imaging direction of the image processing apparatus. For example, when a user wears an image processing apparatus in the form of a neck band, a specific direction (eg, a front direction of the user) captured by a specific camera included in the image processing apparatus may be an output image direction.

The output image horizontal angle of view information may indicate an angle of view in the horizontal direction based on the direction indicated by the output image direction information. When the omnidirectional image captured by the image processing apparatus is represented by one sphere, the horizontal direction may be a longitudinal direction. The output image horizontal angle of view information may include information about the horizontal angle of view selected by the target user.

The output image vertical angle of view information may indicate the angle of view of the vertical direction based on the direction indicated by the output image direction information. When the omnidirectional image captured by the image processing apparatus is represented by one sphere, the vertical direction may be a latitude direction. The output image vertical angle of view information may include information about the vertical angle of view selected by the target user.

The relay user device receives the image information 500 including the output image direction information, the output image horizontal angle of view information, and the output image vertical angle of view information, and transmits partial image data to be transmitted to the target user device based on the image information 500. 550 may be determined.

For example, the relay user device may include the reference image area 520 and the reference image area 520 determined based on the output image angle of view information, the output image horizontal angle of view information, and the output image vertical angle of view information included in the image information 500. The peripheral image area 540 may be further transmitted to the target user device.

For example, the reference image area 520 may include a first direction, an output image horizontal angle of view (-30 degrees to +30 degrees), and an output image vertical angle of view (-30 degrees to +30 degrees) indicated by the target user device. The peripheral image area 540 may extend the output image horizontal angle of view (-30 degrees to +30 degrees) by a first threshold percentage in the first direction, and output image vertical angle of view (-30 degrees to +30 degrees). ) May be an area in which the second threshold percentage is expanded.

When the target user wants to see and the angle of view changes, information about the changed direction and the changed angle of view may be transmitted from the target user device to the relay user device. In this case, the reference image area 520 and the surrounding image area 540 may be changed again.

In addition, according to an embodiment of the present invention, the first threshold percentage and / or the second threshold percentage for determining the surrounding image area 540 may be changed according to the communication state / frequency of screen movement of the user.

The relatively good communication state may relatively increase the first and / or second threshold percentages, and the relatively poor communication state may relatively decrease the first and / or second threshold percentages. .

In addition, the first threshold percentage and / or the second threshold percentage are relatively increased as the screen movement frequency of the user of the target user device is relatively high, and the first threshold percentage is relatively small as the screen movement frequency of the user of the target user device is relatively small. And / or the second threshold percentage may be relatively reduced.

In FIG. 6, a method of automatically adjusting a screen of a target user device for convenience of screen viewing of a remotely located user device is disclosed.

Referring to FIG. 6, an image captured by the image processing apparatus may be delivered to the target user apparatus through the relay user apparatus or the AP as described above.

After receiving the omnidirectional image, the target user device may provide an image to the target user based on a reference point set by the target user.

If the image processing apparatus continuously moves by the movement of the user wearing the image processing apparatus, the user sharing the image may feel dizzy. Therefore, an image may be provided to the target user device based on the reference point 600 set by the target user.

For example, the reference point 600 may be set such that an image of a specific direction, a specific horizontal angle of view, and a specific vertical angle of view is positioned in the middle of the display of the target user device. In this case, even when the position of the image processing apparatus changes or is shaken, an image maintaining a specific horizontal / vertical angle of view and a specific direction may be provided on the target user device.

In detail, the target user may set a specific direction and a specific horizontal / vertical angle of view in the omnidirectional image reproduced on the target user device. For example, a target user sets a direction and a horizontal / vertical angle of view in an omnidirectional image by using a touch screen on the target user device, and generates a specific touch through the user interface to output the image direction information 620 and outputs the image. The image angle of view information 640 may be generated as the screen setting information.

The target user device may output an image indicated by the screen setting information of the omnidirectional image on the target user device. For example, the user sets a horizontal angle of view of -60 degrees to +60 degrees, a vertical angle of view of -45 degrees to +45 degrees based on the reference point 600, and sets an x direction based on the image processing device as a selection direction. In one case, a screen determined based on the screen setting information among the omnidirectional images may be output. That is, only a specific region of the omnidirectional image may be output on the target user device, and through this method, the target user device may continuously receive a screen of a specific field of view regardless of the real-time movement of the image processing device.

In FIG. 7, when a screen of a specific field of view to be tracked by a target user is selected, a method for extracting direction and angle of view information on the screen of the field of view is disclosed. This may be applied to a method of determining the output image direction information, the output image horizontal angle of view information, and the output image vertical angle of view information described above with reference to FIGS. 4 and 5.

Referring to FIG. 7, the output image direction information may be determined by matching the omnidirectional image and the selected image (step S710).

Direction information may be determined based on the selection screen.

The omnidirectional image image may be shaped like a sphere, and the output image direction in the omnidirectional image image may be set in various ways.

For example, the output image direction may be generated based on the imaging directions of the plurality of cameras implemented in the image processing apparatus. Assuming that the image processing apparatus is at the center of the sphere, the direction information of 360 degrees may be determined based on the direction of the imaging line of the first camera of the image processing apparatus. The output image direction information may be determined based on which of 360 degrees the direction of the selection screen selected by the user indicates. The imaging line may be a leader line in the direction indicated by the center of the camera lens.

Alternatively, the output image direction may be a direction relatively determined based on a specific direction (for example, north) rather than the direction of the image processing apparatus.

The output image horizontal angle of view information / output image vertical angle of view information may be determined by matching the omnidirectional image with the selection screen (step S720).

Also, the output image horizontal angle of view information and the output image vertical angle of view information may be determined as the horizontal angle of view and the vertical angle of view based on the output image direction. The horizontal angle of view may be in the longitudinal direction on the sphere, and the vertical angle of view may be in the latitude direction on the sphere.

Based on the maintenance of the output image direction, the output image horizontal angle of view, and the output image vertical angle of view, the target user may be provided with a similar range of view despite the movement of the image capturing apparatus.

The image direction selected by the user may be set based on an absolute position (for example, north), or may be set to a relative position (front of the user, first camera image pickup line, etc.). When the absolute position is selected as the image direction, the image for the specific direction may be continuously provided regardless of the direction change of the user wearing the image processing apparatus. On the contrary, when the relative position is selected in the image direction, the image reflecting the change of the direction of the user wearing the image processing apparatus may be continuously provided.

In addition, according to an embodiment of the present invention, the image output from the target user device may be changed in consideration of the change of direction of the target user device. For example, when the target user device returns to 30 degrees to the left based on the sensor of the target user device, the angle of view of the screen output from the current target user device is adjusted by -30 degrees to further reflect the movement of the target user device. The screen output from the user device can be determined

In addition, according to an embodiment of the present invention, the target user device may also provide a function of rotating the captured image. After capturing the omnidirectional image provided in real time, the omnidirectional image may be rotated on a touch basis, and a variety of angles of view and time that the target user did not check according to the rotation may be provided. As described above, when only some of the reference image area and the surrounding image area are provided, omnidirectional image data related to the entire captured image may be transmitted to the target user device after the capture. When the omnidirectional image is provided in real time, if the target user resets the capture function, the omnidirectional image of the time after the reset may be provided to the target user again.

In FIG. 8, a method of recommending a region of interest to a target user device is disclosed. In FIG. 8, it is assumed that the image processing apparatus is an omnidirectional image processing apparatus and the image is an omnidirectional image.

Referring to FIG. 8, a recommendation screen may be provided to the target user device so that the target user may receive images of various angles of view. For example, when the target user is currently provided with a screen having an angle of view of -30 degrees to +30 degrees as the selection screen, a screen for another angle of view among the omnidirectional image images may be provided as the recommended screen.

For example, the relay user apparatus or the image processing apparatus may determine an angle of view in which a lot of change occurs and provide a screen for the angle of view to the target user as a recommendation screen.

Alternatively, according to an embodiment of the present invention, an optimal view to be provided to the target user may be found and provided to the target user.

According to the exemplary embodiment of the present invention, the default screen 850 may be provided to the target user with the same view as that of the user wearing the omnidirectional image processing apparatus. According to the operation of the omnidirectional image processing apparatus wearer (or the current state 800), the field of view of the omnidirectional image processing apparatus wearer may be changed, and the field of view of the omnidirectional image processing apparatus wearer may be changed according to the operation of the omnidirectional image processing apparatus wearer. May provide a more natural default screen 850 to the target user through learning about the change.

In detail, the current state 800 of the user wearing the omnidirectional image processing apparatus may be determined. The user who wears the omnidirectional image processing apparatus (hereinafter, the wearer of the omnidirectional image processing apparatus) may determine whether to stand, sit, move, or climb the stairs. Determination of an operation (or current state 800) of the wearer of the omnidirectional image processing apparatus may be performed based on a sensor implemented in the omnidirectional image processing apparatus. Alternatively, the determination of the operation (or the current state 800) of the wearer of the omnidirectional image processing apparatus may be performed based on the image change in the omnidirectional image processing apparatus.

Learning of the wearer of the omnidirectional image processing apparatus (or the current state 800) may be performed, and a more accurate motion of the wearer of the current omnidirectional image wearing user (or the current state 800) may be determined based on the learning result. You can decide.

The default screen 850 to be provided to the current target user may be determined based on the current state 800 of the wearer of the omnidirectional image processing apparatus. For example, in the omnidirectional image processing apparatus used as an example in the present invention, when the wearer of the omnidirectional image processing apparatus is standing, the image line reference of the first camera is based on the front surface of the wearer of the omnidirectional image processing apparatus. The 60- + 60 degree direction may be the same as that of the current omnidirectional image processing device wearer. In this case, the view of the wearer of the omnidirectional image processing device and the view of the wearer of the omnidirectional image processing device according to the current state 800 are reflected, so that the field of view of the forward image processing device wearer is the same as or similar to that of the front image processing device wearer. The corresponding screen may be provided as the default screen 850 to the target user device. The determination of the default screen 850 may be performed by at least one of the omnidirectional image processing apparatus, the relay user apparatus, and the target user apparatus. When determined by the relay user device or the target user device, the current state 800 of the wearer of the omnidirectional image processing apparatus is determined based on the motion sensing information transmitted by the omnidirectional image processing apparatus and the screen change of the omnidirectional image processing apparatus. And provide a default screen 850.

Embodiments according to the present invention described above can be implemented in the form of program instructions that can be executed by various computer components, and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. The program instructions recorded on the computer readable recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software field. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks. medium) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. Hardware devices may be modified with one or more software modules to perform the processing according to the present invention, and vice versa.

Although the present invention has been described by specific matters such as specific components and limited embodiments and drawings, this is only provided to help a more general understanding of the present invention, and the present invention is not limited to the above embodiments. Those skilled in the art can make various modifications and changes from this description.

Therefore, the spirit of the present invention should not be limited to the above-described embodiments, and the scope of the spirit of the present invention is defined not only in the claims below, but also in the ranges equivalent to or equivalent to the claims. Will belong to.

Claims

In the video sharing method,

Connecting the target user device to the relay user device based on the first communication network; And

Receiving, by the target user device, image data generated by the image processing apparatus based on the first communication network in real time;

And the image processing device and the relay user device are connected based on a second communication network.
The method of claim 1,

The first communication network is generated based on port information and IP (internet protocol) information set by the relay user device of the target user device based on port forwarding.

The second communication network is generated based on a hotspot function of the relay user device.
The method of claim 1,

Original image data captured by the image processing apparatus and generated are image data of a first angle of view,

The image data is image data of a second angle of view,

The first angle of view is larger than the second angle of view,

And the second angle of view is determined by the target user device.
The method of claim 3,

The target user device generates image information,

The image information includes output image angle of view information indicating the second angle of view,

The output image angle of view information includes information on an output image angle of view to be output from the target user device.

The output image angle of view is determined based on the direction or absolute direction of the image processing apparatus.
The target user device performing the video sharing,

A communication unit implemented to receive image data; And

Includes a processor operatively connected with the communication unit,

The processor is connected with the relay user device based on the first communication network,

It is implemented to receive in real time the image data generated by the image processing apparatus based on the first communication network,

And the image processing apparatus and the relay user apparatus are connected based on a second communication network.
The method of claim 5,

The first communication network is generated based on port information and IP (internet protocol) information set by the relay user device of the target user device based on port forwarding.

And wherein the second communication network is generated based on a hot spot function of the relay user device.
The method of claim 5,

Original image data captured by the image processing apparatus and generated are image data of a first angle of view,

The image data is image data of a second angle of view,

The first angle of view is larger than the second angle of view,

The second angle of view is determined by the target user device.
The method of claim 7, wherein

The target user device generates image information,

The image information includes output image angle of view information indicating the second angle of view,

The output image angle of view information includes information on an output image angle of view to be output from the target user device.

The output image angle of view is determined based on the direction or absolute direction of the image processing apparatus target user device.