JP7006356B2 - Communication terminals, communication systems, communication methods, and programs - Google Patents

Description

The present disclosure relates to communication terminals, communication systems, communication methods, and programs.

A conference system for conducting a remote conference with a remote location via a communication network such as the Internet has become widespread. In this conference system, in a conference room where one of the parties such as attendees who hold a remote conference is present, the communication terminal of the remote conference system is used to capture and collect images and voices of the conference room such as the parties to the conference. However, these are converted into digital data and transmitted to the other party's communication terminal. As a result, it is possible to make a video call (video call) by displaying an image on the display of the other party's conference room and outputting voice through a speaker. (See Patent Document 1).

In addition, a photographing device capable of acquiring a spherical panoramic image in real time is connected to a communication terminal, and the spherical (panoramic) image acquired from this photographing device is distributed to each communication terminal of the other party, and each communication of the other party is performed. A technique is known in a terminal that sequentially performs image conversion processing from a spherical image to a rectangular plane image and displays it on a display or the like (see Patent Document 2).

Furthermore, a communication terminal and a device capable of acquiring image data in real time are placed in the office (living room) where the employee normally works, and a connection is established between the communication terminal placed at home by an employee who works remotely. There is known a system that makes it possible to constantly grasp the situation of the office and at the same time always grasp the state of employees who work remotely from the office (see Patent Document 3).

However, when the transmitted / received image data is spherical image data, the base on the receiving side of the spherical image data can display the base on the transmitting side in a wide range, so that the base on the transmitting side is highly confidential. Even things are displayed. Therefore, conventionally, from the images taken over a wide range such as panoramic images at the base on the transmitting side, a prohibited area that is not to be transmitted or displayed from the viewpoint of security etc. is specified, and the widest possible image within the viewable area. Is disclosed (see Patent Document 4).

However, in the conventional method, since the base on the receiving side of the image data may be rough, there arises a problem that the need for grasping the situation of the entire base on the transmitting side cannot be met.

The invention according to claim 1 is a communication terminal that transmits data of an all-sky image so that another communication terminal can receive the data, and is displayed when the other communication terminal displays the all-sky image. The transmission means has a transmission means for transmitting a display limiting parameter for limiting a region to a predetermined region of a part of the whole celestial sphere image so that the other communication terminal can receive the region, and the transmission means has the other transmission means. It is a communication terminal that transmits display restriction release instruction information indicating an instruction to release the restriction of the display area so that the communication terminal receives.

As described above, according to the present invention, since the base on the receiving side of the image data may be rough, it is possible to meet the needs of grasping the situation of the entire base on the transmitting side.

(A) is a left side view of the photographing device, (b) is a front view of the photographing device, and (c) is a plan view of the photographing device. It is a use image figure of a photographing apparatus. (A) is a hemispherical image (front) taken by the photographing device, (b) is a hemispherical image (rear) taken by the photographing device, and (c) is a diagram showing an image represented by the Mercator projection. (A) A conceptual diagram showing a state of covering a sphere in a Mercator image, and (b) a diagram showing a panoramic image of an omnidirectional sphere. It is a figure which showed the position of the virtual camera and a predetermined area when the whole celestial sphere panoramic image is made into a three-dimensional three-dimensional sphere. (A) is a three-dimensional perspective view of FIG. 5, (b) is a diagram showing a state in which an image of a predetermined area is displayed on the display of a communication terminal, and (c) is an enlarged part of the area of FIG. 6 (b). It is a figure which shows the new predetermined area image at the time of this. It is a figure which showed the relationship between the predetermined area information and the image of a predetermined area T. It is a figure which showed the point in 3D Euclidean space by spherical coordinates. It is a schematic diagram of the image communication system which concerns on embodiment of this invention. It is a hardware block diagram of a photographing apparatus. It is a hardware configuration diagram of a video conference terminal. It is a hardware block diagram of a communication management system and a PC. It is a hardware configuration diagram of a smartphone. It is a functional block diagram of an image communication system. It is a conceptual diagram which shows the image type management table. It is a conceptual diagram which shows the photographing apparatus management table. It is a conceptual diagram which shows the display restriction management table. It is a conceptual diagram which shows the display restriction management table. It is a conceptual diagram which shows the session management table. It is a conceptual diagram which shows the image type management table. It is a conceptual diagram which shows the all display restriction management table. It is a sequence diagram which showed the participation process to a specific communication session. It is a figure which showed the selection screen of a communication session (virtual conference room). It is a sequence diagram which shows the management process of image type information. It is a sequence diagram which shows the communication process of the image data in a video call. It is a flowchart which showed the creation process of the predetermined area image. (A) shows the case where the photographing apparatus 1a is not used, and (b) shows the case where the photographing apparatus 1a is used. An example of a screen of a video call at the base B is shown, and (a) is as it is without creating a spherical panoramic image and a predetermined area image from the image data sent from the photographing devices 1a and 1b. A display case is shown, and FIG. 28B shows a case where an omnidirectional panoramic image and a predetermined area image are created from the image data sent from the photographing devices 1a and 1b. It is a sequence diagram which shows the process of setting a display restriction parameter. It is a sequence diagram which shows the process of canceling the setting of a display restriction parameter by the request of the restricted side. It is a sequence diagram which shows the process of canceling the setting of a display restriction parameter by the request of the restriction side. This is an example of a video call screen including a notification screen. This is an example of a video call screen including an approval request screen. This is an example of a video call screen including a "release restriction" button. It is a sequence diagram which shows the process of changing the setting of a display restriction parameter by the instruction of the restriction side. This is a screen example of a video call including a change screen.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

<< Outline of Embodiment >>
<How to generate a panoramic image of the whole celestial sphere>
A method of generating a spherical panoramic image will be described with reference to FIGS. 1 to 8.

First, the appearance of the photographing apparatus 1 will be described with reference to FIG. The photographing device 1 is a digital camera for obtaining a captured image that is the basis of a panoramic image of an omnidirectional (360 °) panorama. 1 (a) is a left side view of the photographing device, FIG. 1 (b) is a front view of the photographing device, and FIG. 1 (c) is a plan view of the photographing device.

As shown in FIG. 1 (a), the photographing device 1 has a size that a human can hold with one hand. Further, as shown in FIGS. 1 (a), 1 (b), and 1 (c), the image sensor 103a and the back side (rear side) are on the front side (front side) of the upper part of the photographing apparatus 1. ) Is provided with an image pickup device 103b. These image pickup elements (image sensors) 103a and 103b are used together with an optical member (for example, fisheye lenses 102a and 102b described later) capable of capturing a hemispherical image (angle of view of 180 ° or more). Further, as shown in FIG. 1B, an operation unit 115 such as a shutter button is provided on the surface of the photographing device 1 opposite to the front side.

Next, the usage status of the photographing apparatus 1 will be described with reference to FIG. Note that FIG. 2 is an image diagram of the use of the photographing apparatus. As shown in FIG. 2, the photographing device 1 is used, for example, for the user to hold the image in his / her hand and photograph a subject around the user. In this case, two hemispherical images can be obtained by taking an image of a subject around the user by the image sensor 103a and the image sensor 103b shown in FIG. 1, respectively.

Next, the outline of the process from the image taken by the photographing apparatus 1 to the creation of the spherical panoramic image will be described with reference to FIGS. 3 and 4. 3 (a) is a hemispherical image (front side) taken by the photographing device, FIG. 3 (b) is a hemispherical image (rear side) taken by the photographing device, and FIG. 3 (c) is represented by the Mercator projection. It is a figure which showed the image (hereinafter, referred to as "Mercator image"). FIG. 4A is a conceptual diagram showing a state of covering a sphere in a Mercator image, and FIG. 4B is a diagram showing a panoramic image of an omnidirectional sphere.

As shown in FIG. 3A, the image obtained by the image pickup device 103a is a hemispherical image (front side) curved by the fisheye lens 102a described later. Further, as shown in FIG. 3B, the image obtained by the image pickup device 103b is a hemispherical image (rear side) curved by the fisheye lens 102b described later. Then, the hemispherical image (front side) and the hemispherical image (rear side) inverted by 180 degrees are combined by the photographing apparatus 1, and a Mercator image is created as shown in FIG. 3 (c).

Then, by using OpenGL ES (Open Graphics Library for Embedded Systems), as shown in FIG. 4 (a), the Mercator image is pasted so as to cover the spherical surface, and in FIG. 4 (b). An omnidirectional panoramic image as shown is created. In this way, the spherical panoramic image is represented as an image in which the Mercator image faces the center of the sphere. OpenGL ES is a graphics library used to visualize 2D (2-Dimensions) and 3D (3-Dimensions) data. The spherical panoramic image may be a still image or a moving image.

As described above, since the spherical panoramic image is an image pasted so as to cover the spherical surface, it gives a sense of discomfort to humans. Therefore, by displaying a part of the predetermined area of the spherical panoramic image (hereinafter referred to as “predetermined area image”) as a flat image with less curvature, it is possible to display the image without giving a sense of discomfort to humans. This will be described with reference to FIGS. 5 and 6.

Note that FIG. 5 is a diagram showing the positions of a virtual camera and a predetermined area when the panoramic image of the whole celestial sphere is a three-dimensional three-dimensional sphere. The virtual camera IC corresponds to the position of the viewpoint of the user who sees the panoramic image of the whole celestial sphere displayed as a three-dimensional three-dimensional sphere. 6 (a) is a three-dimensional perspective view of FIG. 5, FIG. 6 (b) is a diagram showing a predetermined area image when displayed on a display, and FIG. 6 (c) is a partial area of FIG. 6 (b). It is a figure which shows the new predetermined area image at the time of enlarging.

In FIG. 6A, the spherical panoramic image shown in FIG. 4 is represented by a three-dimensional three-dimensional sphere CS. Assuming that the spherical panoramic image generated in this way is a three-dimensional sphere CS, the virtual camera IC is located outside the spherical panoramic image as shown in FIG. The predetermined area T in the spherical panoramic image is a shooting area of the virtual camera IC, and is specified by predetermined area information indicating the shooting direction and angle of view of the virtual camera IC in the three-dimensional virtual space including the spherical panoramic image. To.

Then, as shown in FIG. 6B, the predetermined area image, which is the image of the predetermined area T shown in FIG. 6A, is an image of the photographing area of the virtual camera IC on the predetermined display. Is displayed as. The image shown in FIG. 6B is a predetermined area image represented by the initial setting (default) predetermined area information (display parameter). Hereinafter, the shooting direction (ea, aa) and the angle of view (α) of the virtual camera IC will be described.

The relationship between the predetermined area information and the image of the predetermined area T will be described with reference to FIG. 7. Note that FIG. 7 is a diagram showing the relationship between the predetermined area information and the image of the predetermined area T. As shown in FIG. 7, “ea” indicates an elevation angle, “aa” indicates an azimuth angle, and “α” indicates an angle of view (Angle). That is, the posture of the virtual camera IC is changed so that the gazing point of the virtual camera IC indicated by the shooting direction (ea, aa) becomes the center point CP of the predetermined area T which is the shooting area of the virtual camera IC. Become. The predetermined region image Q is an image of the predetermined region T in the spherical image CE. f is the distance from the virtual camera IC to the center point CP. L is the distance between an arbitrary vertex of the predetermined region T and the center point CP (2L is a diagonal line). Then, in FIG. 7, the trigonometric function generally represented by the following (Equation 1) holds.

Lf = tan (α / 2) ... (Equation 1)
Further, when a part of the predetermined area image shown in FIG. 6B is enlarged, a new predetermined area image is displayed as shown in FIG. 6C.

FIG. 8 is a diagram showing points in a three-dimensional Euclidean space based on spherical coordinates. Let (r, θ, φ) be the position coordinates when the center point CP is expressed in a spherical polar coordinate system. (R, θ, φ) are the radius, the polar angle, and the azimuth, respectively. The radius r is equal to f because it is the distance from the origin of the three-dimensional virtual space including the spherical panoramic image to the center point CP. FIG. 8 is a diagram showing these relationships. Hereinafter, the description will be made using the position coordinates (r, θ, φ) of the virtual camera IC.

<Outline of image communication system>
Subsequently, with reference to FIG. 9, the outline of the configuration of the image communication system of the present embodiment will be described. FIG. 9 is a schematic diagram of the configuration of the image communication system of the present embodiment.

As shown in FIG. 9, the image communication system of the present embodiment is equipped with an imaging device 1a, 1b, a video conference terminal 3, a communication management system 5, a PC (Personal Computer) 7, an imaging device 8, and a smartphone 9. It is configured and can communicate via a communication network 100 such as the Internet. The connection form of the communication network 100 may be either wireless or wired.

Of these, the photographing devices 1a and 1b are special digital cameras for photographing a subject, a landscape, and the like to obtain two hemispherical images that are the basis of a spherical panoramic image, as described above. On the other hand, the photographing device 8 is a general digital camera for photographing a subject, a landscape, and the like to obtain a general planar image.

The video conference terminal 3 is a terminal dedicated to video conference, and displays an image of a video call (video call) on the display 4 via a wired cable such as a USB (Universal Serial Bus) cable. The video conference terminal 3 normally shoots with the camera 312 described later, but when the video conference terminal 3 is connected to the cradle 2a to which the shooting device 1a is attached with a wired cable, the shooting device 1a has priority and becomes the source of the spherical panoramic image2. Two hemispherical images can be obtained. When a wired cable is used, the cradle 2a not only communicates between the photographing device 1a and the video conference terminal 3, but also plays a role of supplying power to the photographing device 1a and supporting the photographing device 1a. Here, the photographing device 1a, the cradle 2a, the video conference terminal 3, and the display 4 are located at the same base A. In addition, four users A1, A2, A3, and A4 are participating in the video call at the base A.

The communication management system 5 manages the communication of the video conference terminal 3, the PC 7, and the smartphone 9, and manages the types of image data (general image and special image types) to be transmitted and received. Here, the special image is a spherical panoramic image. The communication management system 5 is installed in a service company or the like that provides a video communication service. Further, the communication management system 5 may be constructed by a single computer, or may be constructed by a plurality of computers arbitrarily assigned by dividing each unit (function, means, or storage unit).

By attaching the photographing device 8 to the PC 7, a video call can be made. Here, the PC 7 and the photographing apparatus 8 are located at the base C, which is the same base. Further, at the base C, one user C participates in a video call.

The smartphone 9 displays an image of a video call on a display 917, which will be described later, provided in the own device. The smartphone 9 normally shoots with a CMOS (Complementary Metal Oxide Semiconductor) sensor 905 or the like, which will be described later, provided in its own device, but uses wireless communication technology such as Wi-Fi (Wireless Fidelity) or Bluetooth (registered trademark). Therefore, it is possible to acquire two hemispherical image data that are the basis of the all-sky panoramic image obtained by the photographing apparatus 1b. When using wireless communication technology, the cradle 2b serves only to supply power to the photographing device 1b and support the photographing device 1b. Here, the photographing device 1b, the cradle 2b, and the smartphone 9 are located at the base B, which is the same base. In addition, two users B1 and B2 are participating in the video call at the base B.

Further, the video conference terminal 3, the PC 7, and the smartphone 9 are examples of communication terminals. OpenGL ES is installed in each communication terminal, and it is possible to create predetermined area information indicating a part of the spherical panoramic image, or from the spherical panoramic image sent from another communication terminal. A predetermined area image can be created.

The arrangement of each terminal, device, and user shown in FIG. 9 is an example, and may be another example. For example, at the base C, instead of the photographing device 8, a photographing device capable of photographing a spherical panoramic image may be used. The communication terminal also includes a digital television, a smart watch, a car navigation device, and the like. Further, hereinafter, when any imaging device among the imaging devices 1a and 1b is represented, it is referred to as “photographing device 1”.

<< Hardware configuration of the embodiment >>
Next, the hardware configurations of the photographing device 1, the video conference terminal 3, the communication management system 5, the PC 7, and the smartphone 9 of the present embodiment will be described in detail with reference to FIGS. 10 to 13. Since the photographing device 8 is a general camera, detailed description thereof will be omitted.

<Hardware configuration of shooting device 1>
First, the hardware configuration of the photographing apparatus 1 will be described with reference to FIG. FIG. 10 is a hardware configuration diagram of the photographing device 1. In the following, the photographing device 1 is an omnidirectional (omnidirectional) photographing device using two image pickup elements, but the number of image pickup elements may be two or more. Further, the device does not necessarily have to be a device dedicated to omnidirectional shooting, and by attaching a retrofit omnidirectional shooting unit to a normal digital camera, smartphone, or the like, it may have substantially the same function as the shooting device 1. ..

As shown in FIG. 10, the photographing apparatus 1 includes an imaging unit 101, an image processing unit 104, an imaging control unit 105, a microphone 108, a sound processing unit 109, a CPU (Central Processing Unit) 111, and a ROM (Read Only Memory). ) 112, SRAM (Static Random Access Memory) 113, DRAM (Dynamic Random Access Memory) 114, operation unit 115, network I / F 116, communication unit 117, and antenna 117a.

Of these, the image pickup unit 101 is a wide-angle lens (so-called fisheye lens) 102a, 102b each having an angle of view of 180 ° or more for forming a hemispherical image, and two image pickups provided corresponding to each wide-angle lens. It includes elements 103a and 103b. The image pickup elements 103a and 103b are image sensors such as CMOS (Complementary Metal Oxide Semiconductor) sensors and CCD (Charge Coupled Device) sensors that convert optical images from fisheye lenses 102a and 102b into image data of electrical signals and output them. It has a timing generation circuit that generates a horizontal or vertical sync signal, a pixel clock, and the like, and a group of registers in which various commands and parameters necessary for the operation of this image sensor are set.

The image pickup elements 103a and 103b of the image pickup unit 101 are each connected to the image processing unit 104 by a parallel I / F bus. On the other hand, the image pickup elements 103a and 103b of the image pickup unit 101 are connected by a serial I / F bus (I2C bus or the like) separately from the image pickup control unit 105. The image processing unit 104 and the image pickup control unit 105 are connected to the CPU 111 via the bus 110. Further, a ROM 112, a SRAM 113, a DRAM 114, an operation unit 115, a network I / F 116, a communication unit 117, an electronic compass 118, and the like are also connected to the bus 110.

The image processing unit 104 takes in the image data output from the image pickup elements 103a and 103b through the parallel I / F bus, performs predetermined processing on each image data, and then synthesizes these image data. , Create mercatle image data as shown in FIG. 3 (c).

The image pickup control unit 105 generally uses the image pickup control unit 105 as a master device and the image pickup elements 103a and 103b as slave devices, and sets commands and the like in the register group of the image pickup elements 103a and 103b by using the I2C bus. Necessary commands and the like are received from the CPU 111. Further, the image pickup control unit 105 also uses the I2C bus to take in the status data and the like of the register group of the image pickup elements 103a and 103b and send them to the CPU 111.

Further, the image pickup control unit 105 instructs the image pickup devices 103a and 103b to output image data at the timing when the shutter button of the operation unit 115 is pressed. Depending on the photographing device 1, it may have a preview display function by a display (for example, the display of the video conference terminal 3) or a function corresponding to a moving image display. In this case, the image data is continuously output from the image pickup devices 103a and 103b at a predetermined frame rate (frames / minute).

Further, as will be described later, the image pickup control unit 105 also functions as a synchronization control means for synchronizing the output timings of the image data of the image pickup elements 103a and 103b in cooperation with the CPU 111. In the present embodiment, the photographing apparatus 1 is not provided with a display unit, but a display unit may be provided.

The microphone 108 converts sound into sound (signal) data. The sound processing unit 109 takes in the sound data output from the microphone 108 through the I / F bus and performs predetermined processing on the sound data.

The CPU 111 controls the overall operation of the photographing apparatus 1 and executes necessary processing. The ROM 112 stores various programs for the CPU 111. The SRAM 113 and the DRAM 114 are work memories, and store programs executed by the CPU 111, data in the middle of processing, and the like. In particular, the DRAM 114 stores image data during processing by the image processing unit 104 and data of processed Mercator images.

The operation unit 115 is a general term for various operation buttons, a power switch, a shutter button, a touch panel having both display and operation functions, and the like. By operating the operation buttons, the user inputs various shooting modes and shooting conditions.

Network I / F116 is a general term for interface circuits (USB I / F, etc.) with external media such as SD cards and personal computers. The network I / F116 may be wireless or wired. The Mercator image data stored in the DRAM 114 is recorded on an external medium via the network I / F 116, or transmitted to an external device such as a video conference terminal 3 via the network I / F 116 as needed. Or something.

The communication unit 117 communicates with an external device such as a video conference terminal 3 by a short-range wireless technology such as Wi-Fi or NFC (Near Field Communication) via an antenna 117a provided in the photographing device 1. The communication unit 117 can also transmit the Mercator image data to the external device of the video conference terminal 3.

The electronic compass 118 calculates the direction and tilt (Roll rotation angle) of the photographing device 1 from the magnetism of the earth, and outputs the direction / tilt information. This orientation / tilt information is an example of related information (metadata) along with Exif, and is used for image processing such as image correction of a captured image. The related information also includes the shooting date and time of the image and the data capacity of the image data.

<Hardware configuration of video conference terminal>
Next, the hardware configuration of the video conference terminal 3 will be described with reference to FIG. FIG. 11 is a hardware configuration diagram of the video conference terminal. As shown in FIG. 11, the video conferencing terminal 3 includes a CPU 301, a ROM 302, a RAM 303, a flash memory 304, an SSD 305, a media I / F 307, an operation button 308, a power switch 309, a bus line 310, and a network I / F 311. It is equipped with a camera 312, an image pickup element I / F313, a microphone 314, a speaker 315, a sound input / output I / F316, a display I / F317, an external device connection I / F318, a short-range communication circuit 319, and an antenna 319a of the short-range communication circuit 319. ing.

Of these, the CPU 301 controls the operation of the entire video conference terminal 3. The ROM 302 stores a program used for driving the CPU 301 such as an IPL (Initial Program Loader). The RAM 303 is used as a work area of the CPU 301. The flash memory 304 stores various data such as a communication program, image data, and sound data. The SSD (Solid State Drive) 305 controls reading or writing of various data to the flash memory 304 according to the control of the CPU 301. An HDD may be used instead of the SSD. The media I / F 307 controls reading or writing (storage) of data to the recording medium 306 such as a flash memory. The operation button 308 is a button operated when selecting a destination of the video conference terminal 3. The power switch 309 is a switch for switching ON / OFF of the power of the video conference terminal 3.

Further, the network I / F311 is an interface for performing data communication using a communication network 100 such as the Internet. The camera 312 is a kind of built-in imaging means for capturing an image of a subject and obtaining image data under the control of the CPU 301. The image sensor I / F 313 is a circuit that controls the drive of the camera 312. The microphone 314 is a kind of built-in sound collecting means for inputting voice. The sound input / output I / F 316 is a circuit that processes sound signal input / output between the microphone 314 and the speaker 315 under the control of the CPU 301. The display I / F 317 is a circuit that transmits image data to the external display 320 according to the control of the CPU 301. The external device connection I / F318 is an interface for connecting various external devices. The short-range communication circuit 319 is a communication circuit such as NFC (registered trademark) and Bluetooth (registered trademark).

Further, the bus line 310 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 301 shown in FIG.

The display 4 is a kind of display means composed of a liquid crystal display or an organic EL for displaying an image of a subject, an operation icon, and the like. Further, the display 4 is connected to the display I / F317 by the cable 4c. The cable 4c may be a cable for analog RGB (VGA) signals, a cable for component video, HDMI (High-Definition Multimedia Interface) (registered trademark), or DVI (Digital Video). It may be a cable for Interactive) signals.

The camera 312 includes a lens and a solid-state image sensor that converts light into a charge to digitize an image (video) of the subject, and a CMOS sensor, a CCD sensor, or the like is used as the solid-state image sensor. External devices such as an external camera, an external microphone, and an external speaker can be connected to the external device connection I / F318 by a USB (Universal Serial Bus) cable or the like. When an external camera is connected, the external camera is driven in preference to the built-in camera 312 according to the control of the CPU 301. Similarly, when an external microphone is connected or an external speaker is connected, the external microphone or the external speaker is given priority over the built-in microphone 314 and the built-in speaker 315 according to the control of the CPU 301. The external speaker is driven.

Further, the recording medium 306 has a structure that can be attached to and detached from the video conference terminal 3. Further, as long as it is a non-volatile memory that reads or writes data under the control of the CPU 301, not only the flash memory 304 but also an EEPROM (Electrically Erasable and Programmable ROM) or the like may be used.

<Communication management system, PC hardware configuration>
Next, the hardware configurations of the communication management system 5 and the PC 7 will be described with reference to FIG. FIG. 12 is a hardware configuration diagram of a communication management system and a PC. Since both the communication management system 5 and the PC 7 have the same computer configuration, the configuration of the communication management system 5 will be described below, and the description of the configuration of the PC 7 will be omitted.

The communication management system 5 includes a CPU 501 that controls the operation of the entire communication management system 5, a ROM 502 that stores a program used for driving the CPU 501 such as an IPL, a RAM 503 that is used as a work area of the CPU 501, and a program for the communication management system 5. HD504 that stores various data such as, HDD (Hard Disk Drive) 505 that controls reading or writing of various data to HD504 according to the control of CPU501, reading or writing (storage) of data to recording media 506 such as flash memory. Media drive 507 to control, display 508 that displays various information such as cursors, menus, windows, characters, or images, network I / F 509 for data communication using communication network 100, characters, numerical values, various instructions, etc. A keyboard 511 equipped with multiple keys for inputting data, a mouse 512 for selecting and executing various instructions, selecting processing targets, moving the cursor, etc., and a CD-RW (Compact Disc) as an example of a removable recording medium. -ReWritable) CD-RW drive 514 that controls reading or writing of various data to 513, and an address bus, data bus, etc. for electrically connecting each of the above components as shown in FIG. It is equipped with a bus line 510.

<Smartphone hardware configuration>
Next, the hardware of the smartphone will be described with reference to FIG. FIG. 13 is a hardware configuration diagram of a smartphone. As shown in FIG. 13, the smartphone 9 includes a CPU 901, a ROM 902, a RAM 903, an EEPROM 904, a CMOS sensor 905, an acceleration / direction sensor 906, a media I / F 908, and a GPS receiving unit 909.

Of these, the CPU 901 controls the operation of the entire smartphone 9. The ROM 902 stores a program used to drive the CPU 901 such as an IPL. The RAM 903 is used as a work area for the CPU 901. The EEPROM 904 reads or writes various data such as a smartphone program according to the control of the CPU 901. The CMOS (Complementary Metal Oxide Semiconductor) sensor 905 captures a subject (mainly a self-portrait) according to the control of the CPU 901 and obtains image data. The acceleration / orientation sensor 906 is a variety of sensors such as an electronic magnetic compass, a gyro compass, and an acceleration sensor that detect the geomagnetism. The media I / F908 controls reading or writing (storage) of data to a recording medium 907 such as a flash memory. The GPS receiving unit 909 receives a GPS signal from a GPS satellite.

Further, the smartphone 9 includes a long-distance communication circuit 911, a camera 912, an image pickup element I / F 913, a microphone 914, a speaker 915, a sound input / output I / F 916, a display 917, an external device connection I / F 918, and a short-range communication circuit 919. It includes an antenna 919a of the short-range communication circuit 919 and a touch panel 921.

Of these, the telecommunications circuit 911 is a circuit that communicates with other devices via the communication network 100. The camera 912 is a kind of built-in image pickup means for capturing an image of a subject and obtaining image data under the control of the CPU 901. The image sensor I / F 913 is a circuit that controls the drive of the camera 912. The microphone 914 is a kind of built-in sound collecting means for inputting voice. The sound input / output I / F 916 is a circuit that processes sound signal input / output between the microphone 914 and the speaker 915 under the control of the CPU 901. The display 917 is a kind of display means such as a liquid crystal display or an organic EL for displaying an image of a subject, various icons, and the like. The external device connection I / F 918 is an interface for connecting various external devices. The short-range communication circuit 919 is a communication circuit such as NFC or fBluetooth. The touch panel 921 is a kind of input means for operating the smartphone 9 by the user pressing the display 917.

Further, the smartphone 9 is provided with a bus line 910. The bus line 910 is an address bus, a data bus, or the like for electrically connecting each component such as the CPU 901.

A recording medium such as a CD-ROM in which each of the above programs is stored, and an HD in which these programs are stored can be provided as a program product in Japan or abroad.

<< Functional configuration of the embodiment >>
Next, the functional configuration of this embodiment will be described with reference to FIGS. 14 to 20. FIG. 14 is a functional block diagram of the photographing devices 1a and 1b, the video conference terminal 3, the communication management system 5, the PC 7, and the smartphone 9, which form a part of the image communication system of the present embodiment.

<Functional configuration of imaging device 1a>
As shown in FIG. 14, the photographing apparatus 1a includes a receiving unit 12a, an imaging unit 13a, a sound collecting unit 14a, a communication unit 18a, and a storage / reading unit 19a. Each of these parts is a function or means realized by operating any of the components shown in FIG. 10 by a command from the CPU 111 according to a program for a photographing apparatus developed on the DRAM 114 from the SRAM 113. Is.

Further, the photographing apparatus 1 has a storage unit 1000a constructed by the ROM 112, the SRAM 113, and the DRAM 114 shown in FIG. The storage unit 1000a stores the GUID (Globally Unique Identifier) of the own device.

(Each function configuration of the photographing device 1a)
Next, each functional configuration of the photographing apparatus 1a will be described in more detail with reference to FIGS. 10 and 14.

The reception unit 12a of the photographing apparatus 1a is realized mainly by the processing of the operation unit 115 and the CPU 111 shown in FIG. 10, and receives the operation input from the user.

The image pickup unit 13a is realized mainly by the processing of the image pickup unit 101, the image processing unit 104, the image pickup control unit 105, and the CPU 111 shown in FIG. 10, and images a landscape or the like to obtain photographed image data.

The sound collecting unit 14a is realized by the processing of the microphone 108, the sound processing unit 109, and the CPU 111 shown in FIG. 10, and collects the sound around the photographing device 1.

The communication unit 18a is mainly realized by the processing of the CPU 111, and can communicate with the communication unit 38 of the video conference terminal 3 by the short-range wireless communication technology based on the NFC standard, BlueTooth, Wi-Fi, or the like.

The storage / reading unit 19a is mainly realized by the processing of the CPU 111 shown in FIG. 10, and stores various data (or information) in the storage unit 1000a or stores various data (or information) from the storage unit 1000a. Read it out.

<Each functional configuration of the photographing device 1b>
The photographing apparatus 1b has a receiving unit 12b, an imaging unit 13b, a sound collecting unit 14b, a communication unit 18b, and a storage / reading unit 19b. Since each of these has the same functions as the reception unit 12a, the image pickup unit 13a, the sound collection unit 14a, the communication unit 18a, and the storage / reading unit 19a in the photographing apparatus 1a, the description thereof will be omitted. Further, the photographing apparatus 1 has a storage unit 1000b constructed by the ROM 112, the SRAM 113, and the DRAM 114 shown in FIG. The GUID of the own device is stored in the storage unit 1000b.

<Functional configuration of video conference terminal 3>
As shown in FIG. 14, the video conference terminal 3 includes a transmission / reception unit 31, a reception unit 32, an image / sound processing unit 33, a display control unit 34, a determination unit 35, a creation unit 36, a communication unit 38, and a storage unit. -Has a reading unit 39. Each of these parts is realized by operating any of the components shown in FIG. 11 by a command from the CPU 301 according to the program for the video conference terminal 3 developed on the RAM 303 from the flash memory 304. A function or means.

Further, the video conference terminal 3 has a storage unit 3000 constructed by the ROM 302, the RAM 303, and the flash memory 304 shown in FIG. The storage unit 3000 is constructed with an image type management DB 3001, a photographing device management DB 3002, a display restriction management DB 3003, and a display restriction management DB 3004. Of these, the image type management DB 3001 is configured by the image type management table shown in FIG. The photographing apparatus management DB 3002 is configured by the photographing apparatus management table shown in FIG. The display restriction management DB 3003 is configured by the display restriction management table shown in FIG. The display restricted management DB 3004 is configured by the display restricted management table shown in FIG.

(Image type management table)
FIG. 15 is a conceptual diagram showing an image type management table. In this image type management table, an image data ID, an IP address as an example of a destination of a source terminal, and a source name are stored and managed in association with each other. Of these, the image data ID is an example of image data identification information for identifying image data when performing video communication. The same image data ID is added to the image data transmitted from the same source terminal. As a result, the destination terminal (communication terminal on the receiving side) can specify the source terminal of the received image data. The IP address of the source terminal indicates the IP address of the communication terminal that transmits the image data indicated by the associated image data ID. The source name is a name for specifying a photographing device that outputs image data indicated by the associated image data ID, and is an example of image type information. This source name is a name created by each communication terminal such as a video conference terminal 3 according to a naming convention of a predetermined name.

For example, each of the three communication terminals having IP addresses of "1.2.1.3", "1.2.2.3", and "1.3.1.3" has an image data ID "RS001". , "RS002", "RS003" indicates that the image data indicated by "RS002" is being transmitted. Furthermore, the types of images indicated by the source name of each communication terminal are "Video_Theta", "Video", and "Video_Theta", and these image types are "special image", "general image", and "special image" in that order. It shows that it is. The special image is a spherical panoramic image here.

Data other than image data may also be managed in association with the image data ID. The data other than the image data are, for example, sound data and material data at the time of screen sharing.

(Shooting device management table)
FIG. 16 is a conceptual diagram showing a photographing apparatus management table. In this photographing apparatus management table, the vendor ID and the product ID among the GUIDs of the photographing apparatus capable of obtaining the two hemispherical images which are the sources of the spherical panoramic images are stored and managed. As the GUID, for example, a vendor ID (VID) and a product ID (PID) used in a USB device can be used. The vendor ID and the product ID are stored from the factory shipment of a communication terminal such as a video conference terminal, but may be additionally stored after the factory shipment.

(Display restriction management table)
FIG. 17 is a conceptual diagram showing a display restriction management table. In this display restriction management table, restrictions on the display of a predetermined area image are given for each IP address of the communication terminal (destination terminal) of the destination of the data of the two hemispherical images that are the source of the spherical panoramic image. It manages display restriction parameters that indicate the contents. Specifically, the display limiting parameters are set for each element of the moving diameter (r), the polar angle (θ), the azimuth angle (φ), and the viewing angle (α) shown in FIGS. 7 and 8. Shows the content that gives restrictions. For example, for a communication terminal with an IP address of "1.3.1.2", the contents set so that the viewing angle α must exceed 120 ° (cannot be 120 ° or less) are managed. There is.

(Display restricted management table)
FIG. 18 is a conceptual diagram showing a display restriction management table. In this display restricted management table, the own terminal (video conference terminal 3) is predetermined for each IP address of the communication terminal (source terminal) of the source of the data of the two hemispherical images that are the source of the panoramic image of the whole sky. It manages the display restriction parameter that indicates the content to which the display restriction of the area image is given (received). This display limit parameter is the same as the display limit parameter managed in the display limit management table.

(Each function configuration of the video conference terminal)
Next, each functional configuration of the video conference terminal 3 will be described in more detail with reference to FIGS. 11 and 14.

The transmission / reception unit 31 of the video conference terminal 3 is realized mainly by the processing of the network I / F311 and the CPU 301 shown in FIG. 11, and is realized by the communication management system 5 and various data (or information) via the communication network 100. Send and receive.

The reception unit 32 is realized mainly by processing by the operation buttons 308 and the CPU 301, and receives various selections or inputs from the user. Further, not only the operation button 308 but also a touch panel or the like may be used as another input means.

The image / sound processing unit 33 is realized by a command from the CPU 301 shown in FIG. 11, and performs image processing on the image data obtained by the camera 312 taking an image of the subject. Further, the image / sound processing unit 33 performs voice processing on the sound data related to the voice signal after the user's voice is converted into a voice signal by the microphone 314.

Further, in the image / sound processing unit 33, since the display control unit 34 displays the image on the display 4, the image processing unit 33 performs image processing on the image data received from another communication terminal based on the image type information such as the source name. Do it. Specifically, when the image type information indicates that the image is a special image, the image / sound processing unit 33 uses the image data (for example, as shown in FIGS. 3A and 3B). Based on the hemispherical image data), the all-sky panorama image data is created by converting to the all-sky panorama image data as shown in FIG. 4 (b), and further, in FIG. 6 (b). Create a predetermined area image as shown. Further, the image / sound processing unit 33 outputs a sound signal related to sound data received from another communication terminal via the communication management system 5 to the speaker 315, and outputs the sound from the speaker 315.

The display control unit 34 is realized mainly by the processing of the display I / F 317 and the CPU 301, and controls the display 4 to display various images, characters, and the like.

The determination unit 35 is realized mainly by the processing of the CPU 301, and determines, for example, the image type related to the image data received from the photographing apparatus 1a.

The creation unit 36 is realized mainly by the processing of the CPU 301, and based on the result determined by the determination unit 35 as a general image or a special image (here, a spherical panoramic image), the image type is according to the above-mentioned naming convention. Create a source name that is an example of information. For example, when the determination unit 35 determines that the image is a general image, the creation unit 36 creates a source name "Video" indicating that the image is a general image. On the other hand, when the determination unit 35 determines that the image is a special image, the creation unit 36 creates a source name "Video_Theta" indicating that the image is a special image.

The communication unit 38 is mainly realized by processing the short-range communication circuit 319, the antenna 318a, and the CPU 301, and communicates with the communication unit 18a of the photographing device 1a by short-range wireless technology using NFC, BlueTooth, Wi-Fi, or the like. be able to. Although the communication unit 38 and the transmission / reception unit 31 have been described with a configuration in which the communication unit is separately provided, a shared configuration may be used.

The storage / reading unit 39 is mainly realized by the processing of the CPU 301 shown in FIG. 11, and stores various data (or information) in the storage unit 3000 or stores various data (or information) from the storage unit 3000. Read it out.

<Functional configuration of communication management system>
Next, each functional configuration of the communication management system 5 will be described in detail with reference to FIGS. 12 and 14. The communication management system 5 has a transmission / reception unit 51, a determination unit 55, a generation unit 56, and a storage / reading unit 59. Each of these parts has a function realized by operating any of the components shown in FIG. 12 by an instruction from the CPU 501 according to the program for the communication management system 5 developed on the RAM 503 from the HD 504. It is a means.

Further, the communication management system 5 has a RAM 503 shown in FIG. 12 and a storage unit 5000 constructed by the HD 504. A session management DB 5001, an image type management DB 5002, and a total display restriction management DB 5003 are constructed in the storage unit 5000. Of these, the session management DB 5001 is configured by the session management table shown in FIG. The image type management DB 5002 is configured by the image type management table shown in FIG. The full display limit management DB 5003 is configured by the full display limit management table shown in FIG. 25.

(Session management table)
FIG. 19 is a conceptual diagram showing a session management table. In this session management table, the session ID and the IP address of the participating communication terminal are stored and managed in association with each other. Of these, the session ID is an example of session identification information for identifying a communication session that realizes a video call, and is generated for each virtual conference room. The session ID is also managed by each communication terminal such as the video conference terminal 3, and is used when selecting a communication session in each communication terminal. The IP address of the participating communication terminal indicates the IP address of the communication terminal that participated in the virtual conference room indicated by the associated session ID.

(Image type management table)
FIG. 20 is a conceptual diagram showing an image type management table. In the image type management table shown in FIG. 20, in addition to each information managed in the image type management table shown in FIG. 15, the same session ID as the session ID managed in the session management table is associated with each other. Is managed. Here, in the virtual conference room represented by the same session ID "se101", the IP addresses are "1.2.1.3", "1.2.2.3", and "1.3.1.", Respectively. It is shown that the three communication terminals of "3" are participating. In the communication management system 5, the new communication terminal manages the same image data ID, source terminal IP address, and image type information managed by the communication terminal such as the video conference terminal 3. This is to transmit image type information and the like to a communication terminal that is already in a video call and a newly joined communication terminal when entering a virtual conference room. As a result, it is not necessary to send and receive image type information and the like between the communication terminal already in the video call and the newly joined communication terminal.

(All display limit management table)
FIG. 21 is a conceptual diagram showing a total display restriction management table. This all display restriction management table is a table in which a display restriction table (see FIG. 17) and a display restricted table (see FIG. 18) are fused. That is, in the all display restriction management table, the IP address of the source communication terminal (source terminal) and the destination communication terminal (destination terminal) of the data of the two hemispherical images that are the source of the panoramic image of the whole sky. A display restriction parameter indicating the content that restricts the display of a predetermined area image is managed for each IP address. Thereby, the communication management system 5 can manage what kind of restriction the transmission source of the image data imposes on each transmission destination.

(Each function configuration of communication management system)
Next, each functional configuration of the communication management system 5 will be described in detail with reference to FIGS. 12 and 14.

The transmission / reception unit 51 of the communication management system 5 is mainly realized by the processing of the network I / F 509 and the CPU 501 shown in FIG. 12, and the video conference terminal 3 or the PC 7 and various data (or various data) are realized via the communication network 100. Information) is sent and received.

The determination unit 55 is realized mainly by the processing of the CPU 501, and makes various determinations.

The generation unit 56 is realized mainly by the processing of the CPU 501, and generates an image data ID.

The storage / reading unit 59 is mainly realized by the processing of the HDD 505 and the CPU 501 shown in FIG. 12, and can store various data (or information) in the storage unit 5000 or various data (or information) from the storage unit 5000. Information) is read out.

<PC function configuration>
Next, the functional configuration of the PC 7 will be described in detail with reference to FIGS. 12 and 14. The PC 7 basically has the same function as the video conference terminal 3. That is, as shown in FIG. 14, the PC 7 includes a transmission / reception unit 71, a reception unit 72, an image / sound processing unit 73, a display control unit 74, a judgment unit 75, a creation unit 76, a communication unit 78, and a storage unit. It has a reading unit 79. Each of these parts is a function or means realized by operating any of the components shown in FIG. 12 by an instruction from the CPU 501 according to a program for PC7 developed on the RAM 503 from the HD 504. ..

Further, the PC 7 has a storage unit 7000 constructed by the ROM 502, the RAM 503, and the HD 504 shown in FIG. An image type management DB 7001 and a photographing device management DB 7002 are constructed in the storage unit 7000. Since the image type management DB 7001 and the photographing device management DB 7002 have the same configuration as the image type management DB 3001 and the photographing device management DB 3002, respectively, the description thereof will be omitted.

(Each function configuration of PC)
The transmission / reception unit 71 of the PC 7 is mainly realized by the processing of the network I / F 509 and the CPU 501 shown in FIG. 12, and realizes the same functions as the transmission / reception unit 31.

The reception unit 72 is realized mainly by processing the keyboard 511, the mouse 512, and the CPU 501, and realizes the same functions as the reception unit 32. The image / sound processing unit 73 is realized mainly by a command from the CPU 501, and realizes the same function as the image / sound processing unit 33. The display control unit 74 is realized mainly by the processing of the CPU 501, and realizes the same function as the display control unit 34. The determination unit 75 is realized mainly by the processing of the CPU 501, and realizes the same function as the determination unit 35. The creating unit 76 is realized mainly by the processing of the CPU 501, and realizes the same function as the creating unit 36. The communication unit 78 is mainly realized by the processing of the CPU 501, and realizes the same function as the communication unit 38. The storage / reading unit 79 is realized by the processing of the CPU 501, stores various data (or information) in the storage unit 7000, and reads various data (or information) from the storage unit 7000.

<Functional configuration of smartphone>
Next, the functional configuration of the smartphone 9 will be described in detail with reference to FIGS. 13 and 14. The smartphone 9 basically has the same function as the video conference terminal 3. That is, as shown in FIG. 14, the smartphone 9 has a transmission / reception unit 91, a reception unit 92, an image / sound processing unit 93, a display control unit 94, a judgment unit 95, a creation unit 96, a communication unit 98, and a storage unit. -Has a reading unit 99. Each of these parts is a function or means realized by operating any of the components shown in FIG. 13 by a command from the CPU 901 according to the program for the smartphone 9 developed on the RAM 903 from the EEPROM 904. be.

Further, the smartphone 9 has a storage unit 9000 constructed by the ROM 902, the RAM 903, and the EEPROM 904 shown in FIG. An image type management DB 9001 and a photographing device management DB 9002 are constructed in the storage unit 9000. Since the image type management DB 9001 and the photographing device management DB 9002 have the same configuration as the image type management DB 3001 and the photographing device management DB 3002, respectively, the description thereof will be omitted.

(Each function configuration of smartphone)
The transmission / reception unit 91 of the smartphone 9 is mainly realized by the processing of the long-distance communication circuit 911 and the CPU 901 shown in FIG. 13, and realizes the same function as the transmission / reception unit 31.

The reception unit 92 is realized mainly by the processing of the touch panel 921 and the CPU 901, and realizes the same function as the reception unit 32.

The image / sound processing unit 93 is realized mainly by a command from the CPU 901, and realizes the same function as the image / sound processing unit 33.

The display control unit 94 is realized mainly by the processing of the CPU 901, and realizes the same function as the display control unit 34.

The determination unit 95 is mainly realized by the processing of the CPU 901, and realizes the same function as the determination unit 35.

The creating unit 96 is realized mainly by the processing of the CPU 901, and realizes the same function as the creating unit 36.

The communication unit 98 is mainly realized by the processing of the CPU 901, and realizes the same function as the communication unit 38.

The storage / reading unit 99 is realized by the processing of the CPU 901, stores various data (or information) in the storage unit 9000, and reads various data (or information) from the storage unit 9000.

<< Processing or operation of the embodiment >>
<Participation processing>
Subsequently, the process or operation of the present embodiment will be described with reference to FIGS. 22 to 27. First, the process of participating in a specific communication session will be described with reference to FIGS. 22 and 23. FIG. 22 is a sequence diagram showing a process of participating in a specific communication session. FIG. 23 is a diagram showing a selection screen of a communication session (virtual conference room).

First, when the user of the base A (for example, the user A1) operates to display the selection screen of the communication session (virtual conference room) on the video conference terminal 3, the reception unit 32 displays the selection screen. Upon receiving the operation, the display control unit 34 displays the selection screen as shown in FIG. 23 on the display 4 (step S21). On this selection screen, selection buttons b1, b2, b3 and the like indicating each virtual conference room R1, R2, R3 and the like to be selected are displayed. Further, each session ID is associated with each selection button b1 and the like.

Here, when the user A1 selects a desired selection button (here, selection button b1) in the virtual conference room, the reception unit 32 accepts the selection of the communication session (step S22). Then, the transmission / reception unit 31 transmits a request for participation in the virtual conference room to the communication management system 5 (step S23). The participation request includes a session ID indicating the communication session whose selection has been accepted in step S22, and the IP address of the video conference terminal 3 which is the requesting terminal. As a result, the transmission / reception unit 51 of the communication management system 5 receives the participation request.

Next, in the session management DB 5001 (see FIG. 19), the storage / reading unit 99 enters the IP received in step S23 in the field of the participating terminal IP address in the record having the same session ID as the session ID received in step S23. By adding the address, the process of joining the communication session is performed (step S24). Then, the transmission / reception unit 51 transmits a participation request response to the video conference terminal 3 (step S25). The participation request response includes the session ID received in step S23 and the participation processing result. As a result, the transmission / reception unit 31 of the video conference terminal 3 receives the participation request response. Hereinafter, the case where the participation process is successful will be described.

<Image type information management process>
Subsequently, the image type information management process will be described with reference to FIG. 24. FIG. 24 is a sequence diagram showing a management process of image type information.

First, when the user of the base A (for example, the user A1) connects the USB cable of the cradle 2a with the photographing device 1a attached to the video conference terminal 3, the storage / reading unit 19a of the photographing device 1a is connected. The GUID of the own device (shooting device 1a) stored in the storage unit 1000a is read out, and the communication unit 18a transmits the GUID of the own device to the communication unit 38 of the video conference terminal 3 (step S51). As a result, the communication unit 38 of the video conference terminal 3 receives the GUID of the photographing device 1a.

Next, the determination unit 35 of the video conference terminal 3 manages the vendor ID and product ID in the GUID received in step S51 and the same vendor ID and product ID in the photographing device management DB 3002 (see FIG. 16). The image type is determined by determining whether or not the image is present (step S52). Specifically, when the same vendor ID and product ID are managed in the photographing device management DB 3002, the determination unit 35 captures a special image (here, a spherical panoramic image) by the photographing device 1a. Judge that it is a photographing device. On the other hand, when the same vendor ID and product ID are not managed in the photographing device management DB 3002, the determination unit 35 determines that the photographing device 1a is a photographing device for capturing a general image.

Next, the storage / reading unit 39 uses the IP address of the own terminal (video conference terminal 3), which is the source terminal, and the determination result determined in step S52 for the image type management DB 3001 (see FIG. 15). It is stored in association with a certain image type information (step S53). In this state, the image data ID is not associated. The image type information is, for example, a source name defined according to a predetermined naming convention or an image type (general image, special image).

Next, the transmission / reception unit 31 transmits a request for adding image type information to the communication management system 5 (step S54). The request for adding the image type information includes the IP address of the own terminal, which is the source terminal stored in step S53, and the image type information. As a result, the transmission / reception unit 51 of the communication management system 5 receives the request for adding the image type information.

Next, the storage / reading unit 59 of the communication management system 5 searches the session management DB 5001 (see FIG. 19) using the IP address of the source terminal received in step S54 as a search key, and thereby corresponds to the corresponding session ID. Is read (step S55).

Next, the generation unit 56 generates a unique image data ID (step S56). Then, the storage / reading unit 59 registers the session ID read in step S55, the image data ID generated in step S56, and the image data ID in step S54 as new records in the image type management DB 5002 (see FIG. 20). The received IP address of the source terminal and the image type information are associated and stored (step S57). Then, the transmission / reception unit 51 transmits the image data ID generated in step S56 to the video conference terminal 3. As a result, the transmission / reception unit 31 of the video conference terminal 3 receives the image data ID (step S58).

Next, the storage / reading unit 39 of the video conference terminal 3 stores the IP of the own terminal (video conference terminal 3), which is the source terminal stored in the image type management DB 3001 (see FIG. 15), in the image type management DB 3001 (see FIG. 15). The image data ID received in step S58 is stored in association with the address and the image type information (step S59).

On the other hand, the transmission / reception unit 51 of the communication management system 5 transmits an additional notification of image type information to the smartphone 9 which is another communication terminal (step S60). The additional notification of the image type information includes the image data ID generated in step S56, and the IP address and image type information of the own terminal (video conference terminal 3) which is the source terminal stored in step S53. It has been. As a result, the transmission / reception unit 91 of the smartphone 9 receives the additional notification of the image type information. The transmission destination of the transmission / reception unit 51 is the session management DB 5001 (see FIG. 19), and is another IP address associated with the same session ID as the IP address of the video conference terminal 3. That is, the transmission destination is another communication terminal in the same virtual conference room as the video conference terminal 3.

Next, the storage / reading unit 99 of the smartphone 9 has the image data ID, the IP address of the source terminal, and the image type received in step S60 as a new record in the image type management DB 9001 (see FIG. 15). Information is associated and stored (step S61). Similarly, the additional communication of the image type information is transmitted to the PC 7 which is another communication terminal, and is stored in the image type management DB 7001 (see FIG. 15) in the PC 7. From the above, each communication terminal can share the same information in each image type management DB 3001,7001,9001.

<Communication processing of image data>
25 to 28 will be used to describe communication processing of image data in a video call. FIG. 25 is a sequence diagram showing communication processing of image data in a video call.

First, the image data obtained by photographing a subject, a landscape, or the like is transmitted from the communication unit 18a of the photographing apparatus 1a to the communication unit 38 of the video conference terminal 3 (step S71). In this case, since the photographing device 1a is a device capable of obtaining two hemispherical images that are the basis of the spherical panoramic image, the image data is as shown in FIGS. 3 (a) and 3 (b). It is composed of data from two hemispherical images. As a result, the communication unit 38 of the video conference terminal 3 receives the image data.

Next, the transmission / reception unit 31 of the video conference terminal 3 transmits the image data sent from the photographing device 1a to the communication management system 5 (step S72). This transmission includes an image data ID for identifying the image data to be transmitted. In addition, the IP address of the video conference terminal 3 which is the transmission source is also transmitted. As a result, the transmission / reception unit 51 of the communication management system 5 receives the image data, the image data ID, and the IP address.

Next, the transmission / reception unit 51 of the communication management system 5 transmits the image data sent from the video conference terminal 3 to the smartphone 9 (step S73). This transmission includes an image data ID for identifying the image data to be transmitted. The IP address of the video conference terminal 3 that is the source is also transmitted. As a result, the transmission / reception unit 51 of the smartphone 9 receives the image data, the image data ID, and the IP address.

Next, in the smartphone 9, the storage / reading unit 99 searches the image type management DB 9001 (see FIG. 15) using the image data ID received in step S73 as a search key, thereby performing the corresponding image type information (source). First name) is read (step S74). Then, the smartphone 9 performs a process of creating a predetermined area image (step S75). Here, the process of step S75 will be described in detail with reference to FIG. 26. FIG. 26 is a flowchart showing a process of creating a predetermined area image.

First, in the determination unit 95 of the smartphone 9, the image type of the image data received in step S73 is a special image (here, a spherical panoramic image) based on the image type information read out in step S74. (Step S71-1). Then, in the case of a special image (YES), the storage / reading unit 99 searches for the corresponding display restriction parameter using the IP address of the source communication terminal (here, the video conference terminal 3) as a search key (YES). Step S71-2).

Next, the determination unit 95 determines whether or not there is a display restriction parameter, that is, whether or not the display is restricted (step S71-3). Then, when the display is restricted (YES), the determination unit 95 further determines whether the display restriction parameter is restricted in display size more than the default display parameter (step S71-4). If the determination unit 95 determines that the restriction is made (YES), the image / sound processing unit 93 creates an omnidirectional panoramic image from the image data received in step S73, and further sets it as a display restriction parameter. Based on this, a predetermined area image is created (step S71-5). In this case, the image / sound processing unit 93 synthesizes the icon 191 indicating that the image is a spherical panoramic image, which will be described later, into the predetermined area image based on the image type information indicating that the image is a special image (Video_Theta).

On the other hand, in step S71-3, when the determination unit 95 determines that the display is not restricted (NO), and in step S71-4, the determination unit 95 determines that the display is not restricted (NO). ), The image / sound processing unit 93 creates a spherical panoramic image from the image data received in step S73, and further creates a predetermined area image based on the default display parameters (step S71-6). In this case, the image / sound processing unit 93 synthesizes the icon 191 indicating that the image is a spherical panoramic image, which will be described later, into the predetermined area image based on the image type information indicating that the image is a special image (Video_Theta).

If the determination unit 95 determines in step S71-1 that the image type of the image data is not a special image (NO), the process of step S71 ends.

Next, returning to FIG. 25, the display control unit 94 displays a predetermined area image including the icon 191 on the display 917 of the smartphone 9 (step S76). When the image type information indicates that the image is a general image (Video), the image / sound processing unit 93 does not create an all-sky panorama image from the image data received in step S73, and the display control unit 93. 94 displays a general image that does not include the icon 191.

Subsequently, the state of the video call will be described with reference to FIG. 27. FIG. 27 is an image diagram showing a state of a video call. Of these, FIG. 27A shows a case where the photographing device 1a is not used, and FIG. 27B shows a case where the photographing device 1a is used.

First, as shown in FIG. 27 (a), when the camera 312 (see FIG. 11) provided in advance in the video conference terminal 3 is used without using the photographing device 1a, the angle of view is 125 degrees horizontally. Since it is 70 degrees vertically, the video conference terminal 3 must be placed at the edge of the desk on which each user A1 or the like is displayed. Therefore, each user A1 or the like must face the video conference terminal 3 side and speak. Further, since each user A1 or the like faces the video conference terminal 3, the display 4 is also placed on the side of the video conference terminal 3. As a result, the users A2 and A4 away from the video conference terminal 3 have to speak in a relatively loud voice because they are away from the microphone 314 (see FIG. 11), and it is difficult to see the display contents of the display 4.

On the other hand, as shown in FIG. 27 (b), when the photographing device 1a is used, two hemispherical images that are the basis of the spherical panoramic image can be obtained, so that a video conference can be obtained. The terminal 3 and the display 4 can be placed relatively in the center of the desk. As a result, since each user A1 or the like is close to the microphone 314, he / she can speak in a relatively low voice, and the display contents of the display 4 can be easily seen.

Subsequently, a display example of the display 917 at the base B will be described with reference to FIG. 28. FIG. 28 shows a screen example of a video call at the base B. Of these, FIG. 28A shows the spherical panoramic image and the predetermined area image as they are without creating the spherical panoramic image and the predetermined area image from the image data sent from the video conference terminal 3 (shooting device 1a) and the shooting device 1b. It shows the case of displaying and the case of displaying the image data sent from the PC 7 (shooting device 8) as it is. FIG. 28B shows a case where a spherical panoramic image is created and a predetermined area image is created from the image data sent from the video conference terminal 3 (shooting device 1a) and the shooting device 1b, and PC7 ( The case where the image data sent from the photographing apparatus 8) is displayed as it is is shown. The image of the base A is displayed in the display area on the upper left side of the display 917, the image of the base B (own base) is displayed in the display area on the upper right side, and the image of the base C is displayed in the display area on the lower left side. Is displayed. Further, in this example, since simultaneous video calls are being made at three bases, nothing is displayed in the display area on the lower right side.

When the image data sent from the photographing devices 1a and 1b capable of capturing the spherical panoramic image is displayed as it is, it is displayed as shown in FIG. 28 (a). This is because the A base on the upper left side and the B base on the upper right side (own base) are displayed as a front hemisphere image and a rear hemisphere image, respectively, as shown in FIGS. 3 (a) and 3 (b), respectively. Has been done.

On the other hand, the image / sound processing unit 93 uses the image data sent from the photographing devices 1a and 1b capable of obtaining the two hemispherical images that are the basis of the panoramic panoramic image. When an image is created and a predetermined area image is further created, a predetermined area image which is a plane image is displayed as shown in FIG. 28 (b). Since the base C is provided with a photographing device 8 for obtaining a general image, the general image is displayed in both FIGS. 28 (a) and 28 (b).

Further, an icon 191 indicating that the image is a spherical panoramic image is displayed at the upper left of each of the images of the base A and the base B (own base). The display position of the icon 191 may be anywhere, such as upper right, lower left, and lower right, instead of the upper left. Further, the type of the icon 191 is not limited to FIG. 28 (b). Further, instead of the icon 191 it may be a character such as "omnidirectional image", or it may be a combination of an icon and a character. As shown in FIG. 28B, the icon 192 is similarly displayed in the display area of the base B.

In addition, the user can change the predetermined area related to the predetermined area image in the same spherical panoramic image. That is, the users B1 and B2 touch the touch panel 921 of the smartphone 9 to move the finger, so that the reception unit 92 accepts the movement of the finger, and the display control unit 94 shifts or rotates the predetermined area image. Can be scaled, scaled down, or scaled up. As a result, as shown in FIG. 28 (b), even if only some users A1 and A2 of the base A are displayed by the initial setting (default), the predetermined area image is shifted. Users A4 and A3 can be displayed.

<Display restriction parameter setting process>
Subsequently, the process of setting the display restriction parameter will be described with reference to FIG. 29. FIG. 29 is a sequence diagram showing a process of setting display restriction parameters.

First, in the transmission source communication terminal (here, the video conference terminal 3), the user A1 or the like uses the operation button 308 to set the initial value of the display restriction parameter, and the reception unit 32 sets the initial value. Is accepted (step S101). For example, the initial value is α (viewing angle)> 120 °, and only the enlarged state display is permitted. Next, the storage / reading unit 99 stores the initial value display restriction parameter in the display restriction management DB 3003 (step S102). After that, the video conference terminal 3 notifies the communication terminals of all the bases participating in the conference of the display restriction parameter of the initial value, so that the transmission / reception unit 31 displays the display restriction to the communication management system 5. Display restriction setting information indicating the setting of is transmitted (step S103). The display restriction setting information includes the IP address of the source communication terminal (here, the video conference terminal 3), the list of the IP addresses of the destination communication terminals, and the display restriction parameters set in step S101. ing. The list of IP addresses includes the IP addresses of all communication terminals (here, PC7, smartphone 9) other than the own terminal (here, a video conference terminal) participating in the conference. As a result, the transmission / reception unit 51 of the communication management system 5 receives the display restriction setting information.

Next, in the communication management system 5, the storage / reading unit 99 tells the all display restriction management DB 5003 the IP address of the transmission source communication terminal received in step S103 and the IP address of the communication terminal received in step S103, as shown in FIG. The display restriction parameter is stored for each IP address of the destination communication terminal (step S105). In this case, if the display restriction parameter is already stored for the set of the IP address of the communication terminal of the same source and the IP address of the communication terminal of the destination, the storage / reading unit 99 overwrites and updates.

Next, the transmission / reception unit 51 of the communication management system 5 transmits the display restriction setting information indicating the display restriction setting to the smartphone 9 (step S106). The display restriction setting information includes the IP address of the communication terminal of the transmission source (here, the video conference terminal 3) and the display restriction parameter set in step S101. As a result, the transmission / reception unit 91 of the smartphone 9 receives the display restriction setting information. Then, in the smartphone 9, the storage / reading unit 99 associates the IP address of the communication terminal of the transmission source received in step S105 with the display restriction parameter, and stores the IP address and the display restriction parameter in the display restricted management DB 9004 (step S106). As a result, the setting of the display restriction parameter requested from the video conference terminal 3 is completed on the smartphone 9.

Similarly, the transmission / reception unit 51 of the communication management system 5 transmits the display restriction setting information indicating the display restriction setting to the PC 7 (step S107). The display restriction setting information includes the IP address of the communication terminal of the transmission source (here, the video conference terminal 3) and the display restriction parameter set in step S101. As a result, the transmission / reception unit 71 of the PC 7 receives the display restriction setting information. Then, in the PC 7, the storage / reading unit 79 associates the IP address of the communication terminal of the transmission source received in step S107 with the display restriction parameter, and stores the IP address and the display restriction parameter in the display restricted management DB 7004 (step S108). As a result, the setting of the display restriction parameter requested from the video conference terminal 3 is completed on the PC 7.

This completes the display restriction parameter setting process.

<Display restriction parameter setting cancellation process (restricted side)>
Subsequently, with reference to FIG. 30, a process of canceling the setting of the display restriction parameter according to the request of the restricted side will be described. FIG. 30 is a sequence diagram showing a process of canceling the setting of the display restriction parameter at the request of the restricted side.

For example, when the user of the restricted smartphone 9 wants to release the display restriction parameter restricted from the video conference terminal 3, when the user of the smartphone 9 performs an operation for releasing the display restriction, the smartphone 9 The reception unit 92 of the above accepts the cancellation of the display restriction (step 121). For example, the user B1 of the smartphone 9 displays the display area of the image (here, the user A1 and the like are projected on the upper left) of the image to be released from the display restriction on the screen shown in FIG. 28 (b). Double tap the area).

Next, the transmission / reception unit 91 transmits the display restriction release request information indicating the request for release of the display restriction to the communication management system 5 (step S122). The display restriction release request information includes the IP address of the request source communication terminal (here, the smartphone 9) and the IP address of the request destination communication terminal (here, the video conference terminal 3). The requesting communication terminal is a destination communication terminal that has received the display restriction setting. Further, the communication terminal of the request destination is the communication terminal of the transmission source for which the display restriction is set. As a result, the transmission / reception unit 51 of the communication management system 5 receives the display restriction release request information. Then, the transmission / reception unit 51 transmits the display restriction release request information received in step S122 to the video conference terminal 3 (step S123). The display restriction release request information includes the IP address of the requesting communication terminal (here, the smartphone 9) received in step S122. As a result, the transmission / reception unit 31 of the video conference terminal 3 receives the display restriction release request information.

Next, the video conference terminal 3 executes a process of temporarily releasing the display restriction (step S124). For example, the storage / reading unit 39 searches the display restriction management DB 3003 using the IP address of the communication terminal (here, the smartphone 9) of the request source (destination) received in step S123 as a search key. Temporarily remove display restriction parameters. In this case, the image / sound processing unit 33 outputs a notification sound or notifies the user A1 or the like that the display restriction is requested to be released, or as shown in FIG. 32. The screen 351 may be displayed. FIG. 32 is a screen example of a video call including a notification screen. Further, the video conference terminal 3 may output the notification sound for a certain period of time (for example, 10 seconds), and then the storage / reading unit 39 may automatically delete the display restriction parameter temporarily. Further, the temporarily deleted display restriction parameter is restored after a predetermined time (for example, 10 minutes) from the deletion, or is restored by the restoration instruction from the communication terminal of the transmission source instructing the display restriction.

Further, as the process of step S124, as shown in FIG. 33, the display control unit 34 releases the display restriction to the user A1 or the like of the request destination communication terminal (here, the video conference terminal 3). The approval request screen 352 for requesting approval may be displayed. FIG. 33 is a screen example of a video call including an approval request screen.

The approval request screen 352 includes a "yes" button that is pressed when approving and a "no" button that is pressed when not approving. Then, when approving, the storage / reading unit 39 searches the display restriction management DB 3003 using the IP address of the communication terminal (here, the smartphone 9) of the request source (destination) received in step S123 as a search key. By doing so, the corresponding display restriction parameter is temporarily deleted. On the other hand, if it is not approved, the transmission / reception unit 31 notifies the requesting communication terminal (here, the smartphone 9) of disapproval (denial) via the communication management system 5.

Next, the transmission / reception unit 31 of the video conference terminal 3 transmits the display restriction release instruction information indicating that the display restriction release is completed to the communication management system 5 (step S125). The display restriction release instruction information includes the IP address of the communication terminal of the request destination (source) which is the own terminal (here, the video conference terminal 3) and the IP address of the request source (destination) terminal. .. As a result, the transmission / reception unit 51 of the communication management system 5 receives the display restriction release instruction information.

Next, in the communication management system 5, the storage / reading unit 59 searches the all display restriction management DB 5003 using the set of both IP addresses received in step S125 as a search key, and temporarily sets the corresponding display restriction parameter. By deleting it, the restriction release process is performed (step S126). Then, the transmission / reception unit 51 transmits the display restriction release instruction information indicating that the display restriction release is completed to the smartphone 9. The display restriction release instruction information includes the IP address of the communication terminal of the request destination (source) received in step S125. As a result, the transmission / reception unit 91 of the smartphone 9 receives the display restriction release instruction information.

Next, the smartphone 9 performs a process of canceling the display restriction (step S128). For example, the storage / reading unit 99 searches the display restricted management DB 3004 using the IP address of the communication terminal (here, the video conference terminal 3) of the request destination (source) received in step S127 as a search key. , Temporarily remove the corresponding display restriction parameter. As a result, it is determined that the smartphone 9 is not subject to display restrictions in step 71-3 shown in FIG. 26, and the image / sound processing unit 93 is displayed on the display 917 according to the operations of the users B1 and B2. Can display a predetermined area image.

As a result, the display restriction parameter setting cancellation process (restricted side) is completed.

<Display restriction parameter setting cancellation process (restriction side)>
Subsequently, with reference to FIG. 35, a process of individually canceling the setting of the display restriction parameter according to the instruction on the restriction side will be described. FIG. 31 is a sequence diagram showing a process of canceling the setting of the display restriction parameter at the request of the restriction side.

For example, the display control unit 34 displays the "release restriction release" buttons 361 and 362 during a video call, as shown in FIG. 34. Then, when the user A1 or the like of the video conference terminal 3 on the restricted side wants to cancel the display restriction only for the base B among the bases B and C, the user A1 and the like presses the "release restriction" button 361. When pressed, the reception unit 32 of the video conference terminal 3 accepts the release of the display restriction on the base B (step 201). As a result, the storage / reading unit 39 searches the display restriction management DB 3003 using the IP address of the communication terminal of the selected base B as a search key, and temporarily deletes the corresponding display restriction parameter to display the image. The restriction is released (step S202). Then, the video conference terminal 3 notifies the communication terminal (here, the smartphone 9) of the base B participating in the conference of the release of the display restriction, so that the transmission / reception unit 31 informs the communication management system 5. Then, the display restriction release information indicating the release of the display restriction is transmitted (step S203). The display restriction release information includes the IP address of the communication terminal of the transmission source (here, the video conference terminal 3) and the IP address of the communication terminal of the transmission destination to which the display is released. As a result, the transmission / reception unit 51 of the communication management system 5 receives the display restriction release information.

Next, in the communication management system 5, the storage / reading unit 99 sets the IP address of the transmission source communication terminal and the IP address of the transmission destination communication terminal received in step S203 for the all display restriction management DB 5003. The restriction release process is performed by temporarily deleting the display restriction parameter corresponding to (step S204).

Next, the transmission / reception unit 51 of the communication management system 5 transmits the display restriction release information indicating the release of the display restriction to the smartphone 9 (step S205). The display restriction release information includes the IP address of the transmission source communication terminal (here, the video conference terminal 3) that is the display restriction release source. As a result, the transmission / reception unit 91 of the smartphone 9 receives the display restriction release information. Then, in the smartphone 9, the storage / reading unit 99 temporarily searches the display restricted management DB 9004 using the IP address of the transmission source communication terminal received in step S205 as a search key to temporarily set the corresponding display restriction parameter. The process of releasing the restriction to be deleted is performed (step S206). As a result, the display restriction requested from the video conference terminal 3 is released on the smartphone 9, and the display restriction is not released on the PC 7, and the display restriction parameter setting release process (restricted side) is completed.

<Display restriction parameter setting change processing (restriction side)>
Subsequently, with reference to FIG. 35, a process of canceling the setting of the display restriction parameter according to the instruction on the restriction side will be described. FIG. 35 is a sequence diagram showing a process of changing the setting of the display restriction parameter according to the instruction on the restriction side.

FIG. 36 is a screen example of a video call including a change screen. For example, by operating the operation button 308 by the user A1 during a video call, the display control unit 34 displays the display restriction change screen 371 as shown in FIG. 36. Then, when the user A1 selects whether to restrict the display or not to restrict the display for each of the bases B and C by operating the operation button 308, and presses the "OK" button, the video conference terminal 3 The reception unit 32 receives whether or not there is a display restriction for each base (step S221). Here, the case where the display is restricted to the base B and the display is not restricted to the base C is shown. As a result, the storage / reading unit 39 searches the display restriction management DB 3003 using the IP address of the communication terminal of the selected base C as a search key, thereby temporarily deleting the corresponding display restriction parameter and displaying the display. The presence or absence of restrictions is collectively changed (step S222). Since the display restriction of the base B is continued, the storage / reading unit 39 keeps the display restriction parameter of the base B without temporarily deleting it.

Next, the transmission / reception unit 31 transmits the display restriction change information indicating the change of the display restriction to the communication management system 5 (step S223). This display restriction change information includes a list of IP addresses including the IP address of the source communication terminal (here, the video conference terminal 3) and the IP address of the destination communication terminal to which the display restriction is changed, and display. It contains display restriction release instruction information indicating an instruction to release the restriction, and display restriction reset instruction information indicating an instruction to reset the display restriction. In this case, the display restriction release instruction information or the display restriction reset instruction information is associated with each IP address of the transmission destination communication terminal. As a result, the transmission / reception unit 51 of the communication management system 5 receives the display restriction change information.

Next, in the communication management system 5, the storage / reading unit 99 is received in step S223 for the all display restriction management DB 5003 for the communication terminal of the destination associated with the display restriction release instruction information. The restriction change process is performed by temporarily deleting the display restriction parameter corresponding to the set of the IP address of the communication terminal of the transmission source and the IP address of the communication terminal of the transmission destination (step S224). For the transmission destination communication terminal associated with the display restriction release instruction information, the storage / reading unit 99 maintains the display restriction parameter for all display restriction management DB 5003 without temporarily deleting it. Leave it as it is.

Next, the transmission / reception unit 51 of the communication management system 5 transmits display restriction change information including instructing the smartphone 9 to reset the display restriction (step S225). The display restriction setting information includes the IP address of the communication terminal (here, the video conference terminal 3) of the transmission source. As a result, the transmission / reception unit 91 of the smartphone 9 receives the display restriction change information. Then, in the smartphone 9, the storage / reading unit 99 performs a process of resetting the display restriction parameter for the IP address of the transmission source communication terminal received in step S205 in the display restriction management DB 9004 (step). S226). In the case of resetting, the communication management system 5 does not have to transmit the display restriction change information to the communication terminal.

Further, the transmission / reception unit 51 of the communication management system 5 transmits display restriction change information including instructing the PC 7 to release the display restriction (step S227). The display restriction change information includes the IP address of the communication terminal (here, the video conference terminal 3) of the transmission source that is the release source of the display restriction. As a result, the transmission / reception unit 71 of the PC 7 receives the display restriction change information. Then, in the PC 7, the storage / reading unit 79 temporarily searches the display restricted management DB 7004 using the IP address of the communication terminal of the transmission source received in step S227 as a search key to temporarily set the corresponding display restriction parameter. The process of releasing the restriction to be deleted is performed (step S228). As a result, in the PC 7, the display restriction instructed by the video conference terminal 3 is released, and the display restriction parameter setting change process (restriction side) ends.

<< Main effects of this embodiment >>
As described above, according to the present embodiment, the communication terminal such as the video conferencing terminal 3 creates an all-sky panoramic image based on the image data ID sent together with the image data and the corresponding image type information. Further, a predetermined area image can be created. This has the effect of preventing the front hemisphere image and the rear hemisphere image from being displayed, as shown in FIG. 28 (a).

In addition, the communication terminal may release the display restriction at the request of another communication terminal (see steps S121 to S128), or positively release the display restriction from the own terminal to a specific other communication terminal (see steps S121 to S128). Steps S201 to S206), the display restriction is positively reset (or maintained) or canceled from the own terminal for each other communication terminal (steps S221 to S228). As a result, display restrictions and cancellations can be flexibly performed, so if a user on the other communication terminal side who has received display restrictions wants to roughly grasp the base of the communication terminal, the display restrictions should be released. Can be handled with.

1a Imaging device 1b Imaging device 3 Video conference terminal (example of communication terminal)
5 Communication management system 7 PC (example of communication terminal)
8 Shooting device 9 Smartphone (example of communication terminal)
31 Transmitter / receiver (example of transmission means, example of reception means)
32 Reception Department (an example of reception means)
34 Display control unit (an example of display control means)
71 Transmitter / receiver (example of transmitting means, example of receiving means)
72 Reception Department (an example of reception means)
74 Display control unit (an example of display control means)
91 Transmitter / receiver (example of transmission means, example of reception means)
92 Reception Department (Example of reception means)
94 Display control unit (an example of display control means)

Japanese Unexamined Patent Publication No. 2012-178135 Japanese Unexamined Patent Publication No. 2011-22307 Japanese Unexamined Patent Publication No. 2002-034009 Japanese Unexamined Patent Publication No. 2001-148850

Claims (10)

A communication terminal that transmits spherical image data so that other communication terminals can receive it.
When the other communication terminal displays the spherical image, the other communication terminal receives a display restriction parameter for limiting the display area to a predetermined area of a part of the spherical image. Has a means of transmission to send to
The transmission means is a communication terminal that transmits display restriction release instruction information indicating an instruction to release the restriction of the display area so that the other communication terminal can receive the information. The communication terminal according to claim 1, further
It has a receiving means for receiving display restriction release request information transmitted from the other communication terminal and indicating a request to release the restriction of the display area.
The transmission means is a communication terminal that transmits the display restriction release instruction information so that the other communication terminal can receive the information. The communication terminal according to claim 2, further
It has a display control means for displaying to a predetermined display means that the limitation of the display area is released.
The transmission means is a communication terminal that transmits the display restriction release instruction information in response to the reception of the display restriction release request information. The communication terminal according to claim 2, further
It has a display control means for displaying an approval request screen indicating selection of whether or not to approve the request related to the display restriction release request information on a predetermined display means.
When the approval selection is made, the transmission means is a communication terminal that transmits the display restriction release instruction information. The communication terminal according to claim 1, further
A reception means for accepting the release of the restriction on the display area for each of the plurality of other communication terminals,
The transmission means is a communication terminal that transmits the display restriction release instruction information so that the specific other communication terminal whose cancellation is accepted by the reception means receives the information. The communication terminal according to claim 1, further
A reception means that accepts the release or non-release of the restriction on the display area for each of the plurality of other communication terminals.
Among the plurality of other communication terminals accepted by the reception means, the transmission means is a communication terminal that transmits the display restriction release instruction information so that the specific other communication terminal that has received the cancellation receives the reception. The communication terminal according to any one of claims 1 to 6 and the communication terminal.
A communication management system that relays the communication of the communication terminal and the other communication terminals,
Communication system with. The other communication terminals are
Display restriction release request information indicating a request to release the restriction on the display area is transmitted to the communication terminal via the communication management system.
The communication system according to claim 7, wherein the communication system receives display restriction release instruction information indicating an instruction to release the restriction of the display area from the communication terminal via the communication management system. It is a communication method executed by a communication terminal that transmits spherical image data so that other communication terminals receive it.
The communication terminal is
When the other communication terminal displays the spherical image, the other communication terminal receives a display restriction parameter for limiting the display area to a predetermined area of a part of the spherical image. Send to
A communication method for transmitting display restriction release instruction information indicating an instruction to release the restriction of the display area so that the other communication terminal can receive the information. A program for causing a computer to perform the method according to claim 9.

Images