WO2015119216A1 - Information terminal, system, control method, and recording medium - Google Patents
Information terminal, system, control method, and recording medium Download PDFInfo
- Publication number
- WO2015119216A1 WO2015119216A1 PCT/JP2015/053297 JP2015053297W WO2015119216A1 WO 2015119216 A1 WO2015119216 A1 WO 2015119216A1 JP 2015053297 W JP2015053297 W JP 2015053297W WO 2015119216 A1 WO2015119216 A1 WO 2015119216A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- resolution
- terminal
- transmission
- information
- unit
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G5/005—Adapting incoming signals to the display format of the display terminal
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/36—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of a graphic pattern, e.g. using an all-points-addressable [APA] memory
- G09G5/37—Details of the operation on graphic patterns
- G09G5/377—Details of the operation on graphic patterns for mixing or overlaying two or more graphic patterns
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
- H04N21/258—Client or end-user data management, e.g. managing client capabilities, user preferences or demographics, processing of multiple end-users preferences to derive collaborative data
- H04N21/25808—Management of client data
- H04N21/25833—Management of client data involving client hardware characteristics, e.g. manufacturer, processing or storage capabilities
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2358/00—Arrangements for display data security
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/04—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller
- G09G2370/042—Exchange of auxiliary data, i.e. other than image data, between monitor and graphics controller for monitor identification
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/12—Use of DVI or HDMI protocol in interfaces along the display data pipeline
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/20—Details of the management of multiple sources of image data
Definitions
- One aspect of the present disclosure relates to an information terminal, a system, a control method, and a program.
- This type of remote conference system uses a remote conference system transmission terminal (terminal device) in a conference room where there is one party such as an attendee who conducts a remote conference. Shoot and collect the audio. These are converted into digital data, transmitted to the other party's transmission terminal, displayed on the display device (for example, a display or projector) in the other party's conference room, and output as audio through a speaker. Realize a meeting between the ground.
- terminal device for example, a display or projector
- the transmission terminals of this type of teleconference system are sold as a set together with a display device, and the form in which only the transmission terminal is sold alone is increasing. Therefore, recently, it has become possible to connect display devices having various resolutions to transmission terminals.
- This type of transmission terminal is connected because the resolution of image data transmitted and received with other transmission terminals is designed to be a fixed value of width 1280 pixels ⁇ height 720 pixels (aspect ratio 16: 9). Depending on the resolution of the display device, display may be inconvenient.
- auxiliary information such as operation menus and error messages in addition to conference room images. If the displayed area is missing, the user may not be able to operate the transmission terminal or know the cause of the error.
- Patent Document 1 discloses a method of changing the aspect ratio of an image from 16: 9 to 4: 3 for the purpose of preparing an image for a video conference. Further, in Patent Document 2, for the purpose of performing a shared screen display in real time in a data conference system, one terminal receives the display display capability of another terminal, one terminal refers to the display display capability, A method of transmitting terminal application data after converting it to display resolution of another terminal is disclosed.
- transmission terminals connected to this type of remote conference system may use different resolution settings depending on whether video is output via an analog terminal or video is output via a digital terminal. is there.
- the transmission terminal described above uses a resolution of “1024 ⁇ 768” for an analog terminal and uses a resolution of “1280 ⁇ 720” (720p) for a digital terminal.
- the conventional method does not consider display distortion and display of the operation menu, there is a problem that the screen is distorted or the operation menu is missing depending on the combination with the display device. Further, the conventional method has a problem that it can be used only when the aspect ratio of the input image is 16: 9 and the aspect ratio of the display device is 4: 3, and there is no versatility.
- the present invention has been proposed in view of the above problems, and an object thereof is to appropriately display image data and auxiliary information according to the capability of a display device connected to a transmission terminal.
- an information terminal connected to a display device via a digital terminal and outputting display image data to the display device.
- the information terminal acquires a resolution that can be displayed by the display device when the device information acquired from the display device matches predetermined device information, and the displayable resolution is used for transmission of image data.
- a resolution determining unit that determines whether or not a resolution with an aspect ratio other than the reference aspect ratio is included, and the resolution determining unit has the displayable resolution including a resolution with an aspect ratio other than the reference aspect ratio If it is determined, when selecting a first resolution of an aspect ratio other than the reference aspect ratio from the displayable resolution, and determining that it does not include a resolution of an aspect ratio other than the reference aspect ratio, Resolution selection means for selecting a second resolution of the reference aspect ratio from among the displayable resolutions, and the device information includes the predetermined device.
- the display device changes the resolution of the display device to the resolution selected by the resolution selection means, and the device information does not match the predetermined device information, the recommended resolution of the display device Resolution changing means for changing the resolution of the display device.
- 1 is a schematic diagram of a transmission system according to an embodiment. It is an external view of the transmission terminal which concerns on this embodiment. It is a hardware block diagram of the transmission terminal which concerns on one Embodiment. 1 is a hardware configuration diagram of a transmission management system, a relay device, a program providing server, or an external input device according to an embodiment. It is a functional block diagram of each terminal, apparatus, and system which comprise the transmission system which concerns on one Embodiment. It is a functional block diagram of each terminal, apparatus, and system which comprise the transmission system which concerns on one Embodiment. It is a figure explaining the image quality of image data. It is a figure explaining the image quality of image data. It is a figure explaining the image quality of image data. It is a figure explaining the image quality of image data.
- FIG. 10 is a process flow diagram illustrating a process of narrowing down relay devices. It is the figure which showed the calculation state of the point of priority at the time of performing the narrowing-down process of a relay apparatus. It is the sequence diagram which showed the process which a transmission terminal selects a relay apparatus. It is the processing flowchart which showed the process which selects a relay apparatus in a transmission terminal. It is the sequence diagram which showed the process which transmits / receives image data and audio
- FIG. 1 is a schematic diagram of a transmission system 1 used in the present embodiment.
- a transmission system is a data providing system that transmits content data in one direction from one transmission terminal to the other transmission terminal via a transmission management system, or information and emotions between multiple transmission terminals via a transmission management system.
- This communication system is a system for mutually transmitting information, emotions, and the like between a plurality of communication terminals (corresponding to “transmission terminals”) via a communication management system (corresponding to “transmission management system”).
- Examples of the communication system include a television or video conference system, a video phone system, a voice conference system, a voice phone system, a PC (Personal Computer) screen sharing system, and the like.
- a television or video conference system as an example of a communication system is assumed, and a television or video conference management system as an example of a communication management system is assumed.
- a television or video conference terminal as an example of a communication terminal, a transmission system, a transmission management system, and a transmission terminal will be described. That is, the transmission terminal and the transmission management system of this embodiment are not only applied to a television or video conference system, but also applied to a communication system or a transmission system.
- the relay apparatus (30a, 30b, 30c, 30d), the transmission management system 50, the program providing system 90, and the maintenance system 100 are constructed.
- transmission terminal 10 is used to indicate an arbitrary transmission terminal among the transmission terminals (10aa, 10ab,..., 10db), and any of the displays (120aa, 120ab,..., 120db).
- Display 120 is used to indicate the display of "5"
- Relay device 30 is used to indicate any relay device among the relay devices (30a, 30b, 30c, 30d).
- the transmission terminal 10 transmits / receives image data, audio data, and the like to / from other transmission terminals 10.
- image data In the following, a case where the image of the image data is a moving image will be described, but it may be a still image as well as a moving image.
- the image of the image data may include both a moving image and a still image.
- the relay device 30 relays image data and audio data between the plurality of transmission terminals 10.
- the transmission management system 50 manages the transmission terminal 10 and the relay device 30 in an integrated manner.
- the external input device 40 is connected to the transmission terminal 10 and transmits display data for displaying material data to the transmission terminal 10.
- the material data represents data used using, for example, document creation software, spreadsheet software, presentation software, and the like.
- the program providing system 90 includes an HD (Hard Disk) (not shown) in which a transmission terminal program for causing the transmission terminal 10 to realize various functions or various means is stored. You can send the program.
- the HD of the program providing system 90 also stores a relay device program for causing the relay device 30 to realize various functions or various means, and can transmit the relay device program to the relay device 30. .
- the HD of the program providing system 90 also stores a transmission management program for causing the transmission management system 50 to realize various functions or various means, and transmits the transmission management program to the transmission management system 50. Can do.
- the transmission terminal 10aa, the transmission terminal 10ab, the relay device 30a, and the router 70a are communicably connected via the LAN 2a.
- the transmission terminal 10ba, the transmission terminal 10bb, the relay device 30b, and the router 70b are communicably connected via the LAN 2b.
- the LAN 2a and the LAN 2b are communicably connected via a dedicated line 2ab including the router 70c, and are constructed in a predetermined area A.
- the region A is Japan
- the LAN 2a is constructed in a Tokyo office
- the LAN 2b is constructed in an Osaka office.
- the transmission terminal 10ca, the transmission terminal 10cb, the relay device 30c, and the router 70d are connected to be communicable via the LAN 2c.
- the transmission terminal 10da, the transmission terminal 10db, the relay device 30d, and the router 70e are communicably connected via the LAN 2d.
- the LAN 2c and the LAN 2d are communicably connected by a dedicated line 2cd including the router 70f, and are constructed in a predetermined area B.
- region B is the United States
- LAN 2c is built in a New York office
- LAN 2d is Washington D.C. C. Is built in the office.
- Area A and area B are connected to each other via routers (70c, 70f) via the Internet 2i.
- the transmission management system 50 and the program providing system 90 are connected to the transmission terminal 10 and the relay device 30 through the Internet 2i so as to be communicable.
- the transmission management system 50 and the program providing system 90 may be installed in the region A or the region B, or may be installed in a region other than these.
- the communication network 2 is constructed by the LAN 2a, the LAN 2b, the dedicated line 2ab, the Internet 2i, the dedicated line 2cd, the LAN 2c, and the LAN 2d.
- IPv4 four sets of numbers shown under each transmission terminal 10, each relay device 30, transmission management system 50, each router 70, and program providing system 90 are IP addresses in general IPv4. Is simply shown. For example, the IP address of the transmission terminal 10aa is “1.2.1.3”. Further, IPv6 may be used instead of IPv4. In order to simplify the description, description will be made using IPv4.
- FIG. 2 is an external view of the transmission terminal according to the present embodiment.
- the longitudinal direction of the transmission terminal 10 will be described as the X-axis direction, the direction orthogonal to the X-axis direction in the horizontal plane as the Y-axis direction, and the direction orthogonal to the X-axis direction and the Y-axis direction (vertical direction) as the Z-axis direction. .
- the transmission terminal 10 includes a housing 1100, an arm 1200, and a camera housing 1300.
- the front side wall surface 1110 of the housing 1100 is provided with an air intake surface (not shown) formed by a plurality of air intake holes
- the rear side wall surface 1120 of the housing 1100 is formed with a plurality of exhaust holes.
- An exhaust surface 1121 is provided.
- a sound collecting hole 1131 is formed in the right wall surface 1130 of the housing 1100, and sounds such as voice, sound, noise can be collected by a built-in microphone 114 described later.
- An operation panel 1150 is formed on the right wall surface 1130 side of the housing 1100.
- the operation panel 1150 is provided with a plurality of operation buttons (108a to 108e) which will be described later, a power switch 109 which will be described later, and an alarm lamp 119 which will be described later, and output sound from a built-in speaker 115 which will be described later.
- a sound output surface 1151 formed by a plurality of sound output holes for passing through is formed.
- a housing portion 1160 as a recess for housing the arm 1200 and the camera housing 1300 is formed on the left wall surface 1140 side of the housing 1100.
- the right wall surface 1130 of the housing 1100 is provided with a plurality of connection ports (1132a to 1132c) for electrically connecting cables to an external device connection I / F 118 described later.
- the left wall surface 1140 of the housing 1100 is provided with a connection port (not shown) for electrically connecting the cable 120c for the display 120 to an external device connection I / F 118 described later.
- the “operation button 108” is used when an arbitrary operation button is indicated among the operation buttons (108a to 108e), and the “connection button” is indicated when an arbitrary connection port is indicated among the connection ports (1132a to 1132c). This will be described using the connection port 1132 ”.
- the arm 1200 is attached to the housing 1100 via a torque hinge 1210, and the arm 1200 is configured to be able to rotate in the vertical direction with respect to the housing 1100 within a tilt angle ⁇ 1 of 135 degrees.
- FIG. 2 shows a state where the tilt angle ⁇ 1 is 90 degrees.
- the camera housing 1300 is provided with a built-in camera 1021 that can capture images of users, documents, rooms, and the like.
- a torque hinge 1310 is formed in the camera housing 1300.
- the camera housing 1300 is attached to the arm 1200 via a torque hinge 1310.
- the camera housing 1300 is attached to the arm 1200 via a torque hinge 1310.
- the pan angle ⁇ 2 of ⁇ 180 degrees is assumed with respect to the arm 1200, with the state shown in FIG.
- a tilt angle ⁇ 3 of ⁇ 45 degrees can be rotated in the vertical and horizontal directions.
- relay device 30, the transmission management system 50, and the program providing system 90 have the same external appearance as a general server computer, and thus the description of the external appearance is omitted.
- FIG. 3 is a hardware configuration diagram of the transmission terminal 10 according to an embodiment.
- the transmission terminal 10 of the present embodiment includes a CPU (Central Processing Unit) 101 that controls the operation of the entire transmission terminal 10, a ROM (Read Only Memory) 102 that stores a transmission terminal program, A RAM (Random Access Memory) 103 used as a work area of the CPU 101, a flash memory 104 that stores various data such as image data and audio data, and controls reading or writing of various data to the flash memory 104 according to the control of the CPU 101
- An SSD (Solid State Drive) 105 a media drive 107 that controls reading or writing (storage) of data to a recording medium 106 such as a flash memory
- an operation button 108 that is operated when selecting a destination of the transmission terminal 10, a transmission Turning on / off the terminal 10
- a power switch 109 for switching between them, a network I / F 111 for transmitting data using a communication network 2 described later, a CCD (Charge Coupled Device) 112 for capturing
- a bus line 110 such as an address bus or a data bus is provided for electrical connection.
- the display 120 is a display unit configured by a liquid crystal or an organic EL that displays an image of an object, an operation icon, and the like.
- the display 120 is connected to the display I / F 117 by a cable 120c.
- the cable 120c may be an analog RGB (VGA) signal cable, a component video cable, HDMI (registered trademark) (High-Definition Multimedia Interface), or DVI (Digital Video). Interactive) signal cable may be used.
- the camera 112 includes a lens and a solid-state imaging device that converts light into electric charges and digitizes an object image (video).
- a solid-state imaging device that converts light into electric charges and digitizes an object image (video).
- CMOS Complementary Metal OxideCCDSemiconductor
- CCD Charge Coupled Device
- the external device connection I / F 118 includes an external camera, an external microphone, an external speaker, and the like by a USB (Universal Serial Bus) cable or the like inserted into the connection port 1132 of the housing 1100 shown in FIG. Can be electrically connected to each other.
- a USB Universal Serial Bus
- the external camera is driven in preference to the built-in camera 112 under the control of the CPU 101.
- each of the external microphones and the built-in speaker 115 is given priority over the internal microphone 114 and the internal speaker 115 according to the control of the CPU 101. An external speaker is driven.
- the recording medium 106 is detachable from the transmission terminal 10. Further, as long as it is a non-volatile memory that reads or writes data according to the control of the CPU 101, not only the flash memory 104 but also an EEPROM (Electrically Erasable and Programmable ROM) or the like may be used.
- the camera 112 is a solid-state imaging device that converts light into electric charges and digitizes an image (video) of a subject.
- the camera 112 is not limited to a CCD but may be a CMOS (Complementary Metal Oxide Semiconductor) or the like as long as it captures a subject. May be used.
- the display 120 is configured by a liquid crystal or organic EL that displays an image of a subject, an operation icon, and the like.
- the transmission terminal program may be distributed in a computer-readable recording medium such as the recording medium 106 as a file in an installable or executable format.
- FIG. 4 is a hardware configuration diagram of a transmission management system according to an embodiment.
- the transmission management system 50 includes a CPU 201 that controls the overall operation of the transmission management system 50, a ROM 202 that stores a transmission management program, a RAM 203 that is used as a work area for the CPU 201, an HD (Hard Disk) 204 that stores various data, and a CPU 201.
- a CPU 201 that controls the overall operation of the transmission management system 50
- a ROM 202 that stores a transmission management program
- a RAM 203 that is used as a work area for the CPU 201
- HD Hard Disk
- the HDD (Hard Disk Drive) 205 that controls the reading or writing of various data with respect to the HD 204 in accordance with the above control
- the media drive 207 that controls the reading or writing (storage) of data with respect to the recording medium 206 such as a flash memory, a cursor, a menu
- Display 208 for displaying various information such as windows, characters, images, etc., network I / F 209 for data transmission using communication network 2 to be described later, for inputting characters, numerical values, various instructions, etc.
- a keyboard 211 having a plurality of keys, a mouse 212 for selecting and executing various instructions, selecting a processing target, moving a cursor, and the like, and a CD-ROM (Compact-Disc-Read-Only-Memory) 213 as an example of a removable recording medium
- a CD-ROM drive 214 for controlling reading or writing of data to / from the external device, an external device I / F 215 for transmitting / receiving information to / from an external device, and the above-described components for electrical connection as shown in FIG.
- a bus line 210 such as an address bus or a data bus is provided.
- the transmission management program is a file in an installable or executable format, and may be recorded and distributed on a computer-readable recording medium such as the recording medium 206 or CD-ROM 213. .
- the ROM 202 stores an external input device program for controlling the external input device 40.
- the program for the external input device is a file in an installable format or an executable format, and is recorded on a computer-readable recording medium such as the recording medium 206 or the CD-ROM 213 and distributed. Also good.
- the relay device 30 has the same hardware configuration as that of the transmission management system 50, the description thereof is omitted.
- the ROM 202 stores a relay device program for controlling the relay device 30.
- the relay apparatus program is a file in an installable or executable format, and is recorded on a computer-readable recording medium such as the recording medium 206 or the CD-ROM 213 for distribution. Good.
- the program providing system 90 has the same hardware configuration as the transmission management system 50, the description thereof is omitted.
- a program providing program for controlling the program providing system 90 is recorded in the ROM 202.
- the program providing program is a file in an installable or executable format, and may be recorded on a computer-readable recording medium such as the recording medium 206 or the CD-ROM 213 and distributed. Good.
- the maintenance system 100 is a computer for maintaining, managing, or maintaining at least one of the transmission terminal 10, the relay device 30, the transmission management system 50, and the program providing system 90.
- the maintenance system 100 is installed in the country and the transmission terminal 10, the relay device 30, the transmission management system 50, or the program providing system 90 is installed outside the country, the maintenance system 100 is remotely connected via the communication network 2.
- maintenance such as maintenance, management, and maintenance of at least one of the transmission terminal 10, the relay device 30, the transmission management system 50, the authentication system 80, and the program providing system 90 is performed.
- the maintenance system 100 does not go through the communication network 2, and the model number, the manufacturing number, the sales destination, the maintenance in at least one of the transmission terminal 10, the relay device 30, the transmission management system 50, and the program providing system 90. Perform maintenance such as inspection or management of failure history.
- the program providing system 90 and the maintenance system 100 have the same hardware configuration as the transmission management system 50, the description thereof is omitted.
- a program providing program for controlling the program providing system 90 is recorded in the HD 204.
- the program providing program is a file in an installable or executable format, and may be recorded on a computer-readable recording medium such as the recording medium 206 or the CD-ROM 213 and distributed. Good.
- the program providing system program may be stored in the ROM 202 instead of the HD 204.
- the recording medium is provided by being recorded on a computer-readable recording medium such as a CD-R (Compact Disc Recordable), a DVD (Digital Versatile Disk), or a Blu-ray Disc. May be.
- a computer-readable recording medium such as a CD-R (Compact Disc Recordable), a DVD (Digital Versatile Disk), or a Blu-ray Disc. May be.
- 5A and 5B are functional block diagrams of each terminal, device, and system constituting the transmission system 1 of the present embodiment.
- 5A and 5B, the transmission terminal 10, the relay device 30, and the transmission management system 50 are connected so that data communication can be performed via the communication network 2.
- the external input device 40 is connected so that data can be transmitted to and received from the transmission terminal 10.
- FIG. 24 is a functional block diagram of the external input device 40 constituting the transmission system 1 of the present embodiment.
- the program providing system 90 shown in FIG. 1 is omitted in FIGS. 5A and 5B because it is not directly related to the video conference communication.
- the transmission terminal 10 includes a transmission / reception unit 11, an operation input reception unit 12, a login request unit 13, an imaging unit 14a, an image display control unit 14b, an audio input unit 15a, an audio output unit 15b, a selection processing unit 16, a delay detection unit 17, An external information transmitting / receiving unit 18 and a storage / reading processing unit 19 are provided.
- Each of these units is a function or means realized by any one of the components shown in FIG. 3 operating according to a command from the CPU 201 according to a program stored in the ROM 202.
- the transmission terminal 10 has a storage unit 1000 constructed by the SSD 105 shown in FIG.
- the transmission / reception unit 11 of the transmission terminal 10 is realized by the network I / F 111 illustrated in FIG. 3, and transmits / receives various data (information) to / from other terminals, devices, or systems via the communication network 2.
- the operation input receiving unit 12 is realized by the operation button 108 and the power switch 109 shown in FIG. 3 and receives various inputs by the user. For example, when the user turns on the power switch 109 shown in FIG. 3, the operation input receiving unit 12 shown in FIG. 5B receives the power ON and turns on the power.
- the login request unit 13 is realized by a command from the CPU 101 shown in FIG. 3, and requests the login from the transmission / reception unit 11 to the transmission management system 50 via the communication network 2 when receiving the power ON.
- the login request information indicating the fact and the current IP address of the transmission terminal 10ab are automatically transmitted.
- the imaging unit 14a is realized by the camera 112 and the imaging device I / F 113 shown in FIG. 3, images a subject, and outputs image data obtained by the imaging.
- the image display control unit 14b is realized by the display I / F 117 shown in FIG. 3, and performs control for transmitting image data to the external display 120.
- the image display control unit 14b includes a resolution control unit 14b1 that appropriately controls the resolution of image data to be output in accordance with the resolution of the connected display (display device) 120, an operation menu, and an error. And an auxiliary information display unit 14b2 for controlling display of auxiliary information such as messages.
- the resolution control unit 14b1 includes a plurality of resolutions that can be displayed on the display 120, the resolution currently displayed, or a resolution acquisition unit 14b10 that acquires resolution from data read from the resolution management table when a resolution management table is provided.
- a resolution determination unit 14b11 that determines whether the resolution satisfies a predetermined condition, a resolution selection unit 14b12 that selects a resolution from a plurality of resolutions that can be displayed on the display 120 under a predetermined condition, expansion and contraction of image data, and as necessary
- An image processing unit 14b13 that performs processing such as adding a segment area to the image data, a flag setting unit 14b14 that sets an overlap flag (overlap flag), and a resolution changing unit 14b15 that changes the selected resolution are provided. .
- the resolution control unit 14b1 includes a resolution management table reading unit 14b16 that reads a data row from the resolution management table, a flag acquisition unit 14b17 that acquires a superposition flag from the read data row, and a flag determination unit that determines the value of the superposition flag 14b18 and a segment value acquisition unit 14b19 that acquires a segment value from the data row read from the resolution management table.
- the auxiliary information display unit 14b2 includes an auxiliary information generation unit 14b20 that generates auxiliary information such as an operation menu and an error message, an auxiliary information image generation unit 14b21 that generates an auxiliary information image, and the generated auxiliary information image as an original image. And an auxiliary information image display unit 14b22 that is combined with the data and displayed on the display 120.
- FIG. 30 shows an example of data used for control by the image display control unit 14b, such as “current display resolution”, “displayable resolution”, “flag overlap”, “segment position”, “auxiliary information display position”, “display content”, and the like.
- the “current display resolution” temporarily stores the resolution (width and height) set for display at the present time acquired by the resolution acquisition unit 14 b 10 from the display 120.
- the general display 120 internally stores information on the resolution currently set for display and can be referred to from the outside.
- the “displayable resolution” temporarily holds one or more resolutions (width and height) that can be displayed on the display 120 acquired by the resolution acquisition unit 14b10 from the display 120.
- the general display 120 can display at a plurality of resolutions, and internally stores information on resolutions that can be displayed and can be referred to from the outside.
- the “current display resolution” and “displayable resolution” are displayed together with the aspect ratio in parentheses, but the aspect ratio can be calculated from the resolution and can be omitted.
- “Flag overlap” is a flag indicating whether or not auxiliary information is superimposed on the original image data, and means that auxiliary information is displayed in the added segment area when it is not superimposed.
- Segment position is information indicating a position to which a segment area is added.
- “Auxiliary information display position” is information indicating a position where auxiliary information is displayed.
- Display content is information indicating the content of the auxiliary information. In addition, setting values such as making the background translucent when displaying auxiliary information can be held.
- the voice input unit 15a is realized by the microphone 114 and the voice input / output I / F 116 shown in FIG. 3.
- the voice input unit 15a inputs the voice of the user and converts the voice into a voice signal.
- the audio output unit 15b is realized by the speaker 115 and the audio input / output I / F 116 shown in FIG. 3, and converts an audio signal related to the audio data into audio and outputs it.
- the selection processing unit 16 performs a final narrowing process that finally narrows down from a plurality of relay devices 30 to one relay device 30, a measurement unit 16a, a calculation unit 16b, And the selection part 16c is implement
- the measurement unit 16 a measures the reception date and time when the pre-transmission information is received by the transmission / reception unit 11 for each pre-transmission information described later received by the transmission / reception unit 11.
- the calculation unit 16b determines the pre-transmission information based on the difference between the measured reception time and the transmission date and time included in the pre-transmission information. The time required from transmission to reception is calculated.
- the selection unit 16c finally selects one relay device by selecting the relay device 30 to which the pre-transmission information requiring the shortest required time is relayed among the required times calculated by the calculation unit 16b.
- the delay detection unit 17 is realized by a command from the CPU 101 shown in FIG. 3, and detects a delay time (ms) of image data or audio data sent from another transmission terminal 10 via the relay device 30. To do.
- the external information transmitting / receiving unit 18 transmits / receives data to / from the external device through the external device I / F 215.
- the storage / read processing unit 19 is executed by the SSD 105 shown in FIG. 3, and stores various data in the storage unit 1000 and reads various data stored in the storage unit 1000.
- the storage unit 1000 includes a terminal ID (Identification) for identifying the transmission terminal 10 and a password, as well as a relay device ID for identifying the relay device 30 that transmits image data, audio data, and various data, and a destination terminal.
- the storage unit 1000 also stores a display data acquisition unit 451 and a display data transmission unit 452 that are transmitted to the external input device 40 and operate on the external input device 40.
- the display data acquisition unit 451 is for the external input device 40 to acquire display data
- the display data transmission unit 452 is for transmitting the display data acquired by the display data acquisition unit 451 to the transmission terminal 10.
- Display data represents image data obtained by converting an image displayed on the screen of the display device into a format such as JPEG (Joint Photographic Experts Group) or Bitmap, or a rendering command such as GDI (Graphics Device Interface).
- the terminal ID of this embodiment and the relay device ID described later are identification information such as a language, characters, symbols, or various signs used to uniquely identify the transmission terminal 10 and the relay device 30, respectively. Show. Further, the terminal ID and the relay device ID may be identification information in which at least two of the language, characters, symbols, and various indicia are combined.
- the transmission terminal 10 as a request source requesting the start of a video conference will be described as “request source terminal 10A”
- the transmission terminal 10 as a destination as a request destination will be described as “destination terminal 10B”.
- the external input device 40 includes a transmission / reception unit 41, a connection detection unit 42, an installation determination unit 43, a program acquisition unit 44, an operation input reception unit 46, a display control unit 47, a mount unit 48, and A storage / reading processing unit 49 is provided.
- Each of these units is a function or means realized by any one of the components shown in FIG. 4 operating according to a command from the CPU 201 according to a program stored in the ROM 202.
- the external input device 40 has a storage unit 4000 constructed by the HDD 205 shown in FIG. Further, the external input device 40 is equipped with an OS (Operating System) such as Windows (registered trademark), and thereby has a function of executing a program when connected to another device.
- OS Operating System
- the transmission / reception unit 41 of the external input device 40 is realized by the network I / F 209 illustrated in FIG. 4, and transmits / receives various data (information) from the transmission terminal 10.
- the connection detection unit 42 detects that data transmission / reception with the external device is enabled by the external device input / output I / F 215.
- the installation determination unit 43 determines whether the display data acquisition unit 451 and the display data transmission unit 452 are installed in the external input device 40.
- the program acquisition unit 44 acquires and installs the display data acquisition unit 451 and the display data transmission unit 452 from the storage unit 1000 of the transmission terminal 10 connected via the transmission / reception unit 41.
- the operation input receiving unit 46 receives an input by a user operation.
- the display control unit 47 causes the display device 400 to display an image read by a storage / reading processing unit 49 described later.
- the mount unit 48 mounts a storage unit of various devices connected to the external input device 40.
- the storage / reading processing unit 49 is executed by the HDD 205 shown in FIG. 4 and performs processing of storing various data in the storage unit 4000 and reading out various data stored in the storage unit 4000.
- the storage unit 4000 stores material data and the like.
- the relay device 30 includes a transmission / reception unit 31, a state detection unit 32, a data quality confirmation unit 33, a change quality management unit 34, a data quality change unit 35, and a storage / read processing unit 39. Each of these units is a function or means realized by any one of the components shown in FIG. 4 operating according to a command from the CPU 201 according to a program stored in the ROM 202. Further, the relay device 30 has a storage unit 3000 constructed by the HD 204 shown in FIG.
- a change quality management DB 3001 configured by a change quality management table as shown in FIG.
- the IP address of the transmission terminal 30 as a relay destination of image data and the image quality of the image data relayed by the relay device 30 are associated with the relay destination and managed.
- the image is composed of 160 pixels in the horizontal direction and 120 pixels in the vertical direction, and is a low-resolution image as a base image
- the horizontal size is 320 pixels
- the vertical size is 240 pixels.
- low-quality image data consisting only of low-resolution image data serving as a base image is relayed.
- the band When the band is relatively wide, low-resolution image data serving as a base image and medium-quality image data composed of medium-resolution image data are relayed.
- the bandwidth When the bandwidth is very wide, high-resolution image data composed of low-resolution image data serving as the base image quality, intermediate-resolution image data, and high-resolution image data is relayed.
- the relay device 30 when the relay device 30 relays image data to the destination terminal 10db having the IP address “1.3.2.4”, the relay is performed.
- the image quality (image quality) of the image data is “high quality”.
- each functional unit of the relay device 30 will be described in detail.
- each component of the relay device 30 will be described in relation to main components for realizing each component of the relay device 30 among the components illustrated in FIG. 3.
- the transmission / reception unit 31 of the relay device 30 shown in FIG. 5B is realized by the network I / F 209 shown in FIG. 4, and various data (information) with other terminals, devices, or systems via the communication network 2. ).
- the state detection unit 32 is realized by a command from the CPU 201 illustrated in FIG. 4, and detects the operating state of the relay device 30 having the state detection unit 32.
- the operating state includes “ON line”, “OFF line”, and “failing” state.
- the data quality confirmation unit 33 is realized by a command from the CPU 201 shown in FIG. 4, searches the change quality management table (see FIG. 7) using the IP address of the destination terminal 10B as a search key, and relays the corresponding data.
- the image quality of the relayed image data is confirmed by extracting the image quality of the image data to be relayed.
- the change quality management unit 34 is realized by a command from the CPU 201 shown in FIG. 4 and changes the contents of the change quality management DB 3001 based on quality information to be described later sent from the transmission management system 50. For example, during a video conference by transmitting / receiving high-quality image data between the request source terminal 10aa having the terminal ID “01aa” and the destination terminal 10db having the terminal ID “01db”.
- the relay device No. 30 needs to lower the image quality of image data relayed up to now from high image quality to medium image quality.
- the content of the change quality management DB 3001 is changed so as to lower the image quality of the image data relayed by the relay device 30 from the high image quality to the medium image quality based on the quality information indicating the medium image quality.
- the data quality changing unit 35 is realized by an instruction from the CPU 201 shown in FIG. 4, and the image quality of the image data sent from the transmission source terminal 10 is based on the contents of the changed change quality management DB 3001. To change.
- the storage / reading processing unit 39 is realized by the HDD 205 shown in FIG. 4, and stores various data in the storage unit 3000 and reads various data stored in the storage unit 3000.
- the transmission management system 50 includes a transmission / reception unit 51, a terminal authentication unit 52, a state management unit 53, a terminal extraction unit 54, a terminal state acquisition unit 55, a narrowing unit 56, a session management unit 57, a quality determination unit 58, a storage / read process.
- Unit 59 and delay time management unit 60 Each of these units is a function or means realized by any one of the components shown in FIG. 4 operating according to a command from the CPU 201 according to a program stored in the ROM 202.
- the transmission management system 50 has a storage unit 5000 constructed by the HD 204 shown in FIG.
- a relay device management DB 5001 configured by a relay device management table as shown in FIG. 8 is constructed.
- the IP of the relay device 30 The address and the maximum data transmission rate (Mbps) in the relay device 30 are managed in association with each other.
- the relay device 30a with the relay device ID “111a” has an operation state of “ON line” and the date and time when the transmission management system 50 received the status information.
- “November 10, 2009, 13:00” indicates that the IP address of the relay device 30a is “1.2.1.2” and the maximum data transmission speed in the relay device 30a is 100 Mbps. Has been.
- Terminal authentication management table Furthermore, in the storage unit 5000, a terminal authentication management DB 5002 configured by a terminal authentication management table as shown in FIG.
- each password is associated with each terminal ID of all transmission terminals 10 managed by the transmission management system 50 and managed.
- the terminal authentication management table shown in FIG. 9 indicates that the terminal ID of the transmission terminal 10aa is “01aa” and the password is “aaaa”.
- a terminal management DB 5003 configured by a terminal management table as shown in FIG. 10 is constructed.
- the operation status of each transmission terminal 10 the reception date and time when login request information described later is received by the transmission management system 50, and the IP address of the transmission terminal 10 are associated.
- Managed For example, in the terminal management table shown in FIG. 10, the transmission terminal 10aa whose terminal ID is “01aa” is “ON line” in the operation state, and the date and time when the login management information is received by the transmission management system 50 is “ "November 10, 2009, 13:40" indicates that the IP address of the transmission terminal 10aa is "1.2.1.3".
- a destination list management DB 5004 configured by a destination list management table as shown in FIG.
- all terminal IDs of destination terminals 10B registered as candidates for destination terminal 10B are managed in association with terminal IDs of request source terminal 10A requesting the start of a video conference.
- a candidate for the destination terminal 10B that can request the start of the video conference from the request source terminal 10aa having the terminal ID “01aa” has the terminal ID “01ab”.
- the transmission terminal 10ab has the terminal ID “01ba”
- the transmission terminal 10db has the terminal ID “01db”.
- the candidates for the destination terminal 10B are updated by being added or deleted in response to a request for addition or deletion from the request source terminal 10A to the transmission management system 50.
- a session management DB 5005 configured by a session management table as shown in FIG. 12 is constructed.
- the request source terminal 10A The terminal ID of the destination terminal 10B, the terminal ID of the destination terminal 10B, the reception delay time (ms) when the destination terminal 10B receives image data, and the delay information indicated by this delay time are sent from the destination terminal 10B.
- the reception date and time received and received by the transmission management system 50 is managed in association with each other. For example, in the session management table shown in FIG.
- the relay device 30a (relay device ID “111a”) selected in the session executed using the selection session ID “se1” has the terminal ID “01aa”. "And the destination terminal 10db with the terminal ID" 01db "are relayed image data and audio data, and the destination terminal 10db reads" November 10, 2009 14:00 It is shown that the delay time of the image data at the time is 200 (ms).
- the reception date and time of the delay information may be managed based on the delay information transmitted from the request source terminal 10A instead of the destination terminal 10B. .
- the reception date and time of the delay information is managed based on the delay information transmitted from the transmission terminal 10 on the reception side of the image data and the audio data. To do.
- a priority management DB 5006 configured by an address priority management table as shown in FIG. 13 is constructed.
- this address priority management table in accordance with the difference in the four dot address (Dot Address) portions of the general IPv4 IP addresses, the address priority points are associated and managed so as to increase.
- the address priority point is “5”.
- the address priority point is “3”. In this case, whether the value of the lowest dot address is the same or not is not related to the priority.
- the address priority point is “1”. In this case, whether or not the values of the third and lowest dot addresses from the top are the same has no relation to the priority. In the case of IP addresses having different uppermost values of dot addresses, the address priority point is “0”. In this case, whether or not the values of the second, third, and lowest dot addresses from the top are the same is not related to priority.
- the priority management DB 5006 built in the storage unit 5000 also includes a transmission speed priority management table as shown in FIG.
- the transmission rate priority points are associated and managed in accordance with the value of the maximum data transmission rate (Mbps) in the relay device 30 so as to increase.
- the transmission rate priority point is “5”.
- the transmission rate priority point is “3”.
- the transmission rate priority point is “1”.
- the transmission rate priority point is “0”.
- a quality management DB 5007 configured by a quality management table as shown in FIG.
- the image quality (image quality) of the image data relayed by the relay device 30 is associated and managed according to the delay time (ms) of the image data at the request source terminal 10A or the destination terminal 10B.
- each functional part of the transmission management system 50 will be described in detail.
- a relationship with main constituent elements for realizing each part of the transmission management system 50 among the constituent elements shown in FIG. 4 will also be described. .
- the transmission / reception unit 51 is executed by the network I / F 209 shown in FIG. 4 and transmits / receives various data (information) to / from other terminals, devices or systems via the communication network 2.
- the terminal authentication unit 52 searches the terminal authentication management DB 5002 in the storage unit 5000 using the terminal ID and password included in the login request information received via the transmission / reception unit 51 as search keys, and is identical to the terminal authentication management DB 5002. Terminal authentication is performed by determining whether the terminal ID and password are managed.
- the state management unit 53 stores the terminal ID of the request source terminal 10A, the operation state of the request source terminal 10A, and the transmission in the terminal management table (see FIG. 11).
- the management system 50 stores and manages the reception date and time when the login request information is received and the IP address of the request source terminal 10A in association with each other.
- the terminal extraction unit 54 searches the destination list management table (see FIG. 11) using the terminal ID of the request source terminal 10A that requested the login as a key, and is a candidate terminal of the destination terminal 10B that can communicate with the request source terminal 10A.
- the terminal ID is extracted by reading the ID.
- the terminal extraction unit 54 searches the destination list management table (see FIG. 11) using the terminal ID of the request source terminal 10A that requested the login as a key, and sets the terminal ID of the request source terminal 10A as a candidate for the destination terminal 10B. As well as the terminal IDs of the other request source terminals 10A registered.
- the terminal status acquisition unit 55 searches the terminal management DB table (see FIG. 10) using the candidate terminal ID of the destination terminal 10B extracted by the terminal extraction unit 54 as a search key, and is extracted by the terminal extraction unit 54.
- the operating state is read for each terminal ID.
- the terminal state acquisition unit 55 can acquire the operation state of the candidate of the destination terminal 10B that can communicate with the request source terminal 10A that has requested the login.
- the terminal state acquisition unit 55 searches the terminal management table (see FIG. 10) using the terminal ID extracted by the terminal extraction unit 54 as a search key, and also acquires the operating state of the request source terminal 10A that requested the login. To do.
- the narrowing unit 56 performs a primary narrowing process before the final narrowing process in order to support a final narrowing process that finally narrows down from a plurality of relay apparatuses 30 to one relay apparatus 30.
- a terminal IP address extraction unit 56b, a primary selection unit 56c, and a priority determination unit 56d are included.
- the selection session ID generation unit 56 a generates a selection session ID used for executing a session for selecting the relay device 30.
- the terminal IP address extracting unit 56b The IP address of each corresponding transmission terminal 10 is extracted.
- the primary selection unit 56c selects the relay device ID of the relay device 30 whose operation state is “ON line” from among the relay devices 30 managed in the relay device management table (see FIG. 8). The relay device 30 is selected.
- the primary selection unit 56c searches the relay device management table (see FIG. 8) based on the IP address of the request source terminal 10A and the IP address of the destination terminal 10B extracted by the terminal IP address extraction unit 56b. Thus, it is investigated whether the dot addresses of the IP addresses of the selected relay device 30 are the same as or different from the dot addresses in the IP addresses of the request source terminal 10A and the destination terminal 10B. Further, the primary selection unit 56c, for each relay device, the upper two relays having higher points among the higher points with respect to the transmission terminal 10 at the address priority points and the integration points obtained by integrating the transmission speed priority points. By selecting the device 30, the relay device 30 is further selected.
- the top two relay devices 30 with high points are selected.
- the present invention is not limited to this. If one relay device 30 can be narrowed down as many as possible, the top points with high points are selected. Three or more relay devices 30 may be selected.
- the priority determination unit 56d refers to the priority management table (see FIG. 13) and determines an address priority point for each relay device 30 investigated by the primary selection unit 56c. Further, the priority determination unit 56d searches the priority management table (see FIG. 14) based on the maximum data transmission rate of each relay device 30 managed in the relay device management table (see FIG. 8). The transmission speed priority point is determined for each relay device 30 narrowed down by the primary selection unit 56c.
- the session management unit 57 stores the selection session ID generated by the selection session ID generation unit 56a, the terminal ID of the request source terminal, and the terminal ID of the destination terminal in the session management table (see FIG. 12) of the storage unit 5000. Store and manage in association. In addition, the session management unit 57 selects the relay device of the relay device 30 that is finally selected by the selection unit 16c of the transmission terminal 10 for each session ID for selection with respect to the session management table (see FIG. 12). Store and manage IDs.
- the quality determining unit 58 searches the quality management table (see FIG. 15) using the delay time as a search key, and extracts the image quality of the corresponding image data, thereby determining the image quality of the image data to be relayed to the relay device 30.
- the storage / read processing unit 59 is executed by the HDD 205 shown in FIG. 4, and stores various data in the storage unit 5000 or reads various data stored in the storage unit 5000.
- the delay time management unit 60 extracts a corresponding terminal ID by searching the terminal management table (see FIG. 10) using the IP address of the destination terminal 10B as a search key, and further extracts a session management table (see FIG. 12). ), The delay time indicated in the delay information is stored and managed in the field portion of the delay time in the record including the extracted terminal ID.
- FIG. 16 is a sequence diagram illustrating processing for managing state information indicating the state of each relay device 30 transmitted from each relay device 30 to the transmission management system 50.
- FIG. 17 is a sequence diagram showing a preparation stage process for starting communication between a plurality of transmission terminals 10.
- FIG. 18 is a sequence diagram illustrating processing for narrowing down the relay devices 30.
- FIG. 19 is a process flow diagram illustrating a process of narrowing down the relay devices 30.
- FIG. 20 is a diagram illustrating a point calculation state when the relay device 30 performs the narrowing-down process.
- FIG. 21 is a sequence diagram illustrating processing in which the transmission terminal 10 selects the relay device 30.
- FIG. 22 is a process flow diagram illustrating a process in which the transmission terminal 10 selects the relay device 30.
- FIG. 23 is a sequence diagram illustrating processing for transmitting and receiving image data and audio data between the transmission terminals 10.
- FIG. 25 is a sequence diagram showing a process of displaying the display data displayed by the external input device 40 on the transmission terminal 10 that is a conference partner.
- FIG. 26 is an example of a screen displayed by the external input device 40.
- FIG. 27 is an example of a screen on which the transmission terminal 10 displays image data and display data.
- FIG. 28 is a flowchart showing a process in which the external input device installs the display data acquisition unit.
- each relay device 30 the state detection unit 32 shown in FIG. 5B periodically detects the operating state of the relay device 30 as its own device (S1-1 to S1-4).
- the transmission / reception unit 31 of each relay device 30 periodically sends each status information to the transmission management system 50 via the communication network 2 so that the transmission management system 50 can manage the operation state of each relay device 30 in real time. Transmit (steps S2-1 to S2-4).
- Each state information includes the relay device ID for each relay device 30 and the operating state detected by the state detection unit 32 of the relay device 30 related to each relay device ID.
- the relay devices (30a, 30b, 30d) operate normally and are “ON line”, while the relay device 30c is in operation, but the relay operation of the relay device 30c. The case where some trouble has occurred in the program for executing the “OFF line” is shown.
- the transmission / reception unit 51 receives each status information sent from each relay device 30, and the relay device management table (FIG. 8) of the storage unit 5000 via the storage / read processing unit 59.
- the state information is stored and managed for each relay device ID (steps S3-1 to S3-4).
- the operation status of “ON line”, “OFF line”, or “failing” is stored and managed for each relay device ID in the relay device management table as shown in FIG.
- the reception date and time when the status information is received by the transmission management system 50 is also stored and managed for each relay device ID. If the status information is not sent from the relay device 30, the field portion of the operating state and the field portion of the reception date and time in each record of the relay device management table shown in FIG. The operation status and the reception date and time at the previous reception are shown.
- the login request unit 13 automatically transmits login request information indicating a login request from the transmission / reception unit 11 to the transmission management system 50 via the communication network 2 in response to the reception of the power ON (step S22).
- the login request information includes a terminal ID for identifying the transmission terminal 10aa that is the own apparatus as a request source, and a password.
- terminal ID and password are data read from the storage unit 1000 via the storage / read processing unit 19 and sent to the transmission / reception unit 11.
- the transmission management system 50 that is the reception side can grasp the IP address of the transmission terminal 10ab that is the transmission side.
- the terminal authentication unit 52 of the transmission management system 50 uses the terminal ID and password included in the login request information received via the transmission / reception unit 51 as search keys, and the terminal authentication management table (FIG. 9).
- Terminal authentication is performed by determining whether the same terminal ID and password are managed in the terminal authentication management DB 5002 (step S23). Since the same terminal ID and password are managed by the terminal authentication unit 52, when it is determined that the login request is from the transmission terminal 10 having a valid usage right, the state management unit 53 In the management table (see FIG. 10), the terminal ID of the transmission terminal 10aa, the operating state, the reception date and time when the login request information is received, and the IP address of the transmission terminal 10aa are stored in association with each other (step S24).
- the transmission terminal ID “01aa”, the operation state “ON line”, the reception date and time “2009.11.10.13:40”, and the terminal IP address “1” .2.1.3 is managed in association with each other.
- the transmission / reception unit 51 of the transmission management system 50 transmits the authentication result information indicating the authentication result obtained by the terminal authentication unit 52 to the request source terminal 10aa that has made the login request via the communication network 2. (Step S25).
- the terminal authentication unit 52 determines that the terminal has a valid usage right will be described below.
- the terminal extraction unit 54 of the transmission management system 50 searches the destination list management table (see FIG. 11) using the terminal ID “01aa” of the request source terminal 10aa that requested the login as a search key, and communicates with the request source terminal 10aa. It extracts by reading the terminal ID of the candidate destination terminal 10B (step S26).
- the terminal IDs “01ab”, “01ba”, and “01db” of the destination terminals (10ab, 10ba, 10db) corresponding to the terminal ID “01aa” of the request source terminal 10aa are extracted.
- the terminal status acquisition unit 55 uses the terminal IDs (“01ab”, “01ba”, “01db”) of the candidate destination terminal 10B extracted by the terminal extraction unit 54 as a search key, as a terminal management table (FIG. 10) and reading the operating state (“OFF line”, “ON line”, “ON line”) for each terminal ID extracted by the terminal extraction unit 54, thereby transmitting terminals (10ab, 10ba, 10db) is acquired (step S27).
- the transmission / reception unit 51 operates the terminal ID (“01ab”, “01ba”, “01db”) as the search key used in step S27 and the operating state of the corresponding destination terminal (10ab, 10ba, 10db).
- the destination state information including (“OFF line”, “ON line”, “ON line”) is transmitted to the request source terminal 10aa via the communication network 2 (step S28).
- the request source terminal 10aa transmits the current operating states ("OFF line", "" of the transmission terminals (10ab, 10ba, 10db) that are candidates for the destination terminal 10B that can communicate with the request source terminal 10aa. "ON line", "ON line”).
- the terminal extraction unit 54 of the transmission management system 50 searches the destination list management table (see FIG. 11) using the terminal ID “01aa” of the request source terminal 10aa that has requested the login as a search key, and the request source terminal 10aa.
- the terminal ID of the other request source terminal 10A in which the terminal ID “01aa” is registered as a candidate for the destination terminal 10B is extracted (step S29).
- the terminal IDs of the other request source terminals 10A to be extracted are “01ab”, “01ba”, and “01db”.
- the terminal status acquisition unit 55 of the transmission management system 50 searches the terminal management table (see FIG. 10) using the terminal ID “01aa” of the request source terminal 10aa that has made the login request as a search key, and logs in.
- the operating state of the requesting terminal 10aa that has requested is acquired (step S30).
- the transmission / reception unit 51 includes the terminal management table (FIG. 10) among the transmission terminals (10ab, 10ba, 10db) related to the terminal IDs (“01ab”, “01ba”, and “01db”) extracted in step S29.
- the transmission terminal (10ba, 10db) whose operation state is “ON line” in the reference) includes the terminal ID “01aa” and the operation state “ON line” of the request source terminal 10aa acquired in step S30.
- the destination status information is transmitted (steps S31-1, S31-2).
- the terminal management table shown in FIG. 10 is used based on each terminal ID (“01ba”, “01db”).
- the terminal ID “01aa” of the request source terminal 10aa that requested the login is sent to each of the other destination terminals (10db, 10ba) that can communicate with the request source terminal 10aa that requested the login, and The operating status “ON line” can be communicated.
- step S 21 when the user turns on the power switch 109 shown in FIG. 4, the operation input receiving unit 12 shown in FIG. 5B turns on the power. Since it receives and performs the same processing as the processing of steps S22 to S31-1, 31-2, its description is omitted.
- the request source terminal 10aa is the transmission terminal (10ba, 10db) whose operation state is the ON line, based on the destination state information received in step S28, among the transmission terminals 10 as destination candidates. It is possible to communicate with at least one of the above. Thus, hereinafter, a case will be described in which the user of the request source terminal 10aa selects to start communication with the destination terminal 10db.
- the operation input reception unit 12 shown in FIG. 5B requests to start communication with the transmission terminal 10db. Is received (step S41).
- the transmission / reception unit 11 of the transmission terminal 10aa includes the transmission request management information including the terminal ID “01aa” of the request source terminal 10aa and the terminal ID “01db” of the destination terminal 10db, indicating that communication is to be started. It transmits to the system 50 (step S42).
- the transmission / reception unit 51 of the transmission management system 50 receives the start request information and grasps the IP address “1.2.1.3” of the request source terminal 10aa that is the transmission source.
- the state management unit 53 uses the terminal management table of the terminal management table (see FIG. 10). Then, the field portion of the operation state of the record including the terminal ID “01aa” and the terminal ID “01db” is changed to “busy” (step S43). In this state, the request source terminal 10aa and the destination terminal 10db have not started communication (call), but are in a call state, and another transmission terminal 10 tries to communicate with the request source terminal 10aa or the destination terminal 10db. Then, a voice or display indicating a so-called call state is output.
- the selection session ID generation unit 56a generates a selection session ID used to execute a session for selecting the relay device 30 (step S44).
- the session management unit 57 stores the selection session ID “se1” generated in step S44, the terminal ID “01aa” of the request source terminal 10aa, and the destination in the session management table (see FIG. 12) of the storage unit 5000.
- the terminal ID “01db” of the terminal 10db is associated and stored and managed (step S45).
- the narrowing-down unit 56 of the transmission management system 50 relays the communication between the request source terminal 10aa and the destination terminal 10db based on the relay device management DB 5001, the terminal management DB 5003, and the priority management DB 5006.
- the primary narrowing down of the device 30 is performed (step S46).
- the terminal IP address extraction unit 56b is based on the terminal ID “01aa” of the request source terminal 10aa and the terminal ID “01db” of the destination terminal 10db included in the start communication information transmitted from the request source terminal 10aa.
- the IP address (“1.2.1.3”, “1.3.2.4”) of the corresponding transmission terminal (10aa, 10db) is obtained.
- Extract step S46-11).
- the primary selection unit 56c selects the relay device (30a, 30b, 30d) that is “ON line” among the operating states of the relay device 30 managed in the relay device management table (see FIG. 8).
- Each relay device ID (111a, 111b, 111d) is selected (step S46-2). Further, the primary selection unit 56c extracts the IP address “1.2.1.3” of the request source terminal 10aa and the IP address “1.3.2.4” of the destination terminal 10db extracted in step S46-1. ”On the basis of the IP address (“ 1.2.1. ”) Of the relay device (30a, 30b, 30d) selected in step S46-2 by searching the relay device management table (see FIG. 8). 2. ”,“ 1.2.2.2 ”,“ 1.3.2.2 ”) for each IP address (“ 1.2.1 ”) of the request source terminal 10aa and destination terminal 10db. .3 ",” 1.3.2.4 "), it is checked whether it is the same as or different from each dot address (step S46-3).
- the priority determination unit 57c refers to the priority management table (see FIG. 13), and for each relay device (30a, 30b, 30d) investigated in step 46-3, the address priority point. Is determined (step S46-4).
- FIG. 20 is a diagram illustrating a calculation state of priority points when the relay device 30 performs the narrowing-down process.
- an address priority point for each relay device ID, an address priority point, a transmission speed priority point, and an integration point are shown.
- the address priority points further indicate a point for each requesting terminal 10aa and a point for the destination terminal 10db of each relay device 30.
- the integration point is the sum of the higher one of the two address priority points and the transmission speed priority point.
- the IP address “1.2.1.2” of the relay device 30a is “same as the same” as the IP address “1.2.1.3” of the request source terminal 10aa. Therefore, as shown in FIG. 20, the address priority point is “5”. Further, since the IP address “1.2.1.2” of the relay device 30a is “same.different.different.different” with respect to the IP address “1.3.2.4” of the destination terminal 10db, The address priority point is “1”. Further, the IP address “1.2.2.2” of the relay device 30b is “same, same, different, different” with respect to the IP address “1.2.1.3” of the request source terminal 10aa. The point of the address priority is “3”.
- the IP address “1.2.2.2” of the relay device 30b is “same.different.same.different” with respect to the IP address “1.3.2.4” of the destination terminal 10db
- the address priority point is “1”.
- the IP address “1.3.2.2” of the relay device 30d is “same.different.different.different” with respect to the IP address “1.2.1.3” of the request source terminal 10aa.
- the point of the address priority is “1”.
- the IP address “1.3.2.2” of the relay device 30d is “same. Same. Same. Different” with respect to the IP address “1.3.2.4” of the destination terminal 10db.
- the address priority point is “5”.
- the priority determination unit 57 d determines the priority management table (FIG. 14) based on the maximum data transmission rate of each relay device 30 managed by the relay device management table (see FIG. 8). By searching for (reference), a transmission speed priority point is determined for each relay device (30a, 30b, 30d) narrowed down by the first narrowing-down process in step S46-2 (step S46-5).
- the maximum data transmission rate of the relay device 30a is 100 (Mbps)
- the transmission rate priority shown in FIG. The degree is 3 points.
- the maximum data transmission rate of the relay device 30b is calculated to be 1000 (Mbps)
- the transmission rate priority is 5 points.
- the maximum data transmission rate of the relay device 30d is calculated to be 10 (Mbps)
- the transmission rate priority is 1 point.
- the primary selection unit 56c integrates the higher point of the transmission terminals (10aa, 10db) and the point of transmission speed priority at the address priority point.
- the top two relay devices 30 with higher points are selected (step 46-6).
- the relay device IDs (111a, 111b, 111d) have the integration points “8”, “8”, and “6”, respectively.
- the relay device 30a related to “111a” and the relay device 30b related to the relay device ID “111b” are selected.
- the transmission / reception unit 51 illustrated in FIG. 5B relays the number of relay devices 30 thus narrowed down to the destination terminal 10db via the communication network 2.
- Device narrowing information is transmitted (step S47).
- the relay device narrowing information includes the number “2” of relay devices 30 narrowed down in step S46, the terminal ID “01aa” of the request source terminal 10aa, and the selection session ID “se1”. .
- the transmission terminal 10db grasps the number of relay devices 30 and the transmission terminal 10 from which a request to start a video conference is made in the execution of the session with the selection session ID “se1”.
- the IP address “1.1.1.2” of the transmission management system 50 that is the transmission source of the relay device narrowing information can be grasped.
- the transmission terminal 10db transmits reception completion information indicating that the reception of the relay device narrowing information is completed from the transmission / reception unit 11 to the transmission management system 50 via the communication network 2 (step S48).
- This reception completion information includes the session ID “se1”.
- the transmission management system 50 sets the IP address “1.3.2.4” of the destination terminal 10db as the transmission source, together with the completion of the transmission of the number of relay devices executed with the session ID “se1”. I can grasp it.
- the transmission management system 50 transmits pre-relay request information for requesting relay in advance to each of the relay devices (30a, 30b) narrowed down in step S46. (Steps S61-1, 61-2).
- This pre-relay request information includes the session ID “se1”, the IP address “01aa” of the request source terminal 10aa, and the destination terminal 10db.
- the relay device (30a, 30b) can grasp which selection session it belongs to, what the request source terminal 10A is, and what the destination terminal 10B is, and a prior relay request. It is possible to grasp the IP address “1.1.1.2” of the transmission management system 50 that is the information transmission source.
- each of the relay devices (30a, 30b) sends the transmission / reception unit 31 via the communication network 2 to the request source terminal 10aa grasped in steps S61-1, 61-2 before the start of the video conference.
- Pre-transmission request information indicating that pre-transmission information including ping (Packet
- This pre-transmission information includes the session ID “se1”.
- the request source terminal 10aa grasps that the transmission information is transmitted to each relay device (30a, 30b) in the selection process of the relay device 30 that is executed with the session ID “se1”, and the prior transmission. It is possible to grasp the IP address (“1.2.1.2”, “1.2.2.2”) of the relay device (30a, 30b) that is the transmission source of the request information.
- the transmission management system 50 does not directly notify the request source terminal 10ba of the IP address of the destination terminal 10db, but instead sends the IP address of the destination terminal 10db to the relay device 10aa as in step S61-1.
- the relay terminal 10aa requests the request source terminal 10ba to transmit the pre-transmission request information to the own apparatus (relay apparatus 10aa) as in step 61-2. In order to ensure security, the IP address of the other transmission terminal 10 is not notified.
- the request source terminal 10aa transmits the pre-transmission information from the transmission / reception unit 11 to the relay device (30a, 30b) via the communication network 2 (steps S63-1, 63-2).
- This pre-transmission information is transmitted to the destination terminal 10db via each relay device (30a, 30b) instead of the image data and the audio data prior to the transmission of the image data and the audio data, so that the request source terminal This is information used to measure the time required from transmission of 10aa to reception of the destination terminal db.
- the advance transmission information includes a ping for confirming that the request source terminal 10aa, the relay devices (30a, 30b), and the destination terminal 10db are communicably connected, and the advance transmission information from the request source terminal 10aa.
- each relay device (30a, 30b) can grasp that the pre-transmission information has been sent in the execution of the session with the selection session ID “se1”, and is a transmission source of the pre-transmission information.
- the IP address “1.2.1.3” of the request source terminal 10aa can be grasped.
- each relay device (30a, 30b) sets the IP address “1.3.2.4” of the destination terminal 10db included in the pre-relay request information received in steps S61-1, 61-2.
- the prior transmission information is relayed (steps S64-1, 64-2).
- the destination terminal 10db can grasp that the pre-transmission information has been sent in the execution of the session with the session ID “se1”, and can also determine the relay device (transmission source) that is the transmission source (relay source) of the pre-transmission information.
- IP addresses (“1.2.1.2", "1.2.2.2" can be grasped.
- the selection processing unit 16 of the destination terminal 10db finally narrows down to one relay device 30 that relays image data and audio data in a video conference based on the pre-transmission information (step 65).
- step S65 the process in step S65 will be described in more detail with reference to FIGS. 5A, 5B and FIG.
- the measurement unit 16a of the selection processing unit 16 illustrated in FIG. 5B receives the reception when the transmission / reception unit 11 of the transmission terminal 10db receives, for each pre-transmission information relayed by each relay device (30a, 30b). The date and time are measured (step S65-1).
- the calculation unit 16b determines, for each pre-transmission information whose reception time is measured, from the transmission of each pre-transmission information based on the difference between the reception date and time and the transmission date and time included in the pre-transmission information. The time required until reception is calculated (step S65-2).
- the selection unit 16c determines whether or not all pieces of pre-transmission information corresponding to the number “2” of relay devices 30 scheduled to be relayed have been received in the execution of the session with the session ID “se1” (Step S65—). 3). If not all have been received (NO), the selection unit 16c determines whether or not a predetermined time (here 1 minute) has elapsed since the transmission terminal 10db received the pre-transmission information (step S65-4). ). If the predetermined time has not elapsed (NO), the process returns to step S65-1.
- a predetermined time here 1 minute
- step S65-5 One relay device 30 that relays the pre-transmission information that requires the shortest required time is selected (step S65-5).
- the relay device 30a is selected on the assumption that the pre-transmission information relayed by the relay device 30a has a shorter time from transmission to reception than the pre-transmission information relayed by the relay device 30b. Is shown.
- the relay device 30a is narrowed down on the destination terminal 10db side.
- the present invention is not limited to this, and the destination terminal 10db receives the pre-transmission information from the transmission to the request source terminal 10aa or the transmission management system 50. By transmitting all the required time information indicating the required time until the end, one relay device 30a may be finally narrowed down on the request source terminal 10aa side or the transmission management system 50 side.
- the destination terminal 10db transmits selection information indicating that the relay device 30a has been selected from the transmission / reception unit 11 to the transmission management system 50 via the communication network 2 (step S66).
- This selection information includes the session ID “se1” and the relay device ID “111a” of the selected relay device 30a.
- the transmission management system 50 can grasp that the relay device 30a has been selected in the execution of the session with the session ID “se1”, and the IP address “1.3” of the transmission terminal 10db that is the transmission source of the selection information. .2.4 ".
- the session management unit 57 of the transmission management system 50 sets the final field in the field of the relay device ID of the record including the selection session ID “se1” in the session management table (see FIG. 12) of the session management DB 5005.
- the relay device ID “111a” of the relay device 30a selected as one is stored and managed (step S67-1), and the transmission / reception unit 51 receives the relay device ID “111a” and the IP address “1” of the destination terminal 10db. .3.2.4 "is transmitted to the request source terminal 10aa (step S67-21).
- the transmission / reception unit 51 of the transmission management system 50 transmits relay start request information indicating a request to start relaying to the relay device 30a via the communication network 2 (step S68).
- the relay start request information includes the IP addresses (“1.2.1.3” and “1.3.2.4”) of the request source terminal 10aa and the destination terminal 10db to be relayed.
- the relay device 30a establishes a session for communicating the three image data of low resolution, medium resolution, and high resolution and the audio data between the transmission terminals (10aa, 10db) (step S69). ).
- the transmission terminals (10aa, 10db) can start a video conference.
- step S47 the transmission management system 50 transmits the relay device narrowing information to the destination terminal 10db, so that the selection of the relay device is performed on the destination terminal 10db side through steps S48 to S64-1, 64-2.
- the processing (step S65) is performed, but the present invention is not limited to this.
- step S47 the transmission management system 50 transmits the relay device narrowing information to the request source terminal 10aa, and thereafter, steps S64-1, 64 are performed. Up to -2, the transmission source and reception source of each information may be switched between the request source terminal 10aa and the destination terminal 10db. As a result, the request source terminal 10aa can perform the relay device selection process instead of step S65, and can also transmit the selection information instead of step S66.
- the request source terminal 10aa transmits the image data of the subject imaged by the imaging unit 14a and the audio data of the audio input by the audio input unit 15a from the transmission / reception unit 11 to the relay device 30a via the communication network 2.
- Step S81 high-quality image data composed of three low resolution, medium resolution, and high resolution shown in FIGS. 6A to 6C, and audio data are transmitted.
- the transmission / reception unit 31 receives the image data and the audio data of the three resolutions.
- the data quality confirmation unit 33 searches the change quality management table (see FIG. 7) using the IP address “1.3.2.4” of the destination terminal 10db as a search key, and the image quality of the corresponding relayed image data Is extracted to check the quality of the image data to be relayed (step S82).
- the image quality of the confirmed image data is “high image quality” and is the same as the image quality of the image data received by the transmission / reception unit 31.
- the voice data is transferred to the destination terminal 10db (step S83).
- the destination terminal 10db receives the image data and the audio data at the transmission / reception unit 11, the image display control unit 14b displays an image based on the image data on the display 120, and the audio output unit 15b is based on the audio data. Audio can be output.
- the delay detection unit 17 of the transmission terminal 10db detects the reception delay time of the image data received by the transmission / reception unit 11 at regular time intervals (for example, every second) (step S84). In the present embodiment, the following description is continued for a case where the delay time is 200 (ms).
- the transmission / reception unit 11 of the destination terminal 10db transmits delay information indicating the delay time “200 (ms)” to the transmission management system 50 via the communication network 2 (step S85). Thereby, the transmission management system 50 can grasp the delay time and the IP address “1.3.2.4” of the transmission terminal 10db that is the transmission source of the delay information.
- the delay time management unit 60 of the transmission management system 50 searches the terminal management table (see FIG. 10) by using the IP address “1.3.2.4” of the destination terminal 10db as a search key.
- the corresponding terminal ID “01db” is extracted, and in the session management table (see FIG. 12) of the session management DB 5005, the delay information field part of the record of the terminal ID “01db” is indicated by the delay information.
- the stored delay time “200 (ms)” is stored and managed (step S86).
- the quality determination unit 58 searches the quality management table (see FIG. 15) using the delay time “200 (ms)” as a search key, and extracts the image quality “medium image quality” of the corresponding image data.
- the image quality is determined as “medium image quality” (step S87).
- the transmission / reception unit 51 uses the relay device ID “111a” associated with the terminal ID “01db” in the session management table of the session management table (see FIG. 12) as a search key. 8) and the IP address “1.2.1.2” of the corresponding relay device 30a is extracted (step S88). Then, the transmission / reception unit 51 transmits quality information indicating the image quality “medium image quality” of the image data determined in step S87 to the relay device 30a via the communication network 2 (step S89). This quality information includes the IP address “1.3.2.4” of the destination terminal 10db used as the search key in step S86.
- the change quality management unit 34 stores the IP address “1.3.2.” Of the transmission terminal 10 of the transmission destination (here, the destination terminal 10db) in the change quality management table (see FIG. 7). 4 ”and the image quality“ medium image quality ”of the image data to be relayed are stored and managed in association with each other (step S90).
- the transmission terminal 10aa transmits high-quality image data including three images of low image quality, medium image quality, and high image quality, and audio data to the relay device 30a (step S81). S91).
- the data quality confirmation unit 33 uses the IP address “1.3.2.4” of the destination terminal 10db as a search key to change the quality management table (see FIG. 7). ) And the image quality “medium image quality” of the corresponding image data to be relayed is extracted to check the image quality of the image data to be relayed (step S92).
- the data quality changing unit 35 The image quality of the image data is changed by suppressing the image quality from “high image quality” to “medium image quality” (step S93). Then, the transmitting / receiving unit 31 transmits the image data in which the image quality of the image data is changed to “medium image quality” and the audio data in which the sound quality of the audio is not changed to the transmission terminal 10db via the communication network 2 ( Step S94). In this way, when reception delay occurs at the destination terminal 10db that receives the image data, the relay device 30a changes the quality of the image so that the person participating in the video conference does not feel uncomfortable. can do.
- the relay device ID “111a” and the IP address “1.3.2.4” of the destination terminal 10db transmitted by the transmission management system 50 in S67-21 are transmitted.
- the transmission / reception unit 11 of the terminal 10aa receives the received relay device ID “111a” and the IP address “1.3.2.4”, and the storage / read processing unit 19 stores them in the storage unit 1000 (step S67-22). .
- the connection detection unit 42 of the external input device 40aa detects it (step S70).
- the installation determination unit 43 determines whether the display data transmission unit 452 has already been installed. Is determined (step S71). If it is determined in step S71 that the display data transmission unit 452 is not installed, the program acquisition unit 44 acquires and installs the display data transmission unit 452 stored in the transmission terminal 10aa (step S72). .
- the external input device 40aa requests the transmission terminal 10aa for permission for the display data acquisition unit 451 to execute processing (step S73).
- the display data acquisition unit 451 acquires display data (step S74).
- the display data transmission unit 452 transmits the display data acquired by the display data acquisition unit 451 to the transmission terminal 10aa (step S75).
- step S71 If it is determined in step S71 that the display data transmission unit 452 is installed, the process proceeds to step S73 and subsequent steps.
- the storage / reading processing unit 19 receives the relay device ID “111a” stored in the storage unit 1000 and the IP of the transmission terminal 10db of the destination.
- the address “1.3.2.4” is acquired (step S77).
- the transmission / reception unit 11 causes the display data and the IP address “1.3.2. 4 "is transmitted (step S78).
- the relay device 30 changes the quality of the display data based on the IP address “1.3.2.4” of the transmission terminal 10db (step S79).
- the display data is transmitted to the transmission terminal 10db (step S80). Details of the process in step S77 are the same as the process for changing the quality of the audio data and the image data (steps S81 to S94) described above, and thus the description thereof is omitted.
- the transmission / reception unit 11 of the transmission terminal 10db receives the display data transmitted from the relay device 30, the image display control unit 14b displays the display data.
- the image displayed on the left side of the screen by the external input device 40aa is displayed based on the display data, and the upper right part of the screen is captured by the imaging unit 14a of the transmission terminal 10aa and transmitted by the transmission / reception unit 11. Displayed image data is displayed. In the lower right portion of the screen, image data captured by the imaging unit 14a of the transmission terminal 10db is displayed.
- Display control processing / operation 31A and 31B are flowcharts showing an example of resolution control processing by the image display control unit 14b of the transmission terminal 10.
- the resolution acquisition unit 14b10 of the image display control unit 14b accesses the display 120 and acquires a displayable resolution (step S101).
- the resolution determination unit 14b11 uses a reference aspect ratio (for example, 16: 9 resolution is, for example, 1280 ⁇ 720) used for transmission of image data between the transmission terminal 10 and the relay device 30 for displayable resolution. It is determined whether the aspect ratio resolution is included (step S102). If it is possible to determine whether an aspect ratio resolution other than the reference aspect ratio is included, select an aspect ratio resolution other than the reference aspect ratio and add a segment area for displaying auxiliary information. Because I want to.
- a reference aspect ratio for example, 16: 9 resolution is, for example, 1280 ⁇ 720
- the resolution selection unit 14b12 selects the resolution based on a predetermined reference from the resolutions of the aspect ratio other than the reference aspect ratio (Step S103). ).
- a predetermined standard the highest resolution (width x height having the maximum value) is selected with priority, or the resolution of a specific aspect ratio (for example, 8: 5) is selected with priority.
- a criterion can be used.
- the image processing unit 14b13 expands / contracts the image data generated internally with the reference aspect ratio to the selected resolution, and adds a segment area (step S104). Specifically, the image processing unit 14b13 performs the following processing. First, the image before conversion is expanded and contracted symmetrically so as to match the width after conversion. If the width before conversion and the width after conversion are the same, expansion / contraction is not performed (in other words, the enlargement ratio or reduction ratio can be expressed as 1 time). Next, the height of the image after expansion / contraction is checked, and a segment area is added to the lower end of the image after expansion / contraction so as to be the height after conversion. The position where the segment area is added is not limited to the lower end, but may be added to the upper end, or a segment area having a half height may be added to the upper and lower ends of the image.
- FIG. 32A shows an example in which a resolution with an aspect ratio of 8: 5 is selected for image data with a reference aspect ratio of 16: 9. One segment area is shown as black at the bottom of the image data. The added state is shown. Note that the original image data having a 16: 9 ratio is obtained by receiving image data from a total of 8 sites including the local site from the relay apparatus and combining them at a resolution of 1280 ⁇ 720.
- FIG. 35A shows an example in which a resolution with an aspect ratio of 4: 3 is selected for image data with a standard aspect ratio of 16: 9, and two segment areas are added at the upper and lower ends of the image data. The added state is shown.
- the resolution changing unit 14b15 changes the resolution of the display 120 to the selected resolution (step S105). By this processing, the display 120 is displayed with the changed resolution.
- the flag setting unit 14b14 sets the flag overlap to false (step S106).
- This flag is referenced when the image display control unit 14b detects an error or the like and performs display control of auxiliary information different from the currently displayed image data.
- the overlap value is true when the auxiliary information is displayed so as to overlap the image data, and has a false value when the auxiliary information is controlled not to overlap. Details of the auxiliary information control process will be described later.
- the image processing unit 14b13 expands / contracts the image data generated internally with the reference aspect ratio to the selected resolution (step S108).
- the expansion / contraction has the same aspect ratio, no blank area is generated in either the width or height direction of the image data, and no segment area is added.
- FIG. 32B shows an example of a screen expanded and contracted without adding a segment area.
- the resolution changing unit 14b15 changes the resolution of the display 120 to the selected resolution (step S109).
- the flag setting unit 14b14 sets the flag overlap to true (step S110).
- the resolution acquisition unit 14b10 accesses the display 120 to acquire the currently displayed resolution (step S111).
- the resolution acquisition unit 14b10 accesses the display 120 to acquire a displayable resolution (step S112).
- the resolution determination unit 14b11 includes the resolution of the aspect ratio other than the reference aspect ratio (for example, 16: 9) used for the transmission of the image data between the transmission terminal 10 and the relay device 30 in the displayable resolution. It is determined whether or not (step S113).
- the resolution selection unit 14b12 selects a resolution based on a predetermined reference from resolutions with an aspect ratio other than the reference aspect ratio (step S114).
- the predetermined standard is the same as that in step S103.
- the resolution determination unit 14b11 determines whether the currently displayed resolution is different from the selected resolution (step S115).
- step S115 the image processing unit 14b13 expands / contracts the image data generated internally with the reference aspect ratio to the selected resolution, and segments An area is added (step S116).
- the resolution changing unit 14b15 changes the resolution of the display 120 to the selected resolution (step S117).
- the flag setting unit 14b14 sets the flag overlap to false (step S118).
- the resolution selection unit 14b12 selects a resolution based on a predetermined reference from the resolutions of the reference aspect ratio (step S119).
- the predetermined standard is the same as that in step S103.
- the resolution determination unit 14b11 determines whether the currently displayed resolution is different from the selected resolution (step S120).
- the image processing unit 14b13 expands / contracts the image data generated internally with the reference aspect ratio to the selected resolution (step S121). ).
- the resolution changing unit 14b15 changes the resolution of the display 120 to the selected resolution (step S122).
- the flag setting unit 14b14 sets the flag overlap to true (step S123).
- This repetitive processing corresponds to processing for periodically monitoring the change in the resolution of the display 120, but it is also possible to execute the processing by introducing an event mechanism well known in the Windows (registered trademark) program. is there.
- an event mechanism well known in the Windows (registered trademark) program. is there.
- the image display control unit 14b may execute the processing from step S111 in FIG. 31B.
- this event notification merely notifies that the resolution has been changed, and does not notify that the temporary storage of the resolution information has been completed.
- step S111 the processing waits for a predetermined time before step S111.
- a similar problem may occur immediately after the start of the process. In such a case, the process is added to wait for a predetermined time before step S101. By adding the waiting time, it is possible to reliably refer to the correct resolution information.
- FIG. 33 is a flowchart showing an example of auxiliary information display processing.
- the auxiliary information image generating unit 14b21 of the image display control unit 14b determines whether or not the flag overlap is true. (Step S131).
- the auxiliary information image generation unit 14b21 When the flag overlap is false (No in step S131), the auxiliary information image generation unit 14b21 generates an auxiliary information image in a layer different from the image data (step S132).
- FIG. 34A shows a state where auxiliary information (error message and operation button) is displayed in the segment area added to the lower end of the screen.
- the operation input receiving unit 12 of the transmission terminal 10 receives the press input.
- the image display control unit 14b stops displaying the error message and returns the display on the display 120 to the state shown in FIG. 32A.
- FIG. 35B shows a state where auxiliary information (error message and operation button) is displayed on the lower end side of the segment areas added to the upper end and the lower end of the screen.
- error information is shown as auxiliary information.
- the present invention is not limited to this, and can be applied if information other than image data needs to be displayed.
- the operation input receiving unit 12 receives the pressing of the disconnect button of the transmission terminal 10.
- the unit 14b displays an operation menu.
- the contents to be displayed on the screen are changed to "Do you want to end the meeting?", "If you select OK, the meeting will end. If you select Cancel, the meeting will continue.”
- a cancel button may be added to accept the user's selection from both buttons (not shown).
- information on transmission terminals managed by the transmission management system, information on attendees of meetings, and the like can be displayed as auxiliary information.
- the auxiliary information image generation unit 14b21 generates an auxiliary information image in a layer different from the image data (step S134).
- the auxiliary information image display unit 14b22 displays the generated auxiliary information image so as to overlap, for example, the lower part of the image portion having the reference aspect ratio (step S135).
- “superimposing display” means displaying pixels of the auxiliary information instead of the pixels of the original image data existing in the display range of the auxiliary information image.
- the background portion of the auxiliary information can be transparent or semi-transparent so that the original pixel of the original image data can be displayed as it is, or a pixel of a color mixed with the original image data pixel can be displayed.
- an auxiliary information image and a display position are specified by an image processing function provided by an OS (Operating System) of a computer constituting the transmission terminal 10, and the auxiliary information image is specified to be displayed in the forefront and as necessary. This can be achieved by specifying transparency. Then, after displaying the auxiliary information image, the process is terminated.
- FIG. 34B shows a state in which auxiliary information (error message and operation button) is displayed below the main image portion of the screen.
- the auxiliary information display method includes a method of displaying in the segment area added to the image data and a method of displaying the auxiliary information on the image data.
- the layered display is complicated in the implementation of layers, and the processing is slow.
- priority is given to resolution selection that can be displayed without being overlaid. Therefore, there is also an advantage that priority can be given to a resolution that is displayed quickly without placing a burden on the user.
- FIGS. 36 to 38 show other embodiments of display control.
- the above-described embodiment is processing according to the aspect ratio of the display 120, this embodiment introduces a resolution management table so that display control can be finely set for each resolution.
- the resolution management tables of FIGS. 36 and 37 show examples of resolution management tables used in this embodiment.
- the resolution management tables of FIGS. 36 and 37 have items of “item name”, “resolution”, “overlap (overlap flag)”, and “segment value”.
- the “item name” is a symbol for identifying one line of data (row data).
- “Resolution” is a resolution defined by row data, has values for width and height, and indicates the number of pixels of width and height, respectively.
- “Overlap (overlapping flag)” is a flag indicating whether or not the auxiliary information is superimposed on the original image data, and is set to true when the auxiliary information is overlapped, and false when not overlapping. If they are not overlapped, auxiliary information is displayed in the added segment area.
- Segment value is information indicating the size (size) and position of the segment, controls the segment area to be added when overlap is false, and has values for width, height, and position. “width” and “height” respectively indicate the number of pixels of width and height, and a segment area of this size is added to the image data. In addition, position has values of lower, upper, and both, and indicates that the segment areas defined by the values of width and height are added to the screen at the bottom, the top, and both, respectively. When overlap is true, the segment value is set to NA (Not available: no data). When this value is present, no segment area is added.
- FIG. 36 shows an example in which the higher the resolution, the higher the line (closer to the top).
- FIG. 37 shows an example in which the ones that are not superposed (the resolution at which overlap is false) are arranged higher.
- the resolution that does not overlap with the image data can be preferentially displayed, and if the display speed is to be improved due to the design policy or the like, the image data can be temporarily displayed. This is effective when you do not want to overlap auxiliary information as much as possible.
- display based on other standards can be performed.
- 38A and 38B are flowcharts showing a processing example of the control processing in this embodiment.
- the resolution acquisition unit 14b10 of the image display control unit 14b accesses the display 120 and acquires a displayable resolution (step S141).
- the resolution management table reading unit 14b16 reads row data for one row of the resolution management table (step S142), and determines whether there is a row to be read (step S143).
- the resolution acquisition unit 14b10 acquires the value of the resolution (width and height values) from the read line data (step S144).
- the resolution determination unit 14b11 determines whether or not the acquired resolution is included in the displayable resolution (step S145). If the acquired resolution is not included in the displayable resolution (No in step S145), the process returns to reading the next row data from the resolution management table (step S142).
- the flag acquisition unit 14b17 acquires the value of the flag overlap from the read line data, and the flag setting unit 14b14 uses the acquired value.
- the administrative flag overlap is set (step S146).
- the flag determination unit 14b18 determines whether or not the acquired / set flag overlap is true (step S147).
- the segment value acquisition unit 14b19 acquires a segment value from the read row data (step S148).
- the image processing unit 14b13 expands / contracts the image data generated internally with the reference aspect ratio to the acquired resolution, and adds a segment area based on the acquired segment value (step S149). That is, the image is symmetrically expanded and contracted according to the width of the resolution from which the image data is acquired. After that, a segment area defined by the acquired resolution width (width) and height (height) is created and added to the position defined by position with respect to the image data after expansion / contraction.
- the resolution changing unit 14b15 changes the resolution of the display 120 to the acquired resolution (step S150).
- step S147 the image processing unit 14b13 expands / contracts the image data generated internally with the reference aspect ratio to the acquired resolution (step S151).
- the resolution changing unit 14b15 changes the resolution of the display 120 to the acquired resolution (step S152).
- step S153 If there is no line to be read (Yes in step S143), a part of the initial process of resolution control without using the resolution management table, that is, the same process as in steps S102 to S110 in FIG. 31A is performed (step S153).
- the resolution acquisition unit 14b10 accesses the display 120 and acquires the currently displayed resolution (step S154).
- the resolution acquisition unit 14b10 accesses the display 120 and acquires a displayable resolution (step S155).
- the resolution management table reading unit 14b16 reads row data for one row of the resolution management table (step S156), and determines whether there is a row to be read (step S157).
- the resolution acquisition unit 14b10 acquires a resolution value from the read line data (step S158).
- the resolution determination unit 14b11 determines whether or not the acquired resolution is included in the displayable resolution (step S159). If the acquired resolution is not included in the displayable resolution (No in step S159), the process returns to reading the next row data from the resolution management table (step S156).
- the resolution determination unit 14b11 determines whether the currently displayed resolution is different from the acquired resolution (step S160).
- the flag acquisition unit 14b17 acquires the value of the flag ovlelap from the read line data, and the flag setting unit 14b14 manages the acquired value.
- the upper flag overlap is set (step S161).
- the flag determination unit 14b18 determines whether or not the acquired / set flag overlap is true (step S162).
- the segment value acquisition unit 14b19 acquires a segment value from the read row data (step S163).
- the image processing unit 14b13 expands / contracts the image data generated internally with the reference aspect ratio to the acquired resolution, and adds a segment area based on the acquired segment value (step S164).
- the resolution changing unit 14b15 changes the resolution of the display 120 to the acquired resolution (step S165).
- step S162 If the flag overlap is true (Yes in step S162), the image processing unit 14b13 expands / contracts the image data generated internally with the reference aspect ratio to the acquired resolution (step S166).
- the resolution changing unit 14b15 changes the resolution of the display 120 to the acquired resolution (step S167).
- step S168 If there is no row to be read (Yes in step S157), a part of the resolution control loop processing not using the resolution management table, that is, the same processing as steps S113 to S123 in FIG. 31B is performed (step S168).
- the auxiliary information display process is the same as that shown in FIG.
- the display format reference can be changed by rewriting the resolution management table, there is an advantage that the maintainability is improved as compared with the case of changing the program. In other words, even if it is necessary to change the display control in the future, it is only necessary to add, delete, and change items in the resolution management table, so display control can be managed more easily than directly changing the program. Can do. This is advantageous in that the resolution of a new display can be controlled in an easy way when a display having a higher resolution with better visibility appears in the future.
- FIGS. 39 to 41 show still another embodiment of display control.
- the display 120 connected to the transmission terminal 10 is an analog system or a digital system.
- the digital display 120 when the digital display 120 is connected, the user mostly uses digital input, and the aspect ratio of the digital system is practically the same as the reference aspect ratio of the transmission terminal 10 (the digital system will be used in the future).
- the standard aspect ratio of the transmission terminal 10 is designed to match the aspect ratio of digital television 16: 9). For this reason, when it is recognized that the connected display 120 is a digital input, the resolution control is simplified and the processing speed can be increased.
- FIG. 39 is a diagram illustrating a configuration example of the image display control unit.
- a hardware identification information acquisition / determination unit 14b101 and a digital input acquisition / determination unit 14b102 are newly added to the configuration of the resolution control unit 14b1 of the image display control unit 14b shown in FIG.
- the hardware identification information acquisition / determination unit 14b101 acquires the hardware identification information of the transmission terminal 10, and determines whether or not the value is “TV” indicating that it is compatible with, for example, a digital television.
- the digital input acquisition / determination unit 14b102 acquires information indicating whether or not a digital input state is present from the connected display 120, and determines whether or not the digital input state is present.
- FIG. 40 is a diagram showing an example of data used in an example of resolution control processing. Items such as “digital input digital”, “recommended resolution”, and “hardware identification information” are newly added to the items shown in FIG. “Digital input digital” is information indicating whether or not the current image input signal acquired from the display 120 is a digital input. “Recommended resolution” is a recommended resolution acquired from the display 120. The recommended resolution is a resolution (dot by dot) that can be displayed without enlargement / reduction corresponding to the number of display pixels in full screen. “Hardware identification information” is hardware identification information that is preset in the transmission terminal 10 at the time of shipment. For example, “TV” is compatible with digital TV, and “TV” is for general TV. “D1” or the like is set.
- 41A and 41B are flowcharts showing a processing example of resolution control by the image display control unit 14b of the transmission terminal 10.
- FIG. 41A and 41B are flowcharts showing a processing example of resolution control by the image display control unit 14b of the transmission terminal 10.
- the hardware identification information acquisition / determination unit 14b101 of the image display control unit 14b acquires the hardware identification information of its own transmission terminal 10 (step S171). Then, it is determined whether or not the hardware identification information is “TV” (step S172).
- step S172 the digital input acquisition / determination unit 14b102 accesses the display 120 to acquire a digital input value (digital) (step S173). It is determined whether or not “true” (step S174).
- the resolution acquisition unit 14b10 accesses the display 120 and acquires the recommended resolution (step S175).
- the image processing unit 14b13 expands / contracts the image data generated internally with the reference aspect ratio to the acquired recommended resolution (step S175).
- the expansion / contraction has the same aspect ratio, no blank area is generated in either the width or height direction of the image data, and no segment area is added.
- the resolution of the display 120 is changed to the acquired recommended resolution (step S177).
- the flag setting unit 14b14 sets the flag overlap to true (step S178).
- step S172 When the hardware identification information is not “TV” (No in step S172) or when the digital input (digital) is not “true” (No in step S174), the resolution control initial process in the above-described processing example, that is, The same processing as that in steps S101 to S110 in FIG. 31A or steps S141 to S152 in FIG. 38B is performed (step S179).
- the resolution acquisition unit 14b10 accesses the display 120 and acquires the currently displayed resolution (step S180).
- the digital input acquisition / determination unit 14b102 accesses the display 120 to acquire a digital input value (digital) (step S181), and determines whether or not it is “true” (step S182).
- the resolution acquisition unit 14b10 accesses the display 120 to acquire the recommended resolution (step S183), and the resolution determination unit 14b11 displays the current display. It is determined whether the acquired resolution is different from the acquired recommended resolution (step S184).
- the image processing unit 14b13 expands / contracts the image data generated internally with the reference aspect ratio to the acquired recommended resolution (step). S185).
- the resolution changing unit 14b15 changes the resolution of the display 120 to the acquired recommended resolution (step S186).
- the flag setting unit 14b14 sets the flag overlap to true (step S187).
- step S182 If the digital input (digital) is not “true” (No in step S182), a part of the loop process of the resolution control in the above-described processing example, that is, steps S112 to S123 in FIG. 31B or step S155 in FIG. 38B. Processes similar to S167 are performed (step S188).
- the auxiliary information display process is the same as that shown in FIG.
- the resolution can be set immediately on the assumption that the aspect ratio of the display 120 is the same as the reference aspect ratio.
- the speed of resolution control processing can be increased.
- the transmission management system 50 manages the relay device ID of the relay device 30 that relays audio data and image data by storing the relay device ID in the transmission terminal 10aa.
- the display data of the document data stored in the storage unit 4000 of the external input device 40 that has not been transmitted can be transmitted to the transmission terminal 10db that is the conference partner.
- the display data acquisition unit 451 or the display data is displayed when the transmission terminal 40 is connected. Since the data transmission unit 452 is provided, the screen can be shared.
- the relay device 30 by selecting the relay device 30 to which the upper two or more IP addresses close to any of the IP addresses of the transmission terminals 10 are respectively assigned, two or more candidates for the relay device 30 to be finally used are selected. Can leave.
- the relay device 30 by transmitting and receiving the pre-transmission information between the request source terminal 10A and the destination terminal 10B via each relay device 30 as a candidate in actuality, Therefore, it is possible to narrow down to the relay device 30 that relays the pre-transmission information having the shortest time required for transmission and reception. Therefore, it is possible to realize transmission and reception of high-quality image data or audio data to the maximum in the current communication network 2 environment.
- the relay device 30 when narrowing down the relay devices 30, not only the relay device 30 having an IP address close to the IP address of the transmission terminal 10 that conducts the video conference is preferentially selected, but the maximum data in each relay device 30 is also selected. Two or more relay apparatuses 30 are selected in consideration of the transmission speed. Thereby, the effect that the candidate of the relay apparatus 30 according to the environment of the actual communication network 2 can be narrowed down is produced.
- the candidates for the relay devices 30 that further match the actual communication network 2 environment are narrowed down in order to narrow down the relay devices 30 whose operation state is the ON line. Can do.
- the present embodiment by appropriately displaying image data and auxiliary information according to the capability of the display connected to the transmission terminal, the visibility of information necessary for a meeting or the like is increased, and these pieces of information are displayed. Can be displayed reliably. In addition, the screen area can be effectively used.
- the transmission terminal 10 can output an image to an external display, a projector, or the like through an analog signal output terminal (hereinafter referred to as an analog terminal) typified by a VGA (Video Graphics Array) terminal.
- an analog terminal typified by a VGA (Video Graphics Array) terminal.
- the transmission terminal 10 outputs video through a digital signal output terminal (hereinafter referred to as a digital terminal) such as DVI (Digital Visual Interface), HDMI (registered trademark) (High-Definition Multimedia Interface), and DisplayPort terminal. You can also
- the transmission terminal 10 has a recommended value or default value of the resolution of the video to be output when outputting video via an analog terminal and when outputting video via a digital terminal.
- the value may be different.
- the recommended resolution is often selected according to the support status of display devices on the market.
- the transmission terminal 10 described above uses a resolution of “1024x768” or “1280x800” for video output from an analog terminal, and “1280x720” (720p) for video output from a digital terminal. Resolution can be used.
- the transmission terminal 10 described below makes the resolution of the video output via the digital terminal the same as the resolution of the analog terminal for a projector that satisfies a specific condition.
- the specific condition is defined using product information (apparatus information) such as a projector manufacturer code, a product code, and a model name. This is the case, for example, when the transmission terminal 10 wants to make the resolution of the video output via the digital terminal the same as that of the analog terminal for a projector of a specific manufacturer or a projector of a specific model. ,It is valid.
- the image display control unit 14b of the transmission terminal 10 in the present embodiment newly includes a product information acquisition unit 14b201, a product determination table management unit 14b202, and a product determination unit 14b203 in addition to the functions illustrated in FIG.
- the product information acquisition unit 14b201 acquires the product information of the projector stored in a specific area of the projector when the transmission terminal 10 and the projector are connected.
- An example of a data structure for storing product information is shown in FIG.
- the data structure shown in FIG. 44 has items of “manufacturer code”, “product code”, and “model name” in addition to the data illustrated in FIG. Hereinafter, these three items are referred to as “product information”.
- the manufacturer code represents a code unique to the projector manufacturer
- the product code represents the product code of the projector
- the model name represents the model name of the projector.
- codes or names can be represented by any combination of character strings or numerical values.
- the product code is represented by an alphabet string
- the product code is represented by a hexadecimal number
- the model name is represented by an alphabet string.
- the data structure shown in FIG. 44 is defined by, for example, EDID (Extended Display Identification Data) which is a VESA (Video Electronics Standards Association) standard.
- EDID Extended Display Identification Data
- VESA Video Electronics Standards Association
- the product information acquisition unit 14b201 can acquire the product information stored using EDID when a projector is connected.
- the product determination table management unit 14b202 manages a product determination table for determining whether the resolution of the video output via the digital terminal is the same as the resolution of the video output via the analog terminal.
- 45A to 45C show an example of the product determination table. As shown in FIGS. 45A to 45C, the determination conditions described in the product determination table are defined using the product information described above.
- FIG. 45A shows an example of a product determination table defined using only the manufacturer code in the product information.
- FIG. 45B shows an example of a product determination table defined using a manufacturer code and a model name.
- FIG. 45C shows an example of a product determination table defined using a manufacturer code and a certain range of product codes.
- the product determination table may be defined by any combination of product information or other information.
- the product determination table may be defined on the condition of an arbitrary character string or value included in the EDID.
- the product determination unit 14b203 makes the resolution of the video output from the digital terminal the same as that of the analog terminal based on the product information acquired by the product information acquisition unit 14b201 and the product determination table managed by the product determination table management unit 14b202. To determine. For example, in the example of the product determination table shown in FIG. 45A, the product determination unit 14b203 determines that the condition is satisfied when the “manufacturer code” of the acquired product information is “RRR”, and outputs from the digital terminal The resolution of the video to be played is the same as that of the analog terminal. On the other hand, in the example of FIG.
- the product determination unit 14b203 determines that the “manufacturer code” of the acquired product information is “RRR” and the “model name” is “PPP_01SERIES” or “PPP_02SERIES”. It is determined that the condition is satisfied. On the other hand, in the example of FIG. 45C, the product determination unit 14b203 includes the “manufacturer code” in the acquired product information as “RRR” and the “product code” included in “0x0020h” and “0x002Fh”. If so, it is determined that the condition is satisfied.
- FIG. 46 shows a processing flow when the power of the transmission terminal 10 is turned on in a state where the projector is connected to the digital terminal.
- the digital input acquisition / determination unit 14b102 of the image display control unit 14b accesses the projector and acquires a digital input value (digital) (step S201). Then, the digital input acquisition / determination unit 14b102 determines whether or not the value of the digital input is “true” (step S202).
- the product information acquisition unit 14b201 acquires product information illustrated in FIG. 44 (for example, manufacturer code, product code, and model name). (Step S203).
- step S179 in FIG. 41A that is, steps S141 to S152 in FIG. 38A is executed (step S206), and the process is terminated.
- step S203 the product determination unit 14b203 reads the product determination table managed by the product determination table management unit 14b202 (step S204). Then, the product determination unit 14b203 determines whether the product information acquired in step S203 satisfies the conditions defined in the product determination table (step S205).
- Step S179 in FIG. 41A that is, Steps S141 to S152 in FIG. 38A
- Step S206 the process ends. . That is, the same processing as when the projector is connected to the analog terminal (No in step S202) is executed.
- steps S175 to S178 in FIG. 41A are executed (step S207), and the process is terminated. That is, the resolution is changed according to the recommended resolution of the projector.
- the contents of the data illustrated in FIG. 44 are individually acquired in steps S201 and S203.
- the transmission terminal 10 may acquire the data collectively from the projector after the power is turned on, and store the data in the storage unit 1000.
- the digital input acquisition / determination unit 14b102 or the product information acquisition unit 14b201 may perform processing of reading corresponding data from the storage unit 1000.
- the product determination table read in step S204 may be read when the transmission terminal 10 is started or when a program executed after the start is initialized.
- the product determination unit 14b203 can refer to the read product determination table.
- the resolution acquisition unit 14b10 accesses the projector and acquires the currently displayed resolution (step S301).
- the digital input acquisition / determination unit 14b102 accesses the projector to acquire the digital input value (digital) (step S302), and determines whether or not it is “true” (step S303).
- the product information acquisition unit 14b201 acquires the product information illustrated in FIG. 44 (for example, manufacturer code, product code, and model name). (Step S304).
- step S188 in FIG. 41B that is, steps S155 to S167 in FIG. 38B is executed (step S307), and the process ends.
- step S304 the product determination unit 14b203 reads the product determination table managed by the product determination table management unit 202 (step S305). Then, the product determination unit 14b203 determines whether the product information acquired in step S304 satisfies the conditions defined in the product determination table (step S306).
- Step S307 When the product information satisfies the conditions defined in the product determination table (Yes in Step S306), Step S188 in FIG. 41B (that is, Steps S155 to S167 in FIG. 38B) is executed (Step S307), and the process ends. . That is, the same processing as when the projector is connected to the analog terminal (No in step S202) is executed.
- the resolution acquisition unit 14b10 accesses the projector and acquires the recommended resolution (step S308). Then, the resolution determination unit 14b11 determines whether or not the currently displayed resolution is different from the acquired recommended resolution (step S309).
- steps S185 to S187 in FIG. 41B are executed (step S310), and the process is terminated.
- the process ends.
- the contents of the data illustrated in FIG. 44 are individually acquired in steps S302 and S304.
- the transmission terminal 10 may acquire the data collectively from the projector and connect the data to the storage unit 1000 when the projector is connected.
- the digital input acquisition / determination unit 14b102 or the product information acquisition unit 14b201 may perform processing of reading corresponding data from the storage unit 1000.
- the transmission terminal 10 can adjust the resolution of the video output via the digital terminal, similarly to the resolution of the analog terminal, for a projector having specific product information. it can. Thereby, even when a user newly introduces a projector having a digital terminal, the user can project an image with the same resolution as that of the previous projector. As a result, the call center of the projector manufacturer and the management department that manages the projector in-house do not need to respond to inquiries associated with the resolution change.
- the product determination table is described as being held by the product determination table management unit 14b202.
- the product determination table may be stored in the storage unit 1000 of the transmission terminal 10 or a communication network. 2 may be acquired from the outside (for example, from the transmission management system of FIG. 1).
- the projector is connected to the digital terminal.
- other displays such as a CRT, a liquid crystal display, a television, an electronic blackboard (electronic white board), and the like are used. Any display device may be connected.
- the resolution may change, and the user may feel uncomfortable. This problem can be solved by the transmission terminal 10 described above.
- the transmission terminal 10 may acquire only minimum information (for example, a product identifier such as a model name) necessary for specifying the projector from the projector.
- the transmission terminal 10 holds other information (for example, manufacturer code or product code) corresponding to the identifier in the storage unit 1000 or the like in advance.
- the transmission terminal 10 has been described using an example having the casing shown in FIG.
- the transmission terminal 10 may be an information terminal such as a PC, a smartphone, a tablet, a PDA (Personal Display Assistant), or a wearable device such as a wristwatch or glasses.
- the process of obtaining display data may use a mirror driver.
- the mirror driver can directly transmit the generated display data to the USB driver without going through a program.
- the mirror driver generates display data
- the USB driver transmits the generated display data to the transmission terminal 10 via the external device I / F 118.
- the program acquires image data generated by the display driver and transmits the image data to the transmission terminal 10.
- the program acquires a drawing command generated by GDI and transmits the transmission command to the transmission terminal. You may transmit to 10aa. Since the drawing command has a smaller capacity than the image data, the network load can be reduced.
- the display data acquisition unit 451 may acquire only display data displayed on a predetermined screen among a plurality of screens on the virtual display, and the display data transmission unit 452 may transmit the display data. As a result, the image data displayed on the screen other than the predetermined screen is not shared with the conference partner, so that it is possible to improve security, for example, by not showing highly confidential materials.
- the transmission management system 50, the program providing system 90, and the maintenance system 100 in each of the above embodiments may be constructed by a single computer, or each unit (function or means) is divided and arbitrarily assigned. It may be constructed by a plurality of computers.
- the program transmitted by the program providing system 90 may be transmitted by dividing it into a plurality of modules. It may be transmitted.
- a plurality of modules may be divided and transmitted from each computer.
- the transmission terminal program, the relay device program, and the transmission management program of the present embodiment are stored. These are used when the transmission terminal program, the relay device program, and the transmission management program are provided to a user or the like as a program product (Program Product) domestically or abroad.
- Program Product Program Product
- the present invention is not limited to this.
- Other examples of the quality include the depth of image quality of the image data, the sampling frequency of the audio data, and the bit length of the audio data. You may manage it paying attention to.
- each FQDN (Fully Qualified Domain Name) may be managed as long as it is relay device specifying information for use or terminal specifying information for specifying the transmission terminal 10 on the communication network 2.
- an IP address corresponding to the FQDN is acquired by a known DNS (Domain (Name System) server.
- relay device specifying information for specifying the relay device 30 in the communication network 2 but also “relay device connection destination information indicating a connection destination to the relay device 30 on the communication network 2” or “communication It may be expressed as “relay device destination information indicating a destination to the relay device 30 on the network 2”.
- terminal specifying information for specifying the transmission terminal 10 in the communication network 2 but also “terminal connection destination information indicating a connection destination to the transmission terminal 10 on the communication network 2” or “communication network 2”. It may be expressed as “terminal destination information indicating the destination to the transmission terminal 10”.
- the transmission system 1 may be a car navigation system.
- one of the transmission terminals 30 corresponds to a car navigation device mounted on a car, and the other of the transmission terminals 30 is mounted on a management terminal or management server of a management center that manages car navigation, or another car. It corresponds to the car navigation device that is used.
- FIG. 26 shows an example of a screen displayed by the external input device 40aa.
- an area (window) (a) and an area (b) are displayed on the screen.
- an area to be shared with the transmission terminal 10db is indicated by operating the pointer indicated by (c) in FIG.
- the display data acquisition unit 451 acquires display data for the area (a) pointed to at this time.
- the external input device may include a display data acquisition unit 451 and a display data transmission unit 452 for use in the external input device stored in the storage unit 1000 of the transmission terminal 10 in advance.
- the process of transmitting and receiving the display data acquisition unit 451 and the display data transmission unit 452 can be omitted, and the load on the transmission terminal 10 and the external input device 40 can be reduced.
- the display device 400 may be a device different from the external input device 40 or may be provided in the external input device 40. .
- the installation determination unit 43 may determine whether or not the display data acquisition unit 451 and the display data transmission unit 452 are already installed. In this case, when it is determined in step S71 that the display data transmission unit 452 is not installed, the program acquisition unit 44 uses the display data acquisition unit 451 and the display data transmission unit 452 stored in the transmission terminal 10aa. Obtain and install (step S73).
- the external input device 40aa may have a form in which the processing by the installation determination unit 43 is not provided by providing the display data acquisition unit 451 in advance.
- the display data transmission unit 452 may not be provided by writing the display data acquired by the display data acquisition unit 451 to the storage unit 1000 of the mounted transmission terminal 10aa.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Computer Graphics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Controls And Circuits For Display Device (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Transforming Electric Information Into Light Information (AREA)
Abstract
Description
図1は、本実施形態で用いられる伝送システム1の概略図である。 << Overall configuration of transmission system >>
FIG. 1 is a schematic diagram of a
次に、本実施形態のハードウェア構成を説明する。 << Hardware configuration >>
Next, the hardware configuration of this embodiment will be described.
次に、本実施形態の機能構成について説明する。図5A及び5Bは、本実施形態の伝送システム1を構成する各端末、装置およびシステムの機能ブロック図である。図5A及び5Bでは、伝送端末10、中継装置30、および伝送管理システム50が、通信ネットワーク2を介してデータ通信することができるように接続されている。外部入力装置40は、伝送端末10とデータを送受信することができるように接続されている。また、図24は、本実施形態の伝送システム1を構成する外部入力装置40の機能ブロック図である。また、図1に示されているプログラム提供システム90は、テレビ会議の通信において直接関係ないため、図5A及び5Bでは省略されている。 << Functional configuration >>
Next, the functional configuration of this embodiment will be described. 5A and 5B are functional block diagrams of each terminal, device, and system constituting the
伝送端末10は、送受信部11、操作入力受付部12、ログイン要求部13、撮像部14a、画像表示制御部14b、音声入力部15a、音声出力部15b、選択処理部16、遅延検出部17、外部情報送受信部18、および記憶・読出処理部19を有している。これら各部は、図3に示されている各構成要素のいずれかが、ROM202に記憶されているプログラムに従ったCPU201からの命令によって動作することで実現される機能または手段である。また、伝送端末10は、図3に示されているSSD105によって構築される記憶部1000を有している。 <Functional configuration of transmission terminal>
The
次に、伝送端末の各部を詳細に説明する。伝送端末10の送受信部11は、図3に示されているネットワークI/F111によって実現され、通信ネットワーク2を介して他の端末、装置またはシステムと各種データ(情報)の送受信を行う。操作入力受付部12は、図3に示されている操作ボタン108、および電源スイッチ109によって実現され、利用者による各種入力を受け付ける。例えば、利用者が、図3に示されている電源スイッチ109をONにすると、図5Bに示されている操作入力受付部12が電源ONを受け付けて、電源をONにする。ログイン要求部13は、図3に示されているCPU101からの命令によって実現され、上記電源ONの受け付けを契機として、送受信部11から通信ネットワーク2を介して伝送管理システム50に、ログインを要求する旨を示すログイン要求情報、および伝送端末10abの現時点のIPアドレスを自動的に送信する。 (Each functional part of the transmission terminal)
Next, each part of the transmission terminal will be described in detail. The transmission /
外部入力装置40は、図24に示されているように、送受信部41、接続検出部42、インストール判定部43、プログラム取得部44、操作入力受付部46、表示制御部47、マウント部48および記憶・読出処理部49を有している。これら各部は、図4に示されている各構成要素のいずれかが、ROM202に記憶されているプログラムに従ったCPU201からの命令によって動作することで実現される機能または手段である。また、外部入力装置40は、図4に示されているHDD205によって構築される記憶部4000を有している。また、外部入力装置40は、Windows(登録商標)等のOS(Operating System)を搭載し、これにより、他の装置と接続したときにはプログラムを実行する機能を備えている。 <Functional configuration of external input device>
As shown in FIG. 24, the
次に、外部入力装置40の各部を詳細に説明する。外部入力装置40の送受信部41は、図4に示されているネットワークI/F209によって実現され、伝送端末10から各種データ(情報)の送受信を行う。接続検出部42は外部装置入出力I/F215により外部装置とデータの送受信が可能となったことを検出する。インストール判定部43は外部入力装置40に表示データ取得部451、表示データ送信部452がインストールされているか否かを判定する。プログラム取得部44は、送受信部41を経由して接続された伝送端末10の記憶部1000から表示データ取得部451、表示データ送信部452を取得し、インストールする。操作入力受付部46は、利用者の操作による入力を受け付ける。表示制御部47は、後述する記憶・読出処理部49が読み出した画像を表示装置400に表示させる。マウント部48は、外部入力装置40に接続されている各種装置の記憶部をマウントする。記憶・読出処理部49は、図4に示されているHDD205によって実行され、記憶部4000に各種データを記憶したり、記憶部4000に記憶された各種データを読み出したりする処理を行う。記憶部4000には、資料データ等が記憶される。 <Functional parts of external input device>
Next, each part of the
次に、中継装置30の機能または手段について説明する。中継装置30は、送受信部31、状態検知部32、データ品質確認部33、変更品質管理部34、データ品質変更部35、および記憶・読出処理部39を有している。これら各部は、図4に示されている各構成要素のいずれかが、ROM202に記憶されているプログラムに従ったCPU201からの命令によって動作することで実現される機能または手段である。また、中継装置30は、図4に示されているHD204により構築される記憶部3000を有している。 <Functional configuration of relay device>
Next, functions or means of the
記憶部3000には、図7に示されているような変更品質管理テーブルによって構成されている変更品質管理DB3001が構築される。変更品質管理テーブルでは、画像データの中継先としての伝送端末30のIPアドレス、およびこの中継先に中継装置30が中継する画像データの画質が関連付けられて管理される。 (Change quality control table)
In the storage unit 3000, a change quality management DB 3001 configured by a change quality management table as shown in FIG. In the change quality management table, the IP address of the
次に、中継装置30の各機能構成について詳細に説明する。なお、以下では、中継装置30の各部を説明するにあたって、図3に示されている各構成要素のうち、中継装置30の各部を実現させるための主な構成要素との関係も説明する。 <Each functional unit of the relay device>
Next, each functional configuration of the
次に、伝送管理システム50の機能または手段について説明する。伝送管理システム50は、送受信部51、端末認証部52、状態管理部53、端末抽出部54、端末状態取得部55、絞込部56、セッション管理部57、品質決定部58、記憶・読出処理部59、および遅延時間管理部60を有している。これら各部は、図4に示されている各構成要素のいずれかが、ROM202に記憶されているプログラムに従ったCPU201からの命令によって動作することで実現される機能または手段である。また、伝送管理システム50は、図4に示されているHD204により構築される記憶部5000を有している。 <Functional configuration of transmission management system>
Next, functions or means of the
記憶部5000には、図8に示されているような中継装置管理テーブルによって構成されている中継装置管理DB5001が構築されている。この中継装置管理テーブルでは、各中継装置30の中継装置ID毎に、各中継装置30の稼動状態、稼動状態が示される状態情報が伝送管理システム50で受信された受信日時、中継装置30のIPアドレス、および中継装置30における最大データ伝送速度(Mbps)が関連付けられて管理される。例えば、図8に示されている中継装置管理テーブルにおいて、中継装置IDが「111a」の中継装置30aは、稼動状態が「ONライン」で、伝送管理システム50で状態情報が受信された日時が「2009年11月10日の13時00分」で、この中継装置30aのIPアドレスが「1.2.1.2」で、この中継装置30aにおける最大データ伝送速度が100Mbpsであることが示されている。 (Relay device management table)
In the storage unit 5000, a relay device management DB 5001 configured by a relay device management table as shown in FIG. 8 is constructed. In this relay device management table, for each relay device ID of each
更に、記憶部5000には、図9に示されているような端末認証管理テーブルによって構成されている端末認証管理DB5002が構築されている。この端末認証管理テーブルでは、伝送管理システム50によって管理される全ての伝送端末10の各端末IDに対して、各パスワードが関連付けられて管理される。例えば、図9に示されている端末認証管理テーブルにおいて、伝送端末10aaの端末IDは「01aa」で、パスワードは「aaaa」であることが示されている。 (Terminal authentication management table)
Furthermore, in the storage unit 5000, a terminal authentication management DB 5002 configured by a terminal authentication management table as shown in FIG. In this terminal authentication management table, each password is associated with each terminal ID of all
また、記憶部5000には、図10に示されているような端末管理テーブルによって構成されている端末管理DB5003が構築されている。この端末管理テーブルでは、各伝送端末10の端末ID毎に、各伝送端末10の稼動状態、後述のログイン要求情報が伝送管理システム50で受信された受信日時、および伝送端末10のIPアドレスが関連付けられて管理される。例えば、図10に示されている端末管理テーブルにおいて、端末IDが「01aa」の伝送端末10aaは、稼動状態が「ONライン」で、伝送管理システム50でログイン要求情報が受信された日時が「2009年11月10日の13時40分」で、この伝送端末10aaのIPアドレスが「1.2.1.3」であることが示されている。 (Terminal management table)
Further, in the storage unit 5000, a terminal management DB 5003 configured by a terminal management table as shown in FIG. 10 is constructed. In this terminal management table, for each terminal ID of each
更に、記憶部5000には、図11に示されているような宛先リスト管理テーブルによって構成されている宛先リスト管理DB5004が構築されている。この宛先リスト管理テーブルでは、テレビ会議の開始を要求する要求元端末10Aの端末IDに対して、宛先端末10Bの候補として登録されている宛先端末10Bの端末IDが全て関連付けられて管理される。例えば、図11に示されている宛先リスト管理テーブルにおいて、端末IDが「01aa」である要求元端末10aaからテレビ会議の開始を要求することができる宛先端末10Bの候補は、端末IDが「01ab」の伝送端末10ab、端末IDが「01ba」の伝送端末10ba、および端末IDが「01db」の伝送端末10dbの3つであることが示されている。この宛先端末10Bの候補は、要求元端末10Aから伝送管理システム50に対する追加または削除の要請により、追加または削除されることで更新される。 (Destination list management table)
Further, in the storage unit 5000, a destination list management DB 5004 configured by a destination list management table as shown in FIG. In this destination list management table, all terminal IDs of destination terminals 10B registered as candidates for destination terminal 10B are managed in association with terminal IDs of request source terminal 10A requesting the start of a video conference. For example, in the destination list management table shown in FIG. 11, a candidate for the destination terminal 10B that can request the start of the video conference from the request source terminal 10aa having the terminal ID “01aa” has the terminal ID “01ab”. The transmission terminal 10ab has the terminal ID “01ba”, and the transmission terminal 10db has the terminal ID “01db”. The candidates for the destination terminal 10B are updated by being added or deleted in response to a request for addition or deletion from the request source terminal 10A to the
また、この記憶部5000には、図12に示されているようなセッション管理テーブルによって構成されているセッション管理DB5005が構築されている。このセッション管理テーブルでは、中継装置30を選択するためのセッションの実行に用いられる選択用セッションID毎に、画像データおよび音声データの中継に使用される中継装置30の中継装置ID、要求元端末10Aの端末ID、宛先端末10Bの端末ID、宛先端末10Bにおいて画像データが受信される際の受信の遅延時間(ms)、およびこの遅延時間が示されている遅延情報を宛先端末10Bから送られて来て伝送管理システム50で受信された受信日時が関連付けられて管理される。例えば、図12に示されているセッション管理テーブルにおいて、選択用セッションID「se1」を用いて実行されたセッションで選択された中継装置30a(中継装置ID「111a」)は、端末IDが「01aa」の要求元端末10aaと、端末IDが「01db」の宛先端末10dbとの間で、画像データおよび音声データを中継しており、宛先端末10dbにおいて「2009年11月10日の14時00分」時点における画像データの遅延時間が200(ms)であることが示されている。なお、2つの伝送端末10の間でテレビ会議を行う場合には、上記宛先端末10Bではなく要求元端末10Aから送信されてきた遅延情報に基づいて、遅延情報の受信日時を管理してもよい。但し、3つ以上の伝送端末10の間でテレビ会議を行う場合には、画像データおよび音声データの受信側の伝送端末10から送信されてきた遅延情報に基づいて、遅延情報の受信日時を管理する。 (Session management table)
Further, in this storage unit 5000, a session management DB 5005 configured by a session management table as shown in FIG. 12 is constructed. In this session management table, for each selection session ID used to execute a session for selecting the
更に、記憶部5000には、図13に示されているようなアドレス優先度管理テーブルによって構成されている優先度管理DB5006が構築されている。このアドレス優先度管理テーブルでは、一般的なIPv4におけるIPアドレスのうちの4組のドットアドレス(Dot Address)部分の同異に応じて、アドレス優先度のポイントが高くなるように関連付けられて管理される。例えば、図13に示されているアドレス優先度管理テーブルにおいて、ドットアドレスの上位から下位にかけて3つの値が同じIPアドレスの場合には、アドレス優先度のポイントが「5」である。ドットアドレスの上位から下位にかけて2つの値が同じIPアドレスの場合には、アドレス優先度のポイントが「3」である。この場合、最下位のドットアドレスの値が同じであるか否かは優先度に関係ない。ドットアドレスの最上位の値が同じで、上位から2番目の値が異なるIPアドレスの場合には、アドレス優先度のポイントが「1」である。この場合、上位から3番目および最下位のドットアドレスの値が同じであるか否かは優先度には関係ない。ドットアドレスの最上位の値が異なるIPアドレスの場合には、アドレス優先度のポイントが「0」である。この場合、上位から2番目、3番目、および最下位のドットアドレスの値が同じであるか否かは優先度には関係ない。 (Address priority management table)
Further, in the storage unit 5000, a priority management DB 5006 configured by an address priority management table as shown in FIG. 13 is constructed. In this address priority management table, in accordance with the difference in the four dot address (Dot Address) portions of the general IPv4 IP addresses, the address priority points are associated and managed so as to increase. The For example, in the address priority management table shown in FIG. 13, when the three values are the same IP address from the top to the bottom of the dot address, the address priority point is “5”. When the two values are the same IP address from the top to the bottom of the dot address, the address priority point is “3”. In this case, whether the value of the lowest dot address is the same or not is not related to the priority. In the case of IP addresses having the same highest value of dot addresses and different second values from the top, the address priority point is “1”. In this case, whether or not the values of the third and lowest dot addresses from the top are the same has no relation to the priority. In the case of IP addresses having different uppermost values of dot addresses, the address priority point is “0”. In this case, whether or not the values of the second, third, and lowest dot addresses from the top are the same is not related to priority.
また、記憶部5000に構築されている優先度管理DB5006には、図14に示されているような伝送速度優先度管理テーブルも含まれている。この伝送速度優先度管理テーブルでは、中継装置30における最大データ伝送速度(Mbps)の値に応じて、伝送速度優先度のポイントが高くなるように関連付けられて管理される。例えば、図14に示されている伝送速度優先度管理テーブルにおいて、中継装置30における最大データ伝送速度が1000Mbps以上の場合には、伝送速度優先度のポイントが「5」である。中継装置30における最大データ伝送速度が100Mbps以上1000Mbps未満の場合には、伝送速度優先度のポイントが「3」である。中継装置30における最大データ伝送速度が10Mbps以上100Mbps未満の場合には、伝送速度優先度のポイントが「1」である。中継装置30における最大データ伝送速度が10Mbps未満の場合には、伝送速度優先度のポイントが「0」である。 (Transmission speed priority management table)
The priority management DB 5006 built in the storage unit 5000 also includes a transmission speed priority management table as shown in FIG. In this transmission rate priority management table, the transmission rate priority points are associated and managed in accordance with the value of the maximum data transmission rate (Mbps) in the
更に、記憶部5000には、図15に示されているような品質管理テーブルによって構成されている品質管理DB5007が構築されている。この品質管理テーブルでは、要求元端末10Aまたは宛先端末10Bにおける画像データの遅延時間(ms)に応じて、中継装置30で中継させる画像データの画質(画像の品質)が関連付けられて管理される。 (Quality control table)
Furthermore, in the storage unit 5000, a quality management DB 5007 configured by a quality management table as shown in FIG. In this quality management table, the image quality (image quality) of the image data relayed by the
次に、伝送管理システム50の各機能部について詳細に説明する。なお、以下では、伝送管理システム50の各部を説明するにあたって、図4に示されている各構成要素のうち、伝送管理システム50の各部を実現させるための主な構成要素との関係も説明する。 (Each functional part of the transmission management system)
Next, each functional unit of the
(基本的な処理・動作)
以上が、本実施形態に係る伝送システム1の構成および機能(または手段)の説明であり、続いて、図16乃至図23、および、図25乃至図28を用いて、本実施形態に係る伝送システム1における処理方法を説明する。なお、図16は、各中継装置30から伝送管理システム50に送信された各中継装置30の状態を示す状態情報を管理する処理を示したシーケンス図である。図17は、複数の伝送端末10の間で通信を開始する準備段階の処理を示したシーケンス図である。図18は、中継装置30を絞り込む処理を示したシーケンス図である。図19は、中継装置30を絞り込む処理を示した処理フロー図である。図20は、中継装置30の絞り込み処理を行う際のポイントの計算状態を示した図である。図21は、伝送端末10が中継装置30を選択する処理を示したシーケンス図である。図22は、伝送端末10が中継装置30を選択する処理を示した処理フロー図である。図23は、伝送端末10間で画像データおよび音声データを送受信する処理を示したシーケンス図である。図25は、外部入力装置40が表示した表示データを、会議の相手である伝送端末10に表示させる処理を示したシーケンス図である。図26は、外部入力装置40が表示させる画面の例である。図27は、伝送端末10が画像データおよび表示データを表示させる画面の例である。図28は、外部入力装置が表示データ取得部をインストールする処理を示したフロー図である。 << Processing and Operation of Embodiment >>
(Basic processing / operation)
The above is the description of the configuration and function (or means) of the
図31A及び31Bは伝送端末10の画像表示制御部14bによる解像度制御の処理例を示すフロー図である。 (Display control processing / operation)
31A and 31B are flowcharts showing an example of resolution control processing by the image
以上説明したように本実施形態によれば、音声データおよび画像データを中継する中継装置30の中継装置IDを伝送端末10aaの記憶部1000が記憶しておくことにより、伝送管理システム50によって管理されていない外部入力装置40の記憶部4000に記憶されている資料データの表示データを、会議の相手となる伝送端末10dbに送信することができるようになる。これにより、伝送管理システム50は外部入力装置40を認証する処理も行う必要が無いため、管理負荷を削減することができる。 << Main advantages of the above configuration >>
As described above, according to the present embodiment, the
以上、図1乃至図41を用いて、一実施形態において用いられる伝送端末10の基本的な機能と動作を説明した。以下では、図42乃至図47を用いて、伝送端末10の応用例を説明する。 << Application examples of transmission terminals >>
The basic functions and operations of the
図43を用いて、本実施形態における伝送端末10の画像表示制御部14bの機能を説明する。図43に示される画像表示制御部14bは、図39に示される機能に加えて、新たに、製品情報取得部14b201と、製品判定テーブル管理部14b202と、製品判定部14b203とを有する。 << Functional configuration >>
The function of the image
<<起動時の処理>>
図46を用いて、本実施形態における伝送端末10の制御処理の例を説明する。図46は、デジタル端子により、プロジェクタが接続された状態で、伝送端末10の電源が投入された場合の処理の流れを表している。 << Processing and Operation of Embodiment >>
<< Processing at startup >>
An example of control processing of the
ここまでは、伝送端末10の電源ON時における初期処理である。以降は、電源ONの後にプロジェクタが接続し直された場合に対応するための処理となる。 << Process after startup >>
Up to this point, the initial process is performed when the
上述したように、本実施形態における伝送端末10は、特定の製品情報を有するプロジェクタに対しては、デジタル端子を介して出力する映像の解像度を、アナログ端子の解像度と同様に、調整することができる。これにより、ユーザは、デジタル端子を備えるプロジェクタを新たに導入した場合であっても、以前のプロジェクタと同様の解像度で、映像を投影することができるようになる。その結果、プロジェクタの製造元のコールセンターや、社内でプロジェクタを管理する管理部門は、解像度の変更に伴う問い合わせに対応する必要がなくなる。 << Effect of this embodiment >>
As described above, the
なお、表示データを取得する処理はミラードライバを用いるものでもよい。ミラードライバは、生成された表示データを、プログラムを経由させずに、直接USBドライバに送信することができるものである。この場合、ミラードライバが表示データを生成し、USBドライバが、生成された表示データを外部装置I/F118を経由して伝送端末10へ送信する。この場合、プログラムが表示データを取得する必要がないので、プログラムを実行させるためのリソースを軽減することが可能となる。 << Supplement of Embodiment >>
Note that the process of obtaining display data may use a mirror driver. The mirror driver can directly transmit the generated display data to the USB driver without going through a program. In this case, the mirror driver generates display data, and the USB driver transmits the generated display data to the
10 伝送端末
11 送受信部(表示データ送信手段の一例)
12 操作入力受付部
13 ログイン要求部
14a 撮像部
14b 画像表示制御部
14b1 解像度制御部
14b10 解像度取得部
14b11 解像度判定部
14b12 解像度選択部
14b13 画像加工部
14b14 フラグ設定部
14b15 解像度変更部
14b16 解像度管理表読込部
14b17 フラグ取得部
14b18 フラグ判定部
14b19 セグメント値取得部
14b101 ハードウェア識別情報取得・判定部
14b102 デジタル入力取得・判定部
14b201 製品情報取得部
14b202 製品判定テーブル管理部
14b203 製品判定部
14b2 補助情報表示部
14b20 補助情報生成部
14b21 補助情報画像生成部
14b22 補助情報画像表示部
15a 音声入力部
15b 音声出力部
16 選択処理部
16a 計測部
16b 算出部
16c 選択部
17 遅延検出部
18 外部情報送受信部(表示データ受信手段の一例)
19 記憶・読出処理部
20 検知部
30 中継装置
31 送受信部
32 状態検知部
33 データ品質確認部
34 変更品質管理部
35 データ品質変更部
40 外部入力装置
41 送受信部
42 接続検出部
43 インストール判定部
44 プログラム取得部
451 表示データ取得部
452 表示データ送信部
46 操作入力受付部
47 表示制御部
48 マウント部
49 記憶・読出処理部
50 伝送管理システム
51 送受信部
52 端末認証部
53 状態管理部
54 端末抽出部
55 端末状態取得部
56 絞込部
56a 選択用セッションID生成部
56b 端末IPアドレス抽出部
56c 選択部
56d 優先度決定部
57 セッション管理部
58 品質決定部
60 遅延時間管理部
100 メンテナンスシステム
120 ディスプレイ
400 表示装置
1000 記憶部(宛先情報記憶手段の一例)
3000 記憶部
3001 変更品質管理DB
4000 記憶部
4001 資料管理DB
5000 記憶部
5001 中継装置管理DB
5002 端末認証管理DB
5003 端末管理DB
5004 宛先リスト管理DB
5005 セッション管理DB
5006 優先度管理DB
5007 品質管理DB DESCRIPTION OF
DESCRIPTION OF SYMBOLS 12 Operation
DESCRIPTION OF
3000 storage unit 3001 change quality management DB
4000 storage unit 4001 document management DB
5000 storage unit 5001 relay device management DB
5002 Terminal authentication management DB
5003 Terminal management DB
5004 Destination list management DB
5005 Session management DB
5006 Priority management DB
5007 Quality Management DB
Claims (12)
- デジタル端子を介して表示装置と接続され、当該表示装置に表示用の画像データを出力する情報端末であって、
前記表示装置から取得した装置情報が、所定の装置情報と一致する場合に、前記表示装置が表示可能な解像度を取得し、該表示可能な解像度が、画像データの伝送に用いる基準アスペクト比以外のアスペクト比の解像度を含んでいるか否かを判定する解像度判定手段と、
当該解像度判定手段が、前記表示可能な解像度が前記基準アスペクト比以外のアスペクト比の解像度を含んでいると判定した場合に、前記表示可能な解像度の中から前記基準アスペクト比以外のアスペクト比の第一の解像度を選択し、前記基準アスペクト比以外のアスペクト比の解像度を含んでいないと判定した場合に、前記表示可能な解像度の中から前記基準アスペクト比の第二の解像度を選択する解像度選択手段と、
前記装置情報が、前記所定の装置情報と一致する場合に、前記解像度選択手段により選択された解像度に前記表示装置の解像度を変更し、前記装置情報が、前記所定の装置情報と一致しない場合に、前記表示装置の推奨解像度に前記表示装置の解像度を変更する解像度変更手段と、
を有する情報端末。 An information terminal connected to a display device via a digital terminal and outputting image data for display to the display device,
When the device information acquired from the display device matches predetermined device information, the display device obtains a displayable resolution, and the displayable resolution is other than a reference aspect ratio used for transmission of image data. Resolution determination means for determining whether or not the aspect ratio resolution is included;
When the resolution determining unit determines that the displayable resolution includes a resolution with an aspect ratio other than the reference aspect ratio, the resolution determination unit includes an aspect ratio other than the reference aspect ratio from the displayable resolutions. A resolution selecting unit that selects a second resolution of the reference aspect ratio from among the displayable resolutions when a resolution of one is selected and it is determined that a resolution of an aspect ratio other than the reference aspect ratio is not included. When,
When the device information matches the predetermined device information, the resolution of the display device is changed to the resolution selected by the resolution selection means, and the device information does not match the predetermined device information. Resolution changing means for changing the resolution of the display device to the recommended resolution of the display device;
An information terminal. - 前記装置情報は、製造メーカコード、製品コード及び機種名のうち少なくとも一つを含む、
請求項1に記載の情報端末。 The device information includes at least one of a manufacturer code, a product code, and a model name.
The information terminal according to claim 1. - 前記表示装置から取得された前記装置情報が、所定の装置情報と一致するか判定する装置情報判定手段をさらに有し、
前記装置情報判定手段は、取得された前記装置情報に含まれる前記機種名が、所定の機種名である場合に、前記装置情報が、前記所定の装置情報と一致すると判定する、
請求項2に記載の情報端末。 A device information determination unit that determines whether the device information acquired from the display device matches predetermined device information;
The device information determination unit determines that the device information matches the predetermined device information when the model name included in the acquired device information is a predetermined model name.
The information terminal according to claim 2. - 前記表示装置から取得された前記装置情報が、所定の装置情報と一致するか判定する装置情報判定手段をさらに有し、
前記装置情報判定手段は、取得された前記装置情報に含まれる前記製造メーカコードが、所定の製造メーカコードであり、かつ、取得された前記装置情報に含まれる前記製品コードが、所定の範囲の製品コードである場合に、前記装置情報が、前記所定の装置情報と一致すると判定する、
請求項2に記載の情報端末。 A device information determination unit that determines whether the device information acquired from the display device matches predetermined device information;
The device information determination unit is configured such that the manufacturer code included in the acquired device information is a predetermined manufacturer code, and the product code included in the acquired device information is within a predetermined range. When it is a product code, it is determined that the device information matches the predetermined device information.
The information terminal according to claim 2. - 前記解像度選択手段による第一の解像度の選択の後、前記表示装置に出力する画像データにセグメント領域を付加する加工を行う画像加工手段
をさらに有する、請求項1乃至4何れか一項に記載の情報端末。 5. The image processing unit according to claim 1, further comprising: an image processing unit that performs a process of adding a segment area to the image data output to the display device after the first resolution is selected by the resolution selection unit. Information terminal. - 前記画像加工手段は、
前記第一の解像度と幅が一致する1つ以上の矩形データを生成し、
当該矩形データを前記画像データの高さ方向に付加し、
前記矩形データの高さと前記画像データの高さの合計が前記第一の解像度の高さに一致する、
請求項5に記載の情報端末。 The image processing means includes
Generating one or more pieces of rectangular data whose width matches the first resolution;
The rectangular data is added in the height direction of the image data,
The sum of the height of the rectangular data and the height of the image data matches the height of the first resolution;
The information terminal according to claim 5. - 前記表示装置に補助情報を表示する場合に、前記第一の解像度が選択された場合は、前記セグメント領域に前記補助情報を表示し、前記第二の解像度が選択された場合は、前記画像データの任意の領域に前記補助情報を重ねて表示する補助情報表示手段
をさらに有する、請求項5又は6に記載の情報端末。 When displaying the auxiliary information on the display device, if the first resolution is selected, the auxiliary information is displayed in the segment area, and if the second resolution is selected, the image data is displayed. The information terminal according to claim 5, further comprising auxiliary information display means for displaying the auxiliary information in an overlapping manner on any area of the information. - デジタル端子を介して表示装置と接続され、当該表示装置に表示用の画像データを出力する伝送端末であって、
前記表示装置から取得した装置情報が、所定の装置情報と一致する場合に、前記表示装置が表示可能な解像度を取得する第一の解像度取得手段と、
前記表示装置から取得した前記装置情報が、前記所定の装置情報と一致する場合に、1つ以上のデータ行からなり、当該データ行は少なくとも解像度と重畳フラグを要素として含む解像度管理表から順番に1つのデータ行を読み込み、前記データ行から解像度を取得する第二の解像度取得手段と、
前記第一の解像度取得手段により取得した前記表示可能な解像度に前記第二の解像度取得手段により取得した解像度が含まれているか否かを判定する解像度判定手段と、
前記解像度判定手段が、前記表示可能な解像度に前記第二の解像度取得手段により取得した解像度が含まれていると判定した場合に、読み込んだ前記データ行から重畳フラグを取得するフラグ取得手段と、
当該フラグ取得手段により取得した前記重畳フラグが偽である場合に、前記表示装置に出力する画像データにセグメント領域を付加する加工を行う画像加工手段と、
前記装置情報が、前記所定の装置情報と一致する場合に、前記第二の解像度取得手段により取得した解像度に前記表示装置の解像度を変更し、前記装置情報が、前記所定の装置情報と一致しない場合に、前記表示装置の推奨解像度に前記表示装置の解像度を変更する解像度変更手段と、
を有する情報端末。 A transmission terminal connected to a display device through a digital terminal and outputting image data for display to the display device,
First resolution acquisition means for acquiring a displayable resolution by the display device when the device information acquired from the display device matches predetermined device information;
When the device information acquired from the display device matches the predetermined device information, the device information is composed of one or more data rows, and the data rows are sequentially from a resolution management table including at least a resolution and a superposition flag as elements. Second resolution acquisition means for reading one data row and acquiring the resolution from the data row;
Resolution determination means for determining whether or not the displayable resolution acquired by the first resolution acquisition means includes the resolution acquired by the second resolution acquisition means;
A flag acquisition unit that acquires a superposition flag from the read data row when the resolution determination unit determines that the displayable resolution includes the resolution acquired by the second resolution acquisition unit;
Image processing means for performing processing for adding a segment area to image data to be output to the display device when the superposition flag acquired by the flag acquisition means is false;
If the device information matches the predetermined device information, the resolution of the display device is changed to the resolution acquired by the second resolution acquisition means, and the device information does not match the predetermined device information. A resolution changing means for changing the resolution of the display device to the recommended resolution of the display device;
An information terminal. - 互いにネットワークにより接続された、請求項1乃至8何れか一項に記載の複数の情報端末を含み、
個々の前記情報端末は他の情報端末から送信される画像データを処理して前記画像データとする、
システム。 A plurality of information terminals according to any one of claims 1 to 8, which are connected to each other via a network,
Each of the information terminals processes image data transmitted from other information terminals into the image data.
system. - デジタル端子を介して表示装置と接続され、当該表示装置に表示用の画像データを出力する情報端末の制御方法であって、
前記表示装置から取得した装置情報が、所定の装置情報と一致する場合に、前記表示装置が表示可能な解像度を取得し、該表示可能な解像度が、画像データの伝送に用いる基準アスペクト比以外のアスペクト比の解像度を含んでいるか否かを判定し、
前記表示可能な解像度が前記基準アスペクト比以外のアスペクト比の解像度を含んでいると判定した場合に、前記表示可能な解像度の中から前記基準アスペクト比以外のアスペクト比の第一の解像度を選択し、
前記基準アスペクト比以外のアスペクト比の解像度を含んでいないと判定した場合に、前記表示可能な解像度の中から前記基準アスペクト比の第二の解像度を選択し、
前記装置情報が、前記所定の装置情報と一致する場合に、選択された解像度に前記表示装置の解像度を変更し、
前記装置情報が、前記所定の装置情報と一致しない場合に、前記表示装置の推奨解像度に前記表示装置の解像度を変更する、
制御方法。 A control method of an information terminal connected to a display device via a digital terminal and outputting image data for display to the display device,
When the device information acquired from the display device matches predetermined device information, the display device obtains a displayable resolution, and the displayable resolution is other than a reference aspect ratio used for transmission of image data. Determine if the aspect ratio resolution is included,
When it is determined that the displayable resolution includes a resolution with an aspect ratio other than the reference aspect ratio, a first resolution with an aspect ratio other than the reference aspect ratio is selected from the displayable resolutions. ,
When it is determined that the resolution of the aspect ratio other than the reference aspect ratio is not included, the second resolution of the reference aspect ratio is selected from the displayable resolutions,
If the device information matches the predetermined device information, change the resolution of the display device to the selected resolution;
If the device information does not match the predetermined device information, change the resolution of the display device to the recommended resolution of the display device;
Control method. - 請求項10の制御方法をコンピュータに実行させるためのプログラムを記憶した、コンピュータ読み取り可能な記憶媒体。 A computer-readable storage medium storing a program for causing a computer to execute the control method according to claim 10.
- 表示装置と、該表示装置とデジタル端子により接続され、当該表示装置に表示用の画像データを出力する情報端末とを有するシステムであって、
前記表示装置の装置情報を格納する装置情報格納手段と、
前記表示装置から取得した前記装置情報が、所定の装置情報と一致する場合に、前記表示装置が表示可能な解像度を取得し、該表示可能な解像度が、画像データの伝送に用いる基準アスペクト比以外のアスペクト比の解像度を含んでいるか否かを判定する解像度判定手段と、
当該解像度判定手段が、前記表示可能な解像度が前記基準アスペクト比以外のアスペクト比の解像度を含んでいると判定した場合に、前記表示可能な解像度の中から前記基準アスペクト比以外のアスペクト比の第一の解像度を選択し、前記基準アスペクト比以外のアスペクト比の解像度を含んでいないと判定した場合に、前記表示可能な解像度の中から前記基準アスペクト比の第二の解像度を選択する解像度選択手段と、
前記装置情報が、前記所定の装置情報と一致する場合に、前記解像度選択手段により選択された解像度に前記表示装置の解像度を変更し、前記装置情報が、前記所定の装置情報と一致しない場合に、前記表示装置の推奨解像度に前記表示装置の解像度を変更する解像度変更手段と、
変更された前記解像度により、前記画像データを表示する表示手段と、
を有するシステム。 A system having a display device and an information terminal connected to the display device by a digital terminal and outputting image data for display to the display device,
Device information storage means for storing device information of the display device;
When the device information acquired from the display device matches predetermined device information, the display device obtains a displayable resolution, and the displayable resolution is other than a reference aspect ratio used for transmission of image data. Resolution determination means for determining whether or not the aspect ratio resolution is included,
When the resolution determining unit determines that the displayable resolution includes a resolution with an aspect ratio other than the reference aspect ratio, the resolution determination unit includes an aspect ratio other than the reference aspect ratio from the displayable resolutions. A resolution selecting unit that selects a second resolution of the reference aspect ratio from among the displayable resolutions when a resolution of one is selected and it is determined that a resolution of an aspect ratio other than the reference aspect ratio is not included. When,
When the device information matches the predetermined device information, the resolution of the display device is changed to the resolution selected by the resolution selection means, and the device information does not match the predetermined device information. Resolution changing means for changing the resolution of the display device to the recommended resolution of the display device;
Display means for displaying the image data with the changed resolution;
Having a system.
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2015561036A JP6337910B2 (en) | 2014-02-10 | 2015-02-05 | Information terminal, system, control method, and storage medium |
AU2015215500A AU2015215500A1 (en) | 2014-02-10 | 2015-02-05 | Information terminal, system, control method, and recording medium |
SG11201606311SA SG11201606311SA (en) | 2014-02-10 | 2015-02-05 | Information terminal, system, control method, and recording medium |
EP15746126.0A EP3107282A4 (en) | 2014-02-10 | 2015-02-05 | Information terminal, system, control method, and recording medium |
CN201580016732.2A CN106134184A (en) | 2014-02-10 | 2015-02-05 | Information terminal, system, control method and record medium |
US15/229,826 US10068546B2 (en) | 2014-02-10 | 2016-08-05 | Information terminal, system, control method and recording medium |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2014-023707 | 2014-02-10 | ||
JP2014023707 | 2014-02-10 |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/229,826 Continuation US10068546B2 (en) | 2014-02-10 | 2016-08-05 | Information terminal, system, control method and recording medium |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015119216A1 true WO2015119216A1 (en) | 2015-08-13 |
Family
ID=53778017
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2015/053297 WO2015119216A1 (en) | 2014-02-10 | 2015-02-05 | Information terminal, system, control method, and recording medium |
Country Status (7)
Country | Link |
---|---|
US (1) | US10068546B2 (en) |
EP (1) | EP3107282A4 (en) |
JP (1) | JP6337910B2 (en) |
CN (1) | CN106134184A (en) |
AU (1) | AU2015215500A1 (en) |
SG (1) | SG11201606311SA (en) |
WO (1) | WO2015119216A1 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2018074226A (en) * | 2016-10-25 | 2018-05-10 | ソニー株式会社 | Signal processor, method, and program |
JP2023075517A (en) * | 2021-11-19 | 2023-05-31 | Necプラットフォームズ株式会社 | Control device, display system, control method and control program |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN105376642B (en) * | 2014-08-18 | 2019-12-03 | 深圳Tcl新技术有限公司 | Video playing resolution ratio switching method and system |
EP3247112A1 (en) | 2016-05-20 | 2017-11-22 | Ricoh Company, Ltd. | Information processing apparatus, communication system, and information processing method |
US10356361B2 (en) | 2016-09-16 | 2019-07-16 | Ricoh Company, Ltd. | Communication terminal, communication system, and display method |
CN114268742B (en) * | 2022-03-01 | 2022-05-24 | 北京瞭望神州科技有限公司 | Sky eye chip processing apparatus |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008134520A (en) * | 2006-11-29 | 2008-06-12 | Canon Inc | Image projection device and system |
JP2009180892A (en) * | 2008-01-30 | 2009-08-13 | Lenovo Singapore Pte Ltd | Portable information device and mode changeover method of the same |
JP2012237964A (en) * | 2011-04-28 | 2012-12-06 | Ricoh Co Ltd | Transmission terminal, image display control method, image display control program, record medium, and transmission system |
JP2013242357A (en) * | 2012-05-18 | 2013-12-05 | Ricoh Co Ltd | Information processing apparatus, information processing method, and program |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4738628B2 (en) | 2001-04-25 | 2011-08-03 | 株式会社リコー | Data conference system, data conference terminal, and recording medium recording data conference program |
KR100580245B1 (en) * | 2003-06-26 | 2006-05-16 | 삼성전자주식회사 | Apparatus and method for displaying double picture at the same time |
US7113200B2 (en) | 2004-05-21 | 2006-09-26 | Polycom, Inc. | Method and system for preparing video communication image for wide screen display |
JP3978616B2 (en) * | 2005-09-13 | 2007-09-19 | 船井電機株式会社 | Image output device |
WO2007146112A2 (en) * | 2006-06-07 | 2007-12-21 | Ati Technologies, Ulc | Display information feedback |
-
2015
- 2015-02-05 CN CN201580016732.2A patent/CN106134184A/en active Pending
- 2015-02-05 EP EP15746126.0A patent/EP3107282A4/en not_active Ceased
- 2015-02-05 WO PCT/JP2015/053297 patent/WO2015119216A1/en active Application Filing
- 2015-02-05 AU AU2015215500A patent/AU2015215500A1/en not_active Abandoned
- 2015-02-05 SG SG11201606311SA patent/SG11201606311SA/en unknown
- 2015-02-05 JP JP2015561036A patent/JP6337910B2/en active Active
-
2016
- 2016-08-05 US US15/229,826 patent/US10068546B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2008134520A (en) * | 2006-11-29 | 2008-06-12 | Canon Inc | Image projection device and system |
JP2009180892A (en) * | 2008-01-30 | 2009-08-13 | Lenovo Singapore Pte Ltd | Portable information device and mode changeover method of the same |
JP2012237964A (en) * | 2011-04-28 | 2012-12-06 | Ricoh Co Ltd | Transmission terminal, image display control method, image display control program, record medium, and transmission system |
JP2013242357A (en) * | 2012-05-18 | 2013-12-05 | Ricoh Co Ltd | Information processing apparatus, information processing method, and program |
Non-Patent Citations (1)
Title |
---|
See also references of EP3107282A4 * |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2018074226A (en) * | 2016-10-25 | 2018-05-10 | ソニー株式会社 | Signal processor, method, and program |
JP2023075517A (en) * | 2021-11-19 | 2023-05-31 | Necプラットフォームズ株式会社 | Control device, display system, control method and control program |
JP7327828B2 (en) | 2021-11-19 | 2023-08-16 | Necプラットフォームズ株式会社 | Control device, display system, control method and control program |
Also Published As
Publication number | Publication date |
---|---|
EP3107282A1 (en) | 2016-12-21 |
US20160343347A1 (en) | 2016-11-24 |
JPWO2015119216A1 (en) | 2017-03-30 |
US10068546B2 (en) | 2018-09-04 |
AU2015215500A1 (en) | 2016-08-18 |
CN106134184A (en) | 2016-11-16 |
JP6337910B2 (en) | 2018-06-06 |
SG11201606311SA (en) | 2016-09-29 |
EP3107282A4 (en) | 2017-05-17 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5903835B2 (en) | Transmission terminal, image display control method, image display control program, recording medium, and transmission system | |
JP6691692B2 (en) | Transmission terminal, transmission method, transmission program, and transmission system | |
JP5927900B2 (en) | Electronics | |
JP6337910B2 (en) | Information terminal, system, control method, and storage medium | |
JP5821433B2 (en) | Transmission management system, transmission system, and program for transmission management system | |
JP5942364B2 (en) | Transmission management system, transmission system, and program | |
JP6343897B2 (en) | Transmission terminal, transmission method, and program | |
JP2014003448A (en) | Transmission system, external input device, and program for display resolution conversion | |
JP6194632B2 (en) | Program, setting information utilization system, information processing apparatus | |
JP5397563B1 (en) | Transmission management system, transmission system, program for transmission management system, and control method | |
JP2015173435A (en) | Transmission system, method, program, and system | |
JP2019193279A (en) | Transmission management system, transmission system, program, program providing system, and maintenance system | |
JP6361728B2 (en) | Transmission control system, transmission system, transmission control method, and recording medium | |
JP5966349B2 (en) | Electronics | |
JP6269781B2 (en) | Transmission system | |
JP2016134902A (en) | Transmission management system, communication method, and program |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15746126 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2015561036 Country of ref document: JP Kind code of ref document: A |
|
REEP | Request for entry into the european phase |
Ref document number: 2015746126 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2015746126 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2015215500 Country of ref document: AU Date of ref document: 20150205 Kind code of ref document: A |