JP2016191837A - Relay device and system thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a relay device for outputting a standby screen corresponding to a connection state when a user instructs a display device connected via a relay device connected via a network to output a predetermined image, and for muting a voice at the same time when the user makes a choice to mute the image.SOLUTION: A relay device connected via a network to a client device for communicating with a locally connected display device, and for displaying content generated by the client device via the network at the display device is configured to hold a plurality of screen schedules for successively switching a current screen to a predetermined screen in accordance with a connection state between the client device and itself, and provided with a screen switching part for, prior to the start of plug-and-play of a driver for the display device to be performed by the client device, selecting the screen schedule of a screen to be displayed on the display device posterior to the start of plug-and-play from the plurality of screen schedules.SELECTED DRAWING: Figure 6

Description

  The present invention relates to connection of a client device to a peripheral device via a relay device on a network.

  In recent years, with the widespread use of networks, connecting mobile terminal devices (notebook PCs, tablets, high-function mobile phones, etc.) and display devices through networks has been performed. As a useful item in such an environment, for example, in a seminar or exhibition, the content on the mobile terminal device is separated from the mobile terminal device at hand via a wired or wireless network, There is a relay device that can display content to a plurality of viewers using a projector (Non-Patent Document 1). This relay device can be used as if the user connected the large display or projector on the network with a USB cable using the USB over IP technology.

  In a network environment in which a USB device is connected to a relay device as described above (Non-Patent Document 1), when the USB device is used from a client PC used by a user, the OS (Operating System) of the client PC is the relay device. Plug and play is executed to recognize the USB device connected to the. In plug and play, when a relay device and a USB device (for example, a display device) are physically connected (such as a cable), the OS automatically searches for a necessary USB device driver and starts an appropriate one. Therefore, when a client PC uses a USB device connected to the relay device, the device is always used when the USB device is used for the first time after the power is turned on. Is a process of recognizing Thereafter, data is exchanged between the client PC and the USB device using the USB over IP technology via the relay device.

JP 2009-16896 A JP 2008-278279 A

Silex Technology Co., Ltd. Home Page <http://www.silex.jp/products/netda/sxnd4350wan.html>

  Here, in the relay device described in Non-Patent Document 1, (a) a user newly connects a display device (for example, a display) to the relay device, or instructs the display device (such as turning on / off a power switch). And (b) connection, disconnection, and reconnection when switching between a display device locally connected to the relay device and a plurality of client PCs with a connection tool for controlling the relay device. In this case, the relay device outputs some screen to the connected display device. In the conventional relay device, the display data of the client PC (data that the user wants to display) is displayed on the display device only after the plug and play is finally completed. Even if the screen is provided, the screen may be switched unintentionally due to the operation of the graphic chip set in the relay device, such as a black screen. As a result, a user who browses an image using a conventional relay device feels uncomfortable because he / she continues to see an unexpected image change on the display screen of the display device.

  A user who keeps watching the screen by mitigating such an unexpected change on the display screen of the display device in the image display system using the relay device. It is necessary to reduce the burden (which causes discomfort). Further, if the relay device can autonomously determine whether or not the sound output in synchronization with the video is output in conjunction with the video displayed on the display device, it further increases the burden on the user (discomfort is caused). ) Can be reduced.

  As a countermeasure related to such a problem, Patent Document 1 discloses an instruction to skip a moving image to be reproduced (a discontinuous moving image is included) for the purpose of reducing a burden on a viewer due to a sudden video change during viewing. An image playback device is described that controls to temporarily reduce the brightness of the image before it is detected.

  Japanese Patent Laid-Open No. 2004-228561 can immediately mute the video and audio that the user was viewing by pressing the mute key, and then immediately view the subsequent video and audio if the mute key is pressed by the user. An information recording / reproducing apparatus that can be used is described.

  However, the device described in Patent Document 1 reduces the burden on the user during discontinuous image reproduction by reducing the brightness of the display screen of the device itself. This is not a control for a display device located at a remote location via a network, and does not reduce the burden on a user who uses in such an environment. Moreover, the control performed inside the apparatus is complicated by adjusting the luminance.

  The information recording / reproducing apparatus described in Patent Document 2 is such that when the user wants to mute the video and audio, the user can mute the video and audio by pressing the mute key so that the video and audio cannot be viewed. However, there is a problem in convenience because the user is forced to press the key.

  The present invention has been made in view of the above-described problems. When a user instructs a display device connected via a network-connected relay device to output an image, the relay device displays the image. It is intended to display the screen as if it is instantaneously output to the screen of the device, and to mute the audio at the same time when the user selects to mute the image (so that it cannot be viewed).

  In order to solve the above problems, a relay device according to one embodiment of the present invention is connected to a client device via a network and communicates with a locally connected display device to generate content generated by the client device over the network. The display device is a relay device that displays a plurality of screen schedules that are sequentially switched to a predetermined screen according to the connection state between the client device and the client device. Prior to the start, a screen switching unit for selecting a screen schedule of a screen to be displayed on the display device after the start of plug and play from a plurality of screen schedules is provided.

  Preferably, the screen switching unit may select a screen schedule based on an instruction from the client device.

  More preferably, the screen switching unit may be able to switch between a plurality of screen schedules after plug and play is completed.

  More preferably, even if the plug and play is completed, the plurality of screen schedules do not project an image transmitted from the client device, and display a screen held by the client device until an instruction is received from the client device. It may be included.

  Moreover, it is good also as providing the audio | voice interruption | blocking part which interrupts | blocks the output of the audio | voice transmitted from the client apparatus by selection of the screen schedule performed in a screen switching part.

  A system according to one embodiment of the present invention includes a relay device, a client device connected to the relay device via a network, and a display device locally connected to the relay device, and the content generated by the client device is generated. A system for displaying on a display device over a network, wherein the client device includes a screen switching instruction unit that instructs the switching unit to select a screen schedule on the screen of the relay device, and the relay device connects the client device and itself Multiple screen schedules that sequentially switch to a predetermined screen according to the state, and screen schedules of screens that are displayed on the display device after the start of plug and play before the start of plug and play of the display device driver performed on the client device To select from multiple screen schedules Provided with a door.

  The “screen schedule” here refers to a group of standby screens that are sequentially displayed on the display device in correspondence with a series of states such as a connection processing state, the details of which will be described later.

  According to the present invention, when the user instructs the display device connected to the relay device via the network from the client device to output the content from the client device that the user wants to display once on the connected display device, the desired When the screen is instantly displayed and the image display is muted, the audio can be muted at the same time, reducing the burden on the user.

1 is an overall view of a conventional image transfer system according to an embodiment of the present invention. 2 is a hardware configuration of each device of a conventional image transfer system according to an embodiment of the present invention. It is a functional block diagram of the conventional client apparatus. It is a functional block diagram of the conventional relay apparatus. It is a functional block diagram of the client apparatus concerning embodiment of this invention. It is a functional block diagram of the relay apparatus concerning embodiment of this invention. It is a screen transition diagram of each state in the conventional image transfer system. It is a screen transition diagram of each connection state in the image transfer system according to the embodiment of the present invention. It is a flowchart which performs interruption | blocking control of the audio | voice output in the image transfer system concerning embodiment of this invention.

First, a conventional image transfer system will be described with reference to FIGS. 1, 2, 3, 4 and 7. 1 and 2 are distinguished from each other by assigning reference numerals in the same drawing to the overall view of the image transfer system according to the related art and the embodiment of the present invention and the hardware of each device. Hereinafter, in the description, the conventional and the embodiments of the present invention are distinguished by reference numerals.
(Conventional image transfer system)

  FIG. 1 shows an overall view of a conventional image transfer system.

  The client device 101 is connected to the display device 102 via the relay device 100 through the network. In this system, an image (which may be a moving image) reproduced by the client apparatus 101 is transmitted to the relay apparatus 100 via the network and displayed on the display apparatus 102. The network between the client device 101 and the relay device 100 is a wireless network in FIG. 1, but may be a wired network. Further, in FIG. 1, one display device 102 is connected to the relay device 100. However, a plurality of display devices are connected to one relay device, and a plurality of client devices are displayed separately. You may switch and use an apparatus. In addition, when the client apparatus 101 reproduces content in which audio is added in addition to an image, the image and audio data constituting the content are also displayed via the relay apparatus 100 and the display apparatus 102 and a speaker (not shown). ) Is transferred and played.

  FIG. 2 shows a hardware configuration of each device in the conventional image transfer system.

  As shown in FIG. 2, these devices include a CPU (Central Processing Unit) 200, a ROM (Read Only Memory) 201, a RAM (Random Access Memory) 202, a storage device 203, an I / F_IC 204, a WNIC (Wireless Network Interface). 205, a NIC (Network Interface Card) 206, various I / Fs 207, and an internal bus 208 connecting each component.

  The CPU 200 is a processor that executes a control program stored in the ROM 201.

  The ROM 201 is a read-only storage area that holds a control program and the like, and the RAM 202 is a storage area that is used as a work area used when the CPU 200 executes the control program. Furthermore, the storage device 203 is a storage area for storing a control program, control information, device information, authentication information, or the like.

  The I / F_IC 204 is an IC that mutually converts data into a predetermined data format in input / output of various data performed based on execution of a control program stored in the ROM 201.

  The WNIC 205 includes a wireless communication interface that performs wireless communication. For example, a wireless LAN communication interface conforming to the IEEE802.11a, b, g, n, and ac standards. The NIC 206 includes a wired communication interface that performs wired communication. For example, a wired LAN communication interface conforming to the IEEE 802.3 standard or the like.

  Various I / Fs 207 are communication interfaces compliant with various communication standards for connecting the relay device 100 and the display device 102. Various communication standards are, for example, communication compliant with DVI, HDMI (registered trademark), and the like.

  The internal bus 208 is a bus that electrically connects the CPU 200, ROM 201, RAM 202, storage device 203, I / F_IC 204, WNIC 205, NIC 206, and various I / Fs 207 and exchanges signals.

  Hereinafter, functions of each device in the conventional image transfer system will be described in detail with reference to FIGS.

  FIG. 3 shows functional blocks of the conventional client apparatus 101 in the image transfer system.

  The connection utility 301 is used for acquiring display device information, status, and the like of a display device connected to the relay device 100 on the network from the relay device 100 and managing the device from the client device 101. The user can use the connection utility 301 of the client apparatus 101 to select and connect or disconnect a desired display apparatus 102 connected to the relay apparatus 100. As a result, a device such as the display device 102 selected by the client device 101 can be connected and disconnected as if it were directly connected to the client device 101. The connection utility 301 is realized by the CPU 200, the ROM 201, the RAM 202, the storage device 203, and the like.

  The virtual network driver 302 is indispensable for realizing the USB over IP technology, and a device driver that receives an instruction from an application (not shown) that is used by a user to operate the display device and receives the notification An input / output request to the display device 102 issued by (not shown) is encapsulated in a network packet (hereinafter also referred to as a tunneling packet) and transmitted to the relay device 100 on the network. On the other hand, when the virtual network driver 302 receives a tunneling packet including a response to an input / output request to the display device 102, the virtual network driver 302 extracts this response from the tunneling packet (decapsulation), and an application (not shown) via the device driver. Send to. The virtual network driver 302 is realized by the CPU 200, the ROM 201, the RAM 202, the storage device 203, and the like.

  Based on the device information acquired by the connection utility 301, the control unit 303 performs plug-and-play on the OS (not shown), and the display device 102 to be connected becomes available. The image data to be displayed on the screen is transmitted. The control unit 303 is realized by the CPU 200, the ROM 201, the RAM 202, the storage device 203, and the like.

  The communication control unit 304 performs wireless communication or wired communication between the client PC 101 and the relay device 100, and transmits image data transmitted from the control unit 303 to the relay device 100 via the network. The communication control unit 304 is realized by the CPU 200, the ROM 201, the RAM 202, the storage device 203, the WNIC 204, the NIC 205, and the like.

  FIG. 4 shows functional blocks of the conventional relay apparatus 100 in the image transfer system.

  The first communication control unit 401 performs wireless communication or wired communication between the client apparatus 101 and the relay apparatus 100, receives an image transmitted from the client apparatus 101 via the network, and passes it to the virtual network driver 402. . The first communication control unit 401 is realized by the CPU 200, the ROM 201, the RAM 202, the storage device 203, the WNIC 204, the NIC 205, and the like.

  The virtual network driver 402 has the same function as the virtual network driver 302 of the client apparatus 101 described with reference to FIG.

  The image control unit 403 receives user instructions, image data, audio data, and the like sent from the client apparatus 101 via the network from the virtual network driver 402. Thereafter, the image control unit 403 passes the data to the data conversion unit 404 in order to generate image data and audio data to be displayed on the display device 102. In addition, the image control unit 403 displays a series of processing states (hereinafter referred to as connection processing states) from the start to completion of the device connection process performed between the client device 101 and the display device 102 selected by the user. A plurality of standby screens (for example, connection standby, connection in progress, disconnection, etc.) shown are transmitted to the data conversion unit 404 so as to be displayed on the screen of the display device 102. Note that data of the plurality of standby screens (described in detail later) is stored in the ROM 201 or the storage device 203. The image control unit 403 is realized by the CPU 200, the ROM 201, the RAM 202, the storage device 203, the I / F_IC 204, and the like.

  The data conversion unit 404 converts the image data into a data format handled by the second communication control unit 405 and passes the data to the second communication control unit 405.

  The second communication control unit 405 communicates with the display device 102. The communication is performed in a format compliant with a standard that allows various video, image, and audio communications using a wired cable. For example, in the HDMI standard, both image and audio data are transmitted using a single cable. In the DVI format, image data is sent to the display device, while audio data is sent separately to a speaker. The second communication control unit 405 is realized by the CPU 200, the ROM 201, the RAM 202, the storage device 203, various I / Fs 207, and the like.

  With reference to FIG. 7, a screen that is related to the state of each device connection process and that the conventional relay device 100 transmits to the display device 102 corresponding to each state will be described.

  FIG. 7 shows that in the conventional image transfer system, after the relay device starts to start, each of the “waiting for connection” passes through “waiting for connection”, “connecting”, “projecting image”, and “disconnecting”. FIG. 9 shows a transition diagram (G701 → G702 → G703 → G704 → G705 → G702) of the standby screen generated by the conventional relay device 100 in the state. The relay device generates a standby screen in an order corresponding to each state (hereinafter also referred to as a screen schedule in this specification) or starts a screen from a client device until it becomes “waiting for connection” after starting. Is transferred and displayed on the display device.

  First, the standby screen G701 is a standby screen displayed on the display device 102 while the relay device 100 is initializing the OS. This standby screen G701 is a standby screen displayed only when the relay apparatus 100 is powered on. Hereinafter, this standby screen G701 is also referred to as an “active” standby screen.

  While the standby screen G701 is displayed on the display device 102, in step S701, after the relay device 100 is activated, it prepares to make the device usable from the client device 101, such as obtaining information about the connected device. ing. Hereinafter, the standby screen G701 is also referred to as an “active” standby screen.

  Next, the standby screen G702 is a “waiting for connection” standby screen displayed on the display screen when preparation for making the device (here, the display device) usable from the client apparatus 101 is completed after step S701. It is. The preparation is completed is a state in which the client apparatus 101 can recognize the presence of a device locally connected to the relay apparatus such as the display apparatus 102 by the connection utility 301. However, the client apparatus 101 cannot use the display apparatus 102 unless it passes through the following steps.

  In step S702, after the standby screen G702 is displayed on the display device 102, the user uses the connection utility 301 to arbitrarily select one or more devices connected to the relay device 100, and A connection request regarding the device is made to the relay device 100. Here, the description will proceed assuming that the display device 102 is selected.

  The standby screen G703 is a “connected” standby screen that displays on the display device 102 that the display device 102 is connected to the display device 102 selected by the user in step S702 after step S702. Hereinafter, the standby screen G703 is also referred to as a “connected” standby screen.

  In step S <b> 703, while the standby screen G <b> 703 is displayed on the display device 102, the OS of the client device 101 performs plug and play processing with the display device 102.

  In addition, during step S703, the relay device 100 relays to the display device 102 when switching from a display mode that displays a standby screen stored by itself to a display mode that displays an image transmitted from the outside (client device). There is a period during which data cannot be transmitted from the device 100, and during this time, the display device 102 displays a black screen (a state in which nothing is displayed). When step 703 is completed, the relay apparatus 100 can display an image transmitted from the client apparatus 101, and the process proceeds to an image G704.

  An image G704 illustrates one cut of an image (which may be a moving image) transmitted from the client apparatus 101. After step S703, image data can be transmitted between the client apparatus 101 and the display apparatus 102, and the client apparatus 101 sequentially transmits image data to the display apparatus 102 via the relay apparatus 100. The state in which the image G704 is displayed on the display device 102 is “projecting image” in the connection processing state of the device connection process.

  In step S704, the use of the display device ends, the user requests the relay device 100 to disconnect the display device 102 using the connection utility 301 of the client device, and the disconnection process is performed.

  The standby screen G705 is a “cutting” standby screen that displays on the display device 102 that the display device 102 is being disconnected during step S704. Note that the standby screen 705 is displayed so as to be superimposed on the image G704 displayed on the display device 102 until immediately before cutting. However, here, as in S703, when the display mode is switched, that is, when the display mode for displaying an image transmitted from the outside is switched to the display mode for displaying the standby screen stored by itself, the display device 102 is switched. A certain period of time during which data cannot be transmitted from the relay device 100 occurs, and during this time, the display device 102 displays a black screen.

  In step S705, the disconnection process is performed while the standby screen G705 is displayed on the display device 102. When this process is completed, the process returns to the state of waiting for a connection request from the user. G702) is displayed.

  As described above, in the conventional relay device 100, the connection processing state of a series of device connection processes that the client device 101 connects to the display device 102 via the relay device 100 is displayed on the display device using a plurality of standby screens. However, with the switching of the display mode of the relay device, there is a period during which signals cannot be transmitted to the display device.

  Next, an embodiment of the present invention will be specifically described with reference to FIGS. Numerical values, constituent elements, arrangement positions of constituent elements, and the like shown in the following embodiments are merely examples, and various modifications and changes can be made within the scope of the invention.

  Moreover, the same code | symbol is attached | subjected to the same component and description may be abbreviate | omitted. The general view of the image transfer system according to the embodiment of the present invention and the hardware configuration of each device are the same as those shown in FIGS. Regarding the system components, the client device is denoted by reference numeral 111 and the relay device is denoted by reference numeral 110, but the display device uses the same reference numeral 102.

(Embodiment 1)
Hereinafter, functions of each device in the image transfer system according to the embodiment of the present invention will be described in detail with reference to FIGS.

  FIG. 5 shows functional blocks of the client apparatus 111 according to the embodiment of the present invention.

  As shown in FIG. 5, the client device 111 according to the present invention includes a connection utility 501, a screen switching instruction unit 510, a virtual network driver 502, a control unit 503, a communication control unit 504, and the like. Each function will be described below with a focus on the changes from the conventional client device 101 (FIG. 3).

  The connection utility 501 is software that allows the user to select and connect or disconnect a desired display device 102 connected to the relay device 110 as described in the conventional connection utility 301. In the present invention, in addition to this function, screen switching instruction means 510 is provided. The connection utility 501 is realized by the CPU 200, the ROM 201, the RAM 202, the storage device 203, and the like.

  The screen switching instruction means 510 selects from the client device 111 that the user schedules in advance in some patterns which standby screen the relay device 110 displays on the display device 102 under certain conditions. This is made possible, and this is notified through the communication control unit 504 to instruct the screen switching unit 611 of the relay apparatus 110. Here, for notification to the relay device, for example, each screen schedule may be determined by a number such as “0”, “1”, “2”, or the like. A series of standby screens constituting the screen schedule are stored in the ROM 201 or the storage device of the relay device 110. Thus, the screen can be easily switched by setting a plurality of screen schedules. The screen switching unit 510 is also realized by the CPU 200, the ROM 201, the RAM 202, the storage device 203, and the like.

  Other functional blocks, the virtual network driver 502, the control unit 503, and the communication control unit 504 have the same functions as the corresponding blocks of the conventional client apparatus 101, and detailed description thereof is omitted.

  FIG. 6 shows functional blocks of the relay device 110 according to the embodiment of the present invention.

  As shown in FIG. 6, the relay device 110 according to the present invention includes a first communication control unit 601, a virtual network driver 602, an image control unit 603, a data conversion unit 604, a second communication control unit 605, a screen setting unit 610, and screen switching. A unit 611, a voice blocking unit 612, and the like. In the following, each function will be described in detail with a focus on changes from the conventional relay device 100 (FIG. 4).

  First, the image control unit 603 has a function equivalent to that of the image control unit 403 of the conventional relay apparatus 110, but further includes a screen setting unit 610 and a screen switching unit 611 in the present invention. The image control unit 603 is realized by the CPU 200, the ROM 201, the RAM 202, the storage device 203, the I / F_IC 204, and the like.

  The screen setting unit 610 displays the connection processing state of the device connection process performed by the relay device 110 between the client device 111 and the display device 102 on the display device 102 corresponding to the connection processing state. A standby screen to be generated is generated and transmitted to the second communication control unit 605.

  The screen switching unit 611 displays a standby screen corresponding to the device connection process performed by the relay device 110 between the client device 111 and the display device 102 based on the notification from the screen switching instruction unit 510 of the client device, according to a predetermined screen schedule. Is displayed on the display device 102. More specifically, the relay device 110 has a standby screen sequence table including screen schedule numbers and connection processing states, and the screen switching unit 611 refers to the screen schedule selected by the user. According to the number, the screen setting unit 610 is notified of which standby screen of the standby screen is to be generated by the screen setting unit 610 for each connection processing state. Here, the order (screen schedule) for displaying the standby screen corresponding to the connection processing state on the display device 102 in a predetermined order may be determined in advance at the time of product shipment, or may be initially set by the user in the relay device 110. You may decide when. A specific example of the sequence table will be described in detail with reference to FIG.

  The voice blocking unit 612 always acquires the screen schedule number (for example, “0”, “1”, “2”) from the screen switching unit 611, and the acquired screen schedule number is “1” or “2”. The sound output corresponding to the image until immediately before is cut off (muted). On the other hand, when the acquired screen schedule number is “0”, audio output is performed (the audio is not stopped).

  As described above, the sound blocking unit 612 stops (mutes) the sound in accordance with the timing of switching the screen schedule number, so that the sound is not displayed on the display device 102 even though the image is not displayed. It is possible to prevent the viewer from feeling uncomfortable by playing back only. Usually, the audio output corresponding to the image is often controlled separately due to the hardware and software configuration in the apparatus. However, since the audio blocker 612 can control the audio in association with the image, the switching timing of the standby screen And audio output timing can be linked. The voice blocking unit 612 is realized by the I / F_IC 204 or the like.

  Further, in FIG. 6, the first communication control unit 601, the virtual network driver 602, the data conversion unit 604, and the second communication control unit 605, which are other functional blocks in the relay device according to the embodiment of the present invention, Since it has the same function as the first communication control unit 401, the virtual network driver 402, the data conversion unit 404, and the second communication control unit 405 of the conventional relay device, detailed description thereof is omitted.

  Next, referring to FIG. 8, in the image transfer system according to the embodiment of the present invention, the relay apparatus 110 causes each state of the device connection process (“starting” → “waiting for connection” → “connecting” → The flow of the screen to be transmitted to the display device 102 in response to “Image projecting” → “Disconnecting” → “Waiting for connection”) will be described.

FIG. 8 is a transition diagram of screens transmitted from the relay apparatus 110 to the display apparatus in the image transfer system according to the embodiment of the present invention. Compared to the transition diagram (FIG. 7) of the screen that the conventional relay device 100 transmits to the display device, the standby screen that the relay device 110 of the image transfer system according to the embodiment of the present invention transmits to the display device 102 is Or a screen schedule number preset in the relay apparatus 110. When the user wants to display a desired standby screen on the display device 102, the user designates this screen schedule number with the connection utility 501.
(1) The screen schedule number 0 is a screen schedule that the conventional relay apparatus 100 displays on the display device, and includes a standby screen G702, G703, and G705 and an image G704 transmitted from the client device.
(2) Screen schedule number 1 is a screen schedule for displaying an image transmitted from the client device on the display device only when the user instructs display, and is composed of standby screens G702, G703, G901, and G902.
(3) Screen schedule number 2 is a screen schedule for displaying a black screen, and includes standby screens G800 and G801.
Hereinafter, in FIG. 8, the transition of the screen will be described along the connection processing state of the device connection process.

  First, after the relay apparatus is powered on, a “starting” standby screen (G701) is displayed on the display apparatus 102. In this state, the screen schedule selection is still invalid and the same standby screen is displayed.

  When activation of the relay device is completed, the state is “waiting for connection”. In connection waiting, the user can select a device to be used by using a connection utility as in the case of the conventional relay device, but the relay device of the present invention can also select a screen schedule in addition to this. is there.

In the connection waiting state, the user first selects a screen schedule by using the connection utility, and then selects a device to be used. Then, plug and play is started, and a transition is made to the connected state.
If the standby screen can be selected in this way, it is effective for the convenience of the user. For example, when it is not desired to display the connection processing status on the display device 102, the user selects the screen schedule number = 2 with the connection utility 501, and instructs the relay device 110 via the network to change from the standby screen G702 to the standby screen G800. And a black screen is displayed on the display device 102 during plug and play.

  When the plug and play is completed, the state transits to a state in which an image transferred from the client device can be displayed (a state of “projecting image”). At this time, if the user selects the screen schedule = 0, the connection standby screen (G703) is changed to the screen (G704) from the client device at the moment of completion of plug and play. When the user selects screen schedule = 1, when plug and play is completed, an image lock screen (G810) is displayed instead of an image transmitted from the client device. When the user selects screen schedule = 2, the display device remains in the black screen (G800) even when plug and play is completed.

  When screen schedule number = 2 is selected, a display that displays an image transmitted from the outside (client device) from a display mode in which the relay device displays a standby screen stored by itself, which was a problem in a conventional relay device Since the black screen display moments when switching to the mode are black screens before and after that, unpleasant sudden screen changes can be prevented. The user of the client device can manually switch the screen schedule from 2 to 0 after confirming the completion of plug and play and preparing the screen to be displayed on the client device.

  In addition, the standby screen G810 that appears when the screen schedule number = 1 is selected, does not want the display device 102 to display a screen that is being operated by the user on the client device 111, or intentionally displays an image for a specific period. This is a standby screen that is selected because it is not desired to be displayed on the device 102. While the standby screen G810 is displayed on the display device 102 in the “projecting image” state, an image is transmitted from the client device 111 to the relay device 110, but the display device 102 replaces the image. When the standby screen G801 is displayed, the viewer of the display apparatus 102 views the standby screen G801. In this way, an appropriate standby screen in consideration of the user's intention is displayed on the display device 102.

  That is, in this image projection state, the user can switch between the standby screen G704, the standby screen G810, and the standby screen G800 by giving an instruction through the screen schedule number using the connection utility 501, which is convenient for the user. Effective for sex.

  In the relay device of the present invention, it is impossible to change the screen schedule number during connection, and it is possible to prevent an image of the client device from being unintentionally projected on the display device due to a user's erroneous operation. May be.

  When the user ends the use of the display device during image projection and transmits a disconnection request from the connection utility to the relay device, the display device displays different display screens G705 from the relay device according to screen schedule numbers 0, 1, and 2, respectively. G902 and G801 are received and displayed. In the same manner as described for G705 in FIG. 7, also in G811 and G801, a display indicating that cutting is in progress is displayed superimposed on the previous screen. Again, if the screen schedule number = 2 is selected, the black screen can be prevented from appearing at the moment of switching the display mode.

  When the connection process is completed, the relay apparatus returns to the connection waiting state.

  As described above with reference to FIG. 8, in the image transfer system in which the user wants to display an image to be displayed on the display device 102 connected to the relay device 110 from the client device 111 via the network, the devices of the system By displaying on the display device 102 a standby screen in which the connection processing state of the connection process is associated with each state, the user who operates the client device shows the viewer an image he / she does not want to show to the viewer for the intended time. In addition, since the viewer can recognize each connection processing state, the present invention is effective for the convenience of the image transfer system according to the embodiment.

  Note that the screen schedule shown in FIG. 8 is merely an example. For example, when the screen schedule = 2 is selected in FIG. 8, a black screen (G800) is adopted in “projecting image”, but the display device viewer is also informed that the plug and play has ended. If necessary, a lock screen (G810) may be employed instead of the black screen (G800). In addition, when screen schedule = 2 is selected in FIG. 8, “cutting” employs a black screen (G801) indicating cutting, but it is not desirable to notify the viewer that cutting is in progress. May adopt a black screen (G800) instead of this screen (G801).

  FIG. 9 illustrates a screen schedule number “in image projection” in a series of device connection processes performed by the voice blocking unit 612 of the relay apparatus 110 according to the embodiment of the present invention between the client apparatus 111 and the display apparatus 102. The flow which performs interruption | blocking control of an audio | voice output is shown with changing.

  In step S1001, when image data and audio data to be displayed on the display device 102 are transmitted from the client device 111, if the screen schedule number is “0”, the data conversion unit 604 and the second communication control unit of the relay device 110 are displayed. 605 transmits image data and audio data to the display device 102 and a speaker (not shown).

  In step S1002, it is determined whether the user has instructed the connection utility 501 in the state of “projecting image” and the screen schedule number has been switched from “0” to “1” or “2”. The screen schedule number is determined by the voice blocking unit 612 acquiring it from the screen switching unit 611. If the screen schedule number is “1” or “2”, the process proceeds to step S1003 (Yes in step S1002). On the other hand, if the screen schedule number is “0”, step S1002 is repeated (No in step S1002).

  In step S1003, the voice blocking unit 612 of the relay device 110 blocks the voice data output corresponding to the image from being sent to the data converter 604 until just before it, and stops (mutes) the voice output.

  In step S <b> 1004, it is determined whether the client apparatus 111 has disconnected from the display apparatus 102. In the relay device 110, the user receives a disconnection instruction using the connection utility 501 and disconnects communication with the display device 102. If the communication is disconnected, the process is terminated (Yes in step S1004). If the communication is not disconnected, step S1001 is repeated (No in step S1004).

  By such an operation of the sound blocking unit 612, the viewer of the display device switches the screen G704 of the client device and transitions to G810 or G800, and at the same time, the sound from the client device 111 is also blocked and a speaker (not shown) Therefore, it is possible to avoid unpleasant situations such as only sound flowing from.

  The present invention uses a display device such as a large display device or a projector located at a remote location via a wired or wireless network to display the content on a mobile terminal device used by a user to a plurality of viewers. It can be used in such situations.

100, 110 Relay device 101, 111 Client device 102 Display device 200 CPU
201 ROM
202 RAM
203 storage device 204 I / F_IC
205 WNIC
206 NIC
207 Various I / F
208 Internal bus 301, 501 Connection utility 302, 402, 502, 602 Virtual network driver 303, 503 Control unit 304, 504 Communication control unit 401, 601 First communication control unit 403, 603 Image control unit 404, 604 Data conversion unit 405 , 605 Second communication control unit 510 Screen switching instruction means 610 Screen setting unit 611 Screen switching unit 612 Audio blocking unit

Claims (6)

A relay device that connects to a client device via a network and communicates with a locally connected display device to display content generated by the client device on the display device over the network,
A plurality of screen schedules for sequentially switching to a predetermined screen according to the connection status of the client device and itself are held,
Prior to the start of plug and play of the display device driver performed in the client device, a screen switching unit for selecting a screen schedule of a screen to be displayed on the display device after the start of the plug and play from the plurality of screen schedules is provided. Relay device.   The relay device according to claim 1, wherein the screen switching unit selects a screen schedule based on an instruction from the client device.   The relay device according to claim 1, wherein the screen switching unit is capable of switching between a plurality of screen schedules after the completion of the plug and play.   The plurality of screen schedules include a schedule for displaying a screen held by the client device until an instruction is received from the client device without projecting an image transmitted from the client device even when the plug and play is completed. The relay apparatus according to claim 1, 2 or 3. A voice blocking unit that blocks the output of the voice transmitted from the client device by selecting a screen schedule performed by the screen switching unit;
The relay apparatus according to claim 1, 2, 3, or 4. A system that includes a relay device, a client device connected to the relay device via a network, and a display device locally connected to the relay device, and displays content generated by the client device on the display device over the network There,
The client device includes a screen switching instruction unit that instructs the switching unit to select a screen schedule on the screen of the relay device,
The relay device has a plurality of screen schedules that sequentially switch to a predetermined screen according to the connection state of the client device and itself,
Prior to the start of plug and play of the display device driver performed on the client device, a screen switching unit for selecting a screen schedule of a screen to be displayed on the display device after the start of the plug and play from the plurality of screen schedules. A system with.