JP2019159674A - Multi-display control system, multi-display control method, and multi-display control program - Google Patents

Abstract

To provide a multi-display control system which can operate a multi-display by a motion capture, and can improve operability of the multi-display.SOLUTION: A multi-display control system 1 includes: a multi-display 10 in which a plurality of displays 11 are arranged in a matrix state; a motion capture 40 which is arranged on a desk 30 for business and outputs a control signal by taking an action of an operator; a system control terminal 50 which specifies a region controllable by the desk 30 for business in the multi-display 10 based on the control signal output by the motion capture 40; and a multi-display control terminal 20 which displays a video on the controllable region specified by the system control terminal 50.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a multi-display control system, a multi-display control method, and a multi-display control program.

  Games and mobile terminals using motion capture are widely used. The motion capture is an interface that captures the operation of the operator as a signal to the information device, and improves the operability of the information device in that an input with a keyboard and a mouse is not necessary.

JP 2010-1118060 A JP 2013-143775 A

  It is conceivable to use motion capture for multiple displays. In the multi-display, a plurality of displays are arranged in a matrix. When operating a multi-display by motion capture, it is difficult to improve operability due to the characteristics unique to the multi-display.

  First, as a first problem, it is difficult to determine a person who performs an operation to be captured by motion capture. The multi-display is mainly used in a place where many people gather or where many people move. If the person who operates with motion capture cannot be accurately identified, the control operation cannot be recognized, causing malfunction.

  As a second problem, it is difficult to install motion capture in an existing multi-display system. Space is required to newly introduce devices such as cameras used for motion capture into an existing multi-display system.

  Furthermore, as a third problem, it is difficult to instruct the display position of the video to be displayed on the multi-display by motion capture. For example, when the motion of capturing a hand is captured by motion capture and the display position is designated, the swing width of the hand is not constant depending on the individual.

  In addition, as a fourth problem, it is difficult to instruct the size of an image to be displayed on the multi-display by motion capture. This is because, as in the case of the third problem, when the size of the image to be displayed is indicated, the swing width of the hand is not constant depending on the individual.

  Thus, it is difficult to operate the multi-display by motion capture, and the operability of the multi-display cannot be improved.

  An object of the present disclosure is to provide a multi-display control system, a multi-display control method, and a multi-display control program that solve any of the problems described above.

  A multi-display control system according to an embodiment includes a multi-display in which a plurality of displays are arranged in a matrix, a motion capture that is arranged on a work desk and outputs a control signal by capturing an operation of an operator. Based on the control signal output by the motion capture, a system control terminal that designates an area that can be controlled by the work desk in the multi-display, and a video that is displayed on the controllable area designated by the system control terminal A multi-display control terminal.

  According to one embodiment, a multi-display control system, a multi-display control method, and a multi-display control program capable of operating a multi-display by motion capture and improving the operability of the multi-display are provided.

1 is a configuration diagram illustrating a multi-display control system according to an embodiment. It is the block diagram which illustrated the multi-display control system which concerns on another example of embodiment. It is explanatory drawing which illustrated the some work desk which controls the work desk exclusive area | region of a multi-display and shared area which concern on embodiment. It is the flowchart figure which illustrated the control method of the business desk exclusive area in the multi-display which concerns on embodiment. It is the flowchart figure which illustrated the control method of the shared area in the multi-display which concerns on embodiment.

(Embodiment)
A multi-display control system according to an embodiment will be described. First, the configuration of the multi-display control system will be described. FIG. 1 is a configuration diagram illustrating a multi-display control system according to an embodiment. As shown in FIG. 1, the multi-display control system 1 includes a multi-display 10, a multi-display control terminal 20, a work desk 30, a motion capture 40, a system control terminal 50, a switcher 60, and video sources 71 to 73. .

  The multi display 10 has a plurality of displays. In the multi-display 10, a plurality of displays are arranged in a matrix. For example, the multi-display 10 has M displays arranged vertically and N displays arranged horizontally. The multi display 10 has a rectangular shape as a whole, for example. The multi-display 10 may be configured such that each display independently displays a video, or may display a single video as a whole.

  The multi display control terminal 20 controls an image to be displayed on the multi display 10. For example, the multi-display control terminal 20 controls the video that each display displays independently. In addition, the multi-display control terminal 20 controls the video to be displayed as a whole. Further, the multi-display control terminal 20 controls an image to be displayed in a controllable area of the business console 30 instructed from the system control terminal 50.

  The business desk 30 is a desk for operating the multi-display 10. An operator operates the multi-display 10 on the business desk 30. A motion capture 40 is arranged on the business desk 30. The motion capture 40 is a kind of human interface. The motion capture 40 captures the movement of the operator's hand or foot with a camera or the like. The motion capture 40 outputs a control signal by capturing the operation of the operator. The motion capture 40 designates a controllable area of the multi-display 10 by a control signal.

  The system control terminal 50 controls the entire system. The system control terminal 50 is connected to the business console 30, the multi-display control terminal 20, the multi-display 10, and the switcher 60 via a signal line 51 or the like through which a control signal is transmitted. Note that the signal line 51 includes wireless. The system control terminal 50 receives a control signal from the motion capture 40 via a signal line 51 or the like. The system control terminal 50 instructs the multi-display control terminal 20 and the switcher 60 based on the control signal output from the motion capture 40.

  For example, the system control terminal 50 designates an area that can be controlled by the business console 30 in the multi-display 10 based on the control signal output by the motion capture 40. Further, the system control terminal 50 displays an image on the multi-display control terminal 20 based on the control signal output from the motion capture 40. As a result, the multi-display control terminal 20 displays an image in the area designated by the system control terminal 50.

  The switcher 60 switches the video sources 71 to 73 according to a control signal from the system control terminal 50. The switcher 60 is connected to the video sources 71 to 73 and the multi-display control terminal 20 via a signal line 21 through which a video signal is transmitted. Note that the signal line 21 includes wireless.

  In the multi-display control system 1 in FIG. 1, only one business desk 30 is provided, but a plurality of business desks 30 may be provided.

  FIG. 2 is a configuration diagram illustrating a multi-display control system 1a according to another example of the embodiment. As illustrated in FIG. 2, the multi-display control system 1 a may include a plurality of business tables 31 to 34. Each business desk 31-34 has motion capture 41-44. Each of the business consoles 31 to 34 is connected to the system control terminal 50, the multi-display control terminal 20, the multi-display 10, and the switcher 60 through signal lines 51. The system control terminal 50 instructs the multi-display control terminal 20 and the switcher 60 by the control signals output from the motion captures 41 to 44 in each of the business desks 31 to 34.

  In addition, when generically referring to the work table, it is referred to as a work table 30, and when specifying each work table, any one of the codes such as the work tables 31 to 34 is added. In addition, when referring to motion capture generically, it is referred to as motion capture 40, and when specifying individual motion capture, any one of the symbols such as motion captures 41 to 44 is added.

  Next, operations of the multi-display control systems 1 and 1a according to the embodiment will be described. FIG. 3 is an explanatory diagram illustrating a plurality of business desks 31 to 34 that control the business desk dedicated areas 81 to 84 and the shared area 90 of the multi-display 10 according to the embodiment.

  As illustrated in FIG. 3, the multi-display 10 may include business desk dedicated areas 81 to 84 and a shared area 90. The number of business desk dedicated areas 81 to 84 may be provided as many as the number of business desks 31 to 34. For example, when four business desks 31 to 34 are provided, four business desk dedicated areas 81 to 84 corresponding to the business desks 31 to 34 are provided. In the case of the multi-display control system 1 having one business desk 30, for example, only the business desk 31 and the business desk dedicated area 81 may be provided in FIG.

  Each business desk dedicated area 81 to 84 is provided at four corners of the multi-display 10. Each business desk dedicated area 81 to 84 includes, for example, two displays 11. In the figure, in order not to make the figure cluttered, the reference numeral 11 is given only to some displays, and the signs of other displays are omitted. Note that the number of displays 11 included in each business desk dedicated area 81 to 84 is not limited to two. Further, the positions of the business desk dedicated areas 81 to 84 in the multi-display 10 are not limited to the corners.

  Areas that can be controlled by each of the business desks 31 to 34 are areas for exclusive use of the business desks 81 to 84. Therefore, the area that can be controlled by each business desk 31 to 34 is a control area dedicated to each business desk 31 to 34. The motion capture 41 in the work desk 31 controls the video displayed in the work desk dedicated area 81. Similarly, the motion captures 42 to 44 in the business desks 32 to 34 control images displayed in the business desk dedicated areas 82 to 84. As described above, since the business desk dedicated areas 81 to 84 that can be controlled exclusively by the business desks 31 to 34 are provided, the multi-display 10 can be controlled simultaneously from the plurality of business desks 30.

  The multi display 10 may have one shared area 90. The shared area 90 is disposed at the center of the multi display 10. The shared area 90 includes 12 displays 11. Therefore, the shared area 90 is a display area wider than each business desk dedicated area 81-84. The number of displays 11 included in the shared area 90 is not limited to twelve. Further, the position of the shared area 90 in the multi-display 10 is not limited to the center.

  Each of the business desks 31 to 34 can also control the shared area 90. Each business desk 31 to 34 can control the shared area 90 if it acquires the control right of the shared area 90. The area that can be controlled by the business console 30 that has acquired the control right is a shared control area. The business console 30 that has acquired the control right can exclude control signals from other than the business console 30. Therefore, when the multi-display 10 is operated by the plurality of business desks 31 to 34, it becomes impossible to operate the shared area 90 other than the business desk 30 that has acquired the control right.

  In order to acquire the control right of the shared area 90, it is acquired at the time of operation on the work desk 30. The control right of the shared area 90 may be given, for example, when the motion capture 40 captures a predetermined operation. During the operation pattern from the control start to the control end operation pattern in the work desk 30 that has obtained the control right, the other work desks 30 cannot be controlled.

  For example, each business desk 31 to 34 is associated with a color such as red, green, and blue, and while the business desk 30 that has obtained the control right controls the shared area 90, the multi-display 10 may be displayed with a wavy line of a color corresponding to the work desk 30. Thereby, it is possible to grasp which business desk 30 has control of the shared area 90 from other business desks 30.

  FIG. 4 is a flowchart illustrating a method for controlling the business desk dedicated areas 81 to 84 in the multi-display 10 according to the embodiment. As shown in step S11 of FIG. 4, the operation is started, and first, it is determined whether the control area is the business desk dedicated area 81 to 84 or the shared area 90. For example, a predetermined motion of the operator is captured by the motion capture 40, and a control signal indicating a control region is output based on the captured predetermined motion. Thereby, the system control terminal 50 determines whether the control area is the business desk dedicated area 81 to 84 or the shared area 90.

  In this way, in the multi-display 10 in which the plurality of displays 11 are arranged in a matrix, the multi-display 10 is arranged on the work desk 30 and uses a motion capture 40 that outputs a control signal by capturing the operation of the operator. An area that can be controlled by the business console 30 on the display 10 is designated.

  If the control area is the shared area 90, the process proceeds to a flow of a control method for the shared area 90 as shown in step S12. The flow of the method for controlling the shared area 90 will be described later.

  In step S11, when the control area is the business desk dedicated area 80, the display operation is captured by the motion capture 40 as shown in step S13. The motion capture 40 outputs a control signal for the display operation by capturing the operation of the operator.

  Next, as shown in step S <b> 14, the system control terminal 50 that has received the display operation control signal from the motion capture 40 displays a video window in the business console dedicated area 80 of the multi-display 10. The video window is a screen on which candidates for video sources 71 to 73 and video can be displayed.

  Next, as shown in step S15, the candidates for the video sources 71 to 73 are displayed in the video window displayed in the business desk dedicated area 80.

  Next, as shown in step S <b> 16, the video sources 71 to 73 are scrolled to select a video to be displayed in the work desk dedicated area 80. Then, the motion capture 40 captures the video selection operation of the operator and outputs a control signal for the video selection operation.

  Next, as shown in step S17, a display image is determined. Specifically, the system control terminal 50 causes the switcher 60 to switch to the selected video source 71 to 73 based on the video selection operation control signal from the motion capture 40. Then, the process ends. In this way, on the multi-display 10, an image is displayed in the designated business desk dedicated area 80.

  FIG. 5 is a flowchart illustrating a method for controlling the shared area 90 of the multi-display 10 according to the embodiment. As shown in step S <b> 21 of FIG. 5, first, the business console 30 that intends to operate the shared area 90 acquires the control right. As a result, the shared area 90 can be controlled, and control signals from the work desk 30 other than the work desk 30 to be operated are excluded. The control right of the shared area 90 is given, for example, when the motion capture 40 captures a predetermined operation. While the business desk 30 that has obtained the control right is controlling the shared area 90, the outer frame of the shared area 90 may be displayed with a wavy line indicating the color of the business desk 30 that has obtained the control right.

  The control right of the shared area 90 may be automatically released if there is no control signal within a predetermined time after the operation from the business console 30 that has acquired the control right. The predetermined time is, for example, 5 minutes. In addition, a video control dedicated table (not shown) capable of acquiring the control right with priority from the business console 30 may be provided. When the control is performed from the video control console, even if the business console 30 has the control right, the control right of the business console 30 is invalidated and the shared area 90 is controlled from the video control console. be able to.

  Next, as shown in step S22, it is determined whether there is a control right. If there is no control right, the process returns to step S21 to obtain the control right. The case where there is no control right is, for example, the case where there is no control within a predetermined time and the control right is automatically released. Alternatively, the case where there is no control right is a case where the video control console has the control right.

  In step S22, when there is a control right, the display operation is captured by the motion capture 40 as shown in step S23. The motion capture 40 outputs a control signal for the display operation by capturing the operation of the operator.

  Next, as shown in step S <b> 24, the system control terminal 50 that has received the display operation control signal from the motion capture 40 displays a video window in the shared area 90 in the multi-display 10.

  Next, as shown in step S <b> 25, candidates for video sources 71 to 73 are displayed in the video window displayed in the shared area 90.

  Next, as shown in step S <b> 26, the video sources 71 to 73 are scrolled to select a video to be displayed in the shared area 90. Then, the motion capture 40 captures the video selection operation of the operator and outputs a control signal for the video selection operation.

  Next, as shown in step S27, a display image is determined. Specifically, the system control terminal 50 causes the switcher 60 to switch to the selected video source 71 to 73 based on the video selection operation control signal from the motion capture 40. Then, the process ends. In this way, an image is displayed in the designated shared area 90 in the multi-display 10.

  As described above, as the operation of the multi-display control system 1 and 1a, the control method of the multi-display business desk dedicated area 80 and the shared area 90 has been described. The multi-display control method is performed using the multi-display control program. May be. That is, in the multi-display 10 in which a plurality of displays 11 are arranged in a matrix, the multi-display 10 is arranged using a motion capture 40 that is arranged on a work desk 30 and outputs a control signal by capturing an operation of an operator. An area that can be controlled by the business console 30 is designated, and an image is displayed in the designated controllable area. The multi-display may be controlled using a multi-display control program that causes a computer to execute such a series of procedures.

Next, the effect of this embodiment will be described.
The multi-display control system 1 according to the present embodiment can operate the multi-display 10 by the motion capture 40, and can improve the operability of the multi-display 10.

  The motion capture 40 is arranged on the work desk 30 and operates the multi-display by capturing the actions of the person who is located on the work desk 30. Therefore, since the operation of a person other than the business desk 30 is not taken in, it is possible to accurately determine the person who operates and suppress malfunction.

  In addition, since the motion capture 40 is arranged on the business desk 30, it does not require a new space and can be incorporated into an existing system.

  Further, a business desk dedicated area 80 and a shared area 90 are provided as control areas that can be controlled by each business desk 30. Therefore, the motion capture 40 can instruct the display position and the size of the image to be displayed on the multi-display 10.

  As described above, since the operator can be accurately discriminated and incorporated into an existing system, the multi-display control systems 1 and 1a of the present embodiment can be applied to police-related and fire-related monitoring. it can. In addition, it can be applied to the operation of an advertising multi-display on the street. Since the multi-display control systems 1 and 1a of the present embodiment use the motion capture 40, the multi-display control operation controlled by a plurality of procedures can be performed more intuitively so as to operate a smartphone or a tablet terminal. Operation can be performed and operability can be improved. Moreover, since it is not necessary to contact an apparatus by using the motion capture 40, the failure by operation can be suppressed and the failure by incorrect operation can be suppressed.

  Since the business desk dedicated area 80 that can be controlled exclusively by each business desk 30 is provided, the multi-display 10 can be controlled simultaneously from the plurality of business desks 30. Further, since the common area 90 wider than each business desk dedicated area 80 is provided, each business desk 30 can control an area wider than the business desk dedicated area 80.

  The business console 30 that has the control right of the shared area 90 and has acquired the control right can control the shared area 90 and excludes control signals from other than the business desk 30 that has acquired the control right. Yes. Therefore, the person who operates can be discriminated with high accuracy and malfunctions can be suppressed.

  While each of the business desks 31 to 34 is associated with colors such as red, green, and blue, and the business desk 30 that has obtained the control right controls the shared area 90, the multi-display 10 The outer frame of the shared area 90 is displayed with a wavy line of a color corresponding to the work desk 30. Thereby, it is possible to grasp which business desk 30 has control of the shared area 90 from other business desks 30.

  The control right of the shared area 90 is automatically released if there is no control within a predetermined time after the operation. Therefore, the shared area 90 can be operated without waste.

  A dedicated video control console is provided that can obtain control rights preferentially over the business console 30. Thereby, an unexpected emergency matter can be displayed using the shared area 90. Further, the shared area 90 can be used when the business desk 30 is out of order.

  Note that the present invention is not limited to the above-described embodiment, and can be changed as appropriate without departing from the spirit of the present invention.

1, 1a Multi-display control system 10 Multi-display 11 Display 20 Multi-display control terminals 30, 31, 32, 33, 34 Business consoles 40, 41, 42, 43, 44 Motion capture 50 System control terminal 51 Signal line 60 Switcher 71 72, 73 Video source 81, 82, 83, 84 Professional desk-dedicated area 90 Shared area

Claims (7)

A multi-display in which a plurality of displays are arranged in a matrix, and
Motion capture that is placed on the work desk and outputs the control signal by capturing the actions of the operator,
Based on the control signal output by the motion capture, a system control terminal that specifies an area that can be controlled by the work desk in the multi-display,
A multi-display control terminal for displaying video in the controllable area designated by the system control terminal;
Multi-display control system with The controllable area is a control area dedicated to a business desk.
The multi-display control system according to claim 1. A plurality of the business desks are provided,
The multi-display has an area that can be controlled by each of the business desks.
The multi-display control system according to claim 2. The controllable area is a shared control area, which is a display area wider than the control area dedicated to the work desk,
Obtaining control right during operation on the work desk, and excluding the control signal from other than the work desk that has obtained the control right,
The multi-display control system according to claim 1. The control right is automatically released if the control signal does not exist within a predetermined time from the work desk that acquired the control right.
The multi-display control system according to claim 4. In a multi-display in which a plurality of displays are arranged in a matrix, the work desk in the multi-display is arranged on a work desk and uses a motion capture that outputs a control signal by capturing an operation of an operator. Specifying the controllable area;
Displaying video in the designated controllable area;
A multi-display control method comprising: In a multi-display in which a plurality of displays are arranged in a matrix, the work desk in the multi-display is arranged on a work desk and uses a motion capture that outputs a control signal by capturing an operation of an operator. Specify the controllable area,
Display video in the specified controllable area,
A multi-display control program that causes a computer to execute this.

Images