JP2016042163A - Image display system and control method of the same - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem in which: in a system where the content of display on a display part of a main device is shared by portable terminals and operations are made from the portable terminals, constant synchronization of display states between the main device and portable terminals may increase a load on a network.SOLUTION: In an image display system 1 including a main device 2 and a plurality of portable terminals 3, when one of the portable terminals 3 transmits an image, a low-resolution image creation part 36 of the portable terminal 3 creates a low-resolution image for reducing capacity, and a terminal-side communication part 32 of the portable terminal 3 transmits the low-resolution image to a main-side communication part 22 of the main device 2 and subsequently transmits a high-resolution image before the reduction in capacity to the main-side communication part 22 of the main device 2.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an image display system for transmitting data from a portable information terminal to an image display device and displaying an image related to the transmission data, and a control method therefor.

  An image display device such as an electronic blackboard is used for meeting participants to share information by transferring text and image data from a portable information terminal and displaying the data on the image display device. In addition, an image display device such as a large-screen television may be used for viewing or editing an image captured by a person using a portable information terminal on the image display device.

The conventional image display system as described above is composed of a main device that is an image display device that each person sees in common and a portable information terminal that each person individually holds. Consists of a plurality of portable information terminals. The main device includes an image display unit and a communication unit, and the portable information terminal includes an image display unit, a communication unit, and an operation unit.

The user of the image display system operates the portable information terminal held by each person, corrects the image displayed on the display unit of the portable information terminal, and uses communication between the communication unit and the main device, The image of the main device can be updated by transferring the image. Hereinafter, an image or a character projected on the display unit of the main apparatus or the portable information terminal may be referred to as a display element.

  In such an image display system, when the display unit of the mobile terminal acquires display information such as the size and position of the display element displayed on the display unit of the main device and matches the display contents, The communication unit transmits all the data obtained by digitizing the display information on the display unit of the main device or the difference every time the image displayed on the main device is updated.

  However, in such an image display system, when the image is frequently updated, the amount of data transmitted and received between the main apparatus and the portable information terminal increases, and the main apparatus and the portable information terminal are configured. When the load on the communication network increases and congestion occurs, there is a problem that the communication is stopped or the communication time becomes long, and the usability of the entire system is deteriorated.

One of the conventional image display systems that has solved the above problems is, for example, that an image capturing unit provided in a portable information terminal such as a camera takes an image displayed on the display unit of the main device, etc. Then, the captured image is displayed on the display unit of the portable information terminal. Then, the user of the portable information terminal designates the range of the image captured by the operation unit, updates the image within the designated range, transmits only the updated image portion data to the main device, and Has a technology that can transmit data in a specified range to other portable information terminals, thereby limiting transmission data to data in the specified range and reducing the amount of data. (For example, refer to Patent Document 1).

JP 2014-10568 A

  However, the display content of the main device is sequentially updated by a plurality of persons using the image display system. Therefore, as in the invention of Patent Document 1, when an image projected on the main device is photographed with a camera provided in the portable information terminal and an updated image is created based on the pixel, one user is used. On the portable information terminal of user A (hereinafter referred to as user A), an image update by another user (hereinafter referred to as user B) may occur during the update operation of the captured image. There is sex. In such a case, since the user A is operating, there is a possibility that the user A performs a new update based on the old state without noticing the update by the user B.

  In addition, even if the user A notices the update by the user B, the image displayed on the main device must be taken again with the camera provided in the portable information terminal, which increases the extra work. There is.

  Furthermore, when one user adds a new image or modifies an existing image after obtaining display information, the one user has finished a series of operations and has been updated to the display unit of the main device. Until the image is displayed, another user has a problem that one user does not know what kind of image is added or modified.

An image display system according to the present invention includes a main display unit that can display an image, a main communication unit that communicates with a mobile terminal, and a main control unit that controls the main display unit and the main communication unit. A terminal-side display unit that can display an image, a terminal-side communication unit that communicates with the main device, and a terminal-side control unit that controls the terminal-side display unit and the terminal-side communication unit And at least one portable terminal including: the terminal-side control unit displays a display image on the terminal-side display unit, and the terminal-side communication unit is an image of a low-resolution image related to the display image The data is transmitted to the main communication unit, and then image data of a high resolution image related to the display image is transmitted.

  According to the present invention, when a plurality of users having portable information terminals deliver data to the main apparatus, synchronization between the portable information terminal and the main apparatus is suppressed while suppressing the amount of information flowing through the communication line. Can be done appropriately.

In addition, according to the present invention, since the image can be synchronously transferred immediately after the image is added, other users can immediately know the change in the display state of the display unit of the user who added the image. .

It is a schematic diagram which shows the structure of the image display system in Embodiment 1 of this invention. It is a block diagram which shows an example of the internal structure of the component of the image display system in Embodiment 1 of this invention. It is a flowchart which shows the starting process of the portable terminal in Embodiment 1 of this invention. It is a state transition diagram of the portable terminal in Embodiment 1 of this invention. It is a flowchart which shows the transmission process of the low resolution image of the portable terminal in Embodiment 1 of this invention. It is a flowchart which shows the transmission process of the high resolution image of the portable terminal in Embodiment 1 of this invention. It is a flowchart which shows the transmission process of the display operation information of the image of the portable terminal in Embodiment 1 of this invention. It is a flowchart which shows the image reception process in the portable terminal in Embodiment 1 of this invention. It is a flowchart which shows the reception process of the display operation information of the image in the portable terminal in Embodiment 1 of this invention. It is a flowchart which shows the reception process of the low resolution image in the main apparatus in Embodiment 1 of this invention. It is a flowchart which shows the reception process of the high resolution image in the main apparatus in Embodiment 1 of this invention. 7 is a flowchart showing a reception process of image operation information in the main apparatus according to the first embodiment of the present invention. It is a flowchart which shows the memory | storage process of the halfway transmission task in Embodiment 1 of this invention. It is a flowchart which shows the digest process of the midway transmission task in Embodiment 1 of this invention. It is a schematic diagram which shows the communication structure of the image display system in Embodiment 2 of this invention. It is a flowchart which shows the transmission process of the low resolution image of the portable terminal in Embodiment 2 of this invention. It is a flowchart which shows the transmission process of the operation information of the image of the portable terminal in Embodiment 2 of this invention. It is a flowchart which shows the pre-process of the image reception of the main apparatus in Embodiment 2 of this invention. It is a flowchart which shows the digest process of the midway transmission task in Embodiment 2 of this invention. It is a block diagram which shows the structure of the image display system in Embodiment 3 of this invention. It is a flowchart which shows the process which outputs the display part of the main apparatus in Embodiment 3 of this invention as one image.

Embodiment 1 FIG.
Next, embodiments of the present invention will be described with reference to the drawings. In the following description of the drawings, the same or similar parts are denoted by the same or similar reference numerals. However, it should be noted that the drawings are schematic and ratios of dimensions and the like are different from actual ones. Therefore, specific dimensions and the like should be determined in consideration of the following description. Moreover, it is a matter of course that portions having different dimensional relationships and ratios are included between the drawings.

  1 is a schematic diagram showing a configuration of an image display system according to Embodiment 1 of the present invention. FIG. 2 is a block diagram showing an example of the internal structure of the components of the image display system according to Embodiment 1 of the present invention. As shown in the figure, an image display system 1 according to Embodiment 1 of the present invention includes, for example, a main device 2 and three portable information terminals (a) 3, a portable information terminal (b) 4, and a portable information terminal. (C) It consists of 5. Here, FIG. 1 shows an example in which one main apparatus 2 and three portable information terminals are shown. However, there are a plurality of main apparatuses, two, four, or other portable information terminals. A plurality of units may be configured.

  The main device 2 is an image display device such as a television, and includes at least a main-side display unit 21 that can display an image and a main-side communication unit 22 that communicates with an external device. Here, the display element 6 is displayed on the main display unit 21, and when there are a plurality of display elements 6, they can have different display postures. The image display posture shown here refers to an image state defined by the display position, size, rotation, and the like of the image.

Since the main display unit 21 of the main device 2 and the terminal display unit 31 of the portable information terminal (a) 3 are different in screen size, number of pixels, aspect ratio, and the like, they cannot perform the same display. Displays on the terminal side display unit 31 an image corresponding to the image displayed on the main side display unit 21. Further, since the main-side communication unit 22 and the terminal-side communication unit 32 need to share image information displayed on the main-side display unit 21 and the terminal-side display unit 31, the image information is updated in synchronization. If so, update information is notified. Hereinafter, the update information of the image information may be referred to as operation information.

In the present embodiment, the portable information terminal transmits the operation information as a text difference of each parameter, and reflects the posture operation of the image on the main device. Thus, the amount of data to be transmitted can be reduced as compared with the case where the portable information terminal transmits an image after the display posture operation is performed on the main device. Although only the portable information terminal (a) 3 is described for the terminal-side display unit 31, the same applies to the portable information terminal (b) 4 and the portable information terminal (c) 5.

The exchange of data between the terminal-side communication unit 32 and the main-side communication unit 22 is roughly divided into three types, and uplink communication 41 used for data transmission from the terminal-side communication unit 32 to the main-side communication unit 22; Downlink communication 42 used for data transmission from the main-side communication unit 22 to the terminal-side communication unit 32, and the portable information terminal (a) 3, the portable information terminal (b) 4, and the portable from the main-side communication unit 22 And a multi-communication 43 used for data transmission to the terminal-side communication unit of the information terminal (c) 5. Although only the portable information terminal (a) 3 is described for the terminal-side display unit 31, the same applies to the portable information terminal (b) 4 and the portable information terminal (c) 5.

In the present embodiment, multicast is used as the multi-communication 43, but any method can be used as long as data is transmitted to all portable information terminals. For example, the main communication unit 22 transmits data to each portable information terminal one by one using TCP / IP (Transmission Control Protocol / Internet Protocol: hereinafter sometimes referred to as only TCP / IP). The method of doing is mentioned.

The communication method of the uplink communication 41, the downlink communication 42, and the multi-communication 43 can transmit and receive data such as images, characters, and display operation information that need to be exchanged between the main device 2 and the portable information terminal 3. Any communication method may be used as long as it exists. In addition, since it is desirable that the portable information terminal 3 can be used even if it is moved, the communication method is preferably wireless. For example, a Wi-Fi (Wireless Fidelity) system, a Bluetooth (registered trademark) system, an NFC (Near field communication) system, and the like can be given.

Hereinafter, the main apparatus 2 will be described. As shown in FIG. 2, the main device 2 includes a main display unit 21, a main communication unit 22, a main storage unit 23, a main control unit 24, and an image transmission management unit 25.

The main display unit 21 displays a main display image (each display element) 6. The main communication unit 22 transmits and receives data to and from the portable information terminal (a) 3. The main-side storage unit 23 stores the image and text data received from the portable information terminal (a) 3. The main-side control unit 24 is a so-called CPU (Central Processing Unit: hereinafter referred to as only a CPU), and stores the image acquired by the main-side communication unit 22 in the main-side storage unit 23. The image stored in the main storage unit 23 is read out, transferred to the main communication unit 22 or the main display unit 21, and the operation information acquired by the main communication unit 22 is displayed on the main side on the main display unit 21. Reflected in the display image 6, the image transmission of the main communication unit 22 is controlled in accordance with an instruction from the image transmission management unit 25.

The image transmission management unit 25 instructs data to be transmitted to the main control unit based on the midway transmission task which is information indicating the interruption status of the stored image data transmission. The mid-transmission task is information recorded when transmission interruption occurs during transmission of high-resolution images of the portable information terminal (a) 3, the portable information terminal (b) 4, and the portable information terminal (c) 5, It is composed of the portable information terminal that has sent the high resolution image, the image ID of the high resolution image that has been sent, and the value of the transmitted data capacity of the high resolution image. The midway transmission task is stored in the high-resolution task queue in the order in which it occurs, and is digested in the order in which it occurs.

Next, the portable information terminal (a) 3 will be described. As shown in FIG. 2, the portable information terminal (a) 3 includes a terminal side display unit 31, a terminal side communication unit 32, a terminal side storage unit 33, a terminal side control unit 34, an operation input unit 35, and a low resolution image. A generation unit 36 is included.

The terminal side display unit 31 displays the terminal side display image 7.
The terminal-side communication unit 32 transmits / receives data to / from the main-side communication unit 22.
The terminal-side storage unit 33 stores received data in addition to image and character data in advance.
The terminal-side control unit 34 is a so-called CPU, and performs display control of the terminal-side display unit 31, communication control of the terminal-side communication unit 32, and image reading / writing in the terminal-side storage unit 33.
The operation input unit 35 is a part for recognizing addition, deletion, and posture operations of the terminal-side display image 7 with respect to the portable information terminal (a) 3. For example, the operation input unit 35 may be configured with a button or a touch panel.

The low-resolution image generation unit 36 generates a low-resolution image in which the image in the terminal-side storage unit 33 selected by the operation input unit 35 has a low resolution. A method for generating a low-resolution image is not particularly defined. For example, a bilinear method or a bicubic method is appropriate. The lower resolution is a value determined from the convenience of the system user and is arbitrarily determined, but in the present embodiment, 100 (KB: kilobytes. Hereinafter, only KB may be described). In other words, the data capacity is 1/100 of that of the image before resolution reduction.

Details of each process will be described below. In addition, hereinafter, the display image refers to all elements displayed on the display unit including characters and graphs, and when simply referred to as an image, it refers to the general image including the display image. To do.

First, the activation process of the main device 2 will be described. After the main device 2 is activated, the main control unit 24 displays the entire black image as a blank screen on the main display unit 21. In the present embodiment, the blank screen is defined as the entire display of the black image. However, the main display image 6 is not displayed, and the image recognized by the user that the main display 21 is blank. If it is. This completes the startup process of the main device 2. The main device 2 enters a standby state, and the main control unit 24 controls the components of the main device 2 according to the received content, and the subsequent processing proceeds.

Next, the activation process of the portable information terminal (a) 3 will be described. FIG. 3 is a flowchart showing the activation process of the portable information terminal (a) 3.

As shown in the figure, first, when the portable information terminal (a) 3 is activated, the terminal-side communication unit 32 tries to communicate with the main-side communication unit 22 (S101). The content of communication performed here is for confirming whether the main side apparatus exists on the network to which the terminal side communication unit is connected. This process is repeated until there is a communication response from the main communication unit 22 (S102).

After establishing communication with the main-side communication unit 22 (S102: yes), the terminal-side communication unit 32 receives data representing the current display state from the communicated main-side communication unit 22 (S103). Data representing the current display state includes a low-resolution image of the main-side display image 6 of the main device 2, an image ID for each element of the main-side display image 6, and operation information. The operation information transmitted here is the value of the parameter difference between the image ID of the main display image 6 to be operated and the initial display posture of each element of the main display image 6 and the current posture. It consists of.

After receiving the display state, the terminal-side control unit 34 displays an image on the terminal-side display unit 31 based on the obtained display state (S104). Thus, the activation process of the portable information terminal (a) 3 is completed.

Next, the transition of the internal state after the start-up process of the portable information terminal (a) 3 will be described. FIG. 4 is a state transition diagram after the start-up process of the portable information terminal (a) 3 is completed. The processing in each state will be described later, and only state transition will be described here.

In the figure, it is assumed that the portable information terminal (a) 3 is in a standby state after the activation process (ST101). In the standby state, when an operation is performed on the operation input unit 35, an image is read from the terminal-side storage unit 33 and added to the terminal-side display unit 31 as the terminal-side display image 7, the low-resolution image transmission state (ST102) is obtained. A transition is made (E101).

The processing performed in the low-resolution image transmission state will be described with reference to FIG.
When the low-resolution image transmission process is completed in the low-resolution image transmission state, a transition is made to a standby state (E102).

When a posture operation is applied to the display image 6 of the terminal-side display unit 31 by an operation on the operation input unit 35 in the standby state, a transition is made to the operation information transmission state (ST103) (E103). The processing performed in the operation information transmission state will be described with reference to FIG.
When an operation end event occurs in the operation information transmission state in the operation information transmission state, the state transits to a standby state (E104).

When the terminal side communication unit 32 receives the low resolution image or the operation information from the main side communication unit 22 in the standby state (ST101), the low resolution image transmission state (ST102), and the operation information transmission state (ST103), The reception process is prioritized, and after reception is completed, the original state is restored and the process is continued (E105 to E107). The reception processing of the low resolution image or the operation information will be described with reference to FIGS.

When the terminal-side communication unit 32 receives the transmission start message in the standby state (ST101), the terminal-side communication unit 32 transits to a high-resolution image transmission state (ST104) (E108). Also, when the transmission of the interrupted high resolution image is resumed in the standby state (ST101), the state transits to the high resolution image transmission state (ST104) (E108).

When the terminal-side communication unit 32 receives a transmission start message from the main-side communication unit 22 in the standby state (ST101), when the high-resolution image transmission process ends in the high-resolution image transmission state, the terminal-side communication unit 32 transitions to the standby state. . The high-resolution image transmission process will be described with reference to FIG. 6 (E109).

Further, in the transmission state of the high-resolution image (ST104), an image is selected from the terminal-side storage unit 32 by operating the operation input unit 35 in the same portable information terminal (a) 3, and the terminal-side display unit 31 displays the terminal side. When the same image is added as the display image 7, a transition to the low-resolution image transmission state is made (E110).

Further, in the transmission state of the high-resolution image (ST104), the operation of the posture is performed on the terminal-side display image 7 of the terminal-side display unit 31 by the operation on the operation input unit 35 in the same portable information terminal (a) 3. When added, the state transits to the operation information transmission state (E111).

Next, the low-resolution image transmission process of the portable information terminal (a) 3 will be described. FIG. 5 is a flowchart showing a low-resolution image transmission process from the portable information terminal (a) 3 to the main apparatus 2. The transmission process of the low-resolution image is started at the timing when the image in the terminal-side storage unit 33 to be added to the terminal-side display unit 31 is selected by the operation on the operation input unit. Hereinafter, the selected image is referred to as an additional image.

As shown in FIG. 5, first, the low resolution image generation unit 36 generates a low resolution image in which the additional image has a low capacity (S201).

Subsequently, the terminal-side control unit 34 displays a low-resolution image as an additional image as one of the terminal-side display images 7 in the center of the terminal-side display unit 31 (S202). In the present embodiment, the initial position of the additional image is set at the center of the terminal-side display unit 31, but there is no problem at any position on the terminal-side display unit 31.

Here, the terminal side communication part 32 transmits a low resolution image to the main side communication part 22 (S203).

This completes the low-resolution image transmission process. As described above, in this embodiment, when an image to be transmitted is selected, a low-resolution image in which the selected image has a low capacity is transmitted in advance. Thereby, since the image to be sent has a low capacity, it is possible to synchronize the display state between the respective devices without imposing a load on the network.

Next, the high-resolution image transmission process of the portable information terminal (a) 3 will be described. FIG. 6 is a flowchart showing a high-resolution image transmission process from the portable information terminal (a) 3 to the main device 2. The high-resolution image transmission process is started when the terminal-side communication unit 32 receives the transmission start message.

The transmitted transmission start message includes the image ID and the transmitted data capacity of the high resolution image. Therefore, the portable information terminal 3 can know how much data has been transmitted for which image. Therefore, even if the terminal-side communication unit 32 is in a state where the transmission of the high-resolution image is interrupted, the terminal-side communication unit 32 can transmit only the data of the untransmitted portion with respect to the display image 6 specified by the image ID.

As shown in FIG. 6, the high-resolution image transmission process is a loop process with S301 and S311 as loop ends (S301 to S311).

In the processing loop, first, the terminal side communication unit 32 checks whether or not a transmission interruption message has been received (S302). This transmission interruption message is transmitted from the main communication unit 22 when the other portable information terminal (b) 4 and the portable information terminal (c) 5 start transmitting a low-resolution image or operation information. It is a message transmitted to the terminal side communication part 32 of the portable information terminal (a) 3 which is doing.

When the transmission interruption message has been received (S302: yes), the terminal-side communication unit 32 interrupts the transmission of the high resolution image (S303) and ends the processing of the high resolution image transmission process. The internal state of the portable information terminal (a) 3 changes to the standby state.

If the transmission interruption message has not been received (S302: no), the terminal-side control unit 34 of the portable information terminal (a) 3 checks whether or not an additional image has been selected in the terminal (S304).

When an additional image is selected (S304: yes), the terminal-side communication unit 32 interrupts transmission of the high-resolution image (S305), and transmits a transmission suspension message to the main-side communication unit 22 (S306). The high-resolution image transmission process ends. The internal state of the portable information terminal (a) 3 transits to the low resolution image transmission state.

When there is no selection of an additional image (S304: no), the terminal side control part 34 confirms whether operation of the attitude | position of the display image was performed in the terminal (S307). If there is an operation on the orientation of the display image (S307: yes), the terminal-side communication unit 32 interrupts transmission of the high-resolution image (S308), and transmits a transmission interruption message to the main-side communication unit 22 (S309). ), The high-resolution image transmission process is terminated. The internal state of the portable information terminal (a) 3 changes to the operation information transmission state.

If there is no operation on the orientation of the display image (S307: no), the terminal-side communication unit 32 transmits a part of the high-resolution image to the main-side communication unit 22 (S310), and returns to the beginning of the iterative process (S311). ).

When the transmission of the high resolution image is completed, the transmission process of the high resolution image is completed.

As described above, in the present embodiment, the portable information terminal (a) 3 and the portable information terminal (b) while the terminal-side communication unit 32 of the portable information terminal (a) 3 portable information terminal is transmitting a high-resolution image. When the mobile information terminal 4 transmits a low-resolution image or operation information, the mobile information terminal that is transmitting the high-resolution image interrupts the transmission of the high-resolution image, so that the mobile information terminal (a) 3 and the mobile information terminal Transmission and reception of low-resolution images and operation information of the portable information terminal of the information terminal (b) 4 is performed with priority. Thereby, since the synchronization of the display state between the devices is preferentially performed, the time until the synchronization of the display state between the devices is completed can be shortened.

Next, the operation information transmission process of the portable information terminal (a) 3 will be described. FIG. 7 is a flowchart showing operation information transmission processing from the portable information terminal (a) 3 to the main apparatus 2. The operation information transmission process is started by selecting one of the terminal-side display images 7 of the terminal-side display unit 31 by an operation on the operation input unit 35, and then performing a posture operation on the selected display image. Is the timing when is added. The subject to which the posture operation is applied is not only an image added in the portable information terminal (a) 3 to which the display operation is input, but also an image added in the portable information terminal (b) 4 or the portable information terminal (c). Good. Hereinafter, the target image to which the posture operation is applied is referred to as a selection image.

As shown in FIG. 7, first, the terminal-side control unit 34 performs image display control corresponding to the operation input to the operation input unit 35 on the selected image on the terminal-side display unit 31 (S401). Hereinafter, the display operation is reflected.) That is, when a display operation intended to enlarge is performed on an image, the image is enlarged and displayed according to the display operation.

Then, the terminal side control part 34 updates the display of the terminal side display part 31 (S402).
Further, the terminal-side control unit 34 generates operation information based on the image ID of the selected image and the input operation (S403). And the terminal side communication part 32 transmits operation information to the main side communication part 22 (S404). This is the end of the operation information transmission process.

Next, a process in which the portable information terminal (a) 3 receives a low resolution image will be described. FIG. 8 is a flowchart showing a process in which the portable information terminal (a) 3 receives a low resolution image. As shown in the figure, first, the low-resolution image and the image ID received by the terminal-side communication unit 32 are stored in the terminal-side storage unit 33 (S501).

Subsequently, the terminal-side control unit 34 displays the stored low-resolution image on the terminal-side display unit 31 (S502). The display position of the image at this time is assumed to be the center of the terminal-side display unit 31 that is the same position as the initial position of the additional image when the image is added. This is the end of the low resolution image reception process.

Next, a process in which the portable information terminal (a) 3 receives operation information will be described. FIG. 9 is a flowchart showing a process in which the portable information terminal (a) 3 receives operation information. As shown in the figure, first, the terminal-side control unit 34 reflects the display operation on the target image based on the received operation information (S601).

Subsequently, the terminal-side control unit 34 displays the operation-reflected image on the terminal-side display unit 31 and updates the display state (S602). This completes the operation information reception process.

Next, a synchronization process with the portable information terminal, which is performed when the main device 2 joins the network, will be described. When the terminal-side communication unit 32 of the portable information terminal participating in the network has requested connection to the main-side communication unit 22, the main-side communication unit 22 starts connection with the terminal-side communication unit 32, and then The side communication unit 22 transmits the current display state to the terminal side communication unit 32. This completes the synchronization process with the portable information terminal participating in the network.

Next, processing in which the main apparatus 2 receives a low resolution image from the portable information terminal (a) 3 will be described. FIG. 10 is a flowchart showing processing in which the main apparatus 2 receives a low-resolution image from the portable information terminal (a) 3. As shown in the figure, first, an intermediate transmission task addition process is performed to determine whether or not the transmission of the high resolution image is interrupted in the portable information terminal (a) 3 (S701). The midway transmission task addition process will be described with reference to FIG.

Subsequently, the main storage unit 23 stores the received low resolution image (S702), and the main control unit 24 assigns an image ID to the received low resolution image (S703). Further, the main-side control unit 24 displays the received low-resolution image on the main-side display unit 21 (S704). Next, the main-side communication unit 22 uses the received low-resolution image and the image ID assigned to the received low-resolution image to the portable information terminal (a) 3, the portable information terminal (b) 4, and the portable information terminal ( c) It transmits to the terminal side communication part 32 of 5 (S705).

Then, the mid-transmission task digest processing related to the resumption of the transmission of the high-resolution image interrupted in the portable information terminal (a) 3 is performed (S706). The midway transmission task digest process will be described with reference to FIG. This completes the low-resolution image reception process.

In the first embodiment, the main-side communication unit 22 transmits a low-resolution image to the portable information terminal (a) 3, the portable information terminal (b) 4, and the portable information terminal (c) 5 using multicast. However, the low-resolution image may not be transmitted to the portable information terminal (a) 3 that has transmitted the low-resolution image to the main communication unit 22. Thereby, the reception processing load of the portable information terminal (a) 3 can be reduced.

Next, processing in which the main device 2 receives a high resolution image from the portable information terminal (a) 3 will be described. FIG. 11 is a flowchart showing processing in which the main apparatus 2 receives a high resolution image from the portable information terminal (a) 3. As shown in the figure, first, the terminal-side storage unit 33 accumulates partial data of the received high-resolution image (S801).

Subsequently, the terminal-side control unit 34 determines whether reception of the high-resolution image is completed (S802). The reception completion determination may be performed by the terminal-side communication unit 32 transmitting a transmission completion flag to the main-side communication unit 22, or a high-resolution image sent in advance from the portable information terminal (a) 3 And the capacity of the actual data received by the main communication unit 22 may be compared. If the reception has not been completed (S802: no), the high-resolution image reception process ends.

When reception has been completed (S802: yes), the main storage unit 23 stores the received high resolution image as the main display image 6, and the main control unit 24 stores the stored high resolution image as the main display image 6. The same low resolution image displayed on the side display unit 21 is displayed in the same display state (S803). Simultaneously with the display of the high-resolution image, the corresponding low-resolution image is deleted from the main display unit 21. Then, midway transmission task digestion processing is performed (S804). Thus, the high-resolution image reception process ends.

Next, a process in which the main apparatus 2 receives operation information from the portable information terminal (a) 3 will be described. FIG. 12 is a flowchart showing a process in which the main apparatus 2 receives operation information from the portable information terminal (a) 3. As shown in the figure, first, an intermediate transmission task addition process is performed (S901).

Subsequently, the main control unit 24 reflects the image display operation based on the operation information (S902). Further, the main-side control unit 24 displays an image on which the operation has been reflected on the main-side display unit 21, and updates the display state (S903). Next, the main communication unit 22 transmits the received operation information to the terminal communication units 32 of all the portable information terminals (a) 3 (S904). Then, midway transmission task digestion processing is performed (S905). This is the end of the operation information reception process.

Next, a task addition process in the main device 2 will be described. In the task addition process, a process of determining whether or not the transmission of the high resolution image is interrupted in the portable information terminal (a) 3 is performed. FIG. 13 is a flowchart showing midway transmission task addition processing. As shown in the figure, first, the main communication unit 22 determines whether there is a portable information terminal that is transmitting a high-resolution image.

If there is no portable information terminal that is transmitting a high resolution image (S1001: no), the midway transmission task addition process is terminated. When there is a portable information terminal that is transmitting a high-resolution image (S1001: yes), the main control unit 24 identifies which portable information terminal is transmitting a high-resolution image (S1002).

Subsequently, the main communication unit 22 transmits a transmission interruption message to the terminal side communication unit 32 of the portable information terminal that is transmitting the high resolution image (S1003). Then, the portable information terminal that has sent the high-resolution image to the high-resolution task queue, the image ID of the high-resolution image that has been sent, the transmitted data capacity of the high-resolution image, and the transmission resume The order is stored as an intermediate transmission task (S1004). This completes the midway transmission task addition process.

Next, the midway transmission task digest process in the main device 2 will be described. In the midway transmission task digestion process, it is determined whether or not to resume transmission of the high-resolution image interrupted in the portable information terminal (a) 3. FIG. 14 is a flowchart showing the midway transmission task digestion process. As shown in the figure, first, the main control unit 24 checks whether or not the midway transmission task remains in the high resolution task queue (S1101).

If no midway transmission task remains in the high resolution task queue (S1101: no), the midway transmission task digestion process is terminated. When the mid-transmission task remains in the high-resolution task queue (S1101: yes), the main-side communication unit 22 is associated with the oldest mid-transmission task among the mid-transmission tasks in the high-resolution task queue. The transmission start message is transmitted to the terminal side communication unit 32 of the portable information terminal (S1102).

Subsequently, the main control unit 24 deletes the oldest midway transmission task in the high resolution task queue (S1103). This completes the midway transmission task digestion process.

In the image display system according to the present embodiment, in the portable information terminal to which an image is added, the low-resolution image generation unit generates a low-resolution image with a small capacity, and the terminal-side communication unit generates the low-resolution image. Then, the main communication unit transmits low resolution images to all the terminal communication units. Further, in a portable information terminal that performs a display image orientation operation, the terminal-side control unit generates operation information, the terminal-side communication unit transmits the operation information to the main-side communication unit, and then the main-side communication The unit transmits operation information to all the terminal side communication units.

Since the above communication is performed without a button operation after the user operates the portable information terminal, the display state is updated on the portable information terminal where the display image is added or operated. It can be acquired immediately even by a portable information terminal other than the terminal, and it is easy for other users to understand what display state the user of the portable information terminal is updating.

Further, in the image display system according to the present embodiment, low-resolution images and operation information of the portable information terminal and other portable information terminals are preferentially transmitted and received even when the portable information terminal transmits high-resolution images. Further, the low-resolution image and operation information transmitted here are designed to have a small capacity. Thereby, the synchronization of the state of the display unit between the portable information terminal and the main device and other portable information terminals can be performed at high speed without increasing the load on the network.

In the above description, the specific operation of the portable information terminal (a) 3 has been mainly described, but the same applies to the portable information terminal (b) 4 and the portable information terminal (c) 5. Further, here, the case where there are three portable information terminals has been described, but there may be two, four, or more than two.

Embodiment 2
FIG. 15 is a schematic diagram illustrating a communication configuration of the image display system according to the second embodiment. As shown in the figure, in the present embodiment, the main device 2 does not perform multicast communication with the portable information terminal (a) 3, the portable information terminal (b) 4, and the portable information terminal (c) 5. However, unlike the main device 2 of the first embodiment, the portable information terminal (a) 3 transmits to the main device 2, the portable information terminal (b) 4, and the portable information terminal (c) 5 using multicast. The point having the uplink multi-communication 44 is different from the portable information terminal (a) 3 of the first embodiment. Further, the communication of the image display system 1 is shown only for the portable information terminal (a) 3, but the same communication path is used for the portable information terminals (b) 4 (b) and the portable information terminal (c) 5. have.

In the present embodiment, multicast is used for the uplink multi-communication 44, but any method can be used as long as data is transmitted to the main apparatus 2 or another portable information terminal (a) 3. For example, there is a method in which the terminal-side communication unit 32 transmits data to the main device 2 or another portable information terminal (a) 3 using TCP / IP.

Furthermore, in the present embodiment, the main device 2 is configured such that the image transmission management unit 25 includes two queues, one of which is a high-resolution task queue used in the same application as in the first embodiment. The other is a small-capacity task queue that is a queue for low-resolution image and operation information elements, and is different from the first embodiment.

Below, the transmission process of the low resolution image of the portable information terminal (a) 3 will be described. FIG. 16 is a flowchart showing a low-resolution image transmission process from the portable information terminal (a) 3 to the main apparatus 2. The transmission process of the low-resolution image is started at the timing when the image to be added to the terminal side display unit 31 is selected by the operation on the operation input unit. Note that S203 is the same as that in the first embodiment, and S201 and S202 are the same except for the increase in parallel processing. As shown in the figure, as the parallel processing of S201, the terminal side communication unit 32 transmits a transmission request message to the main side communication unit 22 (S1201). Then, the terminal side communication unit 32 stands by until a transmission start message is sent from the main side communication unit 22 (S1202). When both steps S1202 and S202 are completed, S203 is performed. This completes the low-resolution image transmission process.

Next, the operation information transmission process of the portable information terminal (a) 3 will be described. FIG. 17 is a flowchart showing a process for transmitting operation information from the portable information terminal (a) 3 to the main device 2. The operation information transmission process is started when a display operation is applied to the terminal-side display image 7 of the terminal-side display unit 31 by an operation on the operation input unit 35. Note that S404 is the same as that in the first embodiment, and S401 to S403 are the same except for the increase in parallel processing. As shown in the figure, as the parallel processing of S401, the terminal side communication unit 32 transmits a transmission request message to the main side communication unit 22 (S1301). Then, the terminal side communication unit 32 waits until a transmission start message is sent from the main side communication unit 22 (S1302). When both steps S1302 and S403 are completed, S404 is performed. This completes the process of the operation information transmission state.

Next, processing in which the main apparatus 2 receives a transmission request message from the portable information terminal (a) 3 will be described. FIG. 18 is a flowchart of processing performed when the main apparatus 2 receives a transmission request message from the portable information terminal (a) 3. As shown in the figure, first, the main-side control unit 24 assigns an image ID to a low-resolution image that is a transmission request target (S1401). Next, the main-side communication unit 22 sends the assigned image ID to the terminal-side communication unit 32 of the portable information terminal (a) 3 that has transmitted the transmission request message (S1402). Further, the main-side control unit 24 checks whether or not the main-side communication unit 22 is receiving a low-resolution image and operation information (S1403).

If not being received (S1403: yes), the main communication unit 22 transmits a transmission start message to the terminal communication unit 32 of the portable information terminal (a) 3 that has transmitted the transmission request message (S1404). .

If it is being received (S1403: no), the portable information terminal (a) 3 that has transmitted the transmission request message and the order until the start of transmission are stored in the small-capacity task queue as an intermediate transmission task (S1405). ). This is the end of the process.

In the present embodiment, in the process in which the main-side communication unit 22 receives a low-resolution image or operation information from the terminal-side communication unit 32, a process of assigning an image ID (S703) and a portable information terminal (a) 3 Except that there is no processing (S705, S904) for sending data to the portable information terminal (b) 4 and the portable information terminal (c) 5, the main communication unit 22 sends data other than the transmission request message. The operation when receiving is the same as in the first embodiment.

Further, the task addition process (S701, S901) in the process in which the main apparatus 2 receives the low-resolution image or the operation information from the portable information terminal (a) 3 may be changed to be executed after S1403. .

Next, the digest process of the image transmission task in the main apparatus will be described. FIG. 19 is a flowchart of the digest process of the image transmission task in the main apparatus. As shown in the figure, first, the main control unit 24 checks whether or not the midway transmission task remains in the small capacity task queue (S1501).

If no midway transmission task remains in the small-capacity task queue (S1501: no), the same processing as in the first embodiment is performed (S1101 to S1103).

If the mid-transmission task remains in the small-capacity task queue (S1501: yes), the main communication unit 22 is associated with the oldest mid-transmission task among the mid-transmission tasks in the small-capacity task queue. A transmission start message is transmitted to the terminal side communication part 32 of a portable information terminal (S1502).

Subsequently, the main control unit 24 deletes the oldest halfway transmission task in the small capacity task queue (S1503). This completes the midway transmission task digestion process.

In the image display system according to the present embodiment, the portable information terminal (a) 3 displays the terminal-side display image 7 as the portable information terminal (b) 4 without passing through the main device 2 in synchronization with the terminal-side display image 7. It can be transmitted directly to the portable information terminal (c) 5. Thereby, it is possible to provide an easy-to-use image display system in which the time until synchronization is achieved is shortened.

Embodiment 3
FIG. 20 is a block diagram illustrating a configuration of the image display system according to the third embodiment. As shown in the figure, in the present embodiment, the main device 2 has an image integration unit 26 that integrates a plurality of display images displayed on the main display unit 21 and outputs a single image. This is different from the main device 2 of the first and second embodiments.

Hereinafter, a process in which the portable information terminal (a) 3 acquires the display image 6 displayed on the main display unit 21 as one integrated image will be described. FIG. 21 is a flowchart illustrating processing from when the main communication unit 22 receives a request for an integrated image of the portable information terminal (a) 3 to when the integrated image is transmitted. As shown in the drawing, first, the image integration unit 26 acquires operation information of each element of the main display image 6 and the main display image 6 from the main display unit 21 (S1601). The operation information acquired here is an image ID of the main display image 6 that is an operation target, and a parameter difference value between the initial display posture and the current posture of each element of the main display image 6. Composed.

Next, the image integration unit 26 generates an integrated image from the acquired display image and display state (S1602). Then, the main communication unit 22 transmits the generated integrated image to the portable information terminal (a) 3 that issued the request for the integrated image (S1603). The image transmitted here can be stored in the terminal-side storage unit 33, or transmitted again as a single image from the terminal-side communication unit 32 to the main-side communication unit 22 and displayed on the main-side display unit 21. Is possible. This completes the process related to the integrated image.

As described above, in the present embodiment, the user can acquire a set of a plurality of images displayed and operated on the main display unit 21 as one integrated image. Thereby, the user of the image display system can realize the editing of the plurality of images and the generation of the integrated image as described above by using the main device 2 and the portable information terminal (a) 3. . In addition, the user can reuse the acquired integrated image for an image display system or the like.

DESCRIPTION OF SYMBOLS 1 Image display system 2 Main apparatus 3 Portable information terminal (a)
4 Mobile information terminals (b)
5 Mobile information terminal (c)
6 Main display image 7 Terminal display image 21 Main display unit 22 Main communication unit 23 Main storage unit 24 Main control unit 25 Image transmission management unit 26 Image integration unit 31 Terminal display unit 32 Terminal communication unit 33 Terminal side storage unit 34 Terminal side control unit 35 Operation input unit 36 Low-resolution image generation unit 41 Up communication 42 Down communication 43 Multi communication 44 Up multi communication

Claims (6)

A main display unit capable of displaying an image;
A main communication unit that communicates with the mobile terminal;
A main apparatus including a main control unit that controls the main display unit and the main communication unit;
A terminal-side display capable of displaying images;
A terminal-side communication unit that communicates with the main device;
A terminal-side control unit that controls the terminal-side display unit and the terminal-side communication unit, and at least one portable terminal,
The terminal-side control unit displays a display image on the terminal-side display unit;
The terminal-side communication unit transmits image data of a low-resolution image related to the display image to the main-side communication unit, and then transmits image data of a high-resolution image related to the display image;
An image display system characterized by the above. Have multiple mobile devices,
The main apparatus includes an image transmission management unit that records information related to interruption or resumption of image transmission,
While the terminal-side communication unit of one of the plurality of mobile terminals is transmitting the first image to the main-side communication unit,
Among the plurality of mobile terminals, when the terminal side control unit of another mobile terminal adds the second image to the terminal side display unit,
The terminal-side communication unit of the one mobile terminal interrupts transmission of the first image,
The image transmission management unit records information relating to the suspension of transmission of the first image,
The terminal-side communication unit of the one portable terminal preferentially processes the image data of the low-resolution image related to the second image;
The image display system according to claim 1. The portable terminal includes an operation input unit for inputting information related to image operations,
While the terminal side communication unit is transmitting an image to the main side communication unit,
When the operation input unit recognizes information related to image operation,
The terminal-side communication unit interrupts image transmission,
Prioritize processing of information related to image operations;
The image display system according to claim 1, wherein: The main apparatus includes an image integration unit that integrates and outputs a plurality of elements displayed on the main display unit,
The image integration unit generates an integrated image based on information related to image operations;
The image display system according to any one of claims 1 to 3, wherein: A main display unit capable of displaying an image;
A main communication unit that communicates with the mobile terminal;
A main apparatus including a main control unit that controls the main display unit and the main communication unit;
A terminal-side display capable of displaying images;
A terminal-side communication unit that communicates with the main device;
A terminal-side control unit that controls the terminal-side display unit and the terminal-side communication unit, and at least one portable terminal,
An image display system control method for transferring and displaying an image from the portable terminal to the main device,
The terminal-side communication unit transmits image data of a low-resolution image related to an image to the main-side communication unit, and then transmits image data of a high-resolution image related to the image;
A control method of an image display system characterized by the above. Have multiple mobile devices,
A control method of an image display system for transferring and displaying an image from one portable terminal to the main device,
While the terminal-side communication unit of the one mobile terminal is transmitting the first image to the main-side communication unit,
When the terminal-side control unit of another mobile device adds a second image to its terminal-side display unit,
A terminal-side communication unit of the other portable terminal transmits image data of a low-resolution image related to the second image to the main-side communication unit;
The main communication unit transmits information related to the transmission interruption of the first image to the terminal communication unit of the one mobile terminal,
The terminal-side communication unit of the one mobile terminal interrupts transmission of the first image and preferentially receives image data of a low-resolution image related to the second image;
The method of controlling an image display system according to claim 5.

Images