JP2016090894A - Image supply device, image supply method, program, and image processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reduce a difference in responsiveness when using a plurality of display devices having an input function by an indication body.SOLUTION: An image supply device includes a reception part 201 for sequentially receiving information indicating the operation content of the indication body from a display device, an image processing part 210 for generating image data on the basis of received information, a transmission part 202 for transmitting the generated image data to the display device, and a timing adjustment part 230 for adjusting at least one of the transmission timing of first image data and the transmission timing of second image data, so that a difference between the time required for updating the screen of a first display device and the time required for updating the screen of a second display device is reduced, when the first image data and the second image data are transmitted to the first display device and the second display device respectively.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an image supply apparatus, an image supply method, a program, and an image processing system.

A display area is increased by arranging a plurality of display devices connected to one personal computer next to each other. According to this method, the system can be constructed at a lower cost than using an expensive single large-screen display device.
On the other hand, some display devices have a function of inputting various instructions to a display area using an electronic pen or a finger (see Patent Document 1). By using such a display device, various operations such as drawing an annotation on an image, scrolling the screen, and operating an application can be performed from a location away from the computer. In this case, information about the operation of the indicator acquired by the display device is transmitted to the computer, and the display content is updated by generating screen data corresponding to the operation and transmitting the information to the display device. It will be.

  Here, when using a plurality of display devices having the above input function, the connection form between the personal computer and each display device (for example, connection by cable such as HDMI and wireless connection such as WiFi) may be different. obtain. In this case, there is a possibility that there is a difference in the time until the operation of the indicator is reflected in the display content depending on the display area in charge of each display device. The reason is that the data transmission time varies depending on the connection form. Even if the difference in transmission time can be ignored, the image processing required on the computer (or projector side) may be different due to the difference in communication standards, which appears as the difference in time required for image update. .

  As a result, a phenomenon occurs in which a difference in response occurs between an input operation performed in a certain area of the displayed image and an operation performed using another indicator on another area. In particular, when an operation for drawing an object across a boundary between regions is performed, the user may feel a strong sense of incongruity.

JP 2013-97177 A

  An object of the present invention is to alleviate a difference in responsiveness when a plurality of display devices having an input function using an indicator are used.

The present invention provides an acquisition unit that sequentially acquires information representing the operation content of the indicator from the first display device or the second display device, an image processing unit that generates image data based on the acquired information, A transmission unit that transmits the first image data generated by the image processing unit to the first display device, and that transmits the second image data generated by the image processing unit to the second display device; At least one of the transmission timing of the first image data and the transmission timing of the second image data is used for the time required for the screen update of the first display device and the screen update of the second display device. An image supply apparatus including a control unit that adjusts so that a difference from a required time is reduced.
According to the present invention, the difference in responsiveness in the case where a plurality of display devices having an input function using an indicator is used is alleviated.

The control unit calculates the difference based on a timing at which the information is acquired and a timing at which the generation of the image data is completed, and a time required for updating the screen of the first display device and the second display device The image data transmission process related to the shorter of the time required for the screen update may be delayed.
According to the present invention, a timing shift due to a difference in time required for processing in the image supply apparatus is corrected.

The control unit may calculate the difference based on a result obtained by measuring a period from the information acquisition time point to the image data generation completion time point a plurality of times.
According to the present invention, it is possible to prevent excessive correction from being performed due to a change in time required for the screen update process.

The difference may be calculated based on the resolution of the image.
According to the present invention, the timing shift due to the resolution of the screen to be updated is corrected.

The difference is that a first transmission standard adopted between the image supply device and the first display device, and a second transmission standard adopted between the image supply device and the second display device. May be calculated based on
According to the present invention, the delay caused by the difference in the data transmission path is corrected.

The difference may be calculated based on a compression rate applied to a data compression process executed in the generation of the image data.
According to the present invention, a shift in transmission timing based on a difference in processing time related to the compression rate is corrected.

Steps of sequentially receiving and acquiring information representing the operation content of the indicator from the first display device or the second display device, generating image data based on the acquired information, and generating by the image processing unit Transmitting the processed first image data to the first display device, transmitting the second image data generated by the image processing unit to the second display device, and transmitting the first image data At least one of the timing and the transmission timing of the second image data is required for updating the video displayed on the second display device and the video displayed on the first display device. Adjusting the time difference to be small, receiving information indicating the operation content of the indicator sequentially from the display device, and generating image data based on the received information A step of transmitting the generated image data to the display device, and transmitting the first image data and the second image data to the first display device and the second display device, respectively. At least one of the transmission timing of the first image data and the transmission timing of the second image data is displayed on the first display device and the time required for updating the video displayed on the second display device And a step of adjusting the difference so that a difference from the time required for updating the video to be reduced is reduced.
According to the present invention, the difference in responsiveness in the case where a plurality of display devices having an input function using an indicator is used is alleviated.

The present invention also includes a step of sequentially receiving information representing the operation content of the indicator from the first display device or the second display device, and a step of generating image data based on the received information. , Transmitting the generated first image data to the first display device, transmitting the generated second image data to the second display device, and displaying the generated image data Transmitting to the device, at least one of the transmission timing of the first image data and the transmission timing of the second image data, the time required for updating the video displayed on the second display device, and the And a step of adjusting so as to reduce a difference from a time required for updating the video displayed on the first display device.
According to the present invention, the difference in responsiveness when a plurality of display devices having an input function using an indicator are used is alleviated.

  The present invention also includes a first display device, a second display device, and an image supply device, and each of the first display device and the second display device generates information representing the operation content of the indicator. Means for transmitting the generated information to the image supply device, means for receiving image data from the image supply device, and means for displaying an image based on the received image data, The image supply device generates an image data based on information representing the operation content of the indicator received from each display device, and the generated first image data to the first display device. A transmission unit that transmits the generated second image data to the second display device, and the first image data and the second image that are transmitted to the first display device and the second display device, respectively. When sending data At least one of the transmission timing of the first image data and the transmission timing of the second image data is determined based on the time required for updating the video displayed on the second display device and the first display device. There is provided an image processing system including a control unit that adjusts so as to reduce a difference from a time required for updating a video displayed on the screen.

  According to the present invention, the difference in responsiveness when a plurality of display devices having an input function using an indicator are used is alleviated.

1 is a diagram showing an overview of an image display system 100. FIG. The figure which shows the function of PC200. FIG. 3 is a diagram illustrating functions of a projector 300. The operation | movement flowchart of PC200. The figure which shows the time which each process requires.

1. FIG. 1 shows an overview of an image display system 100. The image display system 100 includes a PC 200, a plurality of projectors 300 (300-1 and 300-2), a display area 500, and an indicator 400.
The PC 200 has a function as a general personal computer and controls image display for all connected projectors 300.
Each projector 300 has a function as a general projector, and projects an image on the display area 500 under the instruction of the PC 200. Each projector 300 is connected to the PC 200 using different connection forms (signal transmission paths and methods). In the example shown in the figure, cable connection is adopted for the projector 300-1, and wireless connection is adopted for the projector 300-2. As the connection method between the PC 200 and each projector 300, any existing one can be adopted. For example, standards such as HDMI (registered trademark), USB (registered trademark), D-sub port, and Display port (registered trademark) are used for cable connection, and any connection from WiFi or Ethernet (registered trademark) is used for network connection. You can choose. Note that the projectors 300 may or may not be completely functionally identical.

  The display area 500 is a dedicated screen or wall surface. In the display area 500, a screen SC1 and a screen SC2 are formed. Screen SC1 and screen SC2 are areas projected by projector 300-1 and projector 300-2, respectively. As shown in the figure, in the image display system 100, the projection conditions such as the installation position and the enlargement ratio of the projector 300-1 and the projector 300-2 are adjusted so that the screen SC1 and the screen SC2 are adjacent to each other. As a result, the user can perceive as if one display area is formed by the screen SC1 and the screen SC2.

  The indicator 400 is an input device such as a user's own hand or finger or an electronic pen used by the user. The user designates a position in the display area 500 using the indicator 400, whereby a process for drawing an image object on the display area 500 is drawn, or an application program running on the PC 200 is used for a predetermined process other than the drawing process. Execute the operation. Specifically, when a drawing application is activated on the PC 200 and a predetermined screen is displayed, an instruction to specify or change drawing contents or drawing conditions, an instruction to start or change the application, an instruction to scroll the screen, and the like. This is performed by operating the indicator 400. In the example of the figure, an example in which the annotation AN1 and the annotation AN2 are drawn (combined display) in the background image using the indicator 400 is shown.

  FIG. 2 shows the functions of the PC 200. The PC 200 includes an image processing unit 210, a communication unit 220, a timing adjustment unit 230, a storage unit 240, a display unit 250, and an input unit 260. The display unit 250 is a display device such as a liquid crystal display. The input unit 260 is an input device such as a keyboard and a mouse, and supplies user instructions and commands to the image processing unit 210.

The communication unit 220 is a communication interface and includes a reception unit 201 and a transmission unit 202. The receiving unit 201 receives operation information Dp (referred to as Dp1 and Dp2 respectively) from the projector 300-1 or the projector 300-2. The operation information Dp includes an identifier for identifying the projector 300-1 or 300-2 that is the transmission source, and the coordinates of the position specified by the indicator 400.
Then, the receiving unit 201 determines whether the transmission source of the operation information Dp is the projector 300-1 or the projector 300-2, the operation information Dp1 to the first image processing unit 211, and the operation information Dp2 to the second. The images are supplied to the image processing unit 212. In addition, the communication unit 220 includes a timer, and processes the time when the operation information Dp is received by measuring the reception time tr (represented as tr1 or tr2 corresponding to the projector 300-1 and the projector 300-2, respectively). It outputs to the time calculation part 231. The transmission unit 202 receives the image data Di (respectively for the projector 300-1 and 300-2 are denoted as Di1 and Di2) supplied from the first image processing unit 211 and the second image processing unit 212, respectively. At a timing according to the control signal ST supplied from the delay processing unit 232, the data is transmitted to the corresponding projector 300-1 or projector 300-2.

  The image processing unit 210 is realized by a CPU, a processor dedicated to image processing, and the like. The image processing unit 210 generates image data Di and supplies the image data Di to the display unit 250 in order to confirm an image to be displayed on each projector 300 by the own apparatus. More specifically, the image processing unit 210 includes a first image processing unit 211 and a second image processing unit 212, and generates image data Di1 and Di2 to be supplied to the projector 300-1 and the projector 300-2, respectively. . The first image processing unit 211 and the second image processing unit 212 operate independently. That is, the update of the screen SC1 and the update of the screen SC2 are performed in parallel.

  The first image processing unit 211 generates image data Di1 to be supplied to the projector 300-1. Specifically, the image to be displayed next (that is, the updated screen content) is determined based on the coordinates included in the operation information Dp1, and image data Di1 representing the determined image is generated. The generated image data Di1 is supplied to the transmission unit 202. In addition, the first image processing unit 211 notifies the timing adjustment unit 230 that the generation processing of the image data Di1 has been completed.

  The second image processing unit 212 generates image data Di2 to be supplied to the projector 300-2. Specifically, the image to be displayed next (that is, the updated screen content) is determined based on the coordinates included in the operation information Dp2, and an image corresponding to the difference between the determined image and the currently displayed image Image data Di2 is generated by generating data and compressing the generated image data. The generated image data Di2 is supplied to the transmission unit 202. In addition, the second image processing unit 212 notifies the timing adjustment unit 230 that the generation processing of the image data Di2 has been completed.

The reason for calculating the difference image and compressing the data in the second image processing unit 212 is that the amount of data that can be transmitted per unit time is relatively small in the transmission path between the PC 200 and the projector 300-2. This is to reduce the amount of data to be transmitted necessary for screen update as much as possible in order to ensure speed (in other words, responsiveness). On the other hand, time is lost by the amount of data compression.
As described above, the first image processing unit 211 and the second image processing unit 212 differ in the processing content required for the screen update. As a result, a difference occurs in the processing time in the PC 200, which is one cause of the difference in responsiveness between the screens SC1 and SC2.
The first image processing unit 211 may also perform the difference extraction process and the data compression process. However, in the following, the contents of the difference extraction process and the image compression process performed by the second image processing unit 212 (compression rate, etc.) ) Are not identical. That is, it is assumed that there is a difference in responsiveness between the screen SC1 and the screen SC2 unless adjustment of the transmission timing of the image data Di described later is performed.

  The timing adjustment unit 230 is realized by a processor such as a CPU, and includes a processing time calculation unit 231 and a delay processing unit 232. The timing adjustment unit 230 transmits at least one of the transmission timing of the image data Di1 and the transmission timing of the image data Di2 when transmitting the image data Di1 and the image data Di2 to the projector 300-1 and the projector 300-2, respectively. The adjustment is made so that the difference between the time required for updating the screen of the first display device and the time required for updating the screen of the second display device is reduced.

  The processing time calculation unit 231 first determines whether or not delay processing is necessary. Specifically, the processing time calculation unit 231 receives the reception time (tr1 or tr2) supplied from the reception unit 201 and the processing completion time (tp1 or tr2) supplied from the first image processing unit 211 or the second image processing unit 212. Based on the difference from tp2), the time required for the update process in the PC 200 (internal processing time TN (referred to as TN1 or TN2 respectively)) is calculated. That is, TN1 = tp1-tr1 and TN2 = tp2-tp1.

  The calculated internal processing time TN is stored in the processing time history M3 and supplied to the delay processing unit 232. Then, the delay processing unit 232 reads the internal processing time TN related to the projector 300 that is not the provision destination projector 300 of the generated image from the storage unit 240 and compares it with the calculated internal processing time TN. When the calculated TN is greater than or equal to the read internal processing time TN (that is, the image data currently being subjected to the screen update process has the same processing time as the image data for the other projector 300, or If it is long), it is determined that delay processing is unnecessary. On the other hand, when the calculated internal processing time TN is shorter than the read internal processing time TN (that is, when the currently generated image data is faster than the image data for the other projector 300), It is determined that delay processing is necessary.

  When delay processing is necessary, the delay processing unit 232 calculates a delay amount Δt corresponding to the calculated internal processing time TN. Specifically, Δt = | TN1−TN2 |. Subsequently, the delay processing unit 232 generates a control signal ST indicating that transmission is performed with a delay by the calculated delay amount Δt, and outputs the control signal ST to the transmission unit 202. As a result, the image data Di1 and the image data Di2 are transmitted from the transmission unit 202 to the projector 300-1 and the projector 300-2, respectively, at a timing according to the control signal ST. When delay processing is not necessary, a control signal ST indicating that Δt = 0 is supplied to the transmission unit 202.

  The storage unit 240 is a storage device such as a hard disk or a semiconductor memory, and stores a program for realizing an operation described later by controlling the communication unit 220, the image processing unit 210, and the timing adjustment unit 230, respectively. In addition, the storage unit 240 stores image attributes M1, transmission environment information M2, processing time history M3, and image data M4. The image attribute M1 includes information about the image to be displayed on the projector 300 (for example, the data amount and the image resolution). The transmission environment information M2 includes information related to the transmission environment between the projector 300-1 and the projector 300-2 (transfer speed and the like). The processing time history M3 includes information indicating the time required for processing in the PC 200 for each of the screen update of the screen SC1 and the screen update of the screen SC2. The processing time history M3 is updated and accumulated every time the screen updating process is executed. The image data M4 is image data to be projected by each projector 300.

FIG. 3 shows the functions of the projector 300. The projector 300 includes a communication unit 310, an image processing unit 320, an operation detection unit 330, and a projection unit 340. The communication unit 310 is a communication interface for transmitting / receiving information to / from the PC 200, and is realized by hardware (for example, an HDMI terminal or a wireless LAN module) that supports a plurality of connection formats. However, in each projector 300, only one selected hardware module is effective at the same time. In this example, it is assumed that the projector 300-1 is connected to the PC 200 using HDMI, and the projector 300-2 is connected to WiFi using WiFi.
More specifically, the communication unit 310 includes a transmission unit 311 and a reception unit 312. When receiving the image data Di1 from the PC 200, the receiving unit 312 supplies the first processing unit 321 with the image data Di1, while receiving the image data Di2 supplies the second processing unit 322 with the image data Di2. The transmission unit 311 transmits the operation information Dp supplied from the operation detection unit 330 to the PC 200.

  The image processing unit 320 is realized by an A / D conversion circuit, a pixel processing processor, a buffer memory, and the like. The image processing unit 320 performs a predetermined drawing process on the image data Di1 or the image data Di2 supplied from the receiving unit 312 and performs a video signal V Is generated. Specifically, the image processing unit 320 includes a first processing unit 321 and a second processing unit 322. The difference in processing between the first processing unit 321 and the second processing unit 322 is that the processing of the second processing unit 322 always includes processing for expanding compressed data. Therefore, even if the same content is updated in the projector 300-1 and the projector 300-2, the content of the processing executed in the projector 300 may be different due to the difference in the connection form. As a result, there may be a difference in processing time between the projector 300-1 and the projector 300-2. The generated video signal V is supplied to the projection unit 340.

  Projection unit 340 includes a light source (laser, etc.), a projection mechanism such as a lens, a mirror, and a prism, and an optical element such as a liquid crystal panel corresponding to each display color, and a modulation mechanism that modulates light from the light source based on a video signal. This is realized by an optical system that guides the modulated light to the projection unit.

  The operation detection unit 330 monitors the position of the indicator 400, and when the position on the display area 500 is designated by the indicator 400, the coordinates of the position and the identifier of the projector 300 responsible for drawing the display area belonging to the position are displayed. The operation information Dp including is generated. The generated operation information Dp is sequentially transmitted to the PC 200 via the transmission unit 311. Specifically, the presence of the indicator 400 and its position are detected by irradiating the screen SC1 or the screen SC2 with visible light or infrared light and receiving and analyzing the reflected light. Alternatively, when the indicator 400 is a device having a wireless transmission function, the radio wave from the indicator 400 may be received, and the position of the indicator 400 with respect to the display area 500 may be determined based on the reception intensity or the like. Any other existing technique may be applied to the method of detecting the position of the indicator 400.

  FIG. 5 shows an operation flow of the PC 200. When the PC 200 recognizes the connection with the plurality of projectors 300, or when a predetermined instruction is input from the user in a state where the plurality of projectors 300 are connected, the PC 200 starts the internal processing times TN1 and TN2. The value is determined according to a predetermined algorithm and written in the storage unit 240 (S600). Thereafter, when the operation information Dp is acquired from any of the projectors 300 (S602, YES), the operation target screen (screen SC1 or screen SC2) and the operation content are specified based on the operation information Dp (S604). Subsequently, the screen of the display unit 250 is updated according to the operation information Dp (S606), and image data Di to be supplied to one of the projector 300-1 and the projector 300-2 specified in S604 is generated (S608). Or S610). When the generation of the image data Di is completed, the time required for the generation process is measured and stored (S612). Subsequently, the processing time of data for the projector 300 that is not the projector 300 identified in S604 is read from the storage unit 240, and the two are compared (S614). Subsequently, it is determined whether or not the generated image data needs to be delayed. If delay processing is necessary, the amount (Δt) is calculated (S616). After outputting the control signal ST to the transmission unit 202, the generated image is transmitted to the projector 300 (S620 or S622).

  The effect in the said Example is demonstrated using FIG. FIG. 5 schematically shows the flow of each process in time series when the transmission timing is not controlled. FIGS. 9A and 9B correspond to the case of updating the projector 300-2 (screen SC2) and the case of updating the projector 300-1 (screen SC1), respectively.

  First, when the operation of the indicator 400 is detected by the projector 300 (time t1), operation information Dp is generated and transmitted from the projector 300 to the PC 200 (time t2). When the PC 200 receives the operation information Dp (time t3), the above-described image processing is started in the image processing unit 210 (time t4). When the image processing is completed (time t5), the image data is transmitted from the PC 200 to the projector 300 (time t6). When the projector 300 receives the image data (time t7), the projector 300 executes image processing to complete the screen update (time t8 to time t9).

  Here, the period T2 and the period T4 are times required for data transmission. The internal processing time TN is a time required for processing inside the PC 200. Although the internal processing time TN is defined as t3 to t5 previously, the period of t5 to t6 is actually sufficiently shorter than the period of t4 to t5, and therefore the internal processing time TN is the period of t3 to t6 ( (From the moment when the PC 200 receives the operation information Dp to the moment when the image data is transmitted), it can be regarded as substantially the same. The period T5 is a time required for processing in the projector 300. The update time TR is a time required for processing executed by the PC 200 necessary to reflect the operation of the indicator 400 on the display content.

  As described above, although the overall processing flow is the same in (a) and (b), the projector 300-1 and the projector 300-2 perform image processing due to the difference in connection form itself or the difference in connection form. Since there is a difference in content, the length of time required to update the screen (TR in the figure) is different. Specifically, the update time TR depends on the content of processing in the PC 200, the content of processing in the projector 300, and the time related to data transmission. As a result, there is a difference in responsiveness between when the indicator 400 is operated on the screen SC1 and when it is operated on the screen SC2. If this difference exceeds a certain level, the user feels uncomfortable.

  As shown in FIG. 5, when one screen is realized by a plurality of projectors 300 having different screen update processing speeds, when the transmission timing adjustment according to the embodiment is applied, the difference is reduced. For the process with the shorter image generation time, the transmission timing of the image data is delayed. Specifically, the transmission time point of the image data in the PC 200 related to the shorter of the time required for the screen update of one projector 300 and the time required for the screen update of the other projector 300 is Δt = | TN1-TN2 | Be late.

  As a result, the time required for updating one screen becomes equal to the time required for updating the other screen (assuming that the PC 200 is estimated to be required when the screen SC2 is updated at that time). . Therefore, the difference in responsiveness existing between the operation on the screen SC1 and the operation on the screen SC2 is alleviated. In particular, when an operation for intermittently moving between the screen SC1 and the screen SC2 is performed, the effect realized by the user becomes more remarkable.

  Further, when the difference in data transmission time and the difference in internal processing in each projector 300 can be substantially ignored (in other words, the cause of the variation in responsiveness can be considered to be substantially only in the processing inside the PC 200), The difference in response between the operation for the screen SC1 and the operation for the screen SC2 is substantially zero.

2. Other Embodiments Regarding the determination of the delay amount, instead of the above-described method, a plurality of methods described below may be used alone or in combination.

  In calculating the delay amount Δt, a predetermined calculation may be performed instead of using the value of | TN1−TN2 | as it is. For example, when it is known in advance that there is a predetermined correlation between the internal processing time TN of a certain image and the transmission speed of that image, the difference between the internal processing times TN is multiplied by a predetermined coefficient. That is, instead of directly measuring the transmission rate, the difference in the update time TR is estimated based on the difference in the internal processing time TN, and the delay amount Δt is determined so that the difference in the update time TR is reduced.

  In determining the internal processing time TN, the processing time calculation unit 231 measures a plurality of times from the acquisition time of the operation information Dp to the transmission time of the image data, not the information about the screen update processing executed immediately before. The result may be used. For example, the time related to the update processing for a predetermined number of times in the past is stored, predetermined statistical processing (average value calculation processing, etc.) is performed on the stored time information, and the obtained value is used as the internal processing described above Adopted as time TN. Depending on the content of the image (content), the delay amount may not be constant, and in some cases, the calculated delay amount Δt may fluctuate greatly every time update processing is performed. Thus, it is possible to prevent the user from feeling uncomfortable due to a large change in response time.

  In calculating the delay amount Δt, the image attribute M1 may be considered in addition to the internal processing time TN. For example, in the case where images with different resolutions are displayed on the screen SC1 and the screen SC2, for data with a smaller size (resolution) of image data per screen, a delay amount corresponding to the difference in the data amount between the two is used. A process of adding to | TN1−TN2 | or multiplying the value of | TN1−TN2 | by a coefficient corresponding to the delay amount is performed.

Further, not only the internal processing time TN but also the delay amount Δt may be determined in consideration of the difference between the period T2 and the period T4 so that Δt = | TR1-TR2 | approaches zero. Specifically, a theoretical transmission time difference Δtx is calculated based on a transmission speed limit value defined by the data transmission standard adopted by the projector 300-1 and the projector 300-2, and Δtx is used. To correct the value of | TN1-TN2 |. In this way, estimation is performed based on the difference in data transmission speed in each transmission path, and the estimation result is reflected in the delay amount Δt.
Note that Δtx may be measured at any time using a test packet, and the latest Δtx may be reflected in Δt. Even if the PC 200 and the projector 300 are connected not using a dedicated cable but using a communication network such as a LAN having a relatively large change in the transmission speed by monitoring the change in the transmission speed and reflecting it in the delay amount. Therefore, the variation in responsiveness can be suppressed within a certain range.

  In calculating the internal processing time TN, instead of actually measuring the processing time, at least one of information relating to image data to be generated (such as resolution) and information relating to image processing (such as parameters such as compression ratio) is used. , May be estimated. For example, generally, the higher the compression rate, the longer the time required for the compression process. Therefore, the compression rate and the processing time are stored in association with the storage unit 240, and the processing time corresponding to the applied compression rate is stored. To correct the value of | TR1-TR2 |.

  Instead of delaying the processing with the shorter processing time in accordance with the longer processing time, the processing time with the longer processing time may be shortened. For example, when TN1 <TN2, the processing of the projector 300-1 is not delayed, and the TN2 is shortened by reducing the image resolution of the projector 300-2. Thereby, the responsiveness can be made uniform without degrading the overall responsiveness.

  The above-described delay processing and shortening processing may be combined. That is, a delay process is performed for a process with a shorter processing time, while a shortening is performed for a process with a longer processing time.

  Or you may employ | adopt methods other than the adjustment method which becomes (DELTA) t = 0. For example, a delay is applied to both the processing having the shorter processing time and the processing having the longer processing time. Specifically, when TN1 <TN2, TN1 + Δs1 and TN1 + Δs2 (Δs1> Δs2) are set. The reason for delaying the slow processing is that the possibility of further delay than the present time due to a change in the transmission path is taken into consideration. Even if the state of the transmission line related to the slower processing deteriorates, the common response is set in anticipation of further delay in the processing time, so the response will be sacrificed somewhat, but the response will be unified. This is preferable from the viewpoint of ensuring the feeling.

  The transmission timing adjustment processing according to the present invention relates to three or more projectors that are simultaneously connected to the PC 200 and are responsible for drawing the screen SCn (n = 1, 2, 3,...) Constituting one screen. You may apply to transmission processing.

  The application of the transmission timing adjustment processing according to the present invention is not limited to a projector, and does not depend on the display principle or display mechanism used. The present invention can be applied to any display device having a function for displaying an image and an input function for designating a position on the display area.

  In short, the image supply device of the present invention includes an acquisition unit that sequentially receives information representing the operation content of the indicator from the display device, an image processing unit that generates image data based on the received information, and the generated A transmission unit that transmits the image data to the display device, wherein the first image data and the second image data are transmitted to the first display device and the second display device, respectively. The time required for updating the screen of the first display device and the time required for updating the screen of the second display device are used as at least one of the transmission timing of the first image data and the transmission timing of the second image data. Adjust so that the difference between is small.

DESCRIPTION OF SYMBOLS 100 ... Image display system, 200 ... PC, 220 ... Communication part, 201 ... Reception part, 202 ... Transmission part, 210 ... Image processing part, 211 ... 1st image Processing unit 212 ... Second image processing unit 230 ... Timing adjustment unit 231 ... Processing time calculation unit 232 ... Delay processing unit 240 ... Storage unit 250 ... Display , 260 ... input unit, 300 ... projector, 310 ... communication unit, 311 ... transmission unit, 312 ... reception unit, 330 ... operation detection unit 330, 320 ... image Processing unit, 321 ... First processing unit, 322 ... Second processing unit, 340 ... Projection unit, 400 ... Indicator, 500 ... Display area

Claims (9)

An acquisition unit that sequentially acquires information representing the operation content of the indicator from the first display device or the second display device;
An image processing unit for generating image data based on the acquired information;
A transmission unit for transmitting the first image data generated by the image processing unit to the first display device, and transmitting the second image data generated by the image processing unit to the second display device; ,
At least one of the transmission timing of the first image data and the transmission timing of the second image data is used for the time required for the screen update of the first display device and the screen update of the second display device. And a control unit that adjusts so that a difference from the time required is reduced. The controller is
Calculating the difference based on the timing at which the information is acquired and the timing at which the generation of the image data is completed;
Of the first image data and the second image data, a transmission process of the image data according to the shorter one of the time required for the screen update of the first display device and the time required for the screen update of the second display device. The image supply device according to claim 1, wherein the image supply device is delayed. The image supply device according to claim 2, wherein the control unit calculates the difference based on a result obtained by measuring a period from the acquisition time of the information to a completion point of generation of the image data a plurality of times. . The image supply apparatus according to any one of claims 1 to 3, wherein the difference is calculated based on a resolution of an image represented by the image data. The difference is that a first transmission standard adopted between the image supply device and the first display device, and a second transmission standard adopted between the image supply device and the second display device. The image supply device according to claim 1, wherein the image supply device is calculated based on The image supply device according to any one of claims 1 to 5, wherein the difference is calculated based on a compression ratio applied to a data compression process executed in the generation of the image data. . Sequentially receiving and obtaining information representing the operation content of the indicator from the first display device or the second display device;
Generating image data based on the acquired information;
Transmitting the first image data generated by the image processing unit to the first display device, and transmitting the second image data generated by the image processing unit to the second display device;
At least one of the transmission timing of the first image data and the transmission timing of the second image data is displayed on the first display device and the time required for updating the video displayed on the second display device. Adjusting the difference so that the time required for updating the video to be updated is reduced. On the computer,
Sequentially receiving information representing the operation content of the indicator from the first display device or the second display device;
Generating image data based on the received information;
A transmission unit for transmitting the generated first image data to the first display device, and transmitting the generated second image data to the second display device;
Transmitting the generated image data to a display device;
At least one of the transmission timing of the first image data and the transmission timing of the second image data is displayed on the first display device and the time required for updating the video displayed on the second display device. For executing the adjustment step so that the difference from the time required for updating the image to be reduced is reduced. A first display device, a second display device, and an image supply device;
Each of the first display device and the second display device is
Means for generating information representing the operation content of the indicator;
Means for transmitting the generated information to the image supply device; means for receiving image data from the image supply device;
Means for displaying an image based on the received image data,
The image supply device includes:
An image processing unit that generates image data based on information representing the operation content of the indicator received from each display device;
A transmission unit for transmitting the generated first image data to the first display device, and transmitting the generated second image data to the second display device;
The transmission timing of the first image data and the transmission of the second image data when transmitting the first image data and the second image data to the first display device and the second display device, respectively. At least one of the timings so that a difference between a time required for updating the video displayed on the second display device and a time required for updating the video displayed on the first display device is reduced. And an adjustment control unit.