JP6606251B2 - SENDING COMPUTER, RECEIVING COMPUTER, METHOD EXECUTED BY THE SAME, AND COMPUTER PROGRAM - Google Patents

Description

  The present invention provides a technique for causing an image displayed on a display provided in a transmission computer as a first computer or connected to the transmission computer to be displayed on a display included in a reception computer as a second computer. About.

  For example, projectors are usually used for presentations at conferences. When giving a presentation, the presenter projects a desired image on a screen or the like from a projector connected to a notebook computer or the like. The audience attending the conference listens to the presenter's presentation while viewing the projected image.

By the way, in the meeting method as described above, the audience who is away from the projected image may not see the image well. Such a problem is likely to occur particularly when the image includes small characters.
In consideration of such a situation, in a meeting, a distribution material that is a printout of at least a part of an image to be projected to the audience may be distributed in advance. In such cases, the audience will hear and watch the presentation, occasionally dropping eyes on the handout. However, when such a presentation method is adopted, a paper called handout is required. Depending on the number of people in the audience, the effort and cost of creating such handouts, and the effort and cost of handing out handouts, are not stupid.

Therefore, the present inventor considered.
Notebook PCs have been popular for a long time, but the popularity of mobile terminals such as smartphones and tablets in recent years is tremendous. One person is no longer the norm.
If the same image as that displayed on the notebook computer used by the presenter who makes the presentation is displayed on such a portable terminal, the above-described problems may be solved at once. If the same image as that displayed on the notebook computer used by the presenter is displayed on the screen of the mobile terminal at hand of the audience, even if the audience is far from the image projected from the projector The problem of difficulty in seeing the generated image is hardly caused.
Further, if the same image as that displayed on the notebook computer used by the presenter is displayed on the screen of the portable terminal, it is not necessary to distribute paper distribution materials. In addition, if the audience can store the image data displayed on the display of the mobile terminal in the mobile terminal, the need to distribute the distribution material becomes even smaller.

  And if such a mechanism can be made, its use is not limited to “an alternative to the conventional projector” in the above-mentioned conference scene, but for example, to perform a play, watch a concert, or play sports It is possible to send desired information to visitors who are watching from one notebook computer or the like. This is like a “small scale, simplified version of a television broadcasting system”, and if such a mechanism is born, there is a possibility that a completely new demand can be generated.

The inventor of the present application can be used at least in the above-mentioned “replacement of the conventional projector”, and is displayed on a display provided in or connected to the transmitting computer as the first computer. Development of a system for providing a technique for displaying the received image on a display included in the receiving computer as the second computer was started.
However, challenges have arisen.
The above-mentioned system may have other specifications, but roughly speaking, the image data obtained by capturing the image displayed on the display of the transmitting computer is compressed into compressed data with a small data amount, The compressed data is transmitted to the receiving computer via the wireless LAN, and the image data obtained by decompressing the compressed data by the receiving computer is displayed on the display of the receiving computer.
However, if the image displayed on the display for obtaining the image data is simply captured by the transmitting computer, the image data does not include the pointer data displayed on the display of the transmitting computer. It will be. If this system is used for the presentation, it is essential to display a pointer for guiding the audience's line of sight on the display of the receiving computer. The presence or absence of this may affect the success of the presentation. is there.
This is not limited to the case where there are a large number of receiving computers with respect to the transmitting computer, and the same applies when there is a one-to-one transmission computer and receiving computer.

  The invention of the present application includes an image displayed on a display connected to the transmitting computer as the first computer or connected to the transmitting computer, including a pointer on the display included in the receiving computer as the second computer. It is an object of the present invention to provide a technique for enabling display.

The inventor of the present application proposes the following invention in order to solve the above-described problems.
The present invention is easy to understand if it is divided into the first to sixth inventions.

The first invention of the present application is used by connecting to a transmitting computer which is a computer having a display or connected to a display, and communicates with a receiving computer which is a computer having a display via a wireless LAN. It is a communication device that can be used.
And this communication apparatus is a screen image captured by dropping a frame from a display image which is an image displayed on a first display which is a display which the transmitting computer has or is connected to the transmitting computer. Acceptance for receiving image data, which is image data, and position data, which is data specifying the position of the pointer displayed on the first display, on the first display from the transmitting computer at a predetermined timing Means, compression means for compressing the image data into a predetermined format, and transmitting the compressed data and the position data to the receiving computer at predetermined time intervals using a wireless LAN function Transmission means, and the receiving computer that receives the compressed data, The compressed data is decompressed and used as the image data, and a composite image that is an image obtained by combining and displaying a pointer at the position specified by the position data of the display image is displayed on a second display that is a display included in the composite image. It is supposed to be possible.

Although the same applies to other inventions, the communication device of the first invention is used by being connected to the transmitting computer as described above. The transmitting computer is a computer that includes a display such as a notebook personal computer or is connected to the display such as a desktop personal computer. The sending computer corresponds to a personal computer operated by a presenter when a presentation is performed.
The communication device according to the first aspect of the present invention is generally provided with an image that is substantially the same as the display image that is provided on the first display that is included in the transmission-side computer or that is connected to the transmission-side computer. Data to be displayed on the second display, which is a display included in the receiving computer corresponding to the mobile terminal described in the technical section, is transmitted to the receiving computer.
Thereby, the communication system including the transmitting computer, the receiving computer, and the communication device of the present application can be applied to “an alternative to the conventional projector”. It will function as a “small, simplified version of a TV broadcast system”.
More specifically, the communication system includes a transmitting computer that is a computer having a display or connected to the display, and a receiving computer that is connected to the transmitting computer and is a computer having a display. A communication device capable of communicating with the receiving computer via a wireless LAN.
The communication device of this communication system captures a frame captured from a display image that is an image displayed on a first display that is a display that the transmitting computer has or is connected to the transmitting computer. Image data, which is image data for a screen, and position data, which is data for specifying the position of the pointer displayed on the first display on the first display, are transmitted from the transmitting computer at a predetermined timing. Receiving means, compressing means for compressing the image data into a predetermined format, and the compressed data and the position data at a predetermined time interval using a wireless LAN function Transmitting means for transmitting to the receiver side receiver that has received the compressed data. The computer is a display provided with a composite image, which is an image obtained by decompressing the compressed data into the image data and combining and displaying a pointer at a position specified by the position data of the display image. It is supposed to be able to be displayed on the display.
Data transmission from the communication device to the receiving computer is realized using a wireless LAN transmission function. Since the portable terminal that is often the receiving computer has the wireless LAN function first, it is not difficult for the receiving computer to receive the above data. As for a communication device, if a wireless LAN function is mounted on the communication device, the wireless LAN communication function includes a function for transmitting data in a one-to-one manner as well as a one-to-one manner. There is no difficulty in sending data to the receiving computer. The wireless LAN is, for example, Wi-Fi. The same applies to the following inventions, but the simultaneous communication function by wireless LAN is 253 at the same time by default if it is Wi-Fi (when 8-bit data is used for identification data). Alternatively, it is configured to be able to communicate wirelessly with 65533 computers (when 16-bit data is used for identification data), and the communication distance depends on the performance of the communication antenna. From 10 m to several hundred m is possible.
However, there is a limitation by using a wireless LAN without using a special communication method. That is, it is difficult to increase the communication speed in the communication between the communication device and the receiving computer as compared with the communication between the transmitting computer and the communication device, which may be wired communication.
The communication apparatus according to the present application captures data about a display image, which is an image displayed on a first display, which is a display included in or connected to the transmission computer, from the transmission computer. The image data is generated as image data, and the image data is compressed by the compression means, and the compressed data, which is the compressed image data, is sent to the receiving computer. The amount of data is smaller than the data before compression as well as the data before compression. As a result, a slow communication speed due to wireless LAN communication does not cause a significant problem.
The compression performed by the compression means may be any known image compression, for example, JPEG compression or MPEG compression.
By the way, as described above, even when the image displayed on the first display is captured, the pointer displayed on the first display is not included in the captured image. Therefore, in the present invention, position data specifying the position of the pointer on the first display at the moment when the image displayed on the first display is captured is acquired by the transmitting computer, and the acquired position data is transmitted via the communication device. Sent to the receiving computer. Upon receiving the compressed data, the receiving computer receives the position data, expands the compressed data into image data, and combines and displays a pointer at the position specified by the position data of the image based on the image data. A composite image can be generated. Since the composite image can be displayed on the second display, the image displayed on the second display of the first invention includes a pointer.
The communication between the communication device in the first invention and the receiving computer is performed using the wireless LAN as described above. This communication has a high affinity with a technology using UDP (User Datagram Protocol). Unlike TCP (Transmission Control Protocol), which is a well-known communication protocol alongside it, UDP is a protocol that allows one-to-many communication from a transmission device to a reception device, not just one-to-one. Further, UDP has a drawback that the reliability of communication is low, but the communication speed is high instead. This seems to be the case in the present invention in which the image data is transmitted from the communication device to the receiving computer even though the capacity has been reduced by compression, and in particular in many cases where the present invention is applied to presentations. This is the right case for when one-to-many communication is required. From such a point of view, it is preferable to use UDP for communication using the above-mentioned wireless LAN. This is because each communication using the wireless LAN used in the second to sixth inventions (in the case of the fifth and sixth inventions, not between the communication device and the receiving computer but the receiving computer and the receiving computer). This is the same for communication between side computers).

The inventor of the present application also proposes a method executed by the communication apparatus of the first invention as the same effect as the communication apparatus of the first invention of the present application.
The method is used by connecting to a transmitting computer that is a computer having a display or connected to the display, and can communicate with a receiving computer that is a computer having a display via a wireless LAN. This is a method executed by a communication device that can be used.
Then, the method is captured by dropping a frame from a display image, which is an image displayed on a first display that is executed by the communication device and that is included in the transmission-side computer or connected to the transmission-side computer. Image data, which is image data for one screen, and position data, which is data for specifying the position of the pointer displayed on the first display, on the first display are predetermined from the transmitting computer. A reception process that is received at a timing, a compression process in which the image data is compressed into a predetermined format, and the compressed data and the position data are received at predetermined time intervals using a wireless LAN function. Transmitting to the side computer, and receiving the compressed data The computer includes a composite image that is an image obtained by decompressing the compressed data into the image data and combining and displaying a pointer at a position specified by the position data of the image based on the image data. It can be displayed on the second display.

The inventor of the present application also proposes a computer program for causing a computer to function as the communication apparatus of the first invention as the same effect as the communication apparatus of the first invention of the present application.
The computer program is used by being connected to a transmitting computer that is a computer having a display or connected to a display, and performs communication via a wireless LAN with a receiving computer that is a computer having a display. This is a computer program for causing a computer configured to be able to function as a communication device.
Then, the computer program drops a frame from the display image, which is an image displayed on the first display, which is the display included in the transmitting computer or connected to the transmitting computer, to the computer included in the communication device. Image data that is image data for one screen captured in this manner, and position data that is data for specifying the position of the pointer displayed on the first display on the first display. A reception process that is received from a computer at a predetermined timing, a compression process that compresses the image data into a predetermined format, and the compressed data and the position data are processed for a predetermined time using a wireless LAN function. A transmission process to send to the receiving computer at intervals The receiving computer that has received the compressed data decompresses the compressed data into the image data, and synthesizes and displays a pointer at a position specified by the position data of the image based on the image data. A composite image that is an image can be displayed on a second display that is a display included in the composite image.

The second invention of the present application is used by connecting to a transmitting computer which is a computer having a display or connected to a display, and communicates with a receiving computer which is a computer having a display via a wireless LAN. It is a communication device that can be used.
In this communication apparatus, the transmitting computer is captured by dropping a frame from a display image that is an image displayed on a first display that is a display that the transmitting computer has or is connected to the transmitting computer. A compression unit that compresses image data, which is image data for one screen, to be compressed data, and a position that is data for specifying a position of the pointer displayed on the first display on the first display A position data generating means for generating data, the receiving means for receiving the compressed data and the position data from the transmitting computer at a predetermined timing, and the compressed data and the position data. Sending to the receiving computer at predetermined time intervals using the wireless LAN function And the receiving computer that has received the compressed data decompresses the compressed data into the image data, and points to a position specified by the position data of the image based on the image data It is supposed that a synthesized image that is an image obtained by synthesizing and displaying can be displayed on a second display that is a display included in the synthesized image.
The communication device according to the first aspect of the present invention receives image data and position data from a transmitting computer, and compresses the image data by itself to form compressed data. On the other hand, the communication apparatus of the second invention receives compressed data and position data, which are already compressed image data, from the transmitting computer. Since the communication device of the second invention can send the compressed data and the position data to the receiving computer, the receiving computer that communicates with the communication device of the second invention also displays the second display on the second display. The same image can be displayed. That is, the same effect as the case of the first invention can be obtained also by the communication device of the second invention.

The inventor of the present application also proposes a method executed by the communication apparatus of the second invention, as the same effect as the communication apparatus of the second invention of the present application.
The method is used by connecting to a transmitting computer that is a computer having a display or connected to the display, and can communicate with a receiving computer that is a computer having a display via a wireless LAN. This is a method executed by a communication device that can be used.
And the method is based on a display image, which is an image displayed on a first display, which is executed by the communication apparatus, and the transmission computer is a display that the transmission computer has or is connected to the transmission computer. Compression means for compressing image data, which is image data for one screen captured by dropping a frame, into compressed data, and a position of the pointer displayed on the first display on the first display A reception process for receiving the compressed data and the position data at a predetermined timing from the transmission-side computer when the apparatus has position data generating means for generating position data that is data to be specified; and the compressed data And the location data using a wireless LAN function at a predetermined time interval. Transmitting the data to the data, and the receiving computer receiving the compressed data decompresses the compressed data into the image data, and uses the position data of the image based on the image data. A composite image, which is an image obtained by combining and displaying pointers at specified positions, can be displayed on a second display which is a display included in the composite image.

The inventor of the present application also proposes a computer program for causing a computer to function as the communication apparatus of the second invention as the same effect as the communication apparatus of the second invention of the present application.
The computer program is used by being connected to a transmitting computer that is a computer having a display or connected to a display, and performs communication via a wireless LAN with a receiving computer that is a computer having a display. This is a computer program for causing a computer configured to be able to function as a communication device.
The computer program is an image displayed on the first display, which is the display included in or connected to the transmitting computer on the computer included in the communication device. Compression means for compressing image data, which is image data for one screen captured by dropping a frame from a display image, into compressed data, and a pointer displayed on the first display on the first display A reception process of receiving the compressed data and the position data at a predetermined timing from the transmission-side computer when having position data generation means for generating position data that is data for specifying the position of Using the function of wireless LAN, the compressed data and the position data And a transmission process of transmitting to the receiving computer at a predetermined time interval, and the receiving computer receiving the compressed data decompresses the compressed data into the image data. A composite image, which is an image obtained by combining and displaying a pointer at a position specified by the position data of the image based on the image data, can be displayed on a second display which is a display included in the composite image.

As another aspect of the second invention, the inventor of the present application also proposes the following communication system that can obtain the same effect as the first invention.
The communication system includes a transmitting computer that is a computer having a display or connected to the display; a receiving computer that is a computer having a display; and the receiving computer A communication system including a computer and a communication device capable of performing communication via a wireless LAN, the communication device being included in the transmitting computer, the transmitting computer, or the transmission Compression by compressing image data, which is image data for one screen captured by dropping a frame from a display image, which is an image displayed on a first display, which is a display connected to the side computer, into compressed data Means and displayed on the first display The position data generation means for generating position data, which is data for specifying the position of the pointer on the first display, the compressed data and the position data from the transmitting computer. Receiving means for receiving at a predetermined timing; and transmitting means for transmitting the compressed data and the position data to a receiving computer at a predetermined time interval by using a wireless LAN function, the compressed data The receiving-side computer that has received the compressed data is expanded into the image data, and a composite image that is an image obtained by combining and displaying a pointer at a position specified by the position data of the image based on the image data, It is a communication system that is supposed to be able to display on a second display, which is a display included in it. .

As another aspect of the first invention and the second invention, the inventor of the present application also proposes the following receiving computer that can obtain the same effect as the first invention.
The receiving computer is a receiving computer that communicates with the communication device of the first and second inventions, the second display, the second receiving means for receiving the compressed data, and the position data; Decompression means for decompressing the compressed data and returning it to image data; and a composite image that is an image obtained by combining and displaying a pointer on the display image based on the image data at a position specified by the position data of the image based on the image data And a display means for displaying on a second display which is a display included in the reception computer.
The display means of the receiving computer synthesizes and displays pointers on the display image based on the one image data at positions specified by a plurality of position data received until the next image data of the image data is received. The plurality of synthesized images may be displayed on the second display a plurality of times. The receiving computer receives the compressed data and the position data. Here, the compressed data is created based on the image data. Here, the image data is created by dropping a frame from a display image that is an image displayed on the first display. That is, the update speed of the image data is slower than the number of frames of the display image displayed on the first display. On the other hand, the position data can be generated from all the frames of the display image displayed on the first display. Since the position data about the coordinates is overwhelmingly smaller than the image data and the compressed data, it is more than the frame captured for generating the image data of the display image that is a moving image displayed on the first display. Even if it is generated from a large number of frames, for example, from all the frames of the display image and delivered to the receiving computer, it is performed using a wireless LAN between the communication device and the receiving computer. The burden on communication is not great. In such a case, the receiving computer will receive more position data from the communication device than the compressed data, in other words, more frequently. At that time, the receiving computer receives position data at the same time as or after receiving certain compressed data as described above, and then receives at least one position data and then receives the next compressed data. The receiving computer can use all of the received position data and some of the position data received before receiving the next compressed data for drawing the pointer. In other words, a composite image is created by combining a pointer with one image data until the next image data is drawn using the one image based on the image data obtained by decompressing the compressed data as the background. Is displayed on the second display, and a composite image is created by combining the same image data with the positioner specified by the next position data, and displayed on the second display. It is possible to repeat the process of creating a synthesized image obtained by synthesizing the positioner specified and displaying it on the second display until the next image data is drawn. By doing this, the update speed (number of frames) of drawing the image based on the image data on the second display is made different from the update speed (number of frames) of the pointer, more precisely the latter is made faster. Is possible. Since most of the images provided by the presentation software are still images, there is no problem even if the image drawing update speed is reduced on the second display, but the pointer often moves violently. If the update speed is slow, the pointer will be jerky and unsightly, but if the pointer update speed is increased, such a problem will not occur.

The present inventor also proposes a method executed by the receiving computer of the first invention and the second invention, as the same effect as the receiving computer of the first invention and the second invention of the present application.
The method is a method executed by a receiving computer having a second display that communicates with the communication device of the first invention or the second invention, and the compressed data executed by the receiving computer; A second reception process for receiving position data; a decompression process for decompressing the compressed data to return it to image data; and a position specified by the position data of the image based on the image data in the display image based on the image data A display step of displaying a composite image, which is an image obtained by combining and displaying a pointer, on a second display which is a display included in the composite image.

The inventor of the present application also has a computer program for causing a computer to function as the receiving computer of the first and second inventions, as the same effect as that of the receiving computer of the first and second inventions of the present application. suggest.
The computer program includes a second receiving process of receiving the compressed data and the position data in a computer included in a receiving computer having a second display that communicates with the communication device of the first invention or the second invention. A decompression process in which the compressed data is decompressed and returned to image data, and a composite image obtained by combining and displaying a pointer on the display image based on the image data at a position specified by the position data of the image based on the image data It is a computer program for performing the display process which displays an image on the 2nd display which is a display with which it is provided.

As another aspect of the second invention, the inventor of the present application also proposes the following transmission-side computer that can obtain the same effect as the first invention.
The transmitting computer is a transmitting computer that communicates with the communication device of the second invention, and is an image for one screen captured by dropping a frame from a display image that is an image displayed on the first display. Compression means for compressing image data as compressed data into compressed data, and position data for generating position data as data for specifying the position of the pointer displayed on the first display on the first display A transmission-side computer, comprising: generation means; means for transmitting the compressed data and the position data to the communication device.

The inventor of the present application also proposes a method executed by the transmitting computer of the second invention as the same effect as that of the transmitting computer of the second invention of the present application.
The method is a method executed by a transmitting computer that communicates with the communication device according to the second aspect of the present invention, and is executed by the transmitting computer, and is a frame from a display image that is an image displayed on the first display. The process of compressing the image data, which is the image data of one screen captured by dropping the image data, into compressed data, and specifying the position of the pointer displayed on the first display on the first display The method includes a step of generating position data that is data, and a step of transmitting the compressed data and the position data to the communication device.

The inventors of the present application also propose a computer program for causing a computer to function as the transmitting computer of the second invention, as the same operation and effect as the transmitting computer of the second invention of the present application.
The computer program is a computer program for causing a computer to function as a transmitting computer that communicates with the communication device of the second invention, and is displayed on the first display on the computer of the transmitting computer. A process of compressing image data, which is image data for one screen captured by dropping a frame from a display image, which is an image, to form compressed data, and the first display of a pointer displayed on the first display A computer program configured to execute a process of generating position data, which is data for specifying a position above, and a process of transmitting the compressed data and the position data to the communication device. .

The third invention of the present application is used by connecting to a transmitting computer which is a computer having a display or connected to a display, and communicates with a receiving computer which is a computer having a display via a wireless LAN. It is a communication device that can be used.
And this communication apparatus is a screen image captured by dropping a frame from a display image which is an image displayed on a first display which is a display which the transmitting computer has or is connected to the transmitting computer. Acceptance for receiving image data, which is image data, and position data, which is data specifying the position of the pointer displayed on the first display, on the first display from the transmitting computer at a predetermined timing Means, compression means for compressing a composite image, which is an image obtained by combining and displaying a pointer at a position specified by the position data of an image corresponding to the image data, into a predetermined format, and the compressed data, Transmission means for transmitting to a receiving computer at a predetermined time interval using a wireless LAN function And the receiving computer that has received the compressed data decompresses the compressed data and combines the pointers at positions specified by the position data of the image based on the image data. It is assumed that an image is displayed and that the image can be displayed on a second display which is a display included in the image.
This communication apparatus also receives image data and pointer position data from the transmitting computer. However, the communication device according to the first aspect of the invention sends the compressed data obtained by compressing the image data and the position data to the receiving computer, and combines the image and the pointer based on the image data obtained by decompressing the compressed data to the receiving computer. I was supposed to make a composite image. Instead, the communication device of the third invention creates a composite image by itself and compresses it before sending it to the receiving computer. The receiving computer can obtain the composite image data simply by decompressing the compressed data, so that the composite image can be displayed on the second display. That is, the same effect as the first invention can be obtained by the third invention.

The inventor of the present application also proposes a method executed by the communication apparatus of the third invention, as the same effect as the communication apparatus of the third invention of the present application.
The method is used by connecting to a transmitting computer that is a computer having a display or connected to the display, and can communicate with a receiving computer that is a computer having a display via a wireless LAN. This is a method executed by a communication device that can be used.
The method is captured by dropping a frame from a display image, which is an image displayed on a first display, which is executed by the communication apparatus, which is included in the transmitting computer or connected to the transmitting computer. Image data as image data for one screen, and pointer data displayed on the first display, position data as data for specifying a position on the first display, are transmitted from the transmitting computer to the predetermined data. An accepting process for receiving at a timing; a compressing process for compressing a composite image, which is an image obtained by combining and displaying a pointer at a position specified by the position data of an image corresponding to the image data, into a predetermined format; and Compressed data is sent to the receiving computer at predetermined time intervals using the wireless LAN function. And receiving the compressed data, the receiving computer decompresses the compressed data and combines and displays a pointer at a position specified by the position data of the image based on the image data. The synthesized image, which is the processed image, is displayed on the second display, which is the display included in the synthesized image.

The inventor of the present application also proposes a computer program for causing a computer to function as the communication apparatus of the third invention, as the same effect as the communication apparatus of the third invention of the present application.
The computer program is used by being connected to a transmitting computer that is a computer having a display or connected to a display, and performs communication via a wireless LAN with a receiving computer that is a computer having a display. This is a computer program for causing a computer configured to be able to function as a communication device.
Then, the computer program drops a frame from the display image, which is an image displayed on the first display, which is the display included in the transmitting computer or connected to the transmitting computer, to the computer included in the communication device. Image data that is image data for one screen captured in this manner, and position data that is data for specifying the position of the pointer displayed on the first display on the first display. A reception process received from a computer at a predetermined timing, and a compressed image obtained by compressing a composite image, which is an image obtained by combining and displaying a pointer at a position specified by the position data of an image corresponding to the image data, into a predetermined format The process and the compressed data are processed by using a wireless LAN function. Transmitting to the receiving computer at a time interval of, and the receiving computer that has received the compressed data decompresses the compressed data and the image of the image data A composite image, which is an image obtained by combining and displaying a pointer at a position specified by the position data, is displayed, and the image can be displayed on a second display that is a display included in the composite image.

As another aspect of the third invention, the inventor of the present application also proposes the following communication system capable of obtaining the same effect as the first invention.
The communication system includes a transmission side computer that is a computer having a display or connected to the display, a reception side computer that is a computer having a display, and the reception side. A communication system including a computer and a communication device capable of performing communication via a wireless LAN, wherein the communication device is included in the transmitting computer or connected to the transmitting computer Image data that is image data of one screen captured by dropping a frame from a display image that is an image displayed on the first display that is the display, and the first of the pointers that are displayed on the first display Data specifying the position on one display A receiving unit that receives certain position data from the transmitting computer at a predetermined timing; and a combined image that is an image obtained by combining and displaying a pointer at a position specified by the position data of the image corresponding to the image data. Compression means for compressing the compressed data into a format, and transmission means for sending the compressed data to a receiving computer at a predetermined time interval using a wireless LAN function, and receiving the compressed data Further, the receiving computer decompresses the compressed data to obtain a composite image that is an image obtained by combining and displaying a pointer at a position specified by the position data of the image based on the image data, and the image is displayed on the display. It is a communication system that enables display on a second display.

As another aspect of the first invention and the third invention, the inventor of the present application also proposes the following transmission-side computer capable of obtaining the same effect as the first invention.
The transmitting computer is a transmitting computer that communicates with the communication device of the first and third inventions, and has a first display or is connected to the first display and is displayed on the first display. The position of the pointer displayed on the first display and the position of the pointer displayed on the first display is specified. It is a transmission side computer provided with the means to transmit the positional data which is data to the said communication apparatus.

The present inventor also proposes a method to be executed by the transmitting computer of the first and third inventions as the same effect as the transmitting computer of the first and third inventions of the present application.
The method is a method executed by a transmitting computer that communicates with the communication device of the first invention or the third invention, and is an image displayed on the first display executed by the transmitting computer. Image data that is image data for one screen captured by dropping a frame from the display image, and position data that is data for specifying the position of the pointer displayed on the first display on the first display Transmitting to the communication device.

The inventor of the present application also has a computer program for causing a computer to function as the transmitting computer of the first and third inventions as the same effect as the transmitting computer of the first and third inventions of the present application. suggest.
The computer program is a computer program for causing a computer to function as a transmission-side computer that communicates with the communication device according to the first or third aspect of the invention. Image data that is image data of one screen captured by dropping a frame from a display image that is a displayed image, and the position of the pointer displayed on the first display on the first display A computer program configured to execute a process of transmitting position data, which is data to be specified, to the communication device.

The fourth invention is used by connecting to a transmitting computer which is a computer having a display or connected to the display, and performs communication via a wireless LAN with a receiving computer which is a computer having a display. It is a communication device that can be
In this communication apparatus, the transmitting computer is captured by dropping a frame from a display image that is an image displayed on a first display that is a display that the transmitting computer has or is connected to the transmitting computer. An image obtained by combining and displaying pointers displayed on the first display when an image corresponding to the image data is displayed on the first display on image data that is image data for one screen. In the case of having compression means for converting the composite image into compressed data in a predetermined format, the reception means for receiving the compressed data from the transmitting computer at a predetermined timing, and the compressed data as a wireless LAN Transmission means for transmitting to the receiving computer at predetermined time intervals using the function. And the receiving computer that has received the compressed data expands the compressed data into a composite image that is an image obtained by combining and displaying a pointer at a position specified by the position data of the image based on the image data, It is supposed that an image can be displayed on a second display which is a display included in the image.
In the first invention, the receiving computer used in combination with the communication device composes an image based on image data and a pointer to create a composite image. On the other hand, in the second invention, the communication apparatus composes an image based on image data and a pointer to create a composite image. In the fourth aspect of the invention, the image by the image data and the pointer are synthesized by the transmitting computer to create a synthesized image. In the fourth invention, the compressed data of the composite image is transferred from the transmitting computer to the communication device, and from the communication device to the receiving computer. If this compressed data is decompressed, the receiving computer can obtain composite image data, so that the receiving computer that communicates with the communication device of the fourth invention also displays the same image on the second display as in the first invention. become able to. That is, the same effect as that of the first invention can be obtained by the communication device of the fourth invention.

The inventor of the present application also proposes a method executed by the communication apparatus according to the fourth aspect of the invention, which produces the same effect as the communication apparatus according to the fourth aspect of the present invention.
The method is used by connecting to a transmitting computer that is a computer having a display or connected to the display, and can communicate with a receiving computer that is a computer having a display via a wireless LAN. This is a method executed by a communication device that can be used.
And the method is based on a display image, which is an image displayed on a first display, which is executed by the communication apparatus, and the transmission computer is a display that the transmission computer has or is connected to the transmission computer. A pointer displayed on the first display when an image corresponding to the image data is displayed on the first display is added to the image data that is image data of one screen captured by dropping a frame. A receiving process for receiving the compressed data from the transmitting computer at a predetermined timing when the compressed data is provided as compressed data obtained by compressing the combined image, which is a combined display image, into a predetermined format; and the compression Data is transmitted to the receiving computer at predetermined time intervals using the wireless LAN function. An image obtained by decompressing the compressed data and combining and displaying a pointer at a position specified by the position data of the image based on the image data. And the image can be displayed on a second display which is a display included in the composite image.

The inventor of the present application also proposes a computer program for causing a computer to function as the communication apparatus according to the fourth aspect of the invention, which produces the same effect as the communication apparatus of the fourth aspect of the present invention.
The computer program is used by being connected to a transmitting computer that is a computer having a display or connected to a display, and performs communication via a wireless LAN with a receiving computer that is a computer having a display. This is a computer program for causing a computer configured to be able to function as a communication device.
The computer program is an image displayed on the first display, which is the display included in or connected to the transmitting computer on the computer included in the communication device. The image corresponding to the image data is displayed on the first display when the image corresponding to the image data is displayed on the first display in the image data captured by dropping a frame from the display image. A receiving process for receiving the compressed data from the transmitting computer at a predetermined timing in the case where there is compression means for converting the combined image, which is an image obtained by combining and displaying the pointer, into compressed data obtained by compressing the composite image into a predetermined format; The compressed data is stored for a predetermined time using a wireless LAN function. Transmitting to the receiving computer at intervals, the receiving computer receiving the compressed data decompresses the compressed data, and the position data of the image based on the image data A composite image, which is an image obtained by combining and displaying pointers at the position specified in (1) above, is displayed so that the image can be displayed on a second display which is a display included in the composite image.

As another aspect of the fourth invention, the inventor of the present application also proposes the following communication system capable of obtaining the same effect as the first invention.
The communication system includes a transmission side computer that is a computer having a display or connected to the display, a reception side computer that is a computer having a display, and the reception side. A communication device capable of communicating with a computer via a wireless LAN, the communication device having the transmitting computer, the transmitting computer having or The image data corresponding to the image data corresponds to the image data that is the image data of one screen captured by dropping the frame from the display image that is the image displayed on the first display that is the display connected to the transmitting computer. The image is displayed on the first display In some cases, the apparatus has compression means for converting the synthesized image, which is an image obtained by synthesizing and displaying the pointer displayed on the first display, into compressed data obtained by compressing the synthesized image into a predetermined format. Receiving means from a computer at a predetermined timing; and transmitting means for transmitting the compressed data to a receiving computer at a predetermined time interval using a wireless LAN function, and receiving the compressed data The receiving computer decompresses the compressed data to form a composite image that is an image obtained by combining and displaying a pointer at a position specified by the position data of the image based on the image data, and the display includes the image. The communication system is configured to be able to display on a second display.

As another aspect of the third and fourth inventions, the inventor of the present application also proposes the following receiving computer that can obtain the same effect as the first invention.
The receiving computer is a receiving computer that communicates with the communication device of the third and fourth inventions, the second display, the second receiving means for receiving the compressed data, and the compressed data by expanding the compressed data. The decompression means for returning the display image to the composite image data in which the pointer is synthesized and displayed at the position specified by the position data of the image based on the image data; and the display image based on the position data of the image based on the image data. And a display unit configured to display a composite image, which is an image obtained by combining and displaying a pointer at a specified position, on a second display that is a display included in the composite image.

The present inventor also proposes a method executed by the receiving computer of the third invention and the fourth invention as the same effect as the receiving computer of the third invention and the fourth invention of the present application.
The method is a method executed by a receiving computer having a second display that communicates with the communication device of the third invention or the fourth invention, wherein the compressed data is received by the receiving computer. 2 receiving process, decompressing the compressed data, and decompressing the display image to return to the composite image data that is an image obtained by combining and displaying the pointer at the position specified by the position data of the image based on the image data; A display step of displaying a composite image, which is an image obtained by combining and displaying a pointer at a position specified by the position data of the image based on the image data, on a second display that is a display provided on the display image. Is the way.

The inventor of the present application also has a computer program for causing a computer to function as the receiving computer of the third and fourth inventions as the same effect as the receiving computer of the third and fourth inventions of the present application. suggest.
The computer program communicates with the communication device according to the third or fourth invention, a second reception process for accepting the compressed data to a computer included in a receiving computer having a second display, and decompressing the compressed data Then, an expansion process for returning the display image to composite image data, which is an image obtained by combining and displaying a pointer at the position specified by the position data of the image based on the image data, and an image based on the image data And a display process of displaying a composite image, which is an image obtained by combining and displaying a pointer at a position specified by the position data, on a second display which is a display included in the composite image.

As another aspect of the fourth invention, the inventor of the present application also proposes the following transmission-side computer that can obtain the same effect as the first invention.
The transmitting computer is a transmitting computer that communicates with the communication device according to the fourth aspect of the present invention, and is an image for one screen captured by dropping a frame from a display image that is an image displayed on the first display. A composite image, which is an image obtained by combining and displaying the pointer displayed on the first display when the image corresponding to the image data is displayed on the first display, is added to the image data that is the data of a predetermined format. A transmission-side computer comprising: compression means for converting the compressed data into compressed data; and means for transmitting the compressed data to the communication device.

The inventor of the present application also proposes a method executed by the transmitting computer of the fourth invention, as the same effect as that of the transmitting computer of the fourth invention of the present application.
The method is a method executed by a transmitting computer that communicates with the communication device according to the fourth aspect of the present invention, and is executed by the transmitting computer, and is a frame from a display image that is an image displayed on the first display. The pointer displayed on the first display when the image corresponding to the image data is displayed on the first display is combined with the image data which is the image data of one screen captured by dropping The method includes a step of converting the composite image, which is a displayed image, into compressed data compressed into a predetermined format, and a step of transmitting the compressed data to the communication device.

The inventors of the present application also propose a computer program for causing a computer to function as the transmitting computer of the fourth invention, as the same operation and effect as the transmitting computer of the fourth invention of the present application.
The computer program is a computer program for causing a computer to function as a transmitting computer that communicates with the communication device of the fourth invention, and is displayed on the first display on the computer of the transmitting computer. When the image corresponding to the image data is displayed on the first display in the image data that is the image data for one screen captured by dropping the frame from the display image that is an image, the image is displayed on the first display. A process of converting a composite image, which is an image obtained by combining and displaying the displayed pointer, into compressed data, and a process of transmitting the compressed data to the communication device are executed. It is a computer program.

In the first to fourth aspects of the invention, in the receiving computer, the communication device receives the compressed data, and the receiving computer decompresses the compressed data into the image data. Designation information for designating software for enabling a synthesized image, which is an image obtained by synthesizing and displaying a pointer at a position specified by the position data, to be displayed on a second display that is a display included in the synthesized image can be changed. In this case, the receiving computer may include an input means for inputting at least a part of the designation information.
Generally, various protocols are implemented in a computer that performs communication. In some protocols, a computer that transmits data can specify which software installed in the computer that receives the data should process the transmitted data. When the communication device of the present application can make such a designation, it is possible to designate which software installed on the receiving computer is to process the compressed data by designation information for designating the software. it can. In particular, when the communication device can change the designation information, and the receiving computer has an input means for inputting at least a part of the designation information, the designation information can be changed by the communication device. In addition, by correctly inputting at least a part of the specified information on the receiving computer, the correct software for processing the compressed data sent from the communication device to the receiving computer and processing the received compressed data installed on the receiving computer. You can let the wearer process as planned. In other words, if at least a part of the designation information is not correctly input on the receiving computer, the receiving computer does not display a display image based on the compressed data on the second display. That is, assuming that there are a plurality of computers that can be receiving computers in the communication range from the communication device, those that should function as receiving computers (those that should display a display image on the second display), and There may be a mixture of things that should not function as a receiving computer (those that should not display a display image on the second display). In such a case, only the user who has the computer that should function as the receiving computer is notified of correct information about at least a part of the specified information verbally, and at least a part of the specified information is received by the receiving computer. As a result, only the computer that should function as the receiving computer can be made to function as the receiving computer. Roughly speaking, this means that only the other party who wants to see the same image displayed on the first display can be shown. The designation information in this case is, for example, UDP (User Datagram Protocol).

The following contents are applicable to the first invention and the second invention.
The transmission unit of the communication apparatus may be configured to transmit the compressed data and the position data to a plurality of the receiving computers at the same time. By doing so, when the communication system including the communication device of the present application is applied to “an alternative to the conventional projector”, it is possible to cope with a plurality of audiences. Application to the “version television broadcasting system” becomes possible.
The following contents are applicable to all of the first to fourth inventions.
The transmission unit of the communication apparatus may transmit the compressed data simultaneously to a plurality of the receiving computers. This is useful for causing a communication system including the communication device of the present application to function as a “small scale, simplified version of a television broadcast system”.
Transmission of data such as image data from the transmitting computer to the communication device may be performed in any manner. For example, this transmission may be performed by wire or wireless, but may be suitable for transmission in the sense that there is no speed limit. An example of wired transmission is data transmission using a USB terminal. For example, the accepting unit of the communication device may be a USB terminal and connected to a USB terminal included in the transmitting computer. The sending computer is often a laptop computer or a desktop computer, and may be a portable terminal. However, in any case, these are often equipped with a USB terminal. There is a high possibility that there will be no inconvenience in adopting.
However, data about the image (image data or compressed data) is intermittently sent from the sending computer to the receiving computer. These data may be sent at predetermined intervals regardless of whether they are constant, for example, data of several frames to several tens of frames per second. It does not matter whether the predetermined interval is a fixed interval.
The communication device may include a projector device that projects the display image. For example, it is possible to perform a presentation while projecting a display image with a projector device by using this communication device.

According to a fifth aspect of the present invention, a transmitting side, which is a computer having a display or connected to a display, capable of communicating with a receiving side computer, which is a computer having a display, via a wireless LAN. It is a computer.
Then, the transmission side computer captures one screen captured by dropping a frame from a display image which is an image displayed on a first display which is a display included in the transmission side computer or connected to the transmission side computer. Compression means for compressing image data, which is image data of the image, into compressed data, and position data which is data for specifying the position of the pointer displayed on the first display on the first display Position data generation means for generating the compressed data, and transmission means for transmitting the compressed data and the position data to a receiving computer at a predetermined time interval using a wireless LAN function. When the receiving computer decompresses the compressed data into the image data, In addition, a synthesized image, which is an image obtained by synthesizing and displaying a pointer at a position specified by the position data of the image based on the image data, can be displayed on a second display which is a display included in the synthesized image. .
This transmitting computer uses the wireless LAN function itself without using a communication device, and sends compressed data obtained by compressing image data and position data to the receiving computer. From the viewpoint of the receiving computer, it receives the same as the first invention and the second invention. Therefore, the receiving computer can cause the second display to display the same image as that displayed on the second display of the receiving computer used in combination with the first invention and the second invention. That is, the same effect as that of the first invention can be obtained by the communication device of the fifth invention.

The inventor of the present application also proposes a method executed by the transmitting computer of the fifth invention, as the same effect as the transmitting computer of the fifth invention of the present application.
The method is performed by a receiving computer, which is a computer having a display or connected to a display, capable of communicating with a receiving computer which is a computer having a display via a wireless LAN. This is the method that is performed.
The method captures a frame from a display image that is an image displayed on a first display that is executed by the transmitting computer, or that is included in the transmitting computer or connected to the transmitting computer. A compression process in which image data, which is the image data for one screen, is compressed into a predetermined format, and a position of the pointer displayed on the first display on the first display is specified. A position data generation process for generating position data as data, and a transmission process for transmitting the compressed data and the position data to a receiving computer at a predetermined time interval using a wireless LAN function. The receiving computer receiving the compressed data decompresses the compressed data and With the image data, the composite image is an image obtained by synthesizing and displaying the pointer on the position specified by the position data of the image by the image data, so that it can be displayed on the second display is a display with.

The inventor of the present application also proposes a computer program for causing a computer to function as the transmission-side computer of the fifth invention as having the same operational effects as the communication apparatus of the fifth invention of the present application.
The computer program uses a computer having a display or connected to the display, which can communicate with a receiving computer, which is a computer having a display, via a wireless LAN, as a transmitting computer. It is a computer program for making it function.
Then, the computer program adds a frame from a display image, which is an image displayed on a first display, which is a display included in the transmission-side computer or connected to the transmission-side computer, to the computer included in the transmission-side computer. A compression process in which image data, which is image data for one screen captured by dropping, is compressed into a predetermined format, and a position of the pointer displayed on the first display on the first display A position data generation process for generating position data, which is data for specifying the data, and a transmission process for transmitting the compressed data and the position data to a receiving computer at predetermined time intervals using a wireless LAN function; And receiving the compressed data. A display on which a side computer decompresses the compressed data to form the image data, and a composite image that is an image obtained by combining and displaying a pointer at a position specified by the position data of the image based on the image data. It can be displayed on a certain second display.

As another aspect of the fifth invention, the inventor of the present application also proposes the following receiving computer that can obtain the same effect as the first invention.
The receiving computer is a receiving computer that communicates with the transmitting computer according to the fifth aspect of the invention, wherein the receiving computer receives a second display, the compressed data, the second receiving means for receiving the position data, and the compressed data. Decompression means for decompressing and returning to image data; and a composite image that is an image obtained by combining and displaying a pointer on the display image based on the image data at a position specified by the position data of the image based on the image data. Display means for displaying on a second display which is a display provided.
The display means of the receiving computer synthesizes and displays pointers on the display image based on the one image data at positions specified by a plurality of position data received until the next image data of the image data is received. The plurality of synthesized images may be displayed on the second display a plurality of times. As a result, the same operation and effect as in the case where the receiving side computers of the first invention and the second invention are used can be obtained.

The inventor of the present application also proposes a method executed by the receiving computer of the fifth invention, as the same effect as the receiving computer of the fifth invention of the present application.
The method is a method executed by a receiving computer having a second display that communicates with a transmitting computer according to a fifth aspect of the invention, wherein the compressed data, the position data, and the like executed by the receiving computer A pointer to a position specified by the position data of the image based on the image data on the display image based on the image data. A display step of displaying a composite image, which is a composite-displayed image, on a second display, which is a display included in the composite image.

The inventors of the present application also propose a computer program for causing a computer to function as the receiving computer of the fifth invention as having the same operational effects as the receiving computer of the fifth invention of the present application.
The computer program communicates with the transmitting computer according to the fifth aspect of the invention, and includes a second receiving process for receiving the compressed data and the position data in a computer included in the receiving computer having the second display, and the compression A decompression process for decompressing data to return to image data, and a composite image that is an image obtained by combining and displaying a pointer on the display image based on the image data at a position specified by the position data of the image based on the image data, A computer program for executing a display process of displaying on a second display which is a display included in the display.

As another aspect of the fifth invention, the inventor of the present application also proposes the following communication system capable of obtaining the same effect as the first invention.
The communication system includes a receiving computer, which is a computer having a display, and a computer having a display or connected to the display, capable of communicating with the receiving computer via a wireless LAN. A communication system including a transmission side computer.
Then, the transmission side computer captures one screen captured by dropping a frame from a display image which is an image displayed on a first display which is a display included in the transmission side computer or connected to the transmission side computer. Compression means for compressing image data, which is image data of the image, into compressed data, and position data which is data for specifying the position of the pointer displayed on the first display on the first display Position data generation means for generating the compressed data, and transmission means for transmitting the compressed data and the position data to a receiving computer at a predetermined time interval using a wireless LAN function. When the receiving computer decompresses the compressed data into the image data, In addition, a synthesized image, which is an image obtained by synthesizing and displaying a pointer at a position specified by the position data of the image based on the image data, can be displayed on a second display which is a display included in the synthesized image. .

The sixth invention of the present application is a transmitting side which is a computer having a display or connected to a display, capable of communicating via a wireless LAN with a receiving side computer which is a computer having a display. It is a computer.
Then, the transmission side computer captures one screen captured by dropping a frame from a display image which is an image displayed on a first display which is a display included in the transmission side computer or connected to the transmission side computer. A composite image that is an image obtained by combining and displaying the pointer displayed on the first display when the image corresponding to the image data is displayed on the first display Compressing means for compressing the compressed data into a format of the above, and transmitting means for transmitting the compressed data to a receiving computer at a predetermined time interval using a wireless LAN function. The receiving computer that has received the data decompresses the compressed data, and A composite image is a pointer composite display image at a position specified by the serial position data, and the image is assumed to be able to display on the second display is a display with it.
The transmitting computer uses the wireless LAN function by itself without using a communication device, and sends compressed data obtained by compressing the composite image data to the receiving computer. From the point of view of the receiving computer, it receives the same thing as the third and fourth inventions. Therefore, the receiving computer can display the same image on the second display as that displayed on the second display of the receiving computer used in combination with the third and fourth inventions. That is, the same effect as that of the first invention can be obtained by the communication device of the sixth invention.

The inventor of the present application also proposes a method executed by the transmitting computer of the sixth invention, as the same effect as the transmitting computer of the sixth invention of the present application.
The method is performed by a receiving computer, which is a computer having a display or connected to a display, capable of communicating with a receiving computer which is a computer having a display via a wireless LAN. This is the method that is performed.
Then, the method captures a frame from a display image that is an image displayed on a first display that is executed by the transmitting computer, that is included in the transmitting computer, or that is connected to the transmitting computer. An image obtained by synthesizing and displaying the pointer displayed on the first display when the image corresponding to the image data is displayed on the first display on the image data that is the image data for one screen. A compression process in which a composite image is compressed into a predetermined format, and a transmission process in which the compressed data is transmitted to a receiving computer at a predetermined time interval using a wireless LAN function. The receiving computer that has received the compressed data decompresses the compressed data to generate the image. Over data pointer to a position specified by the position data of the image and the composite image is synthesized and displayed image by, to be able to display the image on the second display is a display with it.

The inventor of the present application also proposes a computer program for causing a computer to function as the transmission-side computer of the sixth aspect of the invention as the same effect as the communication device of the sixth aspect of the present invention.
The computer program uses a computer having a display or connected to the display, which can communicate with a receiving computer, which is a computer having a display, via a wireless LAN, as a transmitting computer. It is a computer program for making it function.
Then, the computer program adds a frame from a display image, which is an image displayed on a first display, which is a display included in the transmission-side computer or connected to the transmission-side computer, to a computer included in the transmission-side computer. The pointer displayed on the first display when the image corresponding to the image data is displayed on the first display is combined with the image data that is the image data of one screen captured as a drop. A compression process in which a composite image that is a compressed image is compressed into a predetermined format, and a transmission process in which the compressed data is transmitted to a receiving computer at predetermined time intervals using a wireless LAN function. The receiving side controller that has received the compressed data. A computer expands the compressed data into a composite image that is an image obtained by combining and displaying a pointer at a position specified by the position data of the image based on the image data, and the image is a display provided in the second display. It can be displayed on.

As another aspect of the sixth invention, the inventor of the present application also proposes the following receiving computer that can obtain the same effect as the first invention.
The receiving computer is a receiving computer that communicates with the transmitting computer according to the sixth aspect of the invention, and is a second display, second receiving means for receiving the compressed data, and decompressed the compressed data to display the display image. And a decompression means for returning to a composite image data in which a pointer is synthesized and displayed at a position specified by the position data of the image based on the image data, and the display data specified by the position data of the image based on the image data. And a display unit configured to display a composite image, which is an image obtained by combining and displaying a pointer at a position, on a second display that is a display included in the composite image.

The inventor of the present application also proposes a method that is executed by the receiving computer of the sixth invention, as the same effect as that of the receiving computer of the sixth invention of the present application.
The method is a method executed by a receiving computer having a second display that communicates with a transmitting computer according to a sixth aspect of the invention, wherein the receiving computer executes a second receiving process for receiving the compressed data. And decompressing the compressed data to return the display image to composite image data, which is an image obtained by combining and displaying a pointer at the position specified by the position data of the image based on the image data, and the display image And a display step of displaying a composite image, which is an image obtained by combining and displaying a pointer at a position specified by the position data of the image based on the image data, on a second display which is a display included in the composite image. is there.

The present inventor also proposes a computer program for causing a computer to function as the receiving computer of the sixth invention as the same effect as the receiving computer of the sixth invention of the present application.
The computer program includes: a second reception process for receiving the compressed data in a computer included in the receiving computer having a second display that communicates with the transmitting computer according to the sixth aspect of the invention; A decompression process for returning to a composite image, which is an image obtained by combining and displaying a pointer at a position specified by the position data of the image based on the image data, and the position of the image based on the image data on the display image A computer program for executing a display process of displaying a composite image, which is an image obtained by combining and displaying a pointer at a position specified by data, on a second display which is a display included in the composite image.

As another aspect of the sixth invention, the inventor of the present application also proposes the following communication system capable of obtaining the same effect as the first invention.
The communication system includes a receiving computer, which is a computer having a display, and a computer having a display or connected to the display, capable of communicating with the receiving computer via a wireless LAN. A communication system including a transmission side computer.
Then, the transmission side computer captures one screen captured by dropping a frame from a display image which is an image displayed on a first display which is a display included in the transmission side computer or connected to the transmission side computer. A composite image that is an image obtained by combining and displaying the pointer displayed on the first display when the image corresponding to the image data is displayed on the first display Compressing means for compressing the compressed data into a format of the above, and transmitting means for transmitting the compressed data to a receiving computer at a predetermined time interval using a wireless LAN function. The receiving computer that has received the data decompresses the compressed data, and A composite image is a pointer composite display image at a position specified by the serial position data, and the image is assumed to be able to display on the second display is a display with it.

In the fifth to sixth aspects of the invention, in the receiving computer, the transmitting computer receives the compressed data, the receiving computer decompresses the compressed data into the image data, and an image based on the image data. The designation information for designating software for allowing the synthesized image, which is an image obtained by synthesizing and displaying the pointer at the position specified by the position data, to be displayed on the second display, which is the display provided therein, is changed. The receiving computer may include an input means for inputting at least a part of the designation information when it is possible.
Roughly speaking, it is the same as that displayed on the first display, as in the case where the receiving computer in the first to fourth inventions has an input means for inputting at least a part of the specified information. Show only to the person who wants to show the image. The designation information in this case is, for example, UDP (User Datagram Protocol).

1 is a diagram illustrating an overview of a communication system according to a first embodiment. The figure which shows the hardware constitutions of the transmission side computer contained in the communication system shown in FIG. The block diagram which shows the functional block formed inside the transmission side computer contained in the communication system shown in FIG. The figure for demonstrating the production | generation method of the image data in the communication system shown in FIG. The figure which shows the hardware constitutions of the communication apparatus contained in the communication system shown in FIG. The block diagram which shows the functional block formed in the inside of the communication apparatus contained in the communication system shown in FIG. The figure which shows the hardware constitutions of the receiving computer contained in the communication system shown in FIG. The block diagram which shows the functional block formed in the inside of the receiving computer contained in the communication system shown in FIG. The figure which shows the method of the image composition in the image composition part of the receiving computer included in the communication system shown in FIG. FIG. 9 is a perspective view illustrating an overview of a communication device included in a communication system according to a first modification. The block diagram which shows the functional block formed in the inside of the transmission side computer contained in the communication system of 2nd Embodiment. The block diagram which shows the functional block formed inside the communication apparatus contained in the communication system of 2nd Embodiment. The block diagram which shows the functional block formed inside the transmission side computer contained in the communication system of 3rd Embodiment. The block diagram which shows the functional block formed inside the receiving computer contained in the communication system of 3rd Embodiment. The block diagram which shows the functional block formed in the inside of the communication apparatus contained in the communication system of 4th Embodiment. The figure which shows the external appearance of the communication system of 5th Embodiment. The block diagram which shows the functional block formed in the inside of the transmission side computer contained in the communication system of 5th Embodiment. The block diagram which shows the functional block formed inside the transmission side computer contained in the communication system of 6th Embodiment.

Hereinafter, communication systems according to first to sixth embodiments of the present invention will be described. In the description of each embodiment, common objects are denoted by common reference numerals, and redundant descriptions are omitted depending on circumstances.
The communication system in each embodiment is used for presentation at a conference, although not limited thereto.

<< First Embodiment >>
FIG. 1 shows an outline of a communication system in the first embodiment.
The communication system includes a transmission side computer 100, a communication device 200, and a plurality of reception side computers 300.
The sending computer 100 and the communication device 200 are operated by a presenter (or an assistant thereof, the same applies hereinafter) for giving a presentation, and the receiving computer 300 is operated by an audience. The receiving computer 300 may be private to the audience, or may be distributed or lent to the audience by a presenter or a collaborator of the presenter.

The sending computer 100 is a computer. The sending computer 100 of this embodiment is a notebook computer provided with a display 101. Of course, the sending computer 100 may be connected to the external display 101 like a desktop computer. The sending computer 100 also includes an input device 102. Although the input device 102 of this embodiment is a keyboard, the transmitting computer 100 may include other input devices such as a trackball, a mouse, and a touch panel in addition to or instead of the keyboard. The transmitting computer 100 also includes several output terminals not shown. The output terminal is used for connection with the communication apparatus 200 and may be a known one. In this embodiment, it is assumed that at least the USB terminal exists in the transmission-side computer 100.
The sending computer 100 is equipped with known presentation software so that it can perform a presentation. The presentation software is, for example, PowerPoint (trademark) manufactured by Microsoft Japan. A display image, which is an image used for the presentation, is displayed on the display 101, and the presenter performs the presentation while watching it.

The sending computer 100 includes hardware as shown in FIG.
The hardware includes a CPU 111, a ROM 112, a RAM 113, an interface 114, and a hard disk drive 115, which are connected to each other by a bus 116.
The CPU 111 is an arithmetic device that performs arithmetic operations. For example, the CPU 111 executes a process described later by executing a computer program recorded in the ROM 112 or the hard disk drive 115. Note that the sending computer 100 may execute various functions that can be normally performed by a notebook personal computer, such as sending and receiving e-mails, browsing the Internet, and document creation. The sending computer 100 of this embodiment is also the same. Although it is such, a computer program here is a computer program for functioning this transmission side computer 100 as a transmission side computer of this invention. This computer program may be preinstalled in the transmitting computer 100 or may be installed afterwards. The computer program may be installed on the transmission-side computer 100 via a predetermined recording medium such as a memory card, or via a communication line such as a LAN or the Internet.
The ROM 112 records computer programs and data necessary for the CPU 111 to execute processing to be described later. The same applies to the hard disk drive 115, and some or all of the computer program and data may be recorded. In addition to the above-mentioned presentation software, the hard disk drive 115 stores computer programs for executing various functions that can be normally performed by a notebook personal computer, such as sending and receiving e-mails, browsing the Internet, and document creation. .
The RAM 113 provides a work area necessary for the CPU 111 to perform processing. In addition, data generated as a result of processing performed by the CPU 111 can be recorded in the RAM 113. A part of the RAM 113 serves as a frame buffer described later.
The interface 114 exchanges data between the CPU 111 and the RAM 113 connected via the bus 116 and the outside. The interface 114 is connected to the input device 102 described above and a USB terminal (not shown). The operation content from the input device 102 is input from the interface 114, and the data output from the interface 114 to the USB terminal is output from the USB terminal to the outside. A display 101 is connected to the interface 114, and data for controlling a display image displayed on the display 101 is output via the interface 114.

When the CPU 111 executes the computer program, functional blocks as shown in FIG. 3 are generated in the transmitting computer 100. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the transmission-side computer 100. May be.
Inside the transmission-side computer 100, an operation signal analysis unit 121, a control unit 122, a display image data generation unit 123, an image data generation unit 124, a position data generation unit 125, and a transmission unit 126 are generated.

The operation signal analysis unit 121 analyzes the content of the operation signal input from the input device 102. As the operation signal related to this embodiment, there is a signal related to the operation of the presentation software. For example, operation signals related to page turning and animation execution in the presentation software are input from the input device 102. The operation signal analysis unit 121 receives an operation signal for moving a pointer on a display image, which will be described later, from a mouse or other input device 102. The operation signal analysis unit 121 analyzes the contents if the operation signal specifies each of the above contents. The operation content analyzed by the operation signal analysis unit 121 is sent to the control unit 122.
Here, the control unit 122 executes software for presentation. The control unit 122 executes the presentation software based on the information received from the operation signal analysis unit 121 regarding the content of the operation signal input by the presenter from the input device 102. A signal regarding the execution result is sent to the display image data generation unit 123. The control unit 122 also determines where the pointer should be displayed on the display image based on the content of the operation signal for moving the pointer, and sends it to the display image data generation unit 123. Yes.
The display image data generation unit 123 generates display image data, which is data about a display image to be displayed on the display 101, based on a signal regarding the execution result of the presentation software received from the control unit 122. It is. The display image data includes a pointer. The signal generated by the display image data generation unit 123 is sent to the display 101, the image data generation unit 124, and the position data generation unit 125. An image is displayed on the display 101 based on the display image data. This is the display image.
The image data generation unit 124 generates image data from the display image data received from the display image data generation unit 123. The display image data is a moving image signal, and as shown in FIG. 4, the signals for the frames are continuous. One convex in the signal shown in FIG. 4 is a signal for one frame, that is, one screen of a display image. The image data generation unit 124 extracts a signal for one screen every several times from the analog signal, so that it can be called frame dropping. For example, when the original analog signal is 30 fps, as shown by the arrow in FIG. 4, when one screen signal for every three is extracted, the moving image created by the image data obtained thereby becomes 10 fps. . Such frame drop processing is performed in consideration of the limitation of the communication speed by the wireless LAN. The image data generated by the image data generation unit 124 is sent to the transmission unit 126 every time it is created. The image data does not include pointer information.
The position data generation unit 125 detects position data that is data for specifying the position of the pointer included in the display image that is an image based on the display image data in the display image. Normally, this data specifies the position in the display image by the vertical and horizontal (XY) coordinates, and this is the case in this embodiment. The position data generated by the position data generation unit 125 is sent to the transmission unit 126 every time it is created. The position data is created for at least a number of frames in the display image that is larger than the number of frames for which an image signal is to be generated. In this embodiment, the position data is generated from all frames displayed on the display 101. However, the position data is not necessarily generated from the display image data. In this embodiment, the control unit 122 determines where the pointer should be displayed on the display image. It is possible to obtain data on the coordinates, etc. and use it as position data.
The transmission unit 126 transmits the image data and the position data to the communication device 200. Transmission of image data and position data to the communication device 200 is performed from the USB terminal of the transmitting computer 100. Image data and position data are sent to the communication device 200 from different ports. The position data is sent to the communication device 200 more frequently than the image data.

Next, the communication device 200 will be described.
The communication apparatus 200 is connected to the transmitting computer 100 and receives an image received from the transmitting computer 100 and including an almost same pointer as the display image displayed on the display 101 of the transmitting computer 100. Data to be displayed on a display 300, which will be described later, is transmitted to a plurality of receiving computers 300.

The communication device 200 is a computer. The communication device 200 also includes an input device 202. Although the input device 202 of this embodiment is a numeric keypad, a keyboard, a mouse, a touch panel, or the like can be used as the input device 202. The communication apparatus 200 also includes a USB terminal that is an input terminal (not shown).
In addition, the communication device 200 has a wireless LAN function. The wireless LAN function is realized by a wireless LAN communication unit (not shown). The wireless LAN is Wi-Fi (trademark) in this embodiment, although not limited thereto. Wi-Fi is a standard by default, and at the same time, 253 computers (when 8-bit data is used for identification data) or 65533 computers (when 16-bit data is used for identification data) Can be communicated wirelessly. The wireless LAN communication unit uses UDP (User Datagram Protocol) to send data described below to the receiving computer 300.

The communication device 200 includes hardware as shown in FIG.
The hardware includes a CPU 211, a ROM 212, a RAM 213, and an interface 214, which are connected to each other by a bus 216.
The functions of the CPU 211, ROM 212, RAM 213, interface 214, and bus 216 are basically the same as those of the CPU 111, ROM 112, RAM 113, and interface 114 included in the transmitting computer 100.
However, the RAM 213 stores a computer program and data used for performing processing to be described later executed by the communication device 200. This computer program is not necessarily limited to this, but is preinstalled in the communication apparatus 200. The input terminal may be a known one, and in this embodiment, it is assumed that an analog input terminal and a USB terminal exist in the communication device 200. However, input terminals that are not used in the description of each embodiment may not exist in the communication device 200.
The interface 214 exchanges data between the CPU 211, RAM 213, and the like connected via the bus 216 and the outside. The interface 214 is connected to the input device 202 described above and input / output terminals including a USB terminal. The operation content from the input device 202 and the data from the USB terminal are input from the interface 214. Also, compressed data to be sent to each receiving computer 300 is sent from the interface 214 to the wireless LAN communication unit as will be described later.
The USB terminal of this embodiment is connected to the USB terminal of the transmission-side computer 100 by a USB USB cable 100A. Then, image data and position data are input to the USB terminal of the communication apparatus 200 via the USB cable 100A.
In this embodiment, the USB terminal of the transmitting computer 100 and the USB terminal of the receiving computer are connected by the USB cable 100A, but instead, two computers are connected by wire. As another method, a wired LAN, a memory card interface, an express card interface, or the like can be used. In other embodiments and the like, the connection between the USB terminals can be similarly replaced.

When the CPU 211 executes the computer program, a functional block as shown in FIG. 6 is generated in the communication device 200. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS or other computer program installed in the communication device 200. Also good.
In the communication device 200, an operation signal analysis unit 221, a control unit 222, a reception unit 223, a compression unit 224, and a wireless LAN control unit 225 are generated.

The operation signal analysis unit 221 analyzes the content of the operation signal input from the input device 202. In this embodiment, a numerical value which is information for designating designation information described later is input from the input device 202. When an operation signal related to the numerical value is input from the input device 202, the operation signal analysis unit 221 analyzes the numerical value specified by the operation signal. The operation content analyzed by the operation signal analysis unit 221, that is, a numerical value is sent to the control unit 222. Note that the information regarding the numerical value may be input not from the input device 202 but from the input device 102 of the transmission-side computer 100.
Based on the numerical value, the control unit 222 determines a numerical value that designates software in the receiving computer 300 that processes the compressed data sent from the communication device 200 to each receiving computer 300 as described below. In this embodiment, this numerical value is UDP / IP (User Datagram Protocol / Internet Protocol). The UDP / IP specified by the control unit 222 may be a numerical value itself input from the input device 202 or may be a numerical value obtained by performing some operation on the numerical value. The UDP / IP determined by the control unit 222 is sent to the wireless LAN control unit 225.
The receiving unit 223 receives image data and position data sent from the sending computer 100 from the USB terminal. The receiving unit 223 sends image data to the compression unit 224 and position data to the wireless LAN control unit 225, respectively.
Each time the image data is received, the compression unit 224 compresses the received image data. The image data may be compressed in any format, for example, in the MPEG format, but in this embodiment, compression in the JPEG format is performed. Data obtained by compressing image data is compressed data. Each time the compression unit 224 generates compressed data, it sends it to the wireless LAN control unit 225.
As described above, the wireless LAN control unit 225 receives UDP / IP from the control unit 222, position data from the reception unit 223, and compressed data from the compression unit 224. The wireless LAN control unit 225 causes the wireless LAN communication unit to send them to the receiving computer 300. To enable this, the wireless LAN control unit 225 divides the data to be transmitted, such as compressed data and position data, into packets by an existing method. In addition, a header is attached to the leading end of the packets, and the header includes the own IP address, the capacity of the data including the compressed data and the position data transmitted from these, and the reception of the software installed in each receiving computer 300. UDP / IP or the like for specifying software for processing the compressed data is written. These headers and a large number of packets are sent to the wireless LAN communication unit, and sent from the wireless LAN communication unit to each receiving computer 300 using UDP / IP.

Next, the receiving computer 300 will be described.
The receiving computer 300 is a portable computer. The receiving computer 300 is, for example, a notebook computer, a smartphone, or a tablet. For example, the smartphone is an iPhone manufactured and sold by Apple Japan LLC, and the tablet is an ipad manufactured and sold by the company.
The receiving computer 300 includes a display 301. The receiving computer 300 also includes an input device 302. In addition to the physical keys as shown in FIG. 1, the input device 302 can be configured by a touch panel integrated with the display 301 as is well known.
In addition, the receiving-side computer 300 has a wireless LAN function. The wireless LAN function is realized by a wireless LAN communication unit (not shown). The wireless LAN is Wi-Fi in this embodiment, although not limited to this. The wireless LAN communication unit of the receiving computer 300 can communicate with the wireless LAN communication unit of the communication device 200.

The receiving computer 300 includes hardware as shown in FIG.
The hardware includes a CPU 311, a ROM 312, a RAM 313, an interface 314, and a hard disk drive 315, which are connected to each other by a bus 316.
The functions of the CPU 311, ROM 312, RAM 313, interface 314, hard disk drive 315, and bus 316 are basically the same as the functions of the CPU 111, ROM 112, RAM 113, interface 114, hard disk drive 115, and bus 116 in the sending computer 100. .
However, the ROM 312 or the hard disk drive 315 stores computer programs necessary for realizing the following processing executed by the receiving computer 300. The ROM 312 or the hard disk drive 315 stores software necessary for executing processing of enlargement (for example, pinch) and recording of a display image (for example, print screen) described later.
The interface 314 of the receiving computer 300 is connected to the above-described wireless LAN communication unit mounted on the receiving computer 300 so that the wireless LAN communication unit receives the compressed data received from the communication device 200. It has become. Further, the interface 314 is connected to the input device 302 so as to receive operation contents from the input device 302. This operation content includes at least designation information described later. The interface 314 is also connected to the display 301 and transmits data for displaying a predetermined display image on the display 301.

When the CPU 311 executes the computer program, a functional block as shown in FIG. 8 is generated in the receiving computer 300. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the receiving-side computer 300. May be.
An operation signal analysis unit 321, a control unit 322, a designation information analysis unit 323, a reception unit 324, an expansion unit 325, a pointer image generation unit 326, and an image composition unit 327 are generated inside the reception side computer 300.

The operation signal analysis unit 321 analyzes the content of the operation signal input from the input device 302. The operation signal related to this embodiment includes designation information. The designation information designates at least a part of a numerical value for determining which software installed in the receiving computer 300 processes the compressed data received by the receiving computer 300 as will be described later. It is. This numerical value is sent to the control unit 322.
When the control unit 322 receives this numerical value, the control unit 322 determines a numerical value for determining which software installed in the receiving computer 300 should process the compressed data received by the receiving computer 300. Have This numerical value may be the numerical value itself indicated by the operation content input from the operation signal analysis unit 321, or may be a numerical value obtained as a result of performing some operation on the numerical value. In this embodiment, as a result of such calculation, a numerical value for determining which software installed in the receiving computer 300 is to process the compressed data received by the receiving computer 300 is determined. It has become so. This numerical value is sent to the designation information analysis unit 323.
The receiving unit 324 is sent from the wireless LAN communication unit of the communication device 200 and received by the wireless LAN communication unit of the receiving-side computer 300, and the packets of compressed data and position data (hereinafter, for the sake of simplicity). In addition, there is a case where the packet is sometimes referred to as “packet of compressed data”) through the interface 314 each time. When receiving the data, the receiving unit 324 sends data on UDP / IP in the header of the packet such as compressed data to the designated information analyzing unit 323. Further, as will be described later, the receiving unit 324 sends the compressed data received by the receiving computer 300 to the decompressing unit 325 and the position data received by the receiving computer 300 to the pointer image generating unit 326, respectively. There is.
The designation information analysis unit 323 receives the UDP / IP in the header of a packet such as compressed data received from the receiving unit 324 and the compressed data received by the receiving computer 300 sent from the control unit 322. A numerical value for determining which software installed in the computer 300 is used for processing is compared. If the numerical values match, the designation information analysis unit 323 sends information indicating that to the reception unit 324. Even when the numerical values do not match, the designation information analysis unit 323 sends information indicating that fact to the reception unit 324. It is to be noted that UDP / IP in the header of the compressed data packet in the specified information analysis unit 323 and the compressed data received by the receiving computer 300 sent from the control unit 322 are installed in the receiving computer 300. The process of comparing the numerical value for determining which software is to be processed is performed only when the first compressed data is received or at predetermined time intervals such as every 10 minutes. It does not matter.
When the receiving unit 324 receives the above-described information indicating that the numerical values match, the compressed data packet is collected into the original compressed data, and then the compressed data is sent to the decompressing unit 325, and the position data is generated as a pointer image. Each is sent to the unit 326. When receiving the above-described information indicating that the numerical values do not match, the receiving unit 324 discards the compressed data and the position data, and stops the subsequent processing.
When the decompression unit 325 receives compressed data from the reception unit 324, the decompression unit 325 decompresses the compressed data and returns it to image data. The decompression unit 325 sends image data obtained by decompressing the compressed data to the image composition unit 327.
When the pointer image generation unit 326 receives position data from the reception unit 324, the pointer image generation unit 326 generates an image of the pointer to be superimposed on the image based on the image data, and the background image is transparent and has the same size as the image based on the image data. Data for a pointer image drawn on the image is generated. The position of the pointer on the pointer image is the position indicated by the position data. The pointer image generation unit 326 sends pointer image data to the image composition unit 327. More pointer image data is created than display image data.
The image composition unit 327 combines the image data received from the decompression unit 325 and the pointer image data obtained from the pointer image generation unit 326 to generate image data to be finally displayed on the display 301, and An image based on the image data is displayed on the display 301. The composition of the image data performed by the image composition unit 327 and the data of the pointer image is performed by superimposing the latter image on the former image. As a result, an image in which the pointer is synthesized on the image data image is generated.
As described above, the pointer image data is generated more than the image data. In this embodiment, an image based on pointer image data is generated at a speed of 30 fps, and an image based on image data is generated at a speed of 10 fps. As shown in FIG. 9, the image composition unit 327 of this embodiment does not update the image based on the image data until the next image data is received. Thereafter, before receiving the next image data, the received pointer image data is synthesized one after another to generate synthesized image data for the synthesized image. In the figure, P is a pointer. Then, a composite image based on the composite image data is displayed on the display 301 at a speed of 30 fps. Since the frame dropping process has already been performed as described above, the portion based on the image data in the display image displayed on the display 301 of the receiving computer 300 is the display image displayed on the display 101 of the transmitting computer 100. Are basically the same (substantially the same in real time), but the number of frames is somewhat lower than the display image displayed on the display 101 of the transmitting computer 100. On the other hand, the portion (that is, the pointer) based on the pointer image data in the display image displayed on the display 301 of the receiving computer 300 is the same as the display image displayed on the display 101 of the transmitting computer 100 including the number of frames. Therefore, the movement is smooth.

  Next, the usage method and operation | movement of this communication system are demonstrated.

In order to use this communication system, the presenter first connects the USB terminal of the transmission-side computer 100 and the USB terminal of the communication device 200 with the USB cable 100A.
Next, the presenter, regardless of whether the above-described work is performed or not, operates the input device 202 of the communication device 200 to process the compressed data sent to each receiving computer 300 to the communication device 200. The software in the receiving computer 300 is used to input a numerical value designating software in the computer 300 and process the compressed data sent to the receiving computer 300 to the audience. Input a part of the specified numerical value. The audience inputs the numerical value by operating the input device 302.
In general, the numerical value of UDP / IP is determined by adding a predetermined numerical value to the default numerical value of 8255. In this embodiment, the presenter operates the input device 202 to input 8255 + predetermined numerical value (for example, 1000) + a numerical value (for example, 10) that is input to an audience to be permitted to receive and decompress compressed data by the receiving computer 300. Among these, a numerical value obtained by adding a predetermined numerical value (for example, 1000) and a numerical value (for example, 10) to be input to the audience to be permitted to receive and decompress compressed data by the receiving computer 300 is input. Receiving this, the control unit 222 determines UDP / IP as 9265.
On the other hand, in this embodiment, 8255 + a predetermined numerical value (for example, 1000) is input in advance in the computer program installed in the receiving computer 300 of the audience, and the audience operates the input device 302. The input numerical value is further added by the control unit 322. And 8255 + predetermined numerical value (for example, 1000) is set so as not to be seen from the audience. The presenter informs the correct number (which is 10 as described above) to be entered by the audience in some way only to the audience who may participate in the presentation and receive and decompress the compressed data. Only the audience notified of the correct numerical value can obtain a numerical value of 9265, which is a numerical value that specifies the software in the receiving computer 300 that processes the compressed data sent to the receiving computer 300. As described above, in addition to the default value of 8255 of UDP / IP, a predetermined numerical value (for example, 1000) invisible to the user is processed by the receiving computer 300 that processes the compressed data sent to the receiving computer 300. Since a malicious third party processes the compressed data sent to the receiving computer 300, it knows the numerical value specifying the software in the receiving computer 300 because it is used to determine the numerical value specifying the software. Is getting harder.
In communication device 200, the numerical value for the determined UDP / IP is sent from control unit 222 to wireless LAN control unit 225.
In the receiving computer 300, the numerical value specifying the software in the receiving computer 300 that processes the compressed data sent to the receiving computer 300 is sent to the designation information analysis unit 323.

In this state, the presenter starts the presentation.
At that time, the presenter operates the input device 102, and the control unit 122 executes known presentation software according to the operation content from the input device 102 and also specifies the position of the pointer in the display image. A signal regarding the execution result is sent to the display image data generation unit 123.
The display image data generation unit 123 generates data about an image including a pointer to be displayed on the display 101 of the transmission side computer 100. This data is written to the frame buffer each time and sent to the display 101 each time. In this case, the number of frames is, for example, 30 fps. Based on this data, an image used for presentation is displayed on the display 101. This image is a display image.
On the other hand, the display image data generation unit 123 sends data about the display image to the image data generation unit 124. The image data generation unit 124 generates image data while performing frame drop processing. The image data is sent to the transmission unit 126. On the other hand, the display image data generation unit 123 sends data about the display image to the position data generation unit 125. The position data generation unit 125 generates position data that specifies the position of the pointer. The position data is sent to the transmission unit 126.
The transmission unit 126 transmits the image data and the position data to the USB terminal of the transmission-side computer 100. From there, the data is sent to the USB terminal of the communication device 200 via the USB cable 100A. The image data and the position data are not necessarily sent to the receiving computer 300 as a set. That is, only position data may be sent to the receiving computer 300.

The following processing in the communication device 200 is basically performed automatically.
Image data and position data input from the USB terminal of the communication device 200 are sent to the receiving unit 223. The receiving unit 223 sends the image data to the compression unit 224 and the position data to the wireless LAN control unit 225.
Whenever the image data is received, the compression unit 224 compresses the received image data to obtain compressed data. Each time the compression unit 224 generates compressed data, it sends it to the wireless LAN control unit 225.
As described above, the wireless LAN control unit 225 receives UDP / IP from the control unit 222, position data from the reception unit 223, and compressed data from the compression unit 224. The wireless LAN control unit 225 causes the wireless LAN communication unit to send them to the receiving computer 300. To enable this, the wireless LAN control unit 225 divides the data to be transmitted, such as compressed data and position data, into packets by an existing method. In addition, a header is attached to the leading end of the packets, and the header includes the own IP address, the capacity of the data including the compressed data and the position data transmitted from these, and the reception of the software installed in each receiving computer 300. UDP / IP or the like for specifying software for processing the compressed data is written. These headers and a large number of packets are sent to the wireless LAN communication unit, and sent from the wireless LAN communication unit to each receiving computer 300 using UDP / IP.

A series of packets of compressed data starting from the header is received by the receiving unit 324 via the wireless LAN communication unit of the receiving computer 300. The receiving unit 324 sends the data on UDP / IP written in the header among the received data to the designation information analyzing unit 323.
The designation information analysis unit 323 receives the UDP / IP in the header of a packet such as compressed data received from the receiving unit 324 and the compressed data received by the receiving computer 300 sent from the control unit 322. A numerical value for determining which software installed in the computer 300 is used for processing is compared. When the numerical values match, the designation information analysis unit 323 sends information indicating that to the reception unit 324. Also, if the numerical values do not match, the designation information analysis unit 323 sends information indicating that to the reception unit 324. In this embodiment, this process is performed only when the receiving computer 300 receives the compressed data received by the receiving computer 300 and the receiving computer 300 receives the first compressed data.
When the receiving unit 324 receives the above-mentioned information indicating that the numerical values match, the compressed data packet is collected into the original compressed data, and then the compressed data is sent to the decompressing unit 325, and the position data is generated as a pointer image. To each of the units 326. When receiving the above information indicating that the numerical values do not match, the receiving unit 324 discards the compressed data and the position data, and stops the subsequent processing.
When receiving the compressed data from the receiving unit 324, the decompressing unit 325 decompresses the compressed data and returns it to image data. The decompression unit 325 sends the image data obtained by decompressing the compressed data to the image composition unit 327.
The pointer image generation unit 326 generates pointer image data when position data is received from the reception unit 324. The pointer image generation unit 326 sends the pointer image data to the image composition unit 327 every time the pointer image data is generated.
The image composition unit 327 composes the image data received from the decompression unit 325 and the pointer image data obtained from the pointer image generation unit 326, and finally generates image data to be displayed on the display 301. Then, an image based on the image data is displayed on the display 301.
As described above, the pointer image data is generated more than the image data. A composite image based on the composite image data is displayed on the display 301 at a speed of 30 fps. The part based on the pointer image data in the display image (that is, the pointer) is updated faster than the part based on the image data in the display image displayed on the display 301 of the receiving computer 300.

The audience can listen to the presentation provided by the presenter while viewing the display image displayed on the display 301. Thereby, it is not necessary to distribute the distribution material for presentation on paper. Note that the pointer is displayed smoothly on the display image.
If the display image is difficult to see because, for example, small characters are displayed on the display image, the audience can enlarge the display image using a function such as a pinch if the receiving computer 300 is equipped. By doing so, it is possible to clearly recognize even small characters, and to enlarge and view a portion of the display image that one wants to focus on.
In addition, the audience sees the display image displayed on the display 301, and if the reception-side computer 300 has the display image to be stored at the timing when the display image is displayed on the display 301, the display image such as a print screen is displayed. With the saving function, display image data can be saved in, for example, the hard disk drive 315 of the receiving computer 300. As a result, the need to distribute handouts on paper is increasingly reduced.
The mobile terminals of this time, which are scheduled to be used as the receiving computer 300, are usually provided with functions for enlarging the display image and saving the display image. A computer program for causing the computer according to the invention to function as the receiving computer 300 may be provided. The computer program for causing the computer according to the present invention to function as the receiving computer 300 may have at least one of the display image enlargement and display image storage functions according to the following embodiment. The same applies to cases.

<Modification 1>
The communication system of the modification 1 is almost the same as the communication system of the first embodiment.
The only difference is that the communication device 200 of the communication system of the first modification includes a projector. The projector is for projecting an image based on image data received by the communication apparatus 200 of the second embodiment, for example, on an external screen. Since the configuration of the projector is well known, the description of the configuration is omitted. FIG. 10 illustrates the communication device 200 in which the projection unit 203 of the projector is exposed to the outside.
In Modification 1, the above-described projector is connected to the interface 214 of the communication apparatus 200 in addition to the USB terminal.
In the first modification, the receiving unit 223 that has received the image data directly flows the image data to the projector. Based on this data, the projector projects a moving image based on the image data onto a screen or the like. This moving image is the same as a display image to be described later displayed on the display 301 of the receiving computer 300, but is based on the image data. The number of frames is falling. Further, since this image is based only on the image data, no pointer is included. If it is desired to display a pointer, image composition using position data as performed by the image composition unit 327 of the receiving computer 300 of the first embodiment is performed on the image data before being sent to the projector. You can do it.
In the above-described example, the image data is used for displaying an image on the projector. For example, a display image displayed on the display 101 of the transmitting computer 100 from an analog output terminal included in the transmitting computer 100. If the analog signal is output from the analog input terminal of the communication apparatus 200 and the projector is displayed by the analog signal, the analog signal is displayed on the display 101 of the transmitting computer 100. The same image as can be easily projected by a projector. Examples of analog terminals include analog RGB terminals, HDMI terminals, DVI terminals, display ports, thunderbolt terminals, and the like.
Note that a projector similar to that according to the first modification can be provided in the communication device 200 according to the second to fourth embodiments.

<< Second Embodiment >>
A communication system according to the second embodiment will be described.
Similar to the communication system of the first embodiment, the communication system of the second embodiment includes a transmission-side computer 100, a communication device 200, and a plurality of reception-side computers 300.

  The transmission side computer 100 of the second embodiment is a computer similar to that of the first embodiment. The hardware configuration is the same as that of the first embodiment. The transmission-side computer 100 of the second embodiment includes a display 101, an input device 102, and a USB terminal. The transmission-side computer 100 according to the second embodiment also includes a CPU 111, a ROM 112, a RAM 113, an interface 114, a hard disk drive 115, and a bus 116 that connects these components to each other. These functions are basically the same as those in the first embodiment.

When the CPU 111 executes the computer program, functional blocks as shown in FIG. 11 are generated in the transmitting computer 100 of the second embodiment. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the transmission-side computer 100. May be.
In addition to the functional blocks in the first embodiment, a compression unit 127 is generated inside the transmission-side computer 100.

The functions of the operation signal analysis unit 121, the control unit 122, the display image data generation unit 123, the image data generation unit 124, the position data generation unit 125, and the transmission unit 126 are the same as those in the first embodiment. The only difference is that the image data generation unit 124 sends the generated image data to the compression unit 127 instead of the transmission unit 126.
The function of the compression unit 127 of the second embodiment is the same as that of the compression unit 224 that was in the communication device 200 in the first embodiment. The compression unit 127 compresses the image data received from the image data generation unit 124 into compressed data, and sends the compressed data to the transmission unit 126.

Next, the communication device 200 will be described.
The communication device 200 is basically configured similarly to the communication device 200 in the first embodiment.
The communication device 200 is a computer and includes an input device 202. In addition, the communication device 200 has a wireless LAN function that is Wi-Fi in this embodiment.

  The communication device 200 according to the second embodiment includes the same hardware as the communication device 200 according to the first embodiment. Specifically, the communication device 200 according to the second embodiment includes a CPU 211, a ROM 212, a RAM 213, an interface 214, and a bus 216 that interconnects them. The functions of the CPU 211, ROM 212, RAM 213, interface 214, and bus 216 are the same as in the first embodiment.

When the CPU 211 executes the computer program, a functional block as shown in FIG. 12 is generated inside the communication apparatus 200. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS or other computer program installed in the communication device 200. Also good.
In the communication device 200, other functional blocks excluding the compression unit 224 existing in the case of the first embodiment, that is, the operation signal analysis unit 221, the control unit 222, the reception unit 223, and the wireless LAN control unit 225 are included. Is generated. All of these functions are basically the same as those in the first embodiment. The difference is that in the first embodiment, the reception unit 223 sends the reception data to the compression unit 224 with respect to the position data and the image data. The image data is compressed by the compression unit 224 and is then generated by the wireless LAN control unit 225. On the other hand, in the second embodiment, the compressed data received by the receiving unit 223 is sent to the wireless LAN control unit 225 as it is, like the position data.
In other words, the communication system according to the second embodiment can be understood that the compression unit 224 included in the communication apparatus 200 in the first embodiment is merely moved as the compression unit 127 inside the transmission-side computer 100. it can.

Next, the receiving computer 300 will be described.
The hardware configuration of the receiving computer 300 of the second embodiment, the functional blocks generated therein, and the operation thereof are the same as in the case of the first embodiment.

  Next, the usage method and operation of the communication system of the second embodiment will be described.

  In order to use this communication system, the presenter first connects the USB terminal of the transmitting computer 100 and the USB terminal of the communication device 200 with a USB cable. In addition, the presenter operates the input device 202 of the communication device 200 to input a numerical value designating software in the receiving computer 300 that processes the compressed data sent to each receiving computer 300 to the communication device 200. At the same time, the audience is caused to input a part of the numerical value designating the software in the receiving computer 300 that processes the compressed data sent to the receiving computer 300 to the receiving computer 300 of the audience.

In this state, the presenter starts the presentation.
The presenter operates the input device 102, and the control unit 122 specifies the position of the pointer according to the operation content from the input device 102, and executes known presentation software. A signal regarding the execution result is sent to the display image data generation unit 123.
The display image data generation unit 123 generates data about an image including a pointer to be displayed on the display 101 of the transmission side computer 100. This data is written to the frame buffer each time and sent to the display 101 each time. In this case, the number of frames is, for example, 30 fps. Based on this data, a display image used for the presentation is displayed on the display 101.
On the other hand, the display image data generation unit 123 sends data about the display image to the image data generation unit 124. The image data generation unit 124 performs frame drop processing as described above to generate image data. The image data generation unit 124 intermittently sends the generated image data to the compression unit 127. The compression unit 127 compresses the image data into compressed data, and sends the compressed data to the USB terminal of the transmission-side computer 100. The image data is received by the USB terminal of the communication device 200 via the USB cable.

In the communication apparatus 200, the following processing is basically automatically executed.
Note that the processing performed by the operation signal analysis unit 221 and the control unit 222 is the same as that in the first embodiment, and a description thereof will be omitted.
The receiving unit 223 receives the compressed data and the position data input from the USB terminal. The receiving unit 223 sends them to the wireless LAN control unit 225. The wireless LAN control unit 225 divides them into packets in the same manner as in the first embodiment. The wireless LAN control unit 225 divides the compressed data and position data into packets, attaches the same header as in the first embodiment, and sends them to the wireless LAN communication unit. The wireless LAN communication unit sends the data to each receiving computer 300.

  The data received by the receiving computer 300 from the communication device 200 is the same between the case of the first embodiment and the case of the second embodiment. That is, the subsequent processing executed by the receiving computer 300 of the second embodiment is the same as that of the first embodiment.

<< Third Embodiment >>
A communication system according to the third embodiment will be described.
Similar to the communication system of the first embodiment, the communication system of the third embodiment includes a transmission side computer 100, a communication device 200, and a plurality of reception side computers 300.

  The transmission-side computer 100 of the third embodiment is a computer similar to that of the first embodiment. The hardware configuration is the same as that of the first embodiment. The transmission-side computer 100 according to the third embodiment includes a display 101, an input device 102, and a USB terminal. The transmission-side computer 100 according to the third embodiment also includes a CPU 111, a ROM 112, a RAM 113, an interface 114, a hard disk drive 115, and a bus 116 that connects these components to each other. These functions are basically the same as those in the first embodiment.

When the CPU 111 executes the computer program, functional blocks as shown in FIG. 13 are generated in the transmission-side computer 100 of the third embodiment. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the transmission-side computer 100. May be.
In addition to the functional blocks in the case of the second embodiment, a pointer image generation unit 128 and an image composition unit 129 are generated inside the transmission-side computer 100.

The functions of the operation signal analysis unit 121, the control unit 122, the display image data generation unit 123, the image data generation unit 124, the position data generation unit 125, the transmission unit 126, and the compression unit 127 are the same as those in the first embodiment. The difference is that the image data generation unit 124 sends the generated image data to the image synthesis unit 129 instead of the compression unit 127, and the position data generation unit 125 sends the position data to the transmission unit 126. Instead, it is sent to the pointer image generation unit 128.
The functions of the pointer image generation unit 128 and the image synthesis unit 129 of the third embodiment are the same as those of the pointer image generation unit 326 and the image synthesis unit 327 that were in the receiving computer 300 in the first embodiment.
That is, the pointer image generation unit 128 generates pointer image data when position data is received from the position data generation unit 125. The pointer image generation unit 128 sends pointer image data to the image composition unit 129.
The image composition unit 129 synthesizes the image data received from the image data generation unit 124 and the pointer image data obtained from the pointer image generation unit 128, and finally, a composite image that is image data to be displayed on the display 301. Data is generated. The generated composite image data is sent to the compression unit 127.
The compression unit 127 compresses the composite image data to obtain compressed data. Unlike the case of the first embodiment and the second embodiment, this compressed data is not the image data, but the compressed composite image data for the image combined with the pointer. The compressed data is sent to the transmission unit 126.
The transmission unit 126 is configured to send the compressed data to the communication device 200. Unlike the case of the first embodiment and the second embodiment, the position data is not sent to the communication device 200.

Next, the communication device 200 will be described.
The communication device 200 is basically configured similarly to the communication device 200 in the first embodiment.
The communication device 200 is a computer and includes an input device 202. In addition, the communication device 200 has a wireless LAN function that is Wi-Fi in this embodiment.

  The communication device 200 according to the third embodiment includes the same hardware as the communication device 200 according to the first embodiment. Specifically, the communication device 200 according to the third embodiment includes a CPU 211, a ROM 212, a RAM 213, an interface 214, and a bus 216 that interconnects them. The functions of the CPU 211, ROM 212, RAM 213, interface 214, and bus 216 are the same as in the first embodiment.

When the CPU 211 executes the computer program, the same functional blocks as in the second embodiment are generated in the communication device 200. The functional blocks of the communication device 200 may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS or other computer programs installed in the communication device 200. May be.
The function of each functional block generated inside the communication device 200 is basically the same as in the second embodiment. The difference is that, in the second embodiment, the reception unit 223 sends the received data to the reception wireless LAN control unit 225 with the compressed data and the position data, whereas in the third embodiment, the reception unit 223 receives the reception wireless LAN control unit. Only the compressed data is sent to 225.
The wireless LAN control unit 225 sends the compressed data divided into packets to the receiving computer 300 via the wireless LAN communication unit.

Next, the receiving computer 300 will be described.
The receiving computer 300 is configured in the same manner as in the first embodiment. The hardware configuration is the same as in the first embodiment, and the receiving computer 300 of the third embodiment includes a CPU 311, ROM 312, RAM 313, interface 314, hard disk drive 315, and bus 316.
When the CPU 311 executes the computer program, functional blocks as shown in FIG. 14 are generated in the receiving computer 300. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the receiving-side computer 300. May be.
Roughly speaking, the functional blocks generated inside the reception-side computer 300 exclude the pointer image generation unit 326 from the functional blocks generated inside the reception-side computer 300 of the first embodiment, and the image composition unit 327 Instead, a display unit 328 is provided.

The functions of the operation signal analysis unit 321, the control unit 322, the specified information analysis unit 323, the reception unit 324, and the decompression unit 325 are the same as in the case of the first embodiment.
The difference between the first embodiment and the third embodiment is that the receiving unit 324 receives the compressed data and the position data in the case of the first embodiment, but only the position data in the case of the third embodiment. It is a point. The compressed data is sent from the receiving unit 324 to the decompressing unit 325 when the same condition as in the first embodiment is satisfied.
The decompression unit 325 decompresses the compressed data in the same manner as in the first embodiment, but the resulting data differs from the first embodiment, which was image data, and in the case of the third embodiment, the data is synthesized. Image data. The composite image data is sent from the decompression unit 325 to the display unit 328.
The display unit 328 displays an image based on the composite image data on the display 301. Since the pointer is already written in the image based on the composite image data received by the display unit 328, the display unit 328 does not need to perform the image composition process unlike the image composition unit 327 in the first embodiment.
In short, it can be said that the communication system of the third embodiment is one in which the image composition performed in the first embodiment has been completed by the sending computer 100.

  Next, the usage method and operation of the communication system of the third embodiment will be described.

  In order to use this communication system, the presenter first connects the USB terminal of the transmitting computer 100 and the USB terminal of the communication device 200 with a USB cable. In addition, the presenter operates the input device 202 of the communication device 200 to input a numerical value designating software in the receiving computer 300 that processes the compressed data sent to each receiving computer 300 to the communication device 200. At the same time, the audience is caused to input a part of the numerical value designating the software in the receiving computer 300 that processes the compressed data sent to the receiving computer 300 to the receiving computer 300 of the audience.

In this state, the presenter starts the presentation.
The presenter operates the input device 102, and the control unit 122 specifies the position of the pointer according to the operation content from the input device 102, and executes known presentation software. A signal regarding the execution result is sent to the display image data generation unit 123.
The display image data generation unit 123 generates data about an image including a pointer to be displayed on the display 101 of the transmission side computer 100. Based on this data, a display image used for the presentation is displayed on the display 101.
On the other hand, the display image data generation unit 123 sends data about the display image to the image data generation unit 124. The image data generation unit 124 intermittently sends the generated image data to the image composition unit 129. The display image data generation unit 123 also sends data about the display image to the position data generation unit 125. The position data generation unit 125 generates position data and sends it to the pointer image generation unit 128.
The pointer image generation unit 128 generates pointer image data and sends it to the image composition unit 129.
The image combining unit 129 combines the image based on the image data and the pointer image, and generates combined image data that is data about the image that is finally displayed on the display 301 of the receiving computer 300. The composite image data is sent from the image composition unit 129 to the compression unit 127.
The compression unit 127 compresses the composite image data to obtain compressed data. The compression unit 127 sends the compressed data generated by the compression unit 127 to the transmission unit 126.
The transmission unit 126 sends it to the communication device 200.

In the communication apparatus 200, the following processing is basically automatically executed.
Note that the processing performed by the operation signal analysis unit 221 and the control unit 222 is the same as that in the first embodiment, and a description thereof will be omitted.
The receiving unit 223 receives the compressed data input from the USB terminal. The receiving unit 223 sends the compressed data as it is to the wireless LAN control unit 225. The wireless LAN control unit 225 divides the compressed data into packets by the same method as in the first embodiment, attaches the same header as in the first embodiment, and assigns them to the wireless LAN communication unit. Send to. The wireless LAN communication unit sends the data to each receiving computer 300.

A series of packets of compressed data starting from the header is received by the receiving unit 324 via the wireless LAN communication unit of the receiving computer 300. The receiving unit 324 sends the data on UDP / IP written in the header among the received data to the designation information analyzing unit 323.
The designation information analysis unit 323 receives the UDP / IP in the header of a packet such as compressed data received from the receiving unit 324 and the compressed data received by the receiving computer 300 sent from the control unit 322. A numerical value for determining which software installed in the computer 300 is used for processing is compared. When the numerical values match, the designation information analysis unit 323 sends information indicating that to the reception unit 324. Also, if the numerical values do not match, the designation information analysis unit 323 sends information indicating that to the reception unit 324. In this embodiment, this process is performed only when the receiving computer 300 receives the compressed data received by the receiving computer 300 and the receiving computer 300 receives the first compressed data.
When receiving the above-described information indicating that the numerical values match, the receiving unit 324 collects the compressed data packets into the original compressed data, and then sends the compressed data to the decompressing unit 325. When receiving the above-described information indicating that the numerical values do not match, the receiving unit 324 discards the compressed data and stops the subsequent processing.
When receiving the compressed data from the receiving unit 324, the decompressing unit 325 decompresses the compressed data and returns it to the composite image data. The decompression unit 325 sends the composite image data to the display unit 328.
The display unit 328 displays an image including a pointer based on the composite image data on the display 301.

<< Fourth Embodiment >>
A communication system according to the fourth embodiment will be described.
Similar to the communication system of the first embodiment, the communication system of the fourth embodiment includes a transmitting computer 100, a communication device 200, and a plurality of receiving computers 300.

  The transmission-side computer 100 of the fourth embodiment is a computer similar to that of the first embodiment. The hardware configuration is the same as that of the first embodiment. A transmission-side computer 100 according to the fourth embodiment includes a display 101, an input device 102, and a USB terminal. The transmission-side computer 100 according to the fourth embodiment also includes a CPU 111, a ROM 112, a RAM 113, an interface 114, a hard disk drive 115, and a bus 116 that connects these components to each other. These functions are basically the same as those in the first embodiment.

When the CPU 111 executes the computer program, the same functional blocks as those in the first embodiment are generated in the transmission-side computer 100 of the fourth embodiment. The functions of the functional blocks generated in the transmission-side computer 100 in the fourth embodiment are the same as those in the first embodiment.
The functional blocks generated in the transmission-side computer 100 in the fourth embodiment may be generated by the functions of the above-described computer program alone, but the above-described computer program, the OS installed in the transmission-side computer 100, and other functions It may be generated in cooperation with a computer program.

Next, the communication device 200 will be described.
The communication device 200 is basically configured similarly to the communication device 200 in the first embodiment.
The communication device 200 is a computer and includes an input device 202. In addition, the communication device 200 has a wireless LAN function that is Wi-Fi in this embodiment.

  The communication device 200 according to the fourth embodiment includes the same hardware as the communication device 200 according to the first embodiment. Specifically, the communication device 200 according to the fourth embodiment includes a CPU 211, a ROM 212, a RAM 213, an interface 214, and a bus 216 that connects them to each other. The functions of the CPU 211, ROM 212, RAM 213, interface 214, and bus 216 are the same as in the first embodiment.

When the CPU 211 executes the computer program, a pointer image generation unit 226 and an image composition unit 227 are generated in the communication device 200 in addition to the functional blocks generated in the communication device 200 in the first embodiment. (FIG. 15).
The functions of the functional blocks of the operation signal analysis unit 221, the control unit 222, the reception unit 223, the compression unit 224, and the wireless LAN control unit 225 are basically the same as those in the first embodiment. However, the reception unit 223 receives the position data received from the transmission side computer 100 from the wireless LAN control unit 225 instead of the pointer image generation unit 226, and the image data received from the transmission side computer 100 from the compression unit 224 to the image. The data is sent to the combining unit 227. Further, the wireless LAN control unit 225 receives compressed data instead of receiving position data and image data, as will be described later.
The functions of the pointer image generation unit 226 and the image composition unit 227 of the fourth embodiment are the same as those of the pointer image generation unit 326 and the image composition unit 327 that were in the receiving computer 300 in the first embodiment.
That is, the pointer image generation unit 226 generates pointer image data when position data is received from the reception unit 223. The pointer image generation unit 226 sends pointer image data to the image composition unit 227.
The image composition unit 227 synthesizes the image data received from the reception unit 223 and the pointer image data obtained from the pointer image generation unit 226, and finally combines image data that is image data to be displayed on the display 301. Is to be generated. The generated composite image data is sent to the compression unit 224.
In the first embodiment, the compression unit 224 compresses the image data into compressed data, but in the fourth embodiment, the compressed image data is compressed into compressed data. The compression unit 224 sends compressed data obtained by compressing the combined image data of the image combined with the pointer to the wireless LAN control unit 225.
The wireless LAN control unit 225 sends the compressed data divided into packets to the receiving computer 300 via the wireless LAN communication unit. The data transmitted from the wireless LAN control unit 225 to the receiving computer 300 does not include position data in the fourth embodiment.
In short, it can be said that the communication system of the fourth embodiment has completed the image composition performed in the first embodiment by the communication device 200.

Next, the receiving computer 300 will be described.
The receiving computer 300 has the same hardware configuration as that of the third embodiment, including functional blocks generated therein.

  Next, the usage method and operation of the communication system of the fourth embodiment will be described.

  In order to use this communication system, the presenter first connects the USB terminal of the transmitting computer 100 and the USB terminal of the communication device 200 with a USB cable. In addition, the presenter operates the input device 202 of the communication device 200 to input a numerical value designating software in the receiving computer 300 that processes the compressed data sent to each receiving computer 300 to the communication device 200. At the same time, the audience is caused to input a part of the numerical value designating the software in the receiving computer 300 that processes the compressed data sent to the receiving computer 300 to the receiving computer 300 of the audience.

In this state, the presenter starts the presentation.
The processing in the transmission side computer 100 corresponds to the case of the first embodiment.
Image data and position data are sent from the sending computer 100 to the communication device 200.

The receiving unit 223 receives image data and position data from the transmitting computer 100 and sends the position data to the pointer image generation unit 226 and the image data to the image composition unit 227.
When the pointer image generation unit 226 receives position data from the reception unit 223, the pointer image generation unit 226 generates pointer image data. The pointer image generation unit 226 sends the pointer image data to the image composition unit 227.
The image composition unit 227 synthesizes the image data received from the reception unit 223 and the pointer image data obtained from the pointer image generation unit 226, and finally combines image data that is image data to be displayed on the display 301. Generate. The generated composite image data is sent to the compression unit 224.
The compression unit 224 compresses the composite image data to obtain compressed data. The compression unit 224 sends the compressed data obtained by compressing the composite image data to the wireless LAN control unit 225.
The wireless LAN control unit 225 sends the compressed data divided into packets to the receiving computer 300 via the wireless LAN communication unit.

The receiving computer 300 receives the compressed data divided into packets from the communication device 200. This compressed data is obtained by compressing the composite image data, and is the same as the compressed data received from the communication device 200 by the receiving computer 300 of the third embodiment.
As described above, the receiving computer 300 of the fourth embodiment is the same as the receiving computer 300 of the third embodiment. The subsequent processing performed by the receiving computer 300 of the fourth embodiment is the same as the processing performed by the receiving computer 300 of the third embodiment.

«Fifth embodiment»
Next, a communication system according to a fifth embodiment will be described.
As shown in FIG. 16, the communication system according to the fifth embodiment does not include the communication device 200 unlike the communication system according to the first embodiment. That is, the communication system according to the fifth embodiment includes the transmission side computer 100 and the plurality of reception side computers 300.

The transmission computer 100 of the fifth embodiment is a computer, similar to that of the first embodiment. The hardware configuration is the same as that of the first embodiment. The transmitting computer 100 of the fifth embodiment includes a display 101 and an input device 102. There may be no output terminal including a USB terminal. Note that the transmission-side computer 100 of the fifth embodiment is equipped with a wireless LAN communication function. The function is the same as that implemented by the communication apparatus 200 of the first embodiment. Roughly speaking, it can be said that the transmission-side computer 100 of the fifth embodiment is a combination of the transmission-side computer 100 and the communication device 200 of the first embodiment.
The transmission-side computer 100 of the fifth embodiment also includes a CPU 111, a ROM 112, a RAM 113, an interface 114, a hard disk drive 115, and a bus 116 that interconnects them. These functions are basically the same as those in the first embodiment.
Note that the interface 114 is connected to a wireless LAN communication unit similar to that included in the communication device 200 of the first embodiment.

When the CPU 111 executes the computer program, functional blocks as shown in FIG. 17 are generated in the transmitting computer 100 of the fifth embodiment. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the transmission-side computer 100. May be.
Inside the transmission-side computer 100, an operation signal analysis unit 121, a control unit 122, a display image data generation unit 123, an image data generation unit 124, a position data generation unit 125, a compression unit 224, and a wireless LAN control unit 225 are generated. Is done.
The functions of the operation signal analysis unit 121, the control unit 122, the display image data generation unit 123, the image data generation unit 124, and the position data generation unit 125 of the fifth embodiment are the same as those of the transmission computer 100 in the first embodiment. It is not different from those functions that are generated. The functions of the compression unit 224 and the wireless LAN control unit 225 of the fifth embodiment are the same as those functions generated in the communication device 200 in the first embodiment.
However, the operation signal analysis unit 121 according to the fifth embodiment has the functions of the operation signal analysis unit 121 that is included in the transmission-side computer 100 according to the first embodiment and the operation signal analysis unit 221 that is included in the communication apparatus 200. It has become. In addition, the control unit 122 of the fifth embodiment has the functions of the control unit 122 that is in the transmission-side computer 100 of the first embodiment and the control unit 222 that is in the communication device 200. That is, the input device 102 according to the fifth embodiment can input numerical values that specify software in the receiving computer 300 that processes the compressed data sent to the receiving computers 300. The operation signal analysis unit 121 of the fifth embodiment can analyze the numerical value, and the control unit 122 of the fifth embodiment thereby compresses the compression sent to each receiving computer 300. A numerical value for designating software in the receiving computer 300 for processing data can be determined. The control unit 122 is also configured to send the determined numerical value to the wireless LAN control unit 225.
The wireless LAN control unit 225 in the fifth embodiment has the same function as the wireless LAN control unit 225 included in the communication device 200 of the first embodiment. That is, when the wireless LAN control unit 225 receives the compressed data from the compression unit 224 and the position data from the position data generation unit 125, the wireless LAN control unit 225 divides the compressed data and the position data or the position data into packets. The same headers as in the case of the embodiment are attached, and they are sent to the wireless LAN communication unit. The wireless LAN control unit 225 according to the fifth embodiment receives a numerical value designating software in the receiving computer 300 that processes the compressed data sent to each receiving computer 300 from the control unit 122. The numerical value for / IP can be written in the header as in the first embodiment.
The wireless LAN communication unit sends the header and the compressed data packet to each receiving-side computer 300 in the same manner as the wireless LAN communication unit provided in the communication device 200 of the first embodiment.

Next, the receiving computer 300 will be described.
The hardware configuration of the receiving side computer 300 of the fifth embodiment, the functional blocks generated therein, and the operation thereof are the same as in the case of the first embodiment.

  Next, the usage method and operation of the communication system of the fifth embodiment will be described.

  To use this communication system, the presenter first operates the input device 102 of the transmitting computer 100 to process the compressed data sent to each receiving computer 300 to the transmitting computer 100. Enter the numerical value specifying the software in 300, and specify the software in the receiving computer 300 that processes the compressed data sent to the receiving computer 300 for the receiving computer 300 owned by the audience. To input a part of the numerical value.

In this state, the presenter starts the presentation.
The presenter operates the input device 102, and the control unit 122 executes known presentation software according to the operation content from the input device 102. A signal regarding the execution result is sent to the display image data generation unit 123.
The display image data generation unit 123 generates data about an image to be displayed on the display 101 of the transmission side computer 100. This data is sent to the display 101 each time. In this case, the number of frames is, for example, 30 fps. Based on this data, a display image used for the presentation is displayed on the display 101.
On the other hand, the display image data generation unit 123 sends data about the display image to the image data generation unit 124. The image data generation unit 124 performs frame drop processing as described above to generate image data. The image data generation unit 124 intermittently sends the generated image data to the compression unit 224.
Each time the compression unit 224 receives image data, the compression unit 224 compresses the image data to generate compressed data. The compression unit 224 intermittently sends the compressed data to the wireless LAN control unit 225.
Each time the wireless LAN control unit 225 receives the compressed data, the wireless LAN control unit 225 divides the compressed data into packets, attaches the same header as in the first embodiment, and sends them to the wireless LAN communication unit. The position data may be sent together with the compressed data, or only the position data may be sent.
The wireless LAN communication unit sends the data to each receiving computer 300.

  A series of packets of compressed data starting from the header is received by the wireless LAN communication unit of the reception-side computer 300 in the fifth embodiment as well as in the first embodiment. All processing from here on in the receiving computer 300 is the same as in the first embodiment.

<< Sixth Embodiment >>
Next, the communication system of 6th Embodiment is demonstrated.
As in the fifth embodiment, the communication system according to the sixth embodiment includes a transmitting computer 100 and a plurality of receiving computers 300.

The transmission-side computer 100 of the sixth embodiment is a computer similar to that of the fifth embodiment. The hardware configuration is the same as that of the first embodiment. The transmitting computer 100 of the sixth embodiment includes a display 101 and an input device 102. There may be no output terminal including a USB terminal. Note that the transmission-side computer 100 of the sixth embodiment is equipped with a wireless LAN communication function. The function is the same as that implemented by the communication apparatus 200 of the first embodiment. Roughly speaking, it can be said that the transmission-side computer 100 of the sixth embodiment is a combination of the transmission-side computer 100 and the communication device 200 of the third embodiment.
The transmission-side computer 100 of the sixth embodiment also includes a CPU 111, a ROM 112, a RAM 113, an interface 114, a hard disk drive 115, and a bus 116 that connects these components to each other. These functions are basically the same as those in the first embodiment.
Note that the interface 114 is connected to a wireless LAN communication unit similar to that provided in the communication device 200 of the second embodiment.

When the CPU 111 executes the computer program, functional blocks as shown in FIG. 18 are generated in the transmitting computer 100 of the sixth embodiment. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the transmission-side computer 100. May be.
Inside the transmission-side computer 100 are an operation signal analysis unit 121, a control unit 122, a display image data generation unit 123, an image data generation unit 124, a position data generation unit 125, a compression unit 127, a pointer image generation unit 128, and an image composition. The unit 129 and the wireless LAN control unit 225 are generated.
The functions of the operation signal analysis unit 121, the control unit 122, the display image data generation unit 123, the image data generation unit 124, the position data generation unit 125, the compression unit 127, the pointer image generation unit 128, and the image synthesis unit 129 are the third implementation. It is not different from the case of form. The only difference is that the destination to which the image composition unit 129 sends the composite image data is not the transmission unit 126 but the wireless LAN control unit 225.
The function of the wireless LAN control unit 225 of the sixth embodiment is not different from that of the wireless LAN control unit 225 of the third embodiment.

Next, the receiving computer 300 will be described.
The hardware configuration of the receiving side computer 300 of the sixth embodiment, the functional blocks generated therein, and the operation thereof are the same as in the case of the third embodiment.

  Next, the usage method and operation of the communication system of the sixth embodiment will be described.

The usage method and operation of this communication system are the same as those of the communication system of the third embodiment.
The only difference is that the image composition unit 129 sends the composite image data to the wireless LAN control unit 225 instead of the transmission unit 126.

DESCRIPTION OF SYMBOLS 100 Transmission side computer 101 Display 102 Input device 121 Operation signal analysis part 122 Control part 123 Display image data generation part 124 Image data generation part 125 Position data generation part 126 Transmission part 127 Compression part 128 Pointer image generation part 129 Image composition part 200 Communication Device 202 Input device 221 Operation signal analysis unit 222 Control unit 223 Reception unit 224 Compression unit 225 Wireless LAN control unit 226 Pointer image generation unit 227 Image composition unit 300 Receiving computer 301 Display 302 Input device 321 Operation signal analysis unit 322 Control unit 323 Designated information analysis unit 324 reception unit 325 decompression unit 326 pointer image generation unit 327 image composition unit

Claims (7)

The present invention is used by connecting to a transmitting computer that has a display or is connected to a display, and can communicate with a receiving computer that is a computer having a display via a wireless LAN. A communication device comprising:
Image data that is image data of one screen captured by dropping a frame from a display image that is an image displayed on a first display that is a display that the transmitting computer has or is connected to the transmitting computer Receiving means for receiving position data, which is data for specifying a position on the first display, of the pointer displayed on the first display from the transmitting computer at a predetermined timing;
Compression means for compressing the image data into a predetermined format;
Transmitting means for transmitting the compressed data and the position data to a receiving computer at predetermined time intervals using a wireless LAN function;
With
The receiving computer that has received the compressed data expands the compressed data into the image data, and combines the pointer with a position specified by the position data of the image based on the image data. images, together are intended to allow the display on the second display is a display provided it,
The communication device is a port number in the UDP protocol for designating software for the receiving computer that has received the compressed data to display the composite image on a second display that is a display included in the composite image. The designation information can be arbitrarily input by the input of the person who operates the communication device,
The receiving computer comprises input means for a person operating the receiving computer to input at least a part of the designation information, and at least the designation information made by the input means in the receiving computer. Only when the software port number for displaying the composite image on the second display is specified to be the same as that set by the communication device by some input, the second The composite image is displayed on the display.
Communication device. The present invention is used by connecting to a transmitting computer that has a display or is connected to a display, and can communicate with a receiving computer that is a computer having a display via a wireless LAN. A method executed by a communication device comprising:
Executed by the communication device;
Image data that is image data of one screen captured by dropping a frame from a display image that is an image displayed on a first display that is a display that the transmitting computer has or is connected to the transmitting computer Receiving a position data that is data for specifying a position on the first display of the pointer displayed on the first display from the transmitting computer at a predetermined timing;
A compression process for compressing the image data into a predetermined format;
A transmission process of transmitting the compressed data and the position data to a receiving computer at a predetermined time interval using a wireless LAN function;
Contains
The receiving computer that has received the compressed data expands the compressed data into the image data, and combines the pointer with a position specified by the position data of the image based on the image data. The image can be displayed on a second display which is a display included in the image,
The process executed by the communication device is a UDP protocol for designating software for the receiving computer that has received the compressed data to display the composite image on a second display that is a display included in the composite image. Including a step of arbitrarily inputting designation information that is a port number by an input of a person who operates the communication device,
The receiving computer comprises input means for a person operating the receiving computer to input at least a part of the designation information, and at least the designation information made by the input means in the receiving computer. Only when the software port number for displaying the composite image on the second display is specified to be the same as that set by the communication device by some input, the second The composite image is displayed on the display.
Method. The present invention is used by connecting to a transmitting computer that has a display or is connected to a display, and can communicate with a receiving computer that is a computer having a display via a wireless LAN. A computer program for causing a computer to function as a communication device,
In the computer included in the communication device,
Image data that is image data of one screen captured by dropping a frame from a display image that is an image displayed on a first display that is a display that the transmitting computer has or is connected to the transmitting computer Receiving a position data that is data for specifying a position on the first display of the pointer displayed on the first display from the transmitting computer at a predetermined timing;
A compression process for compressing the image data into a predetermined format;
A transmission process of transmitting the compressed data and the position data to a receiving computer at a predetermined time interval using a wireless LAN function;
Is supposed to be executed,
The receiving computer that has received the compressed data expands the compressed data into the image data, and combines the pointer with a position specified by the position data of the image based on the image data. An image can be displayed on a second display which is a display included in the image.
The process executed by the computer of the communication device is for the receiving computer that has received the compressed data to specify software for displaying the composite image on a second display that is a display included in the composite image. Including a step of arbitrarily inputting designation information which is a port number in the UDP protocol by an input of a person who operates the communication device,
The receiving computer comprises input means for a person operating the receiving computer to input at least a part of the designation information, and at least the designation information made by the input means in the receiving computer. Only when the software port number for displaying the composite image on the second display is specified to be the same as that set by the communication device by some input, the second The composite image is displayed on the display.
Computer program. A receiving computer that communicates with the communication device according to claim 1,
A second display;
Second receiving means for receiving the compressed data and the position data;
Decompression means for decompressing the compressed data and returning it to image data;
Display means for displaying, on the second display, a composite image that is an image obtained by combining and displaying a pointer on the display image based on the image data at a position specified by the position data of the image based on the image data;
An input means for a person operating the receiving computer to input at least a part of the specified information ;
And having
A port number of the software for displaying the composite image on the second display by the input of at least a part of the designation information made by the input means in the receiving computer is set in the communication device The composite image is displayed on the second display only when designated to be the same as
Receiving computer. A method executed by a receiving computer having a second display for communicating with the communication device according to claim 1, comprising:
Executed by the receiving computer;
A second receiving process for receiving the compressed data and the position data;
Decompression process of decompressing the compressed data back to image data;
A display step of displaying, on the second display, a composite image that is an image obtained by combining and displaying a pointer on the display image based on the image data at a position specified by the position data of the image based on the image data;
An input process for a person operating the receiving computer to input at least a part of the specified information ;
Including
A port number of the software for displaying the composite image on the second display by the input of at least a part of the designation information made by the input means in the receiving computer is set in the communication device The display process is executed only when specified to be the same as
Method. A computer included in a receiving computer having a second display that communicates with the communication device according to claim 1,
A second receiving process for receiving the compressed data and the position data;
Decompression process of decompressing the compressed data back to image data;
A display step of displaying, on the second display, a composite image that is an image obtained by combining and displaying a pointer on the display image based on the image data at a position specified by the position data of the image based on the image data;
An input process for a person operating the receiving computer to input at least a part of the specified information ;
A computer program for executing
A port number of the software for displaying the composite image on the second display by the input of at least a part of the designation information made by the input means in the receiving computer is set in the communication device The display process is executed only when specified to be the same as
Computer program. A transmission-side computer having a display or connected to the display; a reception-side computer being a computer having a display; and the reception-side computer and a wireless LAN. A communication device capable of performing communication via a communication device,
The communication device is
Image data that is image data of one screen captured by dropping a frame from a display image that is an image displayed on a first display that is a display that the transmitting computer has or is connected to the transmitting computer Receiving means for receiving position data, which is data for specifying a position on the first display, of the pointer displayed on the first display from the transmitting computer at a predetermined timing;
Compression means for compressing the image data into a predetermined format;
Transmitting means for transmitting the compressed data and the position data to a receiving computer at predetermined time intervals using a wireless LAN function;
With
The receiving computer that has received the compressed data expands the compressed data into the image data, and combines the pointer with a position specified by the position data of the image based on the image data. The image is supposed to be displayed on a second display which is a display included in the image.
Communications system.

Images