WO2015012297A1 - Reception device, method, and computer program - Google Patents

Reception device, method, and computer program Download PDF

Info

Publication number
WO2015012297A1
WO2015012297A1 PCT/JP2014/069408 JP2014069408W WO2015012297A1 WO 2015012297 A1 WO2015012297 A1 WO 2015012297A1 JP 2014069408 W JP2014069408 W JP 2014069408W WO 2015012297 A1 WO2015012297 A1 WO 2015012297A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
image data
compressed data
compressed
display
Prior art date
Application number
PCT/JP2014/069408
Other languages
French (fr)
Japanese (ja)
Inventor
山本 正男
小林 進
Original Assignee
スカラ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by スカラ株式会社 filed Critical スカラ株式会社
Priority to JP2015528302A priority Critical patent/JP6485352B2/en
Publication of WO2015012297A1 publication Critical patent/WO2015012297A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • H04N21/43637Adapting the video stream to a specific local network, e.g. a Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4126The peripheral being portable, e.g. PDAs or mobile phones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/43615Interfacing a Home Network, e.g. for connecting the client to a plurality of peripherals

Definitions

  • the present application relates to a technique for transmitting moving image data to a receiving device using a wireless LAN from a transmitting device having a function of processing moving image data.
  • a digital video camera As a device having a function of processing moving image data, for example, there is a digital video camera.
  • the video camera generates moving image data.
  • Most video cameras record moving picture data on a recording medium built in the video camera, and in many cases, the moving picture data can be output to an external device by wire.
  • the display of the external device can be used as a display (monitor) of the video camera.
  • an external device and a video camera are connected wirelessly, the video caused by the trouble of connecting the video camera and the external device with a cable, the annoyance of the cable itself, the length of the cable, etc.
  • the mobile terminals that are now very popular can be external devices as described above.
  • the portable terminal includes a notebook personal computer, a smartphone, a tablet, and the like, but these are provided with a display, and most of them are equipped with a wireless LAN function.
  • An apparatus having a function of processing moving image data includes a computer such as a notebook personal computer. If an image displayed on a display of a notebook personal computer can be displayed on a display of a portable terminal such as another notebook personal computer, it is convenient in the following cases, for example.
  • Projectors are known for presentations at conferences. When giving a presentation, the presenter projects a desired image on a screen or the like from a projector connected to a notebook computer or the like. The audience attending the conference listens to the presentation of the presenter while viewing the projected image.
  • Each of the above examples is a system that can be realized by transmitting moving image data over a wireless LAN from a transmitting device having a function of processing moving image data to a receiving device including a display such as a portable terminal.
  • a transmitting device having a function of processing moving image data to a receiving device including a display such as a portable terminal.
  • a receiving device including a display such as a portable terminal.
  • the inventors of the present application tried to make such a product, further problems occurred. In the transmission / reception of data by a wireless LAN, a situation in which transmitted / received data is often damaged occurs. In such a case, if an unscheduled frame is mixed with a moving image with a reduced frame rate, the moving image becomes very unsightly.
  • the present invention is capable of transmitting moving image data over a wireless LAN from a transmitting device having a function of processing moving image data to a receiving device having a display such as a portable terminal.
  • the problem is to provide a practical technique that can prevent the problem from being unsightly.
  • the present inventor proposes the following invention in order to solve the above-mentioned problems.
  • the invention of the present application has a function of processing moving image data, and means for compressing image data, which is data for one screen appropriately extracted from the processed moving image data, into compressed data, And a transmission device including means for transmitting compressed data via a wireless LAN, and can communicate with the transmission device via a wireless LAN.
  • the receiving device includes a display, a receiving unit that receives the compressed data from the transmitting device as needed, a decompressing unit that decompresses the compressed data received by the receiving unit, and the image data before being compressed into the image data.
  • a determination unit that determines whether there is a change from the image data; an image based on the decompressed image data that has been determined by the determination unit to be unchanged from the original image data is displayed on the display; and the determination unit Display control means for controlling not to display an image based on the decompressed image data determined to have changed from the original image data on the display.
  • the receiving device receives moving image data from the transmitting device via a wireless LAN.
  • the moving image data received by the receiving device is a sequence of image data appropriately extracted from moving image data processed by the transmitting device.
  • the image data is image data for one screen, and is image data for one frame.
  • this corresponds to data that has been dropped appropriately from the original moving image data to be processed by the transmission device to the extent that there is no problem in transmitting at the transmission speed of the wireless LAN.
  • the image data sent from the transmission device via the wireless LAN is compressed by a predetermined format, for example, the JPEG method, and then sent to the reception device after being reduced in capacity. This restriction is not a problem in the sense that it can be used at least in the receiving apparatus of the present application.
  • the receiving device of the present application determines whether there is a change in the image data (including the meanings of both the decompressed image data and the decompressed image data) from the image data before the compressed data.
  • the receiving device of the present application basically displays the moving image data dropped on the frame as described above by the continuous image data on the display, but the unplanned image ( Further, the frame) is dropped from the data of the moving image that has been dropped. As a result, the number of frames of the moving image displayed on the display of the receiving device may be further reduced, but the unpleasant image (frame) is mixed with the moving image displayed on the display of the receiving device.
  • the receiving device of the present application is a technology that can transmit moving image data over a wireless LAN from a transmitting device having a function of processing moving image data to a receiving device having a display, and in particular, the display of the receiving device. It will provide practical technology that can keep the video you see on the screen from unsightly.
  • the present invention is very compatible with a technique using UDP (User Datagram Protocol) when transmitting data from a transmitting device to a receiving device.
  • UDP User Datagram Protocol
  • UDP is a protocol that allows one-to-many communication from a transmission device to a reception device, not just one-to-one. This protocol does not perform a so-called shake hand between the transmission device and the reception device, and has a characteristic that the communication speed is high.
  • This is one-to-many in the present invention in which image data is transmitted from the transmitting apparatus to the receiving apparatus, although the capacity has been reduced by compression, and in particular in many cases where the present invention is applied to presentations. If you need communication, it's just right.
  • communication using UDP differs from communication using TCP in that delivery confirmation is omitted, and data integrity is not guaranteed. Therefore, the process of further dropping unscheduled images (frames) from the damaged image data from the moving image data with dropped frames compensates for the disadvantages of UDP communication and emphasizes only the UDP communication store.
  • the receiving device of the present application includes a determination unit that determines whether there is a change in the image data before the compressed data.
  • a determination unit that determines whether there is a change in the image data before the compressed image data.
  • the determination unit determines that there is no change from the original image data, and obtains the compressed data by decompressing. If the image data is different from the planned size, it may be determined that there is a change from the original image data. This is a determination method in which it is assumed that there is no change in the image data when there is no change in the size of the image data.
  • the transmission device when the transmission device transmits the compressed data, the transmission device describes capacity information for specifying the size of the image data that is the source of the compressed data following the header in the header attached to the compressed data.
  • the determination unit may handle the size specified by the capacity information as the planned size of the image data.
  • the receiving apparatus determines the “scheduled” size of the image data, that is, the size of the reference image data. You must know. It can be determined in advance by a computer program or the like installed in advance in the transmission device and the reception device, but there may be a difference in the size of each image data.
  • the transmitting device writes the capacity information as described above in the header of data used to transmit the compressed data, and the receiving device determines the size of the image data specified by the capacity information as “scheduled” of the image data. If the size of each image data is different, the receiving apparatus determines whether or not the size of the image data has changed according to the size of the image data. This makes it possible to make a determination based on this, and it is not necessary to determine a reference for the size of image data in advance between the transmission device and the reception device. Whether or not the size of the image data has changed can be determined, for example, as follows. Prior to the description, the data structure of data to be transmitted including compressed data to be transmitted from the transmission device to the reception device will be described first.
  • the data sent from the transmission device to the reception device is generally a header including information indicating the compression format of the compressed data, a start block that follows the header, a start block that distinguishes the subsequent data portion from the header, and that follows the start block Is provided with a data portion corresponding to the compressed data itself and a stop block indicating the end of the data portion.
  • the data to be transmitted having the above-described data structure is generally divided into a plurality of packets having the same size and transmitted from the transmission device to the reception device.
  • the first packet often includes a header, a start block, and the first portion of the data portion, the second and subsequent packets each include a divided data portion, and the last packet includes The end part of the data part and the stop block are included.
  • the receiving apparatus can determine whether or not the size of the image data has changed using the following contents as a reference.
  • the receiving computer determines that the size of the image data has changed when the answer to the following contents is Yes, and the answer is No. It is determined that there is no change.
  • the size of data included in a packet is different from the size of data that has been determined in advance between the transmitting device and the receiving device or described in the header, and the packet includes a stop block.
  • Absent? C) Is information indicating the compression format of the compressed data included after the start block? If the above-mentioned C is made more universal, the transmitting device, when transmitting the compressed data, when information to be included in the header attached to the compressed data is included in the compressed data, It may be determined that there is a change from the original image data. That is, an example of information to be included in the header in this case is information indicating the compression format of the compressed data in the case C.
  • the determination means determines that the image data obtained by decompressing the compressed data has no change from the original image data when the compressed data has the same size as the planned size, and the compressed data is When it is different from the planned size, it may be determined that there is a change from the original image data.
  • This is a determination method in which it is assumed that there is no change in the image data when there is no change in the size of the compressed data. In the case described above, it is determined whether or not there is a change in the size of the image data on the basis of the size of the image data, and based on this, it is determined whether or not there is a change in the image data. In that case, the determination can be made only after decompressing the compressed data and returning it to the image data.
  • the transmitting device when transmitting the compressed data, the transmitting device describes capacity information for specifying the size of the compressed data following the header in a header attached to the compressed data.
  • the determination means may handle the size specified by the capacity information as the planned size of the compressed data.
  • the transmitting device includes determination data which is data irrelevant to the image data at a predetermined position of the image data, and the determination unit decompresses the compressed data and obtains the image
  • the determination data having the planned content exists at the planned position of the data, it is determined that there is no change from the original image data, and the image data obtained by decompressing the compressed data If the predetermined content does not exist at the planned position, it may be determined that there is a change from the original image data.
  • This is a determination method in which it is assumed that there is no change in the image data when the determination data of the predetermined content exists at the predetermined position of the image data.
  • the transmitting device when transmitting the compressed data, adds the determination data to the header of the compressed data following the header in the header attached to the compressed data.
  • the determination data specifying information for specifying whether or not the data is included is described, and the determination means sets the position specified by the determination data specifying information and the content to the planned position of the image data. In addition, it may be used as a reference when determining whether or not determination data having the scheduled content exists.
  • the receiving device In order to determine whether or not the determination data of the scheduled content exists at the scheduled position of the image data, the receiving device has a criterion as to what kind of data exists in the image data. You must know the location and the reference content.
  • the reference position and the reference content can be determined in advance by a computer program or the like installed in advance in the transmission device and the reception device, but depending on the type of image data to be handled, If only predetermined ones are used, it may be possible that the above-described determination cannot be made. Therefore, the transmitting apparatus writes the determination data specifying information as described above in the header of the data used for transmitting the compressed data, and the receiving apparatus specifies where and in the image data specified by the determining data specifying information. Such information as to whether or not the determination data is included can be used as a reference for determining whether or not determination data having the predetermined content exists at the predetermined position of the image data.
  • the transmission device includes determination data that is data irrelevant to the compressed data in a predetermined position of the compressed data, and the determination unit is arranged at a predetermined position of the compressed data.
  • the determination data having the planned content exists, it is determined that the image data obtained by decompressing the compressed data has no change from the original image data, and the compressed data is located at the planned position.
  • the determination data having the planned contents does not exist, it may be determined that the image data obtained by decompressing the compressed data has changed from the original image data.
  • the compressed data is sent from the transmitting device to the receiving device several times to several tens of times per second, and the receiving means performs the compression from the transmitting device several times to several tens of times per second. Data may be accepted. If the moving image has such a number of frames, a viewer who sees the moving image on the display of the receiving apparatus can recognize the moving image as a somewhat smooth moving image, and there is no difficulty in transmitting and receiving at the current wireless LAN transmission speed.
  • the receiving device is a computer (a device including an arithmetic device) having a display capable of communication via a wireless LAN, for example, a portable terminal.
  • the portable terminal includes at least a notebook computer, a smartphone, and a tablet.
  • the transmission device may process moving image data, and may be a computer (device including an arithmetic device) capable of wireless LAN communication.
  • portable terminals such as notebook computers, smartphones, and tablets are examples. However, this includes desktop computers and devices that do not include a display such as a video camera.
  • the inventor of the present application also proposes a method for producing the same effect as the receiving apparatus of the present application.
  • An example of the method has a function of processing moving image data, and means for making compressed data obtained by compressing image data, which is data for one screen appropriately extracted from moving image data to be processed, into a predetermined format
  • the compressed data is used in combination with a transmission device including a means for transmitting the compressed data via a wireless LAN, and can communicate with the transmission device via a wireless LAN.
  • a method executed by a receiving device having a display The method includes a receiving process executed by the receiving apparatus for receiving the compressed data from the transmitting apparatus as needed, a decompressing process for expanding the compressed data received in the receiving process, and compressed image data.
  • the inventor of the present application also proposes a computer program that produces the same effect as the receiving apparatus of the present application.
  • An example of the computer program has a function of processing moving image data, and means for compressing image data, which is data for one screen appropriately extracted from processed moving image data, into a predetermined format. And a means for transmitting the compressed data via a wireless LAN, in combination with the transmission device, so that communication with the transmitter via the wireless LAN can be performed.
  • the computer having a display accepts the compressed data from the transmission device as needed, the decompression process of decompressing the compressed data received in the acceptance process, and the image data as compressed data.
  • a determination process for determining whether there is a change from the previous image data, and no change from the original image data due to the determination process An image based on the determined expanded image data is displayed on the display, and an image based on the expanded image data determined to have changed from the original image data by the determination process is displayed on the display. And a display control process for performing control so as not to be executed.
  • the applicant of the present application also proposes a communication system as the same effect as the receiving apparatus of the present application.
  • the communication system has, for example, a function of processing moving image data, and means for compressing image data, which is data for one screen appropriately extracted from the processed moving image data, into a predetermined format.
  • a transmission device comprising: means for transmitting the compressed data via a wireless LAN; and a reception device adapted to perform communication via the wireless LAN with the transmission device;
  • the receiving device includes a display, a receiving unit that receives the compressed data from the transmitting device as needed, a decompressing unit that decompresses the compressed data received by the receiving unit, and the image Determining means for determining whether there is any change from the image data before the data is compressed data, and if there is no change from the original image data by the determining means An image based on the determined expanded image data is displayed on the display, and an image based on the expanded image data determined to have changed from the original image data by the determination unit is displayed on the display And a display control means for controlling to prevent the communication system.
  • FIG. 1 is a diagram illustrating an overview of a communication system according to a first embodiment.
  • the figure which shows the hardware constitutions of the transmission side computer contained in the communication system shown in FIG. The block diagram which shows the functional block formed inside the transmission side computer contained in the communication system shown in FIG.
  • the figure which shows the hardware constitutions of the communication apparatus contained in the communication system shown in FIG. The block diagram which shows the functional block formed in the inside of the communication apparatus contained in the communication system shown in FIG.
  • the figure which shows the hardware constitutions of the receiving computer contained in the communication system shown in FIG. The block diagram which shows the functional block formed in the inside of the receiving computer contained in the communication system shown in FIG.
  • FIG. The figure which shows the external appearance of the communication system of 2nd Embodiment. Sectional drawing for demonstrating the structure of the video camera contained in the communication system of 2nd Embodiment.
  • FIG. 1 shows an outline of a communication system in the first embodiment.
  • the communication system includes a transmission side computer 100, a communication device 200, and a plurality of reception side computers 300.
  • the communication apparatus 200 or a combination of the communication apparatus 200 and the transmission side computer 100 is a transmission apparatus in the present application
  • the reception side computer 300 is a reception apparatus in the present application.
  • the communication system in this embodiment is used for presentation at a conference, although not limited thereto.
  • the sending computer 100 and the communication device 200 are operated by a presenter (or an assistant thereof, the same shall apply hereinafter) giving a presentation
  • the receiving computer 300 is operated by an audience.
  • the receiving computer 300 may be private to the audience, or may be distributed or lent to the audience by a presenter or a collaborator of the presenter.
  • the sending computer 100 is a computer.
  • the sending computer 100 of this embodiment is a notebook computer provided with a display 101. Of course, the sending computer 100 may be connected to the external display 101 like a desktop computer.
  • the sending computer 100 also includes an input device 102. Although the input device 102 of this embodiment is a keyboard, the transmitting computer 100 may include other input devices such as a trackball, a mouse, and a touch panel in addition to or instead of the keyboard.
  • the transmitting computer 100 also includes several output terminals not shown.
  • the output terminal may be a known one, and in this embodiment, an analog output terminal (for example, an analog RGB terminal, an HDMI terminal, a DVI terminal, a display port, a thunderbolt terminal, etc.) is assumed to be present in the transmitting computer 100.
  • the sending computer 100 is equipped with known presentation software so that it can perform a presentation.
  • the presentation software is, for example, PowerPoint (trademark) manufactured by Microsoft Japan.
  • a display image which is an image used for the presentation, is displayed on the display 101, and the presenter performs the presentation while watching it.
  • the sending computer 100 includes hardware as shown in FIG.
  • the hardware includes a CPU 111, a ROM 112, a RAM 113, an interface 114, and a hard disk drive 115, which are connected to each other by a bus 116.
  • the CPU 111 is an arithmetic device that performs arithmetic operations. For example, the CPU 111 executes processing described later by executing a computer program recorded in the ROM 112 or the hard disk drive 115.
  • the sending computer 100 may execute various functions that can be normally performed by a notebook personal computer, such as sending and receiving e-mails, browsing the Internet, and document creation.
  • the sending computer 100 of this embodiment is also the same.
  • a computer program here is a computer program for functioning this transmission side computer 100 as a transmission side computer of this invention.
  • This computer program may be preinstalled in the transmitting computer 100 or may be installed afterwards.
  • the computer program may be installed on the transmission-side computer 100 via a predetermined recording medium such as a memory card, or via a communication line such as a LAN or the Internet.
  • the ROM 112 records computer programs and data necessary for the CPU 111 to execute processing to be described later. The same applies to the hard disk drive 115, and some or all of the computer program and data may be recorded.
  • the hard disk drive stores computer programs for executing various functions that can be normally performed by a notebook personal computer, such as sending and receiving e-mails, browsing the Internet, and document creation.
  • the RAM 113 provides a work area necessary for the CPU 111 to perform processing.
  • data generated as a result of processing performed by the CPU 111 can be recorded in the RAM 113.
  • a part of the RAM 113 serves as a frame buffer described later.
  • the interface 114 exchanges data between the CPU 111 and the RAM 113 connected via the bus 116 and the outside.
  • the interface 114 is connected to the input device 102 described above and an analog output terminal (not shown).
  • the operation content from the input device 102 is input from the interface 114, and the data output from the interface 114 to the analog output terminal is output from the analog output terminal to the outside.
  • a display 101 is connected to the interface 114, and data for controlling a display image displayed on the display 101 is output via the interface 114.
  • a function block as shown in FIG. 3 is generated in the transmitting computer 100.
  • the following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the transmission-side computer 100. May be.
  • An operation signal analysis unit 121, a control unit 122, and a display image data generation unit 123 are generated inside the transmission-side computer 100.
  • the operation signal analysis unit 121 analyzes the content of the operation signal input from the input device 102.
  • the operation signal related to this embodiment there is a signal related to the operation of the presentation software.
  • the operation signal analysis unit 121 specifies that the operation signal specifies the above-described contents. , Analyze its contents.
  • the operation content analyzed by the operation signal analysis unit 121 is sent to the control unit 122.
  • the control unit 122 executes software for presentation.
  • the control unit 122 executes the software for presentation based on the information received from the operation signal analysis unit 121 regarding the content of the operation signal input by the presenter from the input device 102.
  • a signal regarding the execution result is sent to the display image data generation unit 123.
  • the display image data generation unit 123 generates display image data, which is data about a display image to be displayed on the display 101, based on a signal about the execution result of the presentation software received from the control unit 122. It is.
  • the signal generated by the display image data generation unit 123 is sent to the display 101 and an analog output terminal (not shown).
  • the signal sent to the analog output terminal is an analog signal for the display image currently displayed on the display 101. This analog signal is a moving image signal and is a signal in which frames are continuous.
  • the communication device 200 is connected to the transmitting computer 100, and receives an image substantially the same as the display image received from the transmitting computer 100 and displayed on the display 101 of the transmitting computer 100. Data to be displayed on the display is transmitted to a plurality of receiving computers 300.
  • the communication device 200 is a computer.
  • the communication device 200 also includes an input device 202.
  • the input device 202 of this embodiment is a numeric keypad, a keyboard, a mouse, a touch panel, or the like can be used as the input device 202.
  • the communication device 200 also includes an input terminal (not shown).
  • the communication device 200 has a wireless LAN function.
  • the wireless LAN function is realized by a wireless LAN communication unit (not shown).
  • the wireless LAN is Wi-Fi (trademark) in this embodiment, although not limited thereto. Wi-Fi is a standard by default, and at the same time, 253 computers (when 8-bit data is used for identification data) or 65533 computers (when 16-bit data is used for identification data) And can communicate wirelessly.
  • the wireless LAN communication unit uses UDP (User Datagram Protocol) to send data described below to the receiving computer 300.
  • UDP User Datagram Protocol
  • the communication device 200 includes hardware as shown in FIG.
  • the hardware includes a CPU 211, ROM 212, RAM 213, and interface 214, which are connected to each other by a bus 216.
  • the functions of the CPU 211, ROM 212, RAM 213, interface 214, and bus 216 are basically the same as those of the CPU 111, ROM 112, RAM 113, and interface 114 included in the transmitting computer 100.
  • the RAM 213 stores a computer program and data used for performing processing to be described later executed by the communication device 200. This computer program is not necessarily limited to this, but is preinstalled in the communication apparatus 200.
  • the communication device 200 includes an analog input terminal as an input terminal.
  • the analog input terminal of this embodiment is connected to the analog output terminal of the transmitting computer 100 by an analog cable 100A.
  • the analog input terminal receives an analog signal for the display image generated by the display image data generation unit 123 of the transmission-side computer 100 and output from the analog output terminal via the analog cable 100A.
  • the interface 214 exchanges data between the CPU 211, RAM 213, and the like connected via the bus 216 and the outside.
  • the interface 214 is connected to the above-described input device 202 and an analog input terminal (not shown).
  • the operation content from the input device 202 and the data from the analog input terminal are input from the interface 214.
  • compressed data to be sent to each receiving computer 300 is sent from the interface 214 to the wireless LAN communication unit as will be described later.
  • a functional block as shown in FIG. 5 is generated in the communication device 200.
  • the following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the communication device 200. Also good.
  • an operation signal analysis unit 221, a control unit 222, an image data generation unit 223, a compression unit 224, and a wireless LAN control unit 225 are generated.
  • the operation signal analysis unit 221 analyzes the content of the operation signal input from the input device 202.
  • a numerical value that is information for designating a designation signal described later is input from the input device 202.
  • the operation signal analysis unit 221 analyzes the numerical value specified by the operation signal.
  • the operation content analyzed by the operation signal analysis unit 221, that is, a numerical value is sent to the control unit 222. Note that the information regarding the numerical value may be input not from the input device 202 but from the input device 102 of the transmission-side computer 100.
  • the control unit 222 determines a numerical value for designating software in the receiving computer 300 that processes the compressed data sent from the communication device 200 to each receiving computer 300 as described below.
  • This numerical value is a port number or a part thereof in this embodiment.
  • the port number designated by the control unit 222 may be a numerical value itself input from the input device 202, or may be a numerical value obtained by performing some operation on the numerical value.
  • the port number determined by the control unit 222 is sent to the wireless LAN control unit 225.
  • the image data generation unit 223 receives an analog signal for a display image input from an analog input terminal.
  • the image data generation unit 223 generates image data from the input analog signal.
  • the analog signal for the display image is a moving image signal, and as shown in FIG.
  • the signals for the frames are continuous.
  • One convex in the signal shown in FIG. 6 is a signal for one frame, that is, one screen of a display image.
  • the image data generation unit 223 extracts a signal for every other screen from the analog signal to perform a work called frame dropping. For example, if the original analog signal is 30 fps, as shown by the arrow in FIG. 6, if one screen signal for every three is extracted, the moving image created by the image data obtained thereby becomes 10 fps. .
  • Such frame drop processing is performed in consideration of the limitation of the communication speed by the wireless LAN.
  • the image data generated by the image data generation unit 223 is sent to the compression unit 224 every time it is created.
  • the compression unit 224 compresses the received image data.
  • the image data may be compressed in any format, for example, in the MPEG format, but in this embodiment, compression in the JPEG format is performed. Data obtained by compressing image data is compressed data.
  • the compression unit 224 generates compressed data, it sends it to the wireless LAN control unit 225.
  • the wireless LAN control unit 225 receives the port number from the control unit 222 and the compressed data from the compression unit 224 as described above.
  • the wireless LAN control unit 225 sends it to the wireless LAN communication unit, and causes the wireless LAN communication unit to send it to the receiving computer 300.
  • the wireless LAN control unit 225 divides the data to be transmitted, such as compressed data and position data, into packets by an existing method.
  • a header is added to the leading end of the packet, and the header includes the IP address, the capacity of the data including the compressed data and the position data transmitted from these, and the reception of the software installed in each receiving computer 300.
  • the port number or the like for specifying software for processing the compressed data is written.
  • the receiving computer 300 is a portable computer.
  • the receiving computer 300 is, for example, a notebook computer, or a smartphone or a tablet.
  • the smartphone is an iPhone manufactured and sold by Apple Japan LLC, and the tablet is an ipad manufactured and sold by the company.
  • the receiving computer 300 includes a display 301.
  • the receiving computer 300 also includes an input device 302.
  • the input device 302 can be configured by a touch panel integrated with the display 301 as is well known.
  • the receiving-side computer 300 has a wireless LAN function.
  • the wireless LAN function is realized by a wireless LAN communication unit (not shown).
  • the wireless LAN is Wi-Fi in this embodiment, although not limited to this.
  • the wireless LAN communication unit of the receiving computer 300 can communicate with the wireless LAN communication unit of the communication device 200.
  • the receiving computer 300 has hardware as shown in FIG.
  • the hardware includes a CPU 311, a ROM 312, a RAM 313, an interface 314, and a hard disk drive 315, which are connected to each other by a bus 316.
  • the functions of the CPU 311, ROM 312, RAM 313, interface 314, hard disk drive 315, and bus 316 are basically the same as the functions of the CPU 111, ROM 112, RAM 113, interface 114, hard disk drive 115, and bus 116 in the sending computer 100.
  • the ROM 312 or the hard disk drive 315 stores computer programs necessary for realizing the following processing executed by the receiving computer 300.
  • the ROM 312 or the hard disk drive 315 stores software necessary for executing processing of enlargement (for example, pinch) and recording of a display image (for example, print screen) described later.
  • the interface 314 of the receiving computer 300 is connected to the above-described wireless LAN communication unit mounted on the receiving computer 300 so that the wireless LAN communication unit receives the compressed data received from the communication device 200. It has become.
  • the interface 314 is connected to the input device 302 so as to receive operation contents from the input device 302. This operation content includes at least designation information described later.
  • the interface 314 is also connected to the display 301 so as to send data for displaying a predetermined display image on the display 301.
  • a functional block as shown in FIG. 8 is generated in the receiving computer 300.
  • the following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the receiving-side computer 300. May be.
  • An operation signal analysis unit 321, a control unit 322, a designation information analysis unit 323, an identity determination unit 324, an expansion unit 325, and a display image data generation unit 326 are generated inside the reception computer 300.
  • the operation signal analysis unit 321 analyzes the content of the operation signal input from the input device 302.
  • the operation signal related to this embodiment includes designation information.
  • the designation information designates at least a part of a numerical value for determining which software installed in the receiving computer 300 processes the compressed data received by the receiving computer 300 as will be described later. It is.
  • This numerical value is sent to the control unit 322.
  • the control unit 322 determines a numerical value for determining which software installed in the receiving computer 300 should process the compressed data received by the receiving computer 300.
  • This numerical value may be the numerical value itself indicated by the operation content input from the operation signal analysis unit 321, or may be a numerical value obtained as a result of performing some operation on the numerical value.
  • a numerical value for determining which software installed in the receiving computer 300 is to process the compressed data received by the receiving computer 300 is determined. It has become so.
  • This numerical value is sent to the designation information analysis unit 323.
  • the designation information analysis unit 323 receives the header and the compressed data packet transmitted from the wireless LAN communication unit of the communication apparatus 200 and received by the wireless LAN communication unit of the receiving computer 300 via the interface 314 each time. It is like that.
  • the designation information analysis unit 323 reads the information written in the header of the compressed data packet when receiving them.
  • the designated information analysis unit 323 receives the port number in the read information and the compressed data received by the receiving computer 300 sent from the control unit 322, which one is installed in the receiving computer 300.
  • a numerical value for deciding whether to process by software is compared.
  • the designation information analysis unit 323 sends the compressed data packet received by the receiving computer 300 to the identity determination unit 324.
  • the designation information analysis unit 323 also sends to the identity determination unit 324 capacity information for specifying the capacity of the compressed data read from the header, together with the compressed data packet.
  • the designation information analysis unit 323 may combine the packets into the original compressed data.
  • the designation information analysis unit 323 is installed in the receiving computer 300 with the port number in the header of the compressed data packet and the compressed data received from the control unit 322 and received by the receiving computer 300.
  • the packet of the compressed data received by the receiving computer 300 is not sent to the identity determination unit 324. Yes.
  • the port number in the header of the compressed data packet in the specified information analysis unit 323 and the compressed data received by the receiving computer 300 sent from the control unit 322 are installed in the receiving computer 300.
  • the process of comparing with the numerical value for determining which software is to be processed is performed only when the first compressed data is received or every predetermined time interval such as every 10 minutes. It doesn't matter. In this embodiment, it is assumed that the processing is performed only when the first compressed data is received.
  • the identity determination unit 324 determines whether or not there is a change from the original image data before being compressed into image data.
  • the identity determination unit 324 determines that there is no change from the original image data before being compressed into the image data
  • the identity determination unit 324 sends the compressed data to the decompression unit 325, and If it is determined that there is a change from the original image data before being compressed into data, the compressed data is not sent to the decompression unit 325.
  • the decompression unit 325 receives compressed data from the identity determination unit 324
  • the decompression unit 325 decompresses the compressed data and returns it to image data.
  • the decompression unit 325 sends image data obtained by decompressing the compressed data to the display image data generation unit 326.
  • the display image data generation unit 326 displays an image based on the image data (data for one frame) on the display 301 based on the image data received from the decompression unit 325. Every time image data is received, the display image data generation unit 326 causes the display 301 to display an image (display image) based on the image data. Since the frame dropping process has already been performed as described above, the display image displayed on the display 301 of the receiving computer 300 is basically the same as the display image displayed on the display 101 of the transmitting computer 100 (approximately). Although it is the same in real time, the number of frames is somewhat lower than the display image displayed on the display 101 of the transmitting computer 100.
  • the frame of the display image displayed on the display 301 is displayed.
  • the rate may be partially lower than the frame rate when the sending computer 100 drops frames.
  • the presenter In order to use this communication system, the presenter first connects the analog output terminal of the transmitting computer 100 and the analog input terminal of the communication device 200 with the analog cable 100A. The presenter then operates the input device 202 of the communication device 200 to process the compressed data sent to each receiving-side computer 300, regardless of whether the above work is performed or not.
  • the software in the receiving computer 300 that inputs the numerical value designating the software in the receiving computer 300 and processes the compressed data sent to the receiving computer 300 to the receiving computer 300 owned by the audience. Enter a part of the numerical value that specifies.
  • the audience inputs the numerical value by operating the input device 302.
  • the numerical value of the port number is determined by adding a predetermined numerical value to the default numerical value of 8255.
  • the presenter operates the input device 202 to input 8255 + predetermined numerical value (for example, 1000) + a numerical value (for example, 10) that is input to an audience to be permitted to receive and decompress compressed data by the receiving computer 300.
  • a numerical value obtained by adding a predetermined numerical value (for example, 1000) and a numerical value (for example, 10) that is input to the audience to be permitted to receive and decompress the compressed data by the receiving computer 300 is input.
  • the control unit 222 determines that the port number is 9265.
  • 8255 + a predetermined numerical value (for example, 1000) is input in advance in the computer program installed in the receiving computer 300 of the audience, and the audience operates the input device 302.
  • the input numerical value is further added by the control unit 322.
  • 8255 + predetermined numerical value (for example, 1000) is set so as not to be seen from the audience.
  • the presenter informs the correct number (which is 10 as described above) to be entered by the audience in some way only to the audience who may participate in the presentation and receive and decompress the compressed data. . Only the audience who knows the correct notification will be able to obtain a numerical value of 9265, which is a numerical value that specifies the software at the receiving computer 300 that will process the compressed data sent to the receiving computer 300.
  • software in the receiving computer 300 that processes the compressed data sent to the receiving computer 300 by a predetermined numerical value (for example, 1000) invisible to the user in addition to the default numerical value 8255 of the port number.
  • the numerical value specifying the software in the receiving computer 300 is used. It's getting harder.
  • the numerical value for the determined port number is sent from control unit 222 to wireless LAN control unit 225.
  • the numerical value specifying the software in the receiving computer 300 that processes the compressed data sent to the receiving computer 300 is sent to the designation information analysis unit 323.
  • the presenter starts the presentation.
  • the presenter operates the input device 102, and the control unit 122 executes known presentation software according to the operation content from the input device 102.
  • a signal regarding the execution result is sent to the display image data generation unit 123.
  • the display image data generation unit 123 generates data about an image to be displayed on the display 101 of the transmission side computer 100. This data is written to the frame buffer each time and sent to the display 101 each time. In this case, the number of frames is, for example, 30 fps. Based on this data, an image used for presentation is displayed on the display 101. This image is a display image.
  • the display image data generation unit 123 generates an analog signal for the display image currently displayed on the display 101 and sends it to the analog output terminal.
  • An analog signal that is a moving image signal and a signal in which frames are continuous is sent from the analog output terminal to the analog input terminal of the communication apparatus 200 via the analog cable 100A.
  • the following processing in the communication device 200 is basically performed automatically.
  • An analog signal for a display image input from the analog input terminal is sent to the image data generation unit 223.
  • the image data generation unit 223 performs a frame dropping operation from an analog signal in which signals for frames are continuous, for example, a signal of 10 fps. If the speed is 10 fps, ten image signals corresponding to one screen are generated per second.
  • the image data generated by the image data generation unit 223 is sent to the compression unit 224 every time it is created. This frame rate ranges from several times to several tens of times per second, although it depends on the speed of wireless data transmission from the communication device 200 to the receiving computer 300.
  • the compression unit 224 compresses the received image data to obtain compressed data.
  • the image data is compressed in the JPEG format.
  • the size of the compressed data is smaller than the size of the image data.
  • the wireless LAN control unit 225 divides the compressed data into packets and attaches a header to the leading end of the packets.
  • the header is written with its own IP address, capacity information which is information indicating the capacity of compressed data transmitted from these, the above-mentioned port number, and the like. Packets of these headers and a large number of compressed data are sent to the wireless LAN communication unit, and are sent from the wireless LAN communication unit to each receiving computer 300.
  • a series of packets of compressed data starting from the header is received by the wireless LAN communication unit of the receiving computer 300.
  • the received data is sent to the designation information analysis unit 323.
  • the designation information analysis unit 323 reads the above-described information written in the header.
  • the designation information analyzing unit 323 is installed in the receiving computer 300 with the port number written in the header of the compressed data packet and the compressed data received from the control unit 322 and received by the receiving computer 300.
  • the numerical value for determining which software is to be processed is compared. If the numerical values match, the designation information analysis unit 323 sends the compressed data packet received by the receiving computer 300 to the identity determination unit 324 together with the capacity information.
  • the identity determination unit 324 determines whether the image data obtained when the compressed data is expanded has changed from the original image data before compression. When it is determined that the image data obtained when the compressed data is expanded has not changed from the original image data before compression, the identity determination unit 324 sends the compressed data to the expansion unit 325, If it is determined that it has changed, the compressed data is not sent to the decompression unit 325.
  • the identity determination unit 324 obtains image data obtained when the compressed data is expanded. If the size of the compressed data received from the designated information analysis unit 323 is not the same as the size specified by the capacity information unless the original image data before compression is changed, the compressed data is expanded It may be determined that the obtained image data has changed from the original image data before compression. In this embodiment, the identity determination unit 324 determines whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression as follows. It is like that. First, as a premise, in this embodiment, data sent from the communication device 200 to the receiving computer 300 is as shown in FIG. As shown in FIG.
  • each of the data at each stage marked with P is data for one packet. These data are the same size except for the last packet P. For example, except for the last packet P, the size of each packet P is 1460 bytes.
  • the start of the first packet P indicates that the data before it is the header D1, and the data after it is the data to be transmitted (compressed data D3 in this embodiment). There is a block D2.
  • the last packet P has a stop block D4 indicating that the previous data is the compressed data D3. Further, the header D4 includes data D11 indicating the compression format of the compressed data.
  • the data D11 is a character string “JPEG” indicating that the compressed data is compressed in the JPEG format.
  • the identity determination unit 324 in this embodiment uses the following criteria A to C to determine whether the image data obtained when the compressed data is expanded from the original image data before compression: Determine whether or not. When the following content is used as a reference, the identity determination unit 324 determines that the size of the image data has changed when the answer to the reference is Yes for any of the following criteria A to C If the answer is No, it is determined that there is no change in the size of the image data.
  • the identity determination unit 324 determines whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression based on at least one of the following criteria: In this embodiment, all of the following criteria are used to determine whether the image data obtained when decompressing the compressed data has changed from the original image data before compression. It is used as a reference for judging. That is, if the answer to all of the following three criteria is No, the identity determination unit 324 determines that there is no change in the size of the image data, but the answer to at least one of the following three criteria: Is Yes, it is determined that the image data obtained when the compressed data is expanded has changed from the original image data before compression.
  • A) Is the size of the compressed data D3 between the start block D2 and the stop block D4 different from the size of the data described in the header D1?
  • B) The size of data included in a packet P is different from the size of data described in the header D1, and the packet P does not include the stop block D4.
  • the above-mentioned criterion A corresponds to the above-mentioned criterion as to whether or not the size of the received compressed data D3 is the same as the size specified by the capacity information.
  • the criterion B is to determine whether or not there is any change in the size of the compressed data D3 by monitoring whether or not each packet P is missing or missing data. Whether or not the packet P includes the stop block D4 is used as a criterion for determination.
  • the last packet P including the stop block D4 has a smaller data amount than other packets P. This is because, since it is a normal state, it should be determined that no data is lost or lost even if the data amount of the packet P including the stop block D4 is smaller than the data amount of the other packets P. .
  • the capacity information includes information for specifying the data capacity of each packet P except for the last packet P, and based on this, the packet P except for the last packet P has no missing or missing data.
  • the criterion of C is that if the data D11 indicating the compression format of the compressed data D3 is included after the start block D2, the data D11 that should originally be at the head of the header D1 should not exist. Based on the fact that it should be determined that there has been a data change in the compressed data D3. In any case, as described above, when the identity determination unit 324 determines that the image data obtained when decompressing the compressed data has not changed from the original image data before compression, If the compressed data is sent to the decompression unit 325 and it is determined that the compressed data has changed, the compressed data is not sent to the decompression unit 325.
  • the decompressing unit 325 decompresses the compressed data and returns it to image data.
  • the decompression unit 325 sends image data obtained by decompressing the compressed data to the display image data generation unit 326.
  • the display image data generation unit 326 Based on the image data received from the decompression unit 325, the display image data generation unit 326 causes the display 301 to display an image based on the image data every time the image data is received.
  • the display image displayed on the display 301 of the receiving computer 300 is basically the same as the display image displayed on the display 101 of the transmitting computer 100 (same in real time), but the number of frames is This is somewhat lower than the display image displayed on the display 101 of the transmitting computer 100.
  • the image data used for displaying the display image is only the image data determined to be unchanged from the original image data before compression, and the image data determined to be changed from the original image data before compression Is not used to display a display image.
  • the display image data generation unit 326 normally displays an image based on the image data obtained by decompressing the compressed data every time the receiving computer 300 receives the compressed data.
  • the image based on the compressed image data determined that the image data obtained when the compressed data is decompressed by the sex determining unit 324 is not changed from the original image data before compression is displayed on the display 301. Do not show. In that case, the previous image is continuously displayed on the display 301 until the next image is displayed on the display 301.
  • the audience can listen to the presentation provided by the presenter while viewing the display image displayed on the display 301. Thereby, it is not necessary to distribute the distribution material for presentation on paper. If the display image is difficult to see because, for example, small characters are displayed on the display image, the audience can enlarge the display image using a function such as pinch if the receiving computer 300 is equipped. By doing so, small characters can be clearly recognized, and a portion of the displayed image that the user particularly wants to focus on can be enlarged and viewed. In addition, the audience sees the display image displayed on the display 301, and if the receiving computer 300 has the display image to be stored at the timing when the display image is displayed on the display 301, the audience displays the display image such as a print screen.
  • the mobile terminals of this time which are scheduled to be used as the receiving computer 300, are usually provided with functions for enlarging the display image and saving the display image.
  • a computer program for causing the computer according to the invention to function as the receiving computer 300 may be provided.
  • the size of the compressed data is written in the header attached to the head of the compressed data when the compressed data is transmitted from the transmitting computer 100 to the receiving computer 300. It is determined whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression depending on whether or not it matches the size specified by the capacity information. It was decided. In this method, the size of the compressed data specified by the capacity information is used as a reference for determining whether the size of the compressed data has changed.
  • the receiving computer can determine whether the size of the compressed data has changed without depending on the capacity information, depending on whether the compressed data matches the size indicated by the reference.
  • the identity determination unit 324 determines whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression as follows, for example. It may be. Also in this case, it is assumed that data sent from the communication apparatus 200 to the receiving computer 300 has a data structure as shown in FIG.
  • the identity determination unit 324 according to Modification 1 uses the following criteria D to F to determine whether the image data obtained when decompressing the compressed data has changed from the original image data before compression: Determine whether. When the following content is used as a reference, the identity determination unit 324 determines that the size of the image data has changed when the answer to the reference is Yes for any of the following criteria D to F. If the answer is No, it is determined that there is no change in the size of the image data.
  • the identity determination unit 324 determines whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression based on at least one of the following criteria: It is also possible to use all of the following criteria to determine whether the image data obtained when decompressing the compressed data has changed from the original image data before compression. It can also be used as a reference.
  • D) Is the size of the compressed data D3 between the start block D2 and the stop block D4 different from the size of data determined in advance between the communication device 200 and the receiving computer 300?
  • E) The size of data included in a packet P is different from the size of data determined in advance between the communication apparatus 200 and the receiving computer 300, and the packet P does not include the stop block D4. ?
  • F) Is information (data D11 indicating the compression format of the compressed data D3 in this embodiment) that should be included in the header D1 after the start block D2 originally included?
  • the wireless LAN control unit 225 of the communication device 200 writes capacity information together with other information in a header attached to the head of the compressed data in order to transmit the compressed data.
  • the wireless LAN control unit 225 of the communication apparatus 200 according to the second modification writes the above-described other information and determination data specifying information instead of the capacity information in the header attached to the head of the compressed data in order to transmit the compressed data. It is.
  • the determination data specifying information is information for specifying where and what determination data is included in the compressed data.
  • the determination data is data that can be used to determine whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression, depending on whether or not it is at the position where it should be.
  • the identity determination unit 324 of the reception-side computer 300 determines whether or not the image data obtained when the compressed data is expanded has changed from the original image data before compression.
  • the specific method is as follows.
  • the identity determination unit 324 receives the determination data specifying information from the designation information analysis unit 323 that has read it from the header.
  • the determination data specifying information is information for specifying where and what determination data is included in the compressed data.
  • the identity determination unit 324 has the data specified by the determination data specification information at the position specified by the determination data specification information received from the compressed data designation information analysis unit 323 with respect to the compressed data. It is determined whether or not to do so.
  • the identity determination unit 324 determines that the compressed data has not changed, that is, the image data obtained when the compressed data is expanded has not changed from the original image data before compression. On the other hand, if there is no data for determination of the planned content at the planned position of the compressed data, the identity determination unit 324 has changed the compressed data, that is, when the compressed data is expanded. It is determined that the obtained image data has changed from the original image data before compression. For example, in the determination data specifying information, “data“ 00000000 ”is written in the compressed data for each XX byte from the top. ".
  • the identity determination unit 324 determines whether or not such data exists in the compressed data, so that the image data obtained when the compressed data is expanded is obtained from the original image data before compression. It can be determined whether or not it has changed. As shown in this example, the determination data may be plural. When there are a plurality of determination data, the determination data need not all be the same.
  • Modification 3 The same relationship as that of Modification 1 with respect to the first embodiment is also established between Modification 2 and Modification 3.
  • the compressed data is changed based on the information that is specified by the determination data specifying information and where the content of the determination data is included in the compressed data. It was decided to determine whether or not there was.
  • the determination data specifying information indicating the reference is written in the header and transmitted from the communication device 200 to the receiving computer 300.
  • information serving as a reference for determining whether or not there is a change in the compressed data such as where the compressed data includes what kind of determination data is included, is stored in advance. Arrangements are made between the communication device 200 and the receiving computer 300.
  • the information is given to the identity determination unit 324 in advance. By doing so, even if there is no determination data specifying information, the identity determination unit 324 of the receiving computer 300 has the determination data of the planned contents at the planned position of the compressed data. It is possible to determine whether or not the compressed data has changed, and further whether or not the image data obtained by decompressing the compressed data has changed from the original image data before compression. .
  • the identity determination unit 324 of the reception-side computer 300 determines whether or not the size of the compressed data has changed, and the image data obtained when the compressed data is decompressed is the original data before compression. It is determined whether or not the image data has changed.
  • the identity determination unit 324 of the reception-side computer 300 according to the modified example 4 changes the image data from the original image data before compression depending on whether or not the size of the decompressed image data has changed. It is determined whether or not the error occurred.
  • the wireless LAN control unit 225 writes capacity information in a header attached to the head of the compressed data in order to transmit the compressed data.
  • this capacity information is different from the capacity information that specifies the size of the compressed data in the case of the first embodiment, and before the compression that is the source of the compressed data to which the header is attached. This is for specifying the size of the image data.
  • the size of the image data before compression is transmitted from the image data generation unit 223 or the compression unit 224 to the wireless LAN control unit 225 so that the writing can be performed.
  • the functional blocks formed in the reception-side computer 300 of the fourth modification are as shown in FIG. Compared with the functional block shown in FIG. 8, this functional block is obtained by replacing the identity determining unit 324 and the extending unit 325.
  • the designation information analysis unit 323 receives the port number written in the header of the compressed data packet and the compressed data received by the receiving computer 300 sent from the control unit 322. A numerical value for determining which software installed in the computer 300 is used for processing is compared, and if the numerical values match, the compressed data is sent to the identity determination unit 324. .
  • the compressed data destination is not the identity determination unit 324 but the expansion unit 325.
  • the decompressing unit 325 decompresses the compressed data and returns it to the image data as in the first embodiment.
  • the decompression unit 325 according to the modification 4 sends the image data to the identity determination unit 324.
  • the identity determination unit 324 receives capacity information in advance from the designation information analysis unit 323 that has read it from the header. The identity determination unit 324 determines whether or not the image data has changed from the original image data before compression, based on the size of the image data specified by the capacity information. If the identity determination unit 324 determines that the image data has not changed from the original image data before compression, the identity determination unit 324 sends the image data to the display image data generation unit 326, and the image data is converted to the original image data before compression. If it is determined that a change has occurred, the image data is not sent to the display image data generation unit 326.
  • the same modification as the modification to the first modification with respect to the first embodiment is performed on the fourth modification.
  • the communication device 200 and the receiving computer 300 have a predetermined agreement regarding the size of the image data, and the identity determination unit 324 of the receiving computer 300 has the reference in advance. ing.
  • the identity determination unit 324 of the receiving computer 300 matches the image data with the size indicated by the reference. Whether or not there is a change in the size of the compressed data can be determined depending on whether or not the compressed data is received.
  • ⁇ Modification 6> The capacity information of the first embodiment is replaced with determination data specifying information, and the identity determination unit 324 of the receiving computer 300 is not compressed whether the size of the compressed data is the same as the size specified by the capacity information.
  • the second modification it is determined whether or not there is a change in the compressed data depending on whether or not determination data having a predetermined content exists at a predetermined position of the data.
  • the sixth modification the same modification as that obtained when the first embodiment is modified into the second modification is added to the fifth modification. That is, the identity determination unit 324 according to the modification 6 determines whether the image data has the same size as that specified by the capacity information, but does not determine whether the image data has a predetermined position. It is determined whether or not there is a change in the image data depending on whether or not the data exists.
  • Modified example 7 is the same as the modified example added to the modified example 6 when the first embodiment is transformed into the modified example 1 or when the modified example 4 is transformed into the modified example 5. It is. In the modified example 7, it is determined in advance between the communication apparatus 200 and the receiving computer 300 where and what kind of determination data is included in the image data, and the determined reference is used as the receiving computer. 300 identity determination units 324 have in advance. As a result, even if the determination data specifying information is not written in the header and sent from the communication apparatus 200 to the receiving computer 300, the identity determining unit 324 of the receiving computer 300 can determine whether the above-mentioned standard is included. Whether or not the size of the image data has changed can be determined based on whether or not the determination data as indicated by the reference exists at the indicated position.
  • the communication system includes a video camera 400, a recording device 500, and a receiving computer 300.
  • the receiving computer 300 is, for example, a portable terminal, like the receiving computer 300 of the first embodiment.
  • the video camera 400 is a transmitting device referred to in the present invention
  • the receiving computer 300 is a receiving device referred to in the present invention.
  • the receiving computer 300 is used as a monitor of the video camera 400.
  • the video camera 400 is configured as shown in FIG.
  • the video camera has a housing 401 that can be held by hand.
  • a hole 401 ⁇ / b> A is formed at the tip of the housing 401.
  • An imaging element 402 that is, for example, a CCD or a CMOS is provided inside the housing 401.
  • the image sensor 402 captures image light that enters the housing 401 through the hole 401A.
  • the imaging element 402 performs imaging and generates a moving image signal.
  • a magnifying lens 403 is provided between the image sensor 402 and the hole 401A.
  • the magnifying lens 403 enlarges image light.
  • a light source 404 for example, an LED is disposed inside the housing 401.
  • the light source 404 supplies illumination light necessary for imaging with the image sensor 402.
  • the illumination light is supplied through the hole 401A.
  • the focal point is adapted to the inner portion of the hole 401A.
  • an enlarged image of the object positioned inside the hole 401 ⁇ / b> A is captured by the image sensor 402 without shaking.
  • the video camera 400 also includes a control circuit 405.
  • the control circuit 405 is a circuit that controls the image sensor 402.
  • the control circuit 405 is connected to the image sensor 402 via a connection line 406, and controls the image sensor 402 via the connection line 406.
  • the control circuit 405 is configured to receive a moving image signal generated by the image sensor 402 from the image sensor 402.
  • the control circuit 405 is connected to the recording apparatus 500 via an output line 408 inside the tube 407.
  • the recording device 500 records a moving image signal sent from the control circuit 405 via the output line 408, and includes, for example, a hard disk drive.
  • the control circuit 405 has the same hardware configuration as that included in the communication device 200 of the first embodiment, and includes a CPU, a ROM, a RAM, an interface, and a bus. The functions of the CPU, ROM, RAM, interface, and bus are all the same as those in the first embodiment.
  • the control circuit 405 has a function of performing communication via a wireless LAN.
  • the interface of the control circuit 405 is connected to a connection line 406 so as to receive a moving image signal from the image sensor 402.
  • the interface of the control circuit 405 is connected to the output line 408 so as to send a moving image signal to the recording apparatus 500.
  • a functional block as shown in FIG. 12 is generated inside the video camera.
  • the following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the video camera 400. Also good.
  • the functional blocks generated in the video camera 400 are obtained by omitting some of the functional blocks generated in the communication device 200. Specifically, the image data generating unit 223, the compression unit 224, and This is a wireless LAN control unit 225.
  • the functions of the image data generation unit 223, the compression unit 224, and the wireless LAN control unit 225 are the same as those generated in the communication device 200 of the first embodiment.
  • the image data generation unit 223 receives a signal regarding the moving image captured by the image sensor 402 input from the image sensor 402 (this signal is not limited to this, but is an analog signal as in the first embodiment).
  • the image data is generated based on this.
  • the image data generation method is the same as that in the image data generation unit 223 of the first embodiment.
  • the compression unit 224 receives the image data from the image data generation unit 223, and compresses the received image data into compressed data each time the image data is received.
  • the image data can be compressed by the same method as that performed by the compression unit of the first embodiment.
  • the wireless LAN control unit 225 divides the received compressed data into packets, attaches a header to the packet, and sends the data to the wireless LAN communication unit.
  • the processing is basically the same as that performed by the wireless LAN control unit 225 of the first embodiment, except that the wireless LAN control unit 225 of the second embodiment writes information regarding the port number in the header. I won't do that. Packets for the header and the compressed data are sent from the wireless LAN communication unit to each receiving computer 300.
  • the receiving-side computer 300 of the second embodiment has the same hardware as shown in FIG. 7 as in the first embodiment.
  • the functions of the identity determination unit 324, the decompression unit 325, and the display image data generation unit 326 in the second embodiment are the same as those provided in the first embodiment. The only difference is that the compressed data is sent to the identity determination unit 324 in the case of the first embodiment, but it is connected to the interface in the case of the second embodiment.
  • the wireless LAN communication unit is the wireless LAN communication unit.
  • the usage method and operation of the communication system of the second embodiment basically conform to the usage method and operation of the first embodiment.
  • the usage method and operation of this communication system of the second embodiment are the same as the usage method and operation of the first embodiment, except for the part related to the technique of showing the display image only to the audience who wants to show using the port number. be equivalent to.
  • the video camera 400 takes an image.
  • the image sensor 402 of the video camera 400 generates a moving image signal.
  • the moving image signal is sent to the recording apparatus 500 via the connection line 406, the control circuit 405, and the output line 408, and is recorded by the recording apparatus 500.
  • the moving image signal is also sent to the image data generation unit 223 in the video camera 400.
  • the image data generation unit 223 performs a frame dropping operation from an analog signal in which signals for frames are continuous.
  • the image data generated by the image data generation unit 223 is sent to the compression unit 224 every time it is created. Whenever the image data is received, the compression unit 224 compresses the received image data to obtain compressed data.
  • the compression unit 224 Each time the compression unit 224 generates compressed data, it sends it to the wireless LAN control unit 225.
  • the wireless LAN control unit 225 divides the compressed data into packets and attaches a header to the leading end of the packets. Packets of these headers and a large number of compressed data are sent to the wireless LAN communication unit, and are sent from the wireless LAN communication unit to each receiving computer 300.
  • a series of packets of compressed data starting from the header is received by the wireless LAN communication unit of the receiving computer 300.
  • a series of packets with compressed data starting from the header is sent to the identity determination unit 324.
  • the identity determination unit 324 determines whether the image data obtained when the compressed data is expanded has changed from the original image data before compression. The method is the same as that in the first embodiment.
  • the identity determination unit 324 sends the compressed data to the expansion unit 325, If it is determined that it has changed, the compressed data is not sent to the decompression unit 325.
  • the decompressing unit 325 When receiving the compressed data from the identity determining unit 324, the decompressing unit 325 decompresses the compressed data and returns it to image data.
  • the decompression unit 325 sends image data obtained by decompressing the compressed data to the display image data generation unit 326.
  • the display image data generation unit 326 Based on the image data received from the decompression unit 325, the display image data generation unit 326 causes the display 301 to display an image based on the image data every time the image data is received. This is substantially the same regardless of the difference in the number of frames from the moving image captured by the image sensor 402 of the video camera 400.
  • An operator of the video camera 400 can use the display 301 of the reception-side computer 300 as a monitor of the video camera 400. For example, the operator can shift the position of the video camera 400 while viewing the image displayed on the display 301 to capture the image. Can be adjusted.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

Provided is a practical technology with which it is possible to transmit video data via a wireless LAN from a transmission device having the function to process video data to a reception device provided with a display, such as a portable terminal. A transmission-side computer (100) transmits analog data, which are data of a display image displayed on a display (101), to a communication device (200) via an analog cable (101A). The communication device (200) has the function to establish wireless LAN communication by means of Wi-Fi. Compressed data, which are obtained by subjecting the analog data to time-lapse processing and then subjecting the data of each of the remaining frames (data of one image) to JPEG compression, are sent to the reception-side computer (300) having a similar function as the communication device (200). The reception-side computer (300) displays the display image on the display (301) of the reception-side computer (300) only using the image data which is obtained by decompressing the compressed data and which have no changes in size.

Description

受信装置、方法、コンピュータプログラムReceiving apparatus, method, computer program
 本願は動画のデータを処理する機能を有する送信装置から、受信装置に動画のデータを無線LANを用いて送信する技術に関する。 The present application relates to a technique for transmitting moving image data to a receiving device using a wireless LAN from a transmitting device having a function of processing moving image data.
 動画のデータを処理する機能を有する装置としては、例えば、デジタルのビデオカメラがある。ビデオカメラは動画のデータを生成する。大抵のビデオカメラは、それに内蔵する記録媒体に動画のデータを記録し、多くの場合は有線で動画のデータを外部の機器に出力できるようになっている。
 ところで、外部の機器がディスプレイを備えている場合には、特にビデオカメラにディスプレイがない場合においては、その外部の機器のディスプレイをビデオカメラのディスプレイ(モニタ)として利用可能である。しかも、外部の機器とビデオカメラを無線で結んだ場合には、ビデオカメラと外部の機器をケーブルで接続する手間や、ケーブルが存在すること自体による鬱陶しさや、ケーブルの長さ等に起因するビデオカメラと外部の機器との位置関係の制約がないから、便利なことこの上ない。
 そして、今や大いに普及した携帯端末は、上述の如き外部の機器になりうる。携帯端末には、ノート型パソコン、スマートフォン、タブレット等が含まれるが、これらはディスプレイ備えており、また、無線LANの機能が実装されていることが殆どである。
As a device having a function of processing moving image data, for example, there is a digital video camera. The video camera generates moving image data. Most video cameras record moving picture data on a recording medium built in the video camera, and in many cases, the moving picture data can be output to an external device by wire.
By the way, when an external device is provided with a display, especially when the video camera does not have a display, the display of the external device can be used as a display (monitor) of the video camera. In addition, when an external device and a video camera are connected wirelessly, the video caused by the trouble of connecting the video camera and the external device with a cable, the annoyance of the cable itself, the length of the cable, etc. Since there is no restriction on the positional relationship between the camera and external devices, nothing is more convenient.
The mobile terminals that are now very popular can be external devices as described above. The portable terminal includes a notebook personal computer, a smartphone, a tablet, and the like, but these are provided with a display, and most of them are equipped with a wireless LAN function.
 また、動画のデータを処理する機能を有する装置としては、コンピュータ、例えばノート型パソコンがある。そして、あるノート型パソコンのディスプレイに表示されている画像を、他のノート型パソコンを始めとする携帯端末のディスプレイに表示させることができれば例えば、以下の場合便利である。
 会議におけるプレゼンテーションでは、プロジェクタが知られている。プレゼンテーションを行う場合、プレゼンテーターは、ノート型パソコン等と接続されたプロジェクタから所望の画像をスクリーン等に投影する。会議に出席している聴衆は、投影された画像を見ながらプレゼンテーターのプレゼンテーションを聞き、見る。ここで、プレゼンテーターが操作するノート型パソコンのディスプレイに表示されている画像を、聴衆が持つ携帯端末のディスプレイに表示させることができれば便利である。そうすれば、紙の配布資料は必要なくなるし、また、プロジェクタにより投影された画像から遠い人が、特にその画像に小さい字が含まれている場合にその画像を認識するのに苦労する、ということもなくなる。これは別にプレゼンテーションへの応用のみならず、観劇を行う、或いはコンサートを見る、或いはスポーツを観戦する来場者に、一つのノート型パソコン等から、来場者に対して所望の情報発信を行うような応用も可能である。上述のような仕組みは言ってみれば、「規模の小さな、簡易版のテレビ放送システム」のようなものであり、そのようなものが実現できれば、まったく新しい需要を喚起できる可能性がある。
An apparatus having a function of processing moving image data includes a computer such as a notebook personal computer. If an image displayed on a display of a notebook personal computer can be displayed on a display of a portable terminal such as another notebook personal computer, it is convenient in the following cases, for example.
Projectors are known for presentations at conferences. When giving a presentation, the presenter projects a desired image on a screen or the like from a projector connected to a notebook computer or the like. The audience attending the conference listens to the presentation of the presenter while viewing the projected image. Here, it is convenient if the image displayed on the display of the notebook computer operated by the presenter can be displayed on the display of the portable terminal held by the audience. That way, paper handouts are no longer needed, and people far from the image projected by the projector have a hard time recognizing the image, especially if the image contains small letters. Nothing will happen. This is not only applied to presentations, but it is also possible to send desired information to visitors from a single notebook computer, etc. to visitors who watch theater, watch concerts, or watch sports. Application is also possible. Speaking of the mechanism as described above, it is like a “small scale, simplified television broadcasting system”, and if such a system can be realized, there is a possibility that a completely new demand can be generated.
 上述のいずれの例も、動画のデータを処理する機能を有する送信装置から、携帯端末を始めとするディスプレイを備える受信装置に、動画のデータを無線LANで送ることにより実現可能なシステムである。
 しかし、そのようなことを実現するにも制約がある。
 それは、一般的な動画のデータは、現存する無線LANが持つ回線速度では、送るのが難しいという点である。そのために、送信する動画のフレームレートを下げることが必要になる。
 しかしながら、そのような製品を本願発明者は試作してみたものの、更なる課題が生じた。無線LANによるデータの送受信では送受信されるデータが破損する事態がしばしば生じる。そのような場合に、フレームレートを下げた動画に、予定されていないフレームが交じると、その動画は大変見苦しいものとなる。
Each of the above examples is a system that can be realized by transmitting moving image data over a wireless LAN from a transmitting device having a function of processing moving image data to a receiving device including a display such as a portable terminal.
However, there are also restrictions on realizing such things.
That is, it is difficult to send general moving image data at the line speed of an existing wireless LAN. Therefore, it is necessary to lower the frame rate of the moving image to be transmitted.
However, although the inventors of the present application tried to make such a product, further problems occurred. In the transmission / reception of data by a wireless LAN, a situation in which transmitted / received data is often damaged occurs. In such a case, if an unscheduled frame is mixed with a moving image with a reduced frame rate, the moving image becomes very unsightly.
 本願発明は、動画のデータを処理する機能を有する送信装置から、携帯端末を始めとするディスプレイを備える受信装置に、動画のデータを無線LANで送ることのできる、特に受信装置のディスプレイで見る動画が見苦しくないようにできる実用的な技術を提供することをその課題とする。 The present invention is capable of transmitting moving image data over a wireless LAN from a transmitting device having a function of processing moving image data to a receiving device having a display such as a portable terminal. The problem is to provide a practical technique that can prevent the problem from being unsightly.
 本願発明者は、上述の課題を解決するために、以下のような発明を提案する。
 本願発明は、動画のデータを処理する機能を有するとともに、処理される動画のデータから適宜抽出された1画面分のデータである画像データを所定の形式に圧縮した圧縮データとする手段と、前記圧縮データを無線LANを介して送信する手段と、を備えている送信装置、と組合せて用いられるものであり、前記送信装置と、無線LANを介しての通信を行うことができるようになっている受信装置である。
 そして受信装置は、ディスプレイと、前記送信装置から前記圧縮データを随時受付ける受付手段と、前記受付手段で受付けた前記圧縮データを伸長する伸長手段と、前記画像データに圧縮データとされる前の前記画像データから変化がないか判定する判定手段と、前記判定手段により元の画像データから変化がないと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示するとともに、前記判定手段により元の画像データから変化があったと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示しないように制御する表示制御手段と、を有する。
 この受信装置は、送信装置から無線LANにて動画のデータを受取る。受信装置が受取る動画のデータは、送信装置で処理される動画のデータから適宜抜き出された画像データを連続させたものである。画像データは1画面分の画像のデータであり、1フレーム分の画像のデータである。これは、送信装置で処理の対象となる元々の動画のデータから要するに、無線LANの送信速度で送るに問題のない程度に適当にコマ落ちさせたデータに相当する。
 更に、送信装置から無線LANで送られる画像データは、所定の形式、例えばJPEG方式で圧縮することによりその容量を小さくしてから、送信装置から受信装置へ送られるので、無線LANの送信速度についての制約は、本願の受信装置においては、少なくとも実用できるという意味では問題はない。
 また、本願の受信装置は、画像データ(伸長した後の、又は伸長して得られる画像データの双方の意味を含む。)に圧縮データとされる前の画像データから変化がないか判定する判定手段と、判定手段により元の画像データから変化がないと判定された伸長された画像データに基づく画像をディスプレイに表示するとともに、判定手段により元の画像データから変化があったと判定された伸長された画像データに基づく画像をディスプレイに表示しないように制御する表示制御手段とを備えている。
 したがって、本願の受信装置は、基本的には、画像データの連続により、上述のようにコマ落ちさせた動画のデータをそのディスプレイに表示させるものではあるものの、破損した画像データによる予定しない画像(フレーム)は更に、そのコマ落ちさせた動画のデータから落とされることになる。それにより、受信装置のディスプレイで表示される動画のフレーム数は更に落ちる可能性はあるものの、それと、予定しない画像(フレーム)が受信装置のディスプレイで表示される動画に混在することによる見苦しさを本願発明者が評価したところによれば、フレーム数を更に落としても予定しない画像(フレーム)を除いた動画の方が、見るものに与える印象が良いということが判明した。
 したがって、本願の受信装置は、動画のデータを処理する機能を有する送信装置から、ディスプレイを備える受信装置に、動画のデータを無線LANで送ることのできる技術であり、また、特に受信装置のディスプレイで見る動画が見苦しくないようにできる実用的な技術を提供するものとなる。
 ところで、本願発明は、送信装置から受信装置に対してデータを送信するときに、UDP(User Datagram Protocol)を用いる技術と大変親和性が高い。UDPは、それと並んでよく知られている通信のプロトコルであるTCP(Transmission Control Protocol)とは異なり、送信装置から受信装置に対して、一対一のみではなく、一対多の通信を行えるプロトコルである。そして、このプロトコルは、送信装置と受信装置との間でいわゆるシェイクハンドを行わないものであり、通信速度が早いという特性を有する。これは、圧縮して容量が小さくなったとは言え画像データを、送信装置から受信装置へ送信する本願発明に、そして、特にプレゼンテーションに本願発明が応用される場合の多くがそうであるような一対多の通信が必要な場合にまさに向いている。しかしながら、UDPを用いた通信では、TCPを用いた通信とは異なり、送達確認が省略されるので、データの完全性が保証されない。したがって、破損した画像データによる予定しない画像(フレーム)を、コマ落ちさせた動画のデータから更に落とすという処理は、UDPによる通信の欠点を補いUDPによる通信のリ店のみを強調するものとなる。
The present inventor proposes the following invention in order to solve the above-mentioned problems.
The invention of the present application has a function of processing moving image data, and means for compressing image data, which is data for one screen appropriately extracted from the processed moving image data, into compressed data, And a transmission device including means for transmitting compressed data via a wireless LAN, and can communicate with the transmission device via a wireless LAN. Receiving device.
The receiving device includes a display, a receiving unit that receives the compressed data from the transmitting device as needed, a decompressing unit that decompresses the compressed data received by the receiving unit, and the image data before being compressed into the image data. A determination unit that determines whether there is a change from the image data; an image based on the decompressed image data that has been determined by the determination unit to be unchanged from the original image data is displayed on the display; and the determination unit Display control means for controlling not to display an image based on the decompressed image data determined to have changed from the original image data on the display.
The receiving device receives moving image data from the transmitting device via a wireless LAN. The moving image data received by the receiving device is a sequence of image data appropriately extracted from moving image data processed by the transmitting device. The image data is image data for one screen, and is image data for one frame. In short, this corresponds to data that has been dropped appropriately from the original moving image data to be processed by the transmission device to the extent that there is no problem in transmitting at the transmission speed of the wireless LAN.
Furthermore, the image data sent from the transmission device via the wireless LAN is compressed by a predetermined format, for example, the JPEG method, and then sent to the reception device after being reduced in capacity. This restriction is not a problem in the sense that it can be used at least in the receiving apparatus of the present application.
In addition, the receiving device of the present application determines whether there is a change in the image data (including the meanings of both the decompressed image data and the decompressed image data) from the image data before the compressed data. And an image based on the decompressed image data determined to be unchanged from the original image data by the determining means and displayed on the display, and decompressed as determined by the determining means to have changed from the original image data. Display control means for controlling the image based on the image data not to be displayed on the display.
Therefore, the receiving device of the present application basically displays the moving image data dropped on the frame as described above by the continuous image data on the display, but the unplanned image ( Further, the frame) is dropped from the data of the moving image that has been dropped. As a result, the number of frames of the moving image displayed on the display of the receiving device may be further reduced, but the unpleasant image (frame) is mixed with the moving image displayed on the display of the receiving device. According to the evaluation by the present inventor, it has been found that a moving image excluding images (frames) that are not planned even if the number of frames is further reduced gives a better impression to what to see.
Therefore, the receiving device of the present application is a technology that can transmit moving image data over a wireless LAN from a transmitting device having a function of processing moving image data to a receiving device having a display, and in particular, the display of the receiving device. It will provide practical technology that can keep the video you see on the screen from unsightly.
By the way, the present invention is very compatible with a technique using UDP (User Datagram Protocol) when transmitting data from a transmitting device to a receiving device. Unlike TCP (Transmission Control Protocol), which is a well-known communication protocol alongside it, UDP is a protocol that allows one-to-many communication from a transmission device to a reception device, not just one-to-one. This protocol does not perform a so-called shake hand between the transmission device and the reception device, and has a characteristic that the communication speed is high. This is one-to-many in the present invention in which image data is transmitted from the transmitting apparatus to the receiving apparatus, although the capacity has been reduced by compression, and in particular in many cases where the present invention is applied to presentations. If you need communication, it's just right. However, communication using UDP differs from communication using TCP in that delivery confirmation is omitted, and data integrity is not guaranteed. Therefore, the process of further dropping unscheduled images (frames) from the damaged image data from the moving image data with dropped frames compensates for the disadvantages of UDP communication and emphasizes only the UDP communication store.
 本願の受信装置は、上述のように、画像データに圧縮データとされる前の画像データから変化がないか判定する判定手段を備えている。
 判定手段が、画像データに圧縮データとされる前の画像データから変化がないかをどのように判定するかについては、特に制限がない。
 例えば、前記判定手段は、圧縮データを伸長して得られた前記画像データが予定されていた大きさと同じ場合には、元の画像データから変化がないと判定し、圧縮データを伸長して得られた前記画像データが予定されていた大きさと異なる場合には、元の画像データから変化があったと判定するようになっていても良い。これは、画像データの大きさに変化がないことをもって、画像データに変化がないと見做すという判定手法である。
 この場合、前記送信装置は、前記圧縮データを送信する場合に前記圧縮データに付されるヘッダに当該ヘッダに続く前記圧縮データの元となった画像データの大きさを特定する容量情報を記載するようになっており、前記判定手段は、前記容量情報で特定される大きさを、前記画像データの予定されていた大きさとして扱うようになっていても良い。上述のように、画像データが予定されていた大きさと異なるか否かを判定するためには、受信装置は、画像データの「予定されていた」大きさ、つまり基準となる画像データの大きさを把握していなければならない。それは、送信装置と受信装置に予めインストールされているコンピュータプログラム等によって予め決定しておくことも可能であるが、各画像データの大きさにそもそも相違が生じることもある。そこで、送信装置が、圧縮データを送信するために用いるデータのヘッダに上述の如き容量情報を書き込むこととし、受信装置がその容量情報により特定される画像データの大きさを、画像データの「予定されていた」大きさとして用いることとすれば、各画像データの大きさに相違があっても、受信装置は、画像データの大きさに変化が生じたか否かを、画像データの大きさに基いて判定できるようになるし、また、送信装置と受信装置の間で予め、画像データの大きさについての基準を取決めておく必要がなくなる。
 画像データの大きさに変化があったか否かは、例えば、以下のようにして判定することができる。その説明に先立ち、送信装置から受信装置に送られることになる圧縮データを含む送信対象となるデータのデータ構造をまず説明する。送信装置から受信装置に送られるデータは一般に、圧縮データの圧縮形式を示す情報を含むヘッダ、ヘッダの後に続く、その後に続くデータ部とヘッダとを区別するスタートブロック、スタートブロックの後に続く、本願では圧縮データそのものに相当するデータ部、データ部の終わりを示すストップブロックを備えている。そして、上述のデータ構造を持つ送信対象となるデータは、一般に、同じ大きさの複数のパケットに分割して、送信装置から受信装置に送信される。最初のパケットには多くの場合、ヘッダとスタートブロックと、データ部の最初の部分が含まれ、2つ目以降のパケットには、分割されたデータ部がそれぞれ含まれ、最後のパケットには、データ部の終りの部分とストップブロックとが含まれる(なお、最後から2つ目のパケットにデータ部のデータがぴったり収まった場合には、最後のパケットにはデータ部が含まれないことになる。)。このようなデータ構造のデータを受取った場合、受信装置は、以下の内容を基準として用いて、画像データの大きさに変化があったか否かを判定することができる。以下の内容を基準とするとき、受信側コンピュータは、以下の内容に対する回答がYesの場合には、画像データの大きさに変化があったと、その回答がNoの場合には画像データの大きさに変化がないと判定する。
 A)スタートブロックとストップブロックの間にあるデータ部のデータの大きさが、送信装置と受信装置の間で予め決定されていた、或いはヘッダに記載されていたデータの大きさと異なる?
 B)あるパケットに含まれるデータの大きさが、送信装置と受信装置の間で予め決定されていた、或いはヘッダに記載されていたデータの大きさと異なり、且つそのパケットにストップブロックが含まれていない?
 C)スタートブロック以降に、圧縮データの圧縮形式を示す情報が含まれている?
 上記Cをより普遍化するのであれば、前記送信装置は、前記圧縮データを送信する場合に前記圧縮データに付されるヘッダに含まれるべき情報が、前記圧縮データに含まれているときに、元の画像データから変化があると判定するようになっていてもよい、ということになる。つまり、この場合のヘッダに含まれるべき情報の一例が、上記Cの場合の圧縮データの圧縮形式を示す情報である。
As described above, the receiving device of the present application includes a determination unit that determines whether there is a change in the image data before the compressed data.
There is no particular limitation on how the determination means determines whether there is no change from the image data before the compressed image data.
For example, when the image data obtained by decompressing the compressed data has the same size as the planned size, the determination unit determines that there is no change from the original image data, and obtains the compressed data by decompressing. If the image data is different from the planned size, it may be determined that there is a change from the original image data. This is a determination method in which it is assumed that there is no change in the image data when there is no change in the size of the image data.
In this case, when the transmission device transmits the compressed data, the transmission device describes capacity information for specifying the size of the image data that is the source of the compressed data following the header in the header attached to the compressed data. The determination unit may handle the size specified by the capacity information as the planned size of the image data. As described above, in order to determine whether or not the image data is different from the planned size, the receiving apparatus determines the “scheduled” size of the image data, that is, the size of the reference image data. You must know. It can be determined in advance by a computer program or the like installed in advance in the transmission device and the reception device, but there may be a difference in the size of each image data. Therefore, the transmitting device writes the capacity information as described above in the header of data used to transmit the compressed data, and the receiving device determines the size of the image data specified by the capacity information as “scheduled” of the image data. If the size of each image data is different, the receiving apparatus determines whether or not the size of the image data has changed according to the size of the image data. This makes it possible to make a determination based on this, and it is not necessary to determine a reference for the size of image data in advance between the transmission device and the reception device.
Whether or not the size of the image data has changed can be determined, for example, as follows. Prior to the description, the data structure of data to be transmitted including compressed data to be transmitted from the transmission device to the reception device will be described first. The data sent from the transmission device to the reception device is generally a header including information indicating the compression format of the compressed data, a start block that follows the header, a start block that distinguishes the subsequent data portion from the header, and that follows the start block Is provided with a data portion corresponding to the compressed data itself and a stop block indicating the end of the data portion. The data to be transmitted having the above-described data structure is generally divided into a plurality of packets having the same size and transmitted from the transmission device to the reception device. The first packet often includes a header, a start block, and the first portion of the data portion, the second and subsequent packets each include a divided data portion, and the last packet includes The end part of the data part and the stop block are included. (Note that if the data of the data part fits perfectly in the second packet from the end, the data part is not included in the last packet. .) When receiving data having such a data structure, the receiving apparatus can determine whether or not the size of the image data has changed using the following contents as a reference. When the following contents are used as a reference, the receiving computer determines that the size of the image data has changed when the answer to the following contents is Yes, and the answer is No. It is determined that there is no change.
A) Is the data size of the data part between the start block and the stop block different from the data size previously determined between the transmission device and the reception device or described in the header?
B) The size of data included in a packet is different from the size of data that has been determined in advance between the transmitting device and the receiving device or described in the header, and the packet includes a stop block. Absent?
C) Is information indicating the compression format of the compressed data included after the start block?
If the above-mentioned C is made more universal, the transmitting device, when transmitting the compressed data, when information to be included in the header attached to the compressed data is included in the compressed data, It may be determined that there is a change from the original image data. That is, an example of information to be included in the header in this case is information indicating the compression format of the compressed data in the case C.
 或いは、前記判定手段は、前記圧縮データが予定されていた大きさと同じ場合には、前記圧縮データを伸長して得られる画像データに元の画像データから変化がないと判定し、前記圧縮データが予定されていた大きさと異なる場合には元の画像データから変化があったと判定するようになっていても良い。これは、圧縮データの大きさに変化がないことをもって、画像データに変化がないと見做すという判定手法である。上述の場合には、画像データの大きさを基準として画像データの大きさに変化があったか否かを判定し、それに基いて、画像データに変化があったか否かを判定することとしていた。その場合には、圧縮データを伸長して画像データに戻してからでないとその判定を行うことができない。圧縮データの大きさに変化がないことをもって、画像データに変化がないと見做すというこの手法によれば、圧縮データを伸長する前に、画像データに変化があったか否かを判定することも可能である。圧縮データの大きさに変化があったのであれば、その圧縮データは伸長する必要がない。
 この場合、前記送信装置は、前記圧縮データを送信する場合に前記圧縮データに付されるヘッダに当該ヘッダに続く前記圧縮データの大きさを特定する容量情報を記載するようになっており、前記判定手段は、前記容量情報で特定される大きさを、前記圧縮データの予定されていた大きさとして扱うようになっていても良い。ヘッダに画像データの大きさについての容量情報を記載する場合と同様の理屈で、各圧縮データの大きさにそもそも相違がある場合に対応できるようになるし、また、送信装置と受信装置の間で予め、圧縮データの大きさについての基準を取決めておく必要がなくなる。
Alternatively, the determination means determines that the image data obtained by decompressing the compressed data has no change from the original image data when the compressed data has the same size as the planned size, and the compressed data is When it is different from the planned size, it may be determined that there is a change from the original image data. This is a determination method in which it is assumed that there is no change in the image data when there is no change in the size of the compressed data. In the case described above, it is determined whether or not there is a change in the size of the image data on the basis of the size of the image data, and based on this, it is determined whether or not there is a change in the image data. In that case, the determination can be made only after decompressing the compressed data and returning it to the image data. According to this method of assuming that there is no change in the image data when there is no change in the size of the compressed data, it is also possible to determine whether the image data has changed before decompressing the compressed data. Is possible. If there is a change in the size of the compressed data, the compressed data need not be expanded.
In this case, when transmitting the compressed data, the transmitting device describes capacity information for specifying the size of the compressed data following the header in a header attached to the compressed data. The determination means may handle the size specified by the capacity information as the planned size of the compressed data. The same reasoning as when the capacity information about the size of the image data is described in the header, it becomes possible to cope with the case where there is a difference in the size of each compressed data, and between the transmitting device and the receiving device. Thus, it is not necessary to determine a standard for the size of the compressed data in advance.
 前記送信装置は、前記画像データの所定の位置に、前記画像データとは無関係なデータである判定用データを含めるようになっており、前記判定手段は、圧縮データを伸長して得られた画像データの予定された位置に、予定されていた内容の前記判定用データが存在する場合には、元の画像データから変化がないと判定し、圧縮データを伸長して得られた前記画像データの予定された位置に、予定されていた内容前記判定用データが存在しない場合には、元の画像データから変化があったと判定するようになっていてもよい。これは、画像データの予定された位置に、予定された内容の判定用データが存在することをもって、画像データに変化がないと見做すという判定手法である。
 この場合、前記送信装置は、前記圧縮データを送信する場合に前記圧縮データに付されるヘッダに当該ヘッダに続く前記圧縮データの元となった画像データのどこに、どのような前記判定用データを含めたかを特定するための判定用データ特定情報を記載するようになっており、前記判定手段は、前記判定用データ特定情報で特定される位置と、内容を、画像データの予定された位置に、予定されていた内容の判定用データが存在するか否か判定する際の基準として用いるようになっていてもよい。画像データの予定された位置に、予定された内容の判定用データが存在するか否かを判定するためには、受信装置は、画像データのどこに、どのようなデータが存在するかという基準となる位置と、基準となる内容を把握していなければならない。この基準となる位置と、基準となる内容は、送信装置と受信装置に予めインストールされているコンピュータプログラム等によって予め決定しておくことも可能であるが、扱われる画像データの種類によってはそれが予め決められたものだけであると、上述の如き判定を行えない場合が生じることも考えられる。そこで、送信装置が、圧縮データを送信するために用いるデータのヘッダに上述の如き判定用データ特定情報を書き込むこととし、受信装置がその判定用データ特定情報によって特定される画像データのどこに、どのような前記判定用データを含めたかという情報を、画像データの予定された位置に、予定された内容の判定用データが存在するかどうかの判定の基準に用いることができるようになるから、扱われる画像データの種類に起因して、画像データの大きさに変化が生じたか否かの判定ができなくなる、という事態を避けられるし、また送信装置と受信装置の間で予め、画像データのどこにどのような内容のデータを含めておくかということについての取決めをしておく必要もなくなる。
 或いは、前記送信装置は、前記圧縮データの所定の位置に、前記圧縮データとは無関係なデータである判定用データを含めるようになっており、前記判定手段は、圧縮データの予定された位置に、予定されていた内容の前記判定用データが存在する場合には、その圧縮データを伸長して得られる画像データに元の画像データから変化がないと判定し、圧縮データの予定された位置に、予定されていた内容の前記判定用データが存在しない場合には、その圧縮データを伸長して得られる画像データに元の画像データから変化があったと判定するようになっていてもよい。これは、画像データでなく、圧縮データの予定された位置に、予定された判定用データが存在することをもって、画像データに変化がないと見做すという判定手法である。この手法によれば、圧縮データを伸長して画像データとする前に、画像データに変更があったか否かの判定を行える。画像データに変更があったと見做された場合には、その圧縮データは伸長する必要がない。
 この場合、前記送信装置は、前記圧縮データを送信する場合に前記圧縮データに付されるヘッダに当該ヘッダに続く前記圧縮データのどこに、どのような前記判定用データを含めたかを特定するための判定用データ特定情報を記載するようになっており、前記判定手段は、前記判定用データ特定情報で特定される位置と、内容を、圧縮データの予定された位置に、予定されていた内容の判定用データが存在するか否か判定する際の基準として用いるようになっていても良い。扱われる画像データの種類、或いは圧縮データの種類に起因して、画像データに変化が生じたか否かの判定ができなくなる、という事態を避けられるし、また送信装置と受信装置の間で予め、圧縮データのどこにどのような内容のデータを含めておくかということについての取決めをしておく必要もなくなる。
The transmitting device includes determination data which is data irrelevant to the image data at a predetermined position of the image data, and the determination unit decompresses the compressed data and obtains the image When the determination data having the planned content exists at the planned position of the data, it is determined that there is no change from the original image data, and the image data obtained by decompressing the compressed data If the predetermined content does not exist at the planned position, it may be determined that there is a change from the original image data. This is a determination method in which it is assumed that there is no change in the image data when the determination data of the predetermined content exists at the predetermined position of the image data.
In this case, when transmitting the compressed data, the transmitting device adds the determination data to the header of the compressed data following the header in the header attached to the compressed data. The determination data specifying information for specifying whether or not the data is included is described, and the determination means sets the position specified by the determination data specifying information and the content to the planned position of the image data. In addition, it may be used as a reference when determining whether or not determination data having the scheduled content exists. In order to determine whether or not the determination data of the scheduled content exists at the scheduled position of the image data, the receiving device has a criterion as to what kind of data exists in the image data. You must know the location and the reference content. The reference position and the reference content can be determined in advance by a computer program or the like installed in advance in the transmission device and the reception device, but depending on the type of image data to be handled, If only predetermined ones are used, it may be possible that the above-described determination cannot be made. Therefore, the transmitting apparatus writes the determination data specifying information as described above in the header of the data used for transmitting the compressed data, and the receiving apparatus specifies where and in the image data specified by the determining data specifying information. Such information as to whether or not the determination data is included can be used as a reference for determining whether or not determination data having the predetermined content exists at the predetermined position of the image data. It is possible to avoid a situation in which it is impossible to determine whether or not the size of the image data has changed due to the type of image data to be displayed. There is no need to make arrangements for what kind of data to include.
Alternatively, the transmission device includes determination data that is data irrelevant to the compressed data in a predetermined position of the compressed data, and the determination unit is arranged at a predetermined position of the compressed data. When the determination data having the planned content exists, it is determined that the image data obtained by decompressing the compressed data has no change from the original image data, and the compressed data is located at the planned position. When the determination data having the planned contents does not exist, it may be determined that the image data obtained by decompressing the compressed data has changed from the original image data. This is a determination method in which it is assumed that there is no change in the image data when the predetermined determination data exists at a predetermined position of the compressed data instead of the image data. According to this method, it is possible to determine whether or not there has been a change in the image data before decompressing the compressed data into image data. If it is assumed that the image data has changed, the compressed data need not be expanded.
In this case, when transmitting the compressed data, the transmitting device specifies where and what kind of the determination data is included in the compressed data following the header in the header attached to the compressed data. The determination data specifying information is described, and the determining means sets the position specified by the determination data specifying information and the content at the planned position of the compressed data. It may be used as a reference for determining whether or not determination data exists. Due to the type of image data to be handled or the type of compressed data, it is possible to avoid a situation in which it is not possible to determine whether or not a change has occurred in the image data. There is no need to make an arrangement about where and what kind of data is included in the compressed data.
 前記圧縮データは、1秒間に数回~数十回前記送信装置から前記受信装置に送られるようになっており、前記受付手段は、1秒間に数回~数十回前記送信装置から前記圧縮データを受付けるようになっていても良い。
 この程度のフレーム数の動画であれば、受信装置のディスプレイで動画を見る者が動画をある程度滑らかな動画として認識でき、また、現行の無線LANの送信速度で送受信を行うにも無理がない。
The compressed data is sent from the transmitting device to the receiving device several times to several tens of times per second, and the receiving means performs the compression from the transmitting device several times to several tens of times per second. Data may be accepted.
If the moving image has such a number of frames, a viewer who sees the moving image on the display of the receiving apparatus can recognize the moving image as a somewhat smooth moving image, and there is no difficulty in transmitting and receiving at the current wireless LAN transmission speed.
 受信装置は、無線LANでの通信が可能な、ディスプレイを有するコンピュータ(演算装置を含む装置)であり、例えば、携帯端末である。携帯端末には、ノート型パソコン、スマートフォン、タブレットが少なくとも含まれる。
 送信装置は、動画のデータを処理するものであり、無線LANでの通信が可能なコンピュータ(演算装置を含む装置)であれば良い。例えば、ノート型パソコン、スマートフォン、タブレット等の携帯端末がこれに当たる。ただし、デスクトップ型パソコンや、ビデオカメラのようなディスプレイを含まないものもこれに含まれる。
The receiving device is a computer (a device including an arithmetic device) having a display capable of communication via a wireless LAN, for example, a portable terminal. The portable terminal includes at least a notebook computer, a smartphone, and a tablet.
The transmission device may process moving image data, and may be a computer (device including an arithmetic device) capable of wireless LAN communication. For example, portable terminals such as notebook computers, smartphones, and tablets are examples. However, this includes desktop computers and devices that do not include a display such as a video camera.
 本願の受信装置と同様の作用効果を生じる方法をも本願発明者は本願発明として提案する。
 その方法の一例は、動画のデータを処理する機能を有するとともに、処理される動画のデータから適宜抽出された1画面分のデータである画像データを所定の形式に圧縮した圧縮データとする手段と、前記圧縮データを無線LANを介して送信する手段と、を備えている送信装置、と組合せて用いられるものであり、前記送信装置と、無線LANを介しての通信を行うことができるようになっているとともに、ディスプレイを有する受信装置にて実行される方法である。
 そして、その方法は、前記受信装置が実行する、前記送信装置から前記圧縮データを随時受付ける受付過程と、受付過程で受付けた前記圧縮データを伸長する伸長過程と、前記画像データに圧縮データとされる前の前記画像データから変化がないか判定する判定過程と、前記判定過程により元の画像データから変化がないと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示するとともに、前記判定過程により元の画像データから変化があったと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示しないように制御する表示制御過程と、を含む。
The inventor of the present application also proposes a method for producing the same effect as the receiving apparatus of the present application.
An example of the method has a function of processing moving image data, and means for making compressed data obtained by compressing image data, which is data for one screen appropriately extracted from moving image data to be processed, into a predetermined format The compressed data is used in combination with a transmission device including a means for transmitting the compressed data via a wireless LAN, and can communicate with the transmission device via a wireless LAN. And a method executed by a receiving device having a display.
The method includes a receiving process executed by the receiving apparatus for receiving the compressed data from the transmitting apparatus as needed, a decompressing process for expanding the compressed data received in the receiving process, and compressed image data. A determination process for determining whether or not there is a change from the image data before the display, and an image based on the decompressed image data determined to have no change from the original image data by the determination process is displayed on the display, A display control process for controlling to prevent an image based on the decompressed image data determined to have changed from the original image data in the determination process from being displayed on the display.
 本願の受信装置と同様の作用効果を生じるコンピュータプログラムをも本願発明者は本願発明として提案する。
 そのコンピュータプログラムの一例は、動画のデータを処理する機能を有するとともに、処理される動画のデータから適宜抽出された1画面分のデータである画像データを所定の形式に圧縮した圧縮データとする手段と、前記圧縮データを無線LANを介して送信する手段と、を備えている送信装置、と組合せて用いられるものであり、前記送信装置と、無線LANを介しての通信を行うことができるようになっているとともに、ディスプレイを有するコンピュータに、前記送信装置から前記圧縮データを随時受付ける受付過程と、受付過程で受付けた前記圧縮データを伸長する伸長過程と、前記画像データに圧縮データとされる前の前記画像データから変化がないか判定する判定過程と、前記判定過程により元の画像データから変化がないと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示するとともに、前記判定過程により元の画像データから変化があったと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示しないように制御する表示制御過程と、を実行させるためのコンピュータプログラムである。
The inventor of the present application also proposes a computer program that produces the same effect as the receiving apparatus of the present application.
An example of the computer program has a function of processing moving image data, and means for compressing image data, which is data for one screen appropriately extracted from processed moving image data, into a predetermined format. And a means for transmitting the compressed data via a wireless LAN, in combination with the transmission device, so that communication with the transmitter via the wireless LAN can be performed. The computer having a display accepts the compressed data from the transmission device as needed, the decompression process of decompressing the compressed data received in the acceptance process, and the image data as compressed data. A determination process for determining whether there is a change from the previous image data, and no change from the original image data due to the determination process An image based on the determined expanded image data is displayed on the display, and an image based on the expanded image data determined to have changed from the original image data by the determination process is displayed on the display. And a display control process for performing control so as not to be executed.
 本願出願人はまた、本願の受信装置と同様の作用効果を生じるものとして、通信システムをも提案する。
 その通信システムは、例えば、動画のデータを処理する機能を有するとともに、処理される動画のデータから適宜抽出された1画面分のデータである画像データを所定の形式に圧縮した圧縮データとする手段と、前記圧縮データを無線LANを介して送信する手段と、を備えている送信装置と、前記送信装置と、無線LANを介しての通信を行うことができるようになっている受信装置と、を含んでなる通信システムであって、前記受信装置は、ディスプレイと、前記送信装置から前記圧縮データを随時受付ける受付手段と、前記受付手段で受付けた前記圧縮データを伸長する伸長手段と、前記画像データに圧縮データとされる前の前記画像データから変化がないか判定する判定手段と、前記判定手段により元の画像データから変化がないと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示するとともに、前記判定手段により元の画像データから変化があったと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示しないように制御する表示制御手段と、を有する、通信システムである。
The applicant of the present application also proposes a communication system as the same effect as the receiving apparatus of the present application.
The communication system has, for example, a function of processing moving image data, and means for compressing image data, which is data for one screen appropriately extracted from the processed moving image data, into a predetermined format. A transmission device comprising: means for transmitting the compressed data via a wireless LAN; and a reception device adapted to perform communication via the wireless LAN with the transmission device; The receiving device includes a display, a receiving unit that receives the compressed data from the transmitting device as needed, a decompressing unit that decompresses the compressed data received by the receiving unit, and the image Determining means for determining whether there is any change from the image data before the data is compressed data, and if there is no change from the original image data by the determining means An image based on the determined expanded image data is displayed on the display, and an image based on the expanded image data determined to have changed from the original image data by the determination unit is displayed on the display And a display control means for controlling to prevent the communication system.
第1実施形態の通信システムの概観を示す図。1 is a diagram illustrating an overview of a communication system according to a first embodiment. 図1に示した通信システムに含まれる送信側コンピュータのハードウエア構成を示す図。The figure which shows the hardware constitutions of the transmission side computer contained in the communication system shown in FIG. 図1に示した通信システムに含まれる送信側コンピュータの内部に形成される機能ブロックを示すブロック図。The block diagram which shows the functional block formed inside the transmission side computer contained in the communication system shown in FIG. 図1に示した通信システムに含まれる通信装置のハードウエア構成を示す図。The figure which shows the hardware constitutions of the communication apparatus contained in the communication system shown in FIG. 図1に示した通信システムに含まれる通信装置の内部に形成される機能ブロックを示すブロック図。The block diagram which shows the functional block formed in the inside of the communication apparatus contained in the communication system shown in FIG. 図1に示した通信システムに含まれる通信装置に送られるアナログ信号を説明するための図。The figure for demonstrating the analog signal sent to the communication apparatus contained in the communication system shown in FIG. 図1に示した通信システムに含まれる受信側コンピュータのハードウエア構成を示す図。The figure which shows the hardware constitutions of the receiving computer contained in the communication system shown in FIG. 図1に示した通信システムに含まれる受信側コンピュータの内部に形成される機能ブロックを示すブロック図。The block diagram which shows the functional block formed in the inside of the receiving computer contained in the communication system shown in FIG. 変形例4の通信システムに含まれる受信側コンピュータの内部に形成される機能ブロックを示すブロック図。The block diagram which shows the functional block formed in the inside of the receiving computer contained in the communication system of the modification 4. FIG. 第2実施形態の通信システムの概観を示す図。The figure which shows the external appearance of the communication system of 2nd Embodiment. 第2実施形態の通信システムに含まれるビデオカメラの構成を説明するための断面図。Sectional drawing for demonstrating the structure of the video camera contained in the communication system of 2nd Embodiment. 第2実施形態の通信システムに含まれるビデオカメラの内部に形成される機能ブロックを示すブロック図。The block diagram which shows the functional block formed inside the video camera contained in the communication system of 2nd Embodiment. 第2実施形態の通信システムに含まれる受信側コンピュータの内部に形成される機能ブロックを示すブロック図。The block diagram which shows the functional block formed inside the receiving computer contained in the communication system of 2nd Embodiment. 第1実施形態の通信システムで、通信装置から受信側コンピュータに送信されるデータのデータ構造を説明するための図。The figure for demonstrating the data structure of the data transmitted to the receiving side computer from a communication apparatus in the communication system of 1st Embodiment.
 以下、本発明の第1~第2実施形態について説明する。なお、各実施形態の説明において共通する対象には共通する符号を付すものとし、重複する説明は場合により省略するものとする。 Hereinafter, first and second embodiments of the present invention will be described. In the description of each embodiment, common objects are denoted by common reference numerals, and overlapping descriptions are omitted depending on circumstances.
≪第1実施形態≫
 図1に第1実施形態における通信システムの概要を示す。
 通信システムは、送信側コンピュータ100と、通信装置200と、複数の受信側コンピュータ300とを含んで構成されている。捉え方にもよるが、通信装置200、又は通信装置200と送信側コンピュータ100を組合せた装置が本願でいう送信装置であり、受信側コンピュータ300が本願でいう受信装置である。
 この実施形態における通信システムは、これには限られないが、会議でのプレゼンテーションに用いられるものである。送信側コンピュータ100と通信装置200はプレゼンテーションを行うプレゼンテーター(或いはその補助者、以下同じ。)によって操作され、受信側コンピュータ300は聴衆によって操作される。受信側コンピュータ300は聴衆の私物である場合もあるし、プレゼンテーター或いはプレゼンテーターの協力者によって聴衆に配布乃至貸与されたものである場合もある。
<< First Embodiment >>
FIG. 1 shows an outline of a communication system in the first embodiment.
The communication system includes a transmission side computer 100, a communication device 200, and a plurality of reception side computers 300. Although depending on the way of understanding, the communication apparatus 200 or a combination of the communication apparatus 200 and the transmission side computer 100 is a transmission apparatus in the present application, and the reception side computer 300 is a reception apparatus in the present application.
The communication system in this embodiment is used for presentation at a conference, although not limited thereto. The sending computer 100 and the communication device 200 are operated by a presenter (or an assistant thereof, the same shall apply hereinafter) giving a presentation, and the receiving computer 300 is operated by an audience. The receiving computer 300 may be private to the audience, or may be distributed or lent to the audience by a presenter or a collaborator of the presenter.
 送信側コンピュータ100は、コンピュータである。この実施形態の送信側コンピュータ100は、ディスプレイ101を備えたノート型コンピュータである。もっとも、送信側コンピュータ100は、デスクトップ型コンピュータのように外部のディスプレイ101と接続されるものであっても構わない。送信側コンピュータ100は、また、入力装置102を備えている。この実施形態の入力装置102はキーボードであるが、それに加えて、或いはそれに代えて、トラックボール、マウス、タッチパネル等の他の入力装置を送信側コンピュータ100が備えていても構わない。送信側コンピュータ100は、また、図示を省略の幾つかの出力端子を備えている。出力端子は公知のもので良く、この実施形態では、アナログ出力端子(例えば、アナログRGB端子、HDMI端子、DVI端子、ディスプレイポート、サンダーボルト端子等)が送信側コンピュータ100に存在するものとする。
 送信側コンピュータ100は、公知のプレゼンテーション用のソフトウエアを搭載しておりプレゼンテーションを行うことができるようになっている。プレゼンテーション用のソフトウエアは、例えば、日本マイクロソフト株式会社製のPowerPoint(商標)である。プレゼンテーションに用いられる画像である表示画像はディスプレイ101に表示され、プレゼンテーターはそれを見ながらプレゼンテーションを行うことになる。
The sending computer 100 is a computer. The sending computer 100 of this embodiment is a notebook computer provided with a display 101. Of course, the sending computer 100 may be connected to the external display 101 like a desktop computer. The sending computer 100 also includes an input device 102. Although the input device 102 of this embodiment is a keyboard, the transmitting computer 100 may include other input devices such as a trackball, a mouse, and a touch panel in addition to or instead of the keyboard. The transmitting computer 100 also includes several output terminals not shown. The output terminal may be a known one, and in this embodiment, an analog output terminal (for example, an analog RGB terminal, an HDMI terminal, a DVI terminal, a display port, a thunderbolt terminal, etc.) is assumed to be present in the transmitting computer 100.
The sending computer 100 is equipped with known presentation software so that it can perform a presentation. The presentation software is, for example, PowerPoint (trademark) manufactured by Microsoft Japan. A display image, which is an image used for the presentation, is displayed on the display 101, and the presenter performs the presentation while watching it.
 送信側コンピュータ100は、図2に示したようなハードウエアを備えている。
 ハードウエアには、CPU111、ROM112、RAM113、インターフェイス114、ハードディスクドライブ115が含まれており、これらはバス116によって相互に接続されている。
 CPU111は、演算を行う演算装置である。CPU111は、例えば、ROM112、或いはハードディスクドライブ115に記録されたコンピュータプログラムを実行することにより、後述する処理を実行する。なお、送信側コンピュータ100は、電子メールの送受信、インターネットのブラウジング、文書作成等のノート型パソコンが通常行える様々な機能を実行するものであっても良いし、この実施形態の送信側コンピュータ100もそのようなものであるが、ここでいうコンピュータプログラムは、本願発明の送信側コンピュータとしてこの送信側コンピュータ100を機能させるためのコンピュータプログラムである。このコンピュータプログラムは、送信側コンピュータ100にプリインストールされていたものであっても良いし、事後的にインストールされたものであっても良い。このコンピュータプログラムの送信側コンピュータ100へのインストールは、メモリカード等の所定の記録媒体を介して行なわれても良いし、LAN或いはインターネットなどの通信回線を介して行なわれても構わない。
 ROM112は、CPU111が後述する処理を実行するために必要なコンピュータプログラムやデータを記録している。ハードディスクドライブ115も同様であり、上記コンピュータプログラムやデータの一部、或いは全部が記録されている場合がある。ハードディスクドライブには、上述したプレゼンテーション用のソフトウエアに加え、電子メールの送受信、インターネットのブラウジング、文書作成等のノート型パソコンが通常行える様々な機能を実行するためのコンピュータプログラムが記録されている。
 RAM113は、CPU111が処理を行うために必要なワーク領域を提供する。また、RAM113には、CPU111が処理を行った結果生成されたデータが記録されうる。RAM113の一部が後述するフレームバッファとなっている。
 インターフェイス114は、バス116で接続されたCPU111やRAM113等と外部との間でデータのやり取りを行うものである。インターフェイス114には、上述の入力装置102と図示を省略のアナログ出力端子が接続されている。入力装置102からの操作内容は、インターフェイス114から入力されるようになっているとともに、インターフェイス114からアナログ出力端子へ出力されたデータは、アナログ出力端子から外部へ出力されるようになっている。また、インターフェイス114には、ディスプレイ101が接続されており、ディスプレイ101に表示される表示画像を制御するためのデータがインターフェイス114を介して出力されるようになっている。
The sending computer 100 includes hardware as shown in FIG.
The hardware includes a CPU 111, a ROM 112, a RAM 113, an interface 114, and a hard disk drive 115, which are connected to each other by a bus 116.
The CPU 111 is an arithmetic device that performs arithmetic operations. For example, the CPU 111 executes processing described later by executing a computer program recorded in the ROM 112 or the hard disk drive 115. Note that the sending computer 100 may execute various functions that can be normally performed by a notebook personal computer, such as sending and receiving e-mails, browsing the Internet, and document creation. The sending computer 100 of this embodiment is also the same. Although it is such, a computer program here is a computer program for functioning this transmission side computer 100 as a transmission side computer of this invention. This computer program may be preinstalled in the transmitting computer 100 or may be installed afterwards. The computer program may be installed on the transmission-side computer 100 via a predetermined recording medium such as a memory card, or via a communication line such as a LAN or the Internet.
The ROM 112 records computer programs and data necessary for the CPU 111 to execute processing to be described later. The same applies to the hard disk drive 115, and some or all of the computer program and data may be recorded. In addition to the above-described presentation software, the hard disk drive stores computer programs for executing various functions that can be normally performed by a notebook personal computer, such as sending and receiving e-mails, browsing the Internet, and document creation.
The RAM 113 provides a work area necessary for the CPU 111 to perform processing. In addition, data generated as a result of processing performed by the CPU 111 can be recorded in the RAM 113. A part of the RAM 113 serves as a frame buffer described later.
The interface 114 exchanges data between the CPU 111 and the RAM 113 connected via the bus 116 and the outside. The interface 114 is connected to the input device 102 described above and an analog output terminal (not shown). The operation content from the input device 102 is input from the interface 114, and the data output from the interface 114 to the analog output terminal is output from the analog output terminal to the outside. A display 101 is connected to the interface 114, and data for controlling a display image displayed on the display 101 is output via the interface 114.
 CPU111がコンピュータプログラムを実行することにより、送信側コンピュータ100内部には、図3で示されたような機能ブロックが生成される。なお、以下の機能ブロックは、上述のコンピュータプログラム単体の機能により生成されていても良いが、上述のコンピュータプログラムと、送信側コンピュータ100にインストールされたOSその他のコンピュータプログラムとの協働により生成されても良い。
 送信側コンピュータ100の内部には、操作信号解析部121、制御部122、表示画像データ生成部123が生成される。
When the CPU 111 executes the computer program, a function block as shown in FIG. 3 is generated in the transmitting computer 100. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the transmission-side computer 100. May be.
An operation signal analysis unit 121, a control unit 122, and a display image data generation unit 123 are generated inside the transmission-side computer 100.
 操作信号解析部121は、入力装置102から入力された操作信号の内容を解析する。この実施形態と関連する操作信号としては、プレゼンテーション用のソフトウエアの操作に関するものがある。例えば、プレゼンテーション用のソフトウエアにおける頁送りや、アニメーションの実行などに関する操作信号が入力装置102から入力されると、操作信号解析部121はその操作信号が上述の各内容を指定するものであると、その内容を解析する。操作信号解析部121が解析した操作内容は、制御部122に送られるようになっている。
 制御部122は、ここではプレゼンテーション用のソフトウエアを実行する。制御部122は、入力装置102からプレゼンテーターが入力した操作信号の内容に関する、操作信号解析部121から受け取った情報に基いて、プレゼンテーション用のソフトウエアを実行する。その実行の結果についての信号は、表示画像データ生成部123に送られるようになっている。
 表示画像データ生成部123は、制御部122から受付けたプレゼンテーション用のソフトウエアの実行結果についての信号に基いて、ディスプレイ101に表示されるべき表示画像についてのデータである表示画像データを生成するものである。表示画像データ生成部123で生成された信号は、ディスプレイ101と、図示を省略のアナログ出力端子に送られるようになっている。アナログ出力端子に送られる信号は、ディスプレイ101にその時点で表示されている表示画像についてのアナログ信号である。このアナログ信号は、動画の信号であり、フレームが連続する信号である。
The operation signal analysis unit 121 analyzes the content of the operation signal input from the input device 102. As the operation signal related to this embodiment, there is a signal related to the operation of the presentation software. For example, when an operation signal related to page turning or animation execution in presentation software is input from the input device 102, the operation signal analysis unit 121 specifies that the operation signal specifies the above-described contents. , Analyze its contents. The operation content analyzed by the operation signal analysis unit 121 is sent to the control unit 122.
Here, the control unit 122 executes software for presentation. The control unit 122 executes the software for presentation based on the information received from the operation signal analysis unit 121 regarding the content of the operation signal input by the presenter from the input device 102. A signal regarding the execution result is sent to the display image data generation unit 123.
The display image data generation unit 123 generates display image data, which is data about a display image to be displayed on the display 101, based on a signal about the execution result of the presentation software received from the control unit 122. It is. The signal generated by the display image data generation unit 123 is sent to the display 101 and an analog output terminal (not shown). The signal sent to the analog output terminal is an analog signal for the display image currently displayed on the display 101. This analog signal is a moving image signal and is a signal in which frames are continuous.
 次に、通信装置200について説明する。
 通信装置200は、送信側コンピュータ100と接続されており、送信側コンピュータ100から受け取った、送信側コンピュータ100のディスプレイ101に表示されている表示画像と略同様の画像を受信側コンピュータ300の後述するディスプレイに表示させるためのデータを、複数の受信側コンピュータ300に送信するものである。
Next, the communication apparatus 200 will be described.
The communication device 200 is connected to the transmitting computer 100, and receives an image substantially the same as the display image received from the transmitting computer 100 and displayed on the display 101 of the transmitting computer 100. Data to be displayed on the display is transmitted to a plurality of receiving computers 300.
 通信装置200は、コンピュータである。通信装置200は、また、入力装置202を備えている。この実施形態の入力装置202はテンキーであるが、キーボード、マウス、タッチパネルなどを入力装置202として用いることができる。通信装置200は、また、図示を省略の入力端子を備えている。
 また、通信装置200は、無線LANの機能を実装している。無線LANの機能は、図示を省略の無線LAN通信部によって実現される。無線LANは、これには限らないがこの実施形態では、Wi-Fi(商標)である。Wi-Fiは、規格上デフォルトで、同時に、253台(識別用のデータに8ビットのデータを使用したとき)、或いは65533台(識別用のデータに16ビットのデータを使用したとき)のコンピュータと無線で通信を行える。無線LAN通信部は、UDP(User Datagram Protocol)を用いて、以下に説明するデータを、受信側コンピュータ300へ送るようになっている。
The communication device 200 is a computer. The communication device 200 also includes an input device 202. Although the input device 202 of this embodiment is a numeric keypad, a keyboard, a mouse, a touch panel, or the like can be used as the input device 202. The communication device 200 also includes an input terminal (not shown).
In addition, the communication device 200 has a wireless LAN function. The wireless LAN function is realized by a wireless LAN communication unit (not shown). The wireless LAN is Wi-Fi (trademark) in this embodiment, although not limited thereto. Wi-Fi is a standard by default, and at the same time, 253 computers (when 8-bit data is used for identification data) or 65533 computers (when 16-bit data is used for identification data) And can communicate wirelessly. The wireless LAN communication unit uses UDP (User Datagram Protocol) to send data described below to the receiving computer 300.
 通信装置200は、図4に示したようなハードウエアを備えている。
 ハードウエアには、CPU211、ROM212、RAM213、インターフェイス214が含まれており、これらはバス216によって相互に接続されている。
 CPU211、ROM212、RAM213、インターフェイス214、及びバス216の機能は基本的に、送信側コンピュータ100に含まれていたCPU111、ROM112、RAM113、インターフェイス114と変わらない。
 ただし、RAM213には、この通信装置200が実行する後述の処理を行うために用いられるコンピュータプログラムと、データが記録されている。このコンピュータプログラムは、必ずしもこの限りではないが、通信装置200にプリインストールされていたものである。通信装置200は、入力端子として、アナログ入力端子を備えている。
 この実施形態のアナログ入力端子は、送信側コンピュータ100のアナログ出力端子とアナログケーブル100Aで接続されている。そして、アナログ入力端子には、アナログケーブル100Aを介して、送信側コンピュータ100の表示画像データ生成部123で生成され、アナログ出力端子から出力された表示画像についてのアナログ信号が入力されるようになっている。
 インターフェイス214は、バス216で接続されたCPU211やRAM213等と外部との間でデータのやり取りを行うものである。インターフェイス214には、上述の入力装置202と図示を省略のアナログ入力端子が接続されている。入力装置202からの操作内容と、アナログ入力端子からのデータは、インターフェイス214から入力されるようになっている。また、インターフェイス214から無線LAN通信部に、後述するようにして各受信側コンピュータ300に送られる圧縮データが送られるようになっている。
The communication device 200 includes hardware as shown in FIG.
The hardware includes a CPU 211, ROM 212, RAM 213, and interface 214, which are connected to each other by a bus 216.
The functions of the CPU 211, ROM 212, RAM 213, interface 214, and bus 216 are basically the same as those of the CPU 111, ROM 112, RAM 113, and interface 114 included in the transmitting computer 100.
However, the RAM 213 stores a computer program and data used for performing processing to be described later executed by the communication device 200. This computer program is not necessarily limited to this, but is preinstalled in the communication apparatus 200. The communication device 200 includes an analog input terminal as an input terminal.
The analog input terminal of this embodiment is connected to the analog output terminal of the transmitting computer 100 by an analog cable 100A. The analog input terminal receives an analog signal for the display image generated by the display image data generation unit 123 of the transmission-side computer 100 and output from the analog output terminal via the analog cable 100A. ing.
The interface 214 exchanges data between the CPU 211, RAM 213, and the like connected via the bus 216 and the outside. The interface 214 is connected to the above-described input device 202 and an analog input terminal (not shown). The operation content from the input device 202 and the data from the analog input terminal are input from the interface 214. Also, compressed data to be sent to each receiving computer 300 is sent from the interface 214 to the wireless LAN communication unit as will be described later.
 CPU211がコンピュータプログラムを実行することにより、通信装置200内部には、図5で示されたような機能ブロックが生成される。なお、以下の機能ブロックは、上述のコンピュータプログラム単体の機能により生成されていても良いが、上述のコンピュータプログラムと、通信装置200にインストールされたOSその他のコンピュータプログラムとの協働により生成されても良い。
 通信装置200の内部には、操作信号解析部221、制御部222、画像データ生成部223、圧縮部224、及び無線LAN制御部225が生成される。
When the CPU 211 executes the computer program, a functional block as shown in FIG. 5 is generated in the communication device 200. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the communication device 200. Also good.
In the communication device 200, an operation signal analysis unit 221, a control unit 222, an image data generation unit 223, a compression unit 224, and a wireless LAN control unit 225 are generated.
 操作信号解析部221は、入力装置202から入力された操作信号の内容を解析する。この実施形態では、入力装置202からは、後述する指定信号を指定するための情報である数値が入力される。入力装置202からその数値に関する操作信号が入力されると、操作信号解析部221はその操作信号が指定する数値を解析する。操作信号解析部221が解析した操作内容、つまり数値は、制御部222に送られるようになっている。なお、この数値に関する情報は、入力装置202からでなく、送信側コンピュータ100の入力装置102から入力されるようになっていても構わない。
 制御部222は、その数値に基いて、通信装置200から各受信側コンピュータ300に後述のようにして送られた圧縮データを処理する、受信側コンピュータ300におけるソフトウエアを指定する数値を決定する。この数値は、この実施形態では、ポート番号、或いはその一部である。制御部222によって指定されるポート番号は、入力装置202から入力された数値そのものであってもよいし、それに何らかの演算を行なって得られた数値であってもよい。制御部222が決定したポート番号は、無線LAN制御部225に送られるようになっている。
 画像データ生成部223には、アナログ入力端子から入力された表示画像についてのアナログ信号が入力されるようになっている。画像データ生成部223は、入力されたアナログ信号から画像データを生成する。上述したように、表示画像についてのアナログ信号は動画の信号であり、図6に示したように、フレームについての信号が連続したものとなっている。図6に示された信号中の一つの凸が、1フレーム分の、つまり、表示画像の1画面分の信号である。画像データ生成部223は、アナログ信号から、幾つかおきに1画面分の信号を抜き出すことで、言わばコマ落としと呼べる作業を行う。例えば、元々のアナログ信号が30fpsであった場合、図6で矢示したように、3つ毎の1画面分の信号を抜き出すと、それにより得られる画像データによって作られる動画は、10fpsとなる。そのようなコマ落としの処理を行うのは、無線LANによる通信の速度に制限があることを考慮したものである。画像データ生成部223が生成した画像データは、作られる都度、圧縮部224に送られるようになっている。なお、コマ落としの処理を行うにあたっては、常に一定数のフレームおきにフレームを抜き出す必要はない。
 圧縮部224は、画像データを受取る都度、受け取った画像データの圧縮を行う。画像データの圧縮は、どのような形式で行なっても良く、例えばMPEG形式とすることもできるが、この実施形態ではJPEG形式での圧縮が行われるようになっている。画像データが圧縮されたデータが圧縮データである。圧縮部224は、圧縮データを生成する都度、それを無線LAN制御部225に送る。
 無線LAN制御部225は、上述のように、制御部222からポート番号を、圧縮部224から圧縮データをそれぞれ受付ける。無線LAN制御部225は、それを無線LAN通信部に送り、無線LAN通信部に受信側コンピュータ300へ送らせる。それが可能なように、無線LAN制御部225は、圧縮データと位置データ等の送信の対象となるデータを既存の方法でパケットに分割する。また、それらパケットの先端にヘッダを付け、そのヘッダに、自らのIPアドレスやこれらから送信する圧縮データ及び位置データを含むデータの容量と、各受信側コンピュータ300にインストールされたソフトウエアのうち受信された圧縮データを処理するソフトウエアを指定するポート番号等を書き込む。これらヘッダと多数のパケットは、無線LAN通信部へ送られ、無線LAN通信部から、これには限られないが、この実施形態ではUDP/IPを用いて各受信側コンピュータ300へ送られることになる。なお、かかる通信はUDP/IPではなくTCP/IP等の他のプロトコルで行われても良い。
The operation signal analysis unit 221 analyzes the content of the operation signal input from the input device 202. In this embodiment, a numerical value that is information for designating a designation signal described later is input from the input device 202. When an operation signal related to the numerical value is input from the input device 202, the operation signal analysis unit 221 analyzes the numerical value specified by the operation signal. The operation content analyzed by the operation signal analysis unit 221, that is, a numerical value is sent to the control unit 222. Note that the information regarding the numerical value may be input not from the input device 202 but from the input device 102 of the transmission-side computer 100.
Based on the numerical value, the control unit 222 determines a numerical value for designating software in the receiving computer 300 that processes the compressed data sent from the communication device 200 to each receiving computer 300 as described below. This numerical value is a port number or a part thereof in this embodiment. The port number designated by the control unit 222 may be a numerical value itself input from the input device 202, or may be a numerical value obtained by performing some operation on the numerical value. The port number determined by the control unit 222 is sent to the wireless LAN control unit 225.
The image data generation unit 223 receives an analog signal for a display image input from an analog input terminal. The image data generation unit 223 generates image data from the input analog signal. As described above, the analog signal for the display image is a moving image signal, and as shown in FIG. 6, the signals for the frames are continuous. One convex in the signal shown in FIG. 6 is a signal for one frame, that is, one screen of a display image. The image data generation unit 223 extracts a signal for every other screen from the analog signal to perform a work called frame dropping. For example, if the original analog signal is 30 fps, as shown by the arrow in FIG. 6, if one screen signal for every three is extracted, the moving image created by the image data obtained thereby becomes 10 fps. . Such frame drop processing is performed in consideration of the limitation of the communication speed by the wireless LAN. The image data generated by the image data generation unit 223 is sent to the compression unit 224 every time it is created. It is not always necessary to extract frames every certain number of frames when performing the frame dropping process.
Each time the image data is received, the compression unit 224 compresses the received image data. The image data may be compressed in any format, for example, in the MPEG format, but in this embodiment, compression in the JPEG format is performed. Data obtained by compressing image data is compressed data. Each time the compression unit 224 generates compressed data, it sends it to the wireless LAN control unit 225.
The wireless LAN control unit 225 receives the port number from the control unit 222 and the compressed data from the compression unit 224 as described above. The wireless LAN control unit 225 sends it to the wireless LAN communication unit, and causes the wireless LAN communication unit to send it to the receiving computer 300. In order to make this possible, the wireless LAN control unit 225 divides the data to be transmitted, such as compressed data and position data, into packets by an existing method. In addition, a header is added to the leading end of the packet, and the header includes the IP address, the capacity of the data including the compressed data and the position data transmitted from these, and the reception of the software installed in each receiving computer 300. The port number or the like for specifying software for processing the compressed data is written. These headers and a large number of packets are sent to the wireless LAN communication unit, and the wireless LAN communication unit is not limited to this. In this embodiment, it is sent to each receiving computer 300 using UDP / IP. Become. Note that such communication may be performed using another protocol such as TCP / IP instead of UDP / IP.
 次に受信側コンピュータ300について説明する。
 受信側コンピュータ300は、携帯型のコンピュータである。受信側コンピュータ300は、例えば、ノート型コンピュータであり、或いはスマートフォン、タブレットである。スマートフォンは例えば、Apple Japan合同会社が製造、販売を行うiPhoneであり、タブレットは同社が製造、販売を行うiPadである。
 受信側コンピュータ300は、ディスプレイ301を備えている。受信側コンピュータ300は、また、入力装置302を備えている。入力装置302は、図1に示したような物理キーの他、公知のように、ディスプレイ301と一体となったタッチパネルにより構成することもできる。
 また、受信側コンピュータ300は、無線LANの機能を実装している。無線LANの機能は、図示を省略の無線LAN通信部によって実現される。無線LANは、これには限らないがこの実施形態では、Wi-Fiである。受信側コンピュータ300の無線LAN通信部は、通信装置200の無線LAN通信部と通信を行えるようになっている。
Next, the receiving computer 300 will be described.
The receiving computer 300 is a portable computer. The receiving computer 300 is, for example, a notebook computer, or a smartphone or a tablet. For example, the smartphone is an iPhone manufactured and sold by Apple Japan LLC, and the tablet is an ipad manufactured and sold by the company.
The receiving computer 300 includes a display 301. The receiving computer 300 also includes an input device 302. In addition to the physical keys as shown in FIG. 1, the input device 302 can be configured by a touch panel integrated with the display 301 as is well known.
In addition, the receiving-side computer 300 has a wireless LAN function. The wireless LAN function is realized by a wireless LAN communication unit (not shown). The wireless LAN is Wi-Fi in this embodiment, although not limited to this. The wireless LAN communication unit of the receiving computer 300 can communicate with the wireless LAN communication unit of the communication device 200.
 受信側コンピュータ300は、図7に示したようなハードウエアを備えている。
 ハードウエアには、CPU311、ROM312、RAM313、インターフェイス314、ハードディスクドライブ315が含まれており、これらはバス316によって相互に接続されている。
 CPU311、ROM312、RAM313、インターフェイス314、ハードディスクドライブ315、バス316の各機能は、基本的に、送信側コンピュータ100におけるCPU111、ROM112、RAM113、インターフェイス114、ハードディスクドライブ115、バス116の機能と同様である。
 ただし、ROM312又はハードディスクドライブ315には、受信側コンピュータ300で実行される以下の処理を実現するために必要なコンピュータプログラムが記録されている。また、ROM312またはハードディスクドライブ315には、後述する拡大(例えば、ピンチ)や、表示画像の記録(例えば、プリントスクリーン)の処理を実行するために必要なソフトウエアが記録されている。
 また、受信側コンピュータ300のインターフェイス314は、受信側コンピュータ300に搭載された上述の無線LAN通信部と接続されており、無線LAN通信部が通信装置200から受け取った圧縮データの受取りを行うようになっている。また、インターフェイス314は入力装置302と接続されており、入力装置302から操作内容を受付けるようになっている。この操作内容は、少なくとも後述する指定情報を含む。インターフェイス314はまた、ディスプレイ301に接続されており、ディスプレイ301に所定の表示画像を表示するためのデータを送るようになっている。
The receiving computer 300 has hardware as shown in FIG.
The hardware includes a CPU 311, a ROM 312, a RAM 313, an interface 314, and a hard disk drive 315, which are connected to each other by a bus 316.
The functions of the CPU 311, ROM 312, RAM 313, interface 314, hard disk drive 315, and bus 316 are basically the same as the functions of the CPU 111, ROM 112, RAM 113, interface 114, hard disk drive 115, and bus 116 in the sending computer 100. .
However, the ROM 312 or the hard disk drive 315 stores computer programs necessary for realizing the following processing executed by the receiving computer 300. The ROM 312 or the hard disk drive 315 stores software necessary for executing processing of enlargement (for example, pinch) and recording of a display image (for example, print screen) described later.
The interface 314 of the receiving computer 300 is connected to the above-described wireless LAN communication unit mounted on the receiving computer 300 so that the wireless LAN communication unit receives the compressed data received from the communication device 200. It has become. The interface 314 is connected to the input device 302 so as to receive operation contents from the input device 302. This operation content includes at least designation information described later. The interface 314 is also connected to the display 301 so as to send data for displaying a predetermined display image on the display 301.
 CPU311がコンピュータプログラムを実行することにより、受信側コンピュータ300内部には、図8で示されたような機能ブロックが生成される。なお、以下の機能ブロックは、上述のコンピュータプログラム単体の機能により生成されていても良いが、上述のコンピュータプログラムと、受信側コンピュータ300にインストールされたOSその他のコンピュータプログラムとの協働により生成されても良い。
 受信側コンピュータ300の内部には、操作信号解析部321、制御部322、指定情報解析部323、同一性判定部324、伸長部325、及び表示画像データ生成部326が生成される。
When the CPU 311 executes the computer program, a functional block as shown in FIG. 8 is generated in the receiving computer 300. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the receiving-side computer 300. May be.
An operation signal analysis unit 321, a control unit 322, a designation information analysis unit 323, an identity determination unit 324, an expansion unit 325, and a display image data generation unit 326 are generated inside the reception computer 300.
 操作信号解析部321は、入力装置302から入力された操作信号の内容を解析する。この実施形態と関連する操作信号としては、指定情報がある。指定情報は、後述するようにして受信側コンピュータ300が受けとった圧縮データを、受信側コンピュータ300にインストールされているどのソフトウエアで処理するかを決定するための数値の少なくとも一部を指定するものである。この数値は、制御部322に送られるようになっている。
 制御部322は、この数値を受取ったときに、受信側コンピュータ300が受けとった圧縮データを、受信側コンピュータ300にインストールされているどのソフトウエアで処理するかを決定するための数値を決定する機能を有する。この数値は、操作信号解析部321から入力された操作内容によって示される数値そのものでも良いが、その数値に対して何らかの演算を行った結果得られる数値であっても良い。そして、この実施形態では、そのような演算の結果、受信側コンピュータ300が受けとった圧縮データを、受信側コンピュータ300にインストールされているどのソフトウエアで処理するかを決定するための数値が決定されるようになっている。この数値は、指定情報解析部323に送られるようになっている。
 指定情報解析部323は、通信装置200の無線LAN通信部から送られてきて、受信側コンピュータ300の無線LAN通信部が受取ったヘッダ、及び圧縮データのパケットを、インターフェイス314を介して、都度受取るようになっている。指定情報解析部323は、それらを受取ったときに、圧縮データのパケットのヘッダに書き込まれた情報を読み出すようになっている。また、指定情報解析部323は、読み出された情報中のポート番号と、制御部322から送られてきた、受信側コンピュータ300が受けとった圧縮データを、受信側コンピュータ300にインストールされているどのソフトウエアで処理するかを決定するための数値とを、比較するようになっている。この数値が一致した場合には、指定情報解析部323は、受信側コンピュータ300が受取った圧縮データのパケットを、同一性判定部324に送るようになっている。指定情報解析部323は、圧縮データのパケットとともに、ヘッダから読み出された、圧縮データの容量を特定する容量情報をも同一性判定部324に送るようになっている。なお、指定情報解析部323は、同一性判定部324に圧縮データのパケットを送るに先立って、それらパケットを一纏めにして元の圧縮データにしても良い。他方、指定情報解析部323は、圧縮データのパケットのヘッダの中のポート番号と、制御部322から送られてきた、受信側コンピュータ300が受けとった圧縮データを、受信側コンピュータ300にインストールされているどのソフトウエアで処理するかを決定するための数値と、が一致しなかった場合には、受信側コンピュータ300が受取った圧縮データのパケットを、同一性判定部324に送らないようになっている。なお、指定情報解析部323における、圧縮データのパケットのヘッダの中のポート番号と、制御部322から送られてきた、受信側コンピュータ300が受けとった圧縮データを、受信側コンピュータ300にインストールされているどのソフトウエアで処理するかを決定するための数値と、を比較する処理は、最初の圧縮データを受取ったときのみ、或いは10分毎等の所定の時間間隔毎に行われるようになっていても構わない。この実施形態では、最初の圧縮データを受取ったときにのみ、その処理が行われるものとする。
 同一性判定部324は、画像データに圧縮される前の元の画像データから変化があったか否かを判定するものである。かかる判定の方法についての詳細は後述するが、同一性判定部324は、画像データに圧縮される前の元の画像データから変化がなかったと判定すれば、圧縮データを伸長部325に送り、画像データに圧縮される前の元の画像データから変化があったと判定すれば、圧縮データを伸長部325に送らない。
 伸長部325は、同一性判定部324から圧縮データを受取った場合に、その圧縮データを伸長して画像データに戻すものである。伸長部325は、圧縮データを伸長して得た画像データを、表示画像データ生成部326に送るようになっている。
 表示画像データ生成部326は、伸長部325から受付けた画像データに基いて、その画像データ(一フレーム分のデータ)に基づく画像をディスプレイ301に表示させるものである。表示画像データ生成部326は、画像データを受取る度に、ディスプレイ301にその画像データに基づく画像(表示画像)を表示させる。上述のように既にコマ落としの処理がなされているので、受信側コンピュータ300のディスプレイ301に表示される表示画像は、送信側コンピュータ100のディスプレイ101に表示される表示画像と基本的に同じ(略実時間で同じ)ものではあるが、そのフレーム数が、送信側コンピュータ100のディスプレイ101に表示される表示画像よりも幾らか落ちたものとなる。また、同一性判定部324で圧縮される前の元の画像データから変化があったと判定された画像データに基づく画像もディスプレイ301には表示されないから、ディプレイ301に表示される表示画像のフレームレートは、送信側コンピュータ100でコマ落としされたときのフレームレートよりも部分的に落ちている場合がある。
The operation signal analysis unit 321 analyzes the content of the operation signal input from the input device 302. The operation signal related to this embodiment includes designation information. The designation information designates at least a part of a numerical value for determining which software installed in the receiving computer 300 processes the compressed data received by the receiving computer 300 as will be described later. It is. This numerical value is sent to the control unit 322.
When the control unit 322 receives this numerical value, the control unit 322 determines a numerical value for determining which software installed in the receiving computer 300 should process the compressed data received by the receiving computer 300. Have This numerical value may be the numerical value itself indicated by the operation content input from the operation signal analysis unit 321, or may be a numerical value obtained as a result of performing some operation on the numerical value. In this embodiment, as a result of such calculation, a numerical value for determining which software installed in the receiving computer 300 is to process the compressed data received by the receiving computer 300 is determined. It has become so. This numerical value is sent to the designation information analysis unit 323.
The designation information analysis unit 323 receives the header and the compressed data packet transmitted from the wireless LAN communication unit of the communication apparatus 200 and received by the wireless LAN communication unit of the receiving computer 300 via the interface 314 each time. It is like that. The designation information analysis unit 323 reads the information written in the header of the compressed data packet when receiving them. In addition, the designated information analysis unit 323 receives the port number in the read information and the compressed data received by the receiving computer 300 sent from the control unit 322, which one is installed in the receiving computer 300. A numerical value for deciding whether to process by software is compared. When the numerical values match, the designation information analysis unit 323 sends the compressed data packet received by the receiving computer 300 to the identity determination unit 324. The designation information analysis unit 323 also sends to the identity determination unit 324 capacity information for specifying the capacity of the compressed data read from the header, together with the compressed data packet. Prior to sending the packets of compressed data to the identity determination unit 324, the designation information analysis unit 323 may combine the packets into the original compressed data. On the other hand, the designation information analysis unit 323 is installed in the receiving computer 300 with the port number in the header of the compressed data packet and the compressed data received from the control unit 322 and received by the receiving computer 300. If the numerical value for determining which software is to be processed does not match, the packet of the compressed data received by the receiving computer 300 is not sent to the identity determination unit 324. Yes. Note that the port number in the header of the compressed data packet in the specified information analysis unit 323 and the compressed data received by the receiving computer 300 sent from the control unit 322 are installed in the receiving computer 300. The process of comparing with the numerical value for determining which software is to be processed is performed only when the first compressed data is received or every predetermined time interval such as every 10 minutes. It doesn't matter. In this embodiment, it is assumed that the processing is performed only when the first compressed data is received.
The identity determination unit 324 determines whether or not there is a change from the original image data before being compressed into image data. Although the details of the determination method will be described later, if the identity determination unit 324 determines that there is no change from the original image data before being compressed into the image data, the identity determination unit 324 sends the compressed data to the decompression unit 325, and If it is determined that there is a change from the original image data before being compressed into data, the compressed data is not sent to the decompression unit 325.
When the decompression unit 325 receives compressed data from the identity determination unit 324, the decompression unit 325 decompresses the compressed data and returns it to image data. The decompression unit 325 sends image data obtained by decompressing the compressed data to the display image data generation unit 326.
The display image data generation unit 326 displays an image based on the image data (data for one frame) on the display 301 based on the image data received from the decompression unit 325. Every time image data is received, the display image data generation unit 326 causes the display 301 to display an image (display image) based on the image data. Since the frame dropping process has already been performed as described above, the display image displayed on the display 301 of the receiving computer 300 is basically the same as the display image displayed on the display 101 of the transmitting computer 100 (approximately). Although it is the same in real time, the number of frames is somewhat lower than the display image displayed on the display 101 of the transmitting computer 100. In addition, since an image based on the image data determined to have changed from the original image data before being compressed by the identity determination unit 324 is not displayed on the display 301, the frame of the display image displayed on the display 301 is displayed. The rate may be partially lower than the frame rate when the sending computer 100 drops frames.
 次に、この通信システムの使用方法、及び動作について説明する。 Next, the usage method and operation of this communication system will be described.
 この通信システムを用いるには、まず、プレゼンテーターは、送信側コンピュータ100のアナログ出力端子と通信装置200のアナログ入力端子とをアナログケーブル100Aにて接続する。
 次いで、上述の作業との先後を問わないが、プレゼンテーターは、通信装置200の入力装置202を操作して、通信装置200に、各受信側コンピュータ300に送られた圧縮データを処理する、受信側コンピュータ300におけるソフトウエアを指定する数値を入力するとともに、聴衆に、自らが持つ受信側コンピュータ300に対して、受信側コンピュータ300に送られた圧縮データを処理する、受信側コンピュータ300におけるソフトウエアを指定する数値の一部を入力させる。聴衆はその数値を、入力装置302の操作により入力する。
 一般に、ポート番号の数値は、8255というデフォルトの数値に対して、所定の数値を加算して、決定されるようになっている。この実施形態では、プレゼンテーターは、入力装置202を操作して、8255+所定の数値(例えば1000)+受信側コンピュータ300による圧縮データの受取り及び伸長を許可するべき聴衆に入力させる数値(例えば、10)のうち、所定の数値(例えば1000)と受信側コンピュータ300による圧縮データの受取り及び伸長を許可するべき聴衆に入力させる数値(例えば、10)を合算した数値を入力する。これを受取った制御部222は、ポート番号を9265と決定する。
 他方、この実施形態では、聴衆の持つ受信側コンピュータ300にインストールされているコンピュータプログラムには、8255+所定の数値(例えば1000)が予め、入力されており、聴衆が、入力装置302を操作して入力された数値が、制御部322により、これに更に加えられるようになっている。そして、8255+所定の数値(例えば1000)は聴衆から見えないように設定されている。プレゼンテーターは、聴衆が入力すべき正しい数値(これは上述のように10である。)を、プレゼンテーションに参加して、圧縮データを受取り伸長してもよい聴衆にのみ何からの方法で通知する。その正しい通知を知っている聴衆のみが、受信側コンピュータ300に送られた圧縮データを処理する、受信側コンピュータ300におけるソフトウエアを指定する数値である9265という数値を得られることになる。上述のように、ポート番号のデフォルトの8255という数値に加えて、ユーザには見えない所定の数値(例えば1000)が受信側コンピュータ300に送られた圧縮データを処理する、受信側コンピュータ300におけるソフトウエアを指定する数値の決定に用いられているので、悪意の第三者が、受信側コンピュータ300に送られた圧縮データを処理する、受信側コンピュータ300におけるソフトウエアを指定する数値を知ることは難しくなっている。
 通信装置200では、決定されたポート番号についての数値は、制御部222から無線LAN制御部225に送られる。
 また、受信側コンピュータ300では、決定された、受信側コンピュータ300に送られた圧縮データを処理する、受信側コンピュータ300におけるソフトウエアを指定する数値は、指定情報解析部323に送られる。
In order to use this communication system, the presenter first connects the analog output terminal of the transmitting computer 100 and the analog input terminal of the communication device 200 with the analog cable 100A.
The presenter then operates the input device 202 of the communication device 200 to process the compressed data sent to each receiving-side computer 300, regardless of whether the above work is performed or not. The software in the receiving computer 300 that inputs the numerical value designating the software in the receiving computer 300 and processes the compressed data sent to the receiving computer 300 to the receiving computer 300 owned by the audience. Enter a part of the numerical value that specifies. The audience inputs the numerical value by operating the input device 302.
Generally, the numerical value of the port number is determined by adding a predetermined numerical value to the default numerical value of 8255. In this embodiment, the presenter operates the input device 202 to input 8255 + predetermined numerical value (for example, 1000) + a numerical value (for example, 10) that is input to an audience to be permitted to receive and decompress compressed data by the receiving computer 300. ), A numerical value obtained by adding a predetermined numerical value (for example, 1000) and a numerical value (for example, 10) that is input to the audience to be permitted to receive and decompress the compressed data by the receiving computer 300 is input. Receiving this, the control unit 222 determines that the port number is 9265.
On the other hand, in this embodiment, 8255 + a predetermined numerical value (for example, 1000) is input in advance in the computer program installed in the receiving computer 300 of the audience, and the audience operates the input device 302. The input numerical value is further added by the control unit 322. And 8255 + predetermined numerical value (for example, 1000) is set so as not to be seen from the audience. The presenter informs the correct number (which is 10 as described above) to be entered by the audience in some way only to the audience who may participate in the presentation and receive and decompress the compressed data. . Only the audience who knows the correct notification will be able to obtain a numerical value of 9265, which is a numerical value that specifies the software at the receiving computer 300 that will process the compressed data sent to the receiving computer 300. As described above, software in the receiving computer 300 that processes the compressed data sent to the receiving computer 300 by a predetermined numerical value (for example, 1000) invisible to the user in addition to the default numerical value 8255 of the port number. Since a malicious third party processes the compressed data sent to the receiving computer 300, it is known that the numerical value specifying the software in the receiving computer 300 is used. It's getting harder.
In communication apparatus 200, the numerical value for the determined port number is sent from control unit 222 to wireless LAN control unit 225.
In the receiving computer 300, the numerical value specifying the software in the receiving computer 300 that processes the compressed data sent to the receiving computer 300 is sent to the designation information analysis unit 323.
 この状態で、プレゼンテーターはプレゼンテーションを開始する。
 そのとき、プレゼンテーターは、入力装置102を操作し、制御部122が入力装置102からの操作内容にしたがって、公知のプレゼンテーション用のソフトウエアを実行する。その実行結果についての信号は表示画像データ生成部123に送られる。
 表示画像データ生成部123は、送信側コンピュータ100のディスプレイ101に表示する画像についてのデータを生成する。このデータはフレームバッファに都度書き込まれ、ディスプレイ101に都度送られる。この場合のフレーム数は、例えば30fpsである。このデータに基いて、ディスプレイ101には、プレゼンテーションに用いられる画像が表示される。この画像が表示画像である。
 他方表示画像データ生成部123は、ディスプレイ101にその時点で表示されている表示画像についてのアナログ信号を生成し、それをアナログ出力端子に送る。動画の信号であり、フレームが連続する信号であるアナログ信号は、アナログ出力端子から、アナログケーブル100Aを介して、通信装置200のアナログ入力端子に送られる。
In this state, the presenter starts the presentation.
At that time, the presenter operates the input device 102, and the control unit 122 executes known presentation software according to the operation content from the input device 102. A signal regarding the execution result is sent to the display image data generation unit 123.
The display image data generation unit 123 generates data about an image to be displayed on the display 101 of the transmission side computer 100. This data is written to the frame buffer each time and sent to the display 101 each time. In this case, the number of frames is, for example, 30 fps. Based on this data, an image used for presentation is displayed on the display 101. This image is a display image.
On the other hand, the display image data generation unit 123 generates an analog signal for the display image currently displayed on the display 101 and sends it to the analog output terminal. An analog signal that is a moving image signal and a signal in which frames are continuous is sent from the analog output terminal to the analog input terminal of the communication apparatus 200 via the analog cable 100A.
 通信装置200での以下の処理は基本的に自動的に行われる。
 アナログ入力端子から入力された表示画像についてのアナログ信号は、画像データ生成部223に送られる。画像データ生成部223は、フレームについての信号が連続したアナログ信号から、コマ落としの作業を行い、例えば10fpsの信号にする。10fpsの早さであれば、1秒間に10個の1画面分の信号である画像信号を生成する。画像データ生成部223が生成した画像データは、作られる都度、圧縮部224に送られる。このフレームレートは、通信装置200から受信側コンピュータ300への無線でのデータ送信の早さにもよるが、1秒間に数回から数十回の範囲とする。
 圧縮部224は、画像データを受取る都度、受け取った画像データの圧縮を行い圧縮データとする。画像データの圧縮は、この実施形態では、JPEG形式で行う。もちろん、圧縮データの大きさは、画像データの大きさよりも小さくなる。圧縮部224は、圧縮データを生成する都度、それを無線LAN制御部225に送る。
 無線LAN制御部225は、圧縮データをパケットに分割し、また、それらパケットの先端にヘッダを付ける。ヘッダには、自らのIPアドレス、これらから送信する圧縮データの容量を示す情報である容量情報、上述のポート番号、等が書き込まれる。これらヘッダと多数の圧縮データについてのパケットは、無線LAN通信部へ送られ、無線LAN通信部から、各受信側コンピュータ300へ送られることになる。
The following processing in the communication device 200 is basically performed automatically.
An analog signal for a display image input from the analog input terminal is sent to the image data generation unit 223. The image data generation unit 223 performs a frame dropping operation from an analog signal in which signals for frames are continuous, for example, a signal of 10 fps. If the speed is 10 fps, ten image signals corresponding to one screen are generated per second. The image data generated by the image data generation unit 223 is sent to the compression unit 224 every time it is created. This frame rate ranges from several times to several tens of times per second, although it depends on the speed of wireless data transmission from the communication device 200 to the receiving computer 300.
Whenever the image data is received, the compression unit 224 compresses the received image data to obtain compressed data. In this embodiment, the image data is compressed in the JPEG format. Of course, the size of the compressed data is smaller than the size of the image data. Each time the compression unit 224 generates compressed data, it sends it to the wireless LAN control unit 225.
The wireless LAN control unit 225 divides the compressed data into packets and attaches a header to the leading end of the packets. The header is written with its own IP address, capacity information which is information indicating the capacity of compressed data transmitted from these, the above-mentioned port number, and the like. Packets of these headers and a large number of compressed data are sent to the wireless LAN communication unit, and are sent from the wireless LAN communication unit to each receiving computer 300.
 ヘッダを先頭とした圧縮データについての一連のパケットは、受信側コンピュータ300の無線LAN通信部によって受取られる。受取られたそれらデータは、指定情報解析部323に送られる。
 指定情報解析部323は、それらデータを受取ったときに、ヘッダに書き込まれた上述の情報を読み出す。指定情報解析部323は、圧縮データのパケットのヘッダに書き込まれていたポート番号と、制御部322から送られてきた、受信側コンピュータ300が受けとった圧縮データを、受信側コンピュータ300にインストールされているどのソフトウエアで処理するかを決定するための数値とを、比較する。それら数値が一致した場合には、指定情報解析部323は、受信側コンピュータ300が受取った圧縮データのパケットを、容量情報とともに同一性判定部324に送る。
 正しい数値を入力装置302から入力できなかったために、指定情報解析部323に制御部322から受信側コンピュータ300が受けとった圧縮データを、受信側コンピュータ300にインストールされているどのソフトウエアで処理するかを決定するための正しい数値を得られなかった聴衆の受信側コンピュータ300では、以後の処理が行われない。
A series of packets of compressed data starting from the header is received by the wireless LAN communication unit of the receiving computer 300. The received data is sent to the designation information analysis unit 323.
When the designation information analysis unit 323 receives the data, the designation information analysis unit 323 reads the above-described information written in the header. The designation information analyzing unit 323 is installed in the receiving computer 300 with the port number written in the header of the compressed data packet and the compressed data received from the control unit 322 and received by the receiving computer 300. The numerical value for determining which software is to be processed is compared. If the numerical values match, the designation information analysis unit 323 sends the compressed data packet received by the receiving computer 300 to the identity determination unit 324 together with the capacity information.
Which software installed in the receiving computer 300 is used to process the compressed data received by the receiving computer 300 from the control unit 322 in the designation information analysis unit 323 because a correct numerical value cannot be input from the input device 302. In the receiving computer 300 of the audience who has not obtained a correct numerical value for determining, the subsequent processing is not performed.
 同一性判定部324は、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているかについての判定を行う。
 同一性判定部324は、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化していないと判定した場合には、その圧縮データを伸長部325に送り、変化していると判定した場合には、その圧縮データを伸長部325に送らない。
The identity determination unit 324 determines whether the image data obtained when the compressed data is expanded has changed from the original image data before compression.
When it is determined that the image data obtained when the compressed data is expanded has not changed from the original image data before compression, the identity determination unit 324 sends the compressed data to the expansion unit 325, If it is determined that it has changed, the compressed data is not sent to the decompression unit 325.
 同一性判定部324は、例えば、指定情報解析部323から受取った圧縮データの大きさが、容量情報で特定される大きさと同じであれば、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化していないと、指定情報解析部323から受取った圧縮データの大きさが、容量情報で特定される大きさと同じでなければ、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化していると判定するようになっていても良い。
 この実施形態では、同一性判定部324は、以下のようにして、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているか、いないかを判定するようになっている。
 まず、前提として、この実施形態では、通信装置200から受信側コンピュータ300に送られるデータは、図14に示すようなものとなっている。図14に示したように、通信装置200から受信側コンピュータ300に送られるデータは、パケットに分割されている。このデータは、最上段の左側が先頭であり、最下段の右側が終端である。図14中、Pの符号が付された各段のデータのそれぞれが1パケット分のデータである。これらデータは、最後のパケットPを除いて、同じ大きさである。例えば、最後のパケットPを除いて、各パケットPの大きさは1460バイトである。最初のパケットPの先頭にはそれより前のデータがヘッダD1であり、それより後のデータが事実上送信の対象となっているデータ(この実施形態では圧縮データD3)であることを示すスタートブロックD2がある。また、最後のパケットPには、それより前のデータが圧縮データD3であることを示すストップブロックD4がある。また、ヘッダD4の中には、圧縮データの圧縮形式を示すデータD11が含まれている。この実施形態では、このデータD11は、圧縮データがJPEG形式で圧縮されたことを示す、JPEGという文字列である。
 そして、この実施形態における同一性判定部324は、以下のA~Cの基準を用いて、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているか、いないかを判定する。以下の内容を基準とするとき、同一性判定部324は、以下のA~Cの基準のいずれについても、その基準に対する回答がYesの場合には、画像データの大きさに変化があったと、その回答がNoの場合には画像データの大きさに変化がないと判定する。同一性判定部324は、以下の基準の少なくとも一つのみを、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているか、いないかを判定するための基準として用いることもできるが、この実施形態では、以下の基準のすべてを、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているか、いないかを判定するための基準として用いる。つまり、以下の3つの基準のすべてに対する回答がNoの場合には、同一性判定部324は、画像データの大きさに変化がないと判定するが、以下の3つの基準のすくなくとも一つに対する回答がYesの場合には、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化している、と判定する。
 A)スタートブロックD2とストップブロックD4の間にある圧縮データD3の大きさが、ヘッダD1に記載されていたデータの大きさと異なる?
 B)あるパケットPに含まれるデータの大きさが、ヘッダD1に記載されていたデータの大きさと異なり、且つそのパケットPにストップブロックD4が含まれていない?
 C)スタートブロックD2以降に、本来であればヘッダD1に含まれるべき情報(この実施形態では圧縮データD3の圧縮形式を示すデータD11)が含まれている?
 ちなみに上記Aの基準は、受取った圧縮データD3の大きさが、容量情報で特定される大きさと同じであるか否かという上述の基準に相当する。
 上記Bの基準は、各パケットPにデータの欠落或いは欠損がなかったかどうかを監視することにより、圧縮データD3の大きさに変化がないか否かを判定するものである。パケットPにストップブロックD4が含まれているか否かも判断の基準に用いているのは、ストップブロックD4が含まれている最後のパケットPは、他のパケットPよりもそのデータ量が小さいのが通常の状態であるから、ストップブロックD4が含まれているパケットPのデータ量が他のパケットPのデータ量よりも小さくても、データの欠落或いは欠損は生じてないと判定すべきだからである。この場合、上記容量情報には、最後のパケットPを除く各パケットPのデータの容量を特定する情報が含まれ、それに基いて最後のパケットPを除くパケットPにデータの欠落或いは欠損がなかったかどうかの判定がなされることになる。
 上記Cの基準は、スタートブロックD2以降に、圧縮データD3の圧縮形式を示すデータD11が含まれている場合には、本来はヘッダD1の先頭にあるべきデータD11が本来あるべきではないことをもって、圧縮データD3にデータの変化があったと判定すべきである、ということに基づく。
 いずれにせよ、同一性判定部324は、上述したように、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化していないと判定した場合には、その圧縮データを伸長部325に送り、変化していると判定した場合には、その圧縮データを伸長部325に送らない。
For example, if the size of the compressed data received from the designation information analysis unit 323 is the same as the size specified by the capacity information, the identity determination unit 324 obtains image data obtained when the compressed data is expanded. If the size of the compressed data received from the designated information analysis unit 323 is not the same as the size specified by the capacity information unless the original image data before compression is changed, the compressed data is expanded It may be determined that the obtained image data has changed from the original image data before compression.
In this embodiment, the identity determination unit 324 determines whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression as follows. It is like that.
First, as a premise, in this embodiment, data sent from the communication device 200 to the receiving computer 300 is as shown in FIG. As shown in FIG. 14, the data sent from the communication device 200 to the receiving computer 300 is divided into packets. In this data, the left side at the top is the head and the right side at the bottom is the end. In FIG. 14, each of the data at each stage marked with P is data for one packet. These data are the same size except for the last packet P. For example, except for the last packet P, the size of each packet P is 1460 bytes. The start of the first packet P indicates that the data before it is the header D1, and the data after it is the data to be transmitted (compressed data D3 in this embodiment). There is a block D2. The last packet P has a stop block D4 indicating that the previous data is the compressed data D3. Further, the header D4 includes data D11 indicating the compression format of the compressed data. In this embodiment, the data D11 is a character string “JPEG” indicating that the compressed data is compressed in the JPEG format.
The identity determination unit 324 in this embodiment uses the following criteria A to C to determine whether the image data obtained when the compressed data is expanded from the original image data before compression: Determine whether or not. When the following content is used as a reference, the identity determination unit 324 determines that the size of the image data has changed when the answer to the reference is Yes for any of the following criteria A to C If the answer is No, it is determined that there is no change in the size of the image data. The identity determination unit 324 determines whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression based on at least one of the following criteria: In this embodiment, all of the following criteria are used to determine whether the image data obtained when decompressing the compressed data has changed from the original image data before compression. It is used as a reference for judging. That is, if the answer to all of the following three criteria is No, the identity determination unit 324 determines that there is no change in the size of the image data, but the answer to at least one of the following three criteria: Is Yes, it is determined that the image data obtained when the compressed data is expanded has changed from the original image data before compression.
A) Is the size of the compressed data D3 between the start block D2 and the stop block D4 different from the size of the data described in the header D1?
B) The size of data included in a packet P is different from the size of data described in the header D1, and the packet P does not include the stop block D4.
C) After the start block D2, information that should originally be included in the header D1 (data D11 indicating the compression format of the compressed data D3 in this embodiment) is included?
Incidentally, the above-mentioned criterion A corresponds to the above-mentioned criterion as to whether or not the size of the received compressed data D3 is the same as the size specified by the capacity information.
The criterion B is to determine whether or not there is any change in the size of the compressed data D3 by monitoring whether or not each packet P is missing or missing data. Whether or not the packet P includes the stop block D4 is used as a criterion for determination. The last packet P including the stop block D4 has a smaller data amount than other packets P. This is because, since it is a normal state, it should be determined that no data is lost or lost even if the data amount of the packet P including the stop block D4 is smaller than the data amount of the other packets P. . In this case, the capacity information includes information for specifying the data capacity of each packet P except for the last packet P, and based on this, the packet P except for the last packet P has no missing or missing data. A determination of whether or not will be made.
The criterion of C is that if the data D11 indicating the compression format of the compressed data D3 is included after the start block D2, the data D11 that should originally be at the head of the header D1 should not exist. Based on the fact that it should be determined that there has been a data change in the compressed data D3.
In any case, as described above, when the identity determination unit 324 determines that the image data obtained when decompressing the compressed data has not changed from the original image data before compression, If the compressed data is sent to the decompression unit 325 and it is determined that the compressed data has changed, the compressed data is not sent to the decompression unit 325.
 伸長部325は、指定情報解析部323から圧縮データを受取ると、その圧縮データを伸長して画像データに戻す。伸長部325は、圧縮データを伸長して得た画像データを、表示画像データ生成部326に送る。
 表示画像データ生成部326は、伸長部325から受付けた画像データに基いて、その画像データに基づく画像を、画像データを受取る都度ディスプレイ301に表示させる。受信側コンピュータ300のディスプレイ301に表示される表示画像は、送信側コンピュータ100のディスプレイ101に表示される表示画像と基本的に同じ(略実時間で同じ)ものではあるが、そのフレーム数が、送信側コンピュータ100のディスプレイ101に表示される表示画像よりも幾らか落ちたものとなる。表示画像の表示に用いられる画像データは、圧縮前の元の画像データから変化していないと判定されたもののみであり、圧縮前の元の画像データから変化していると判定された画像データは表示画像の表示には用いられない。
 つまり、本来であれば、表示画像データ生成部326は、受信側コンピュータ300が圧縮データを受取る度に、その圧縮データを伸長して得られる画像データに基づく画像をディスプレイ301に表示するが、同一性判定部324に、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化していないと判定された圧縮データによる画像データに基づく画像は、ディスプレイ301には表示されない。その場合には、その一つ前の画像が、次の画像がディスプレイ301に表示されるまで、ディスプレイ301に表示され続けることになる。
When receiving the compressed data from the designation information analyzing unit 323, the decompressing unit 325 decompresses the compressed data and returns it to image data. The decompression unit 325 sends image data obtained by decompressing the compressed data to the display image data generation unit 326.
Based on the image data received from the decompression unit 325, the display image data generation unit 326 causes the display 301 to display an image based on the image data every time the image data is received. The display image displayed on the display 301 of the receiving computer 300 is basically the same as the display image displayed on the display 101 of the transmitting computer 100 (same in real time), but the number of frames is This is somewhat lower than the display image displayed on the display 101 of the transmitting computer 100. The image data used for displaying the display image is only the image data determined to be unchanged from the original image data before compression, and the image data determined to be changed from the original image data before compression Is not used to display a display image.
In other words, the display image data generation unit 326 normally displays an image based on the image data obtained by decompressing the compressed data every time the receiving computer 300 receives the compressed data. The image based on the compressed image data determined that the image data obtained when the compressed data is decompressed by the sex determining unit 324 is not changed from the original image data before compression is displayed on the display 301. Do not show. In that case, the previous image is continuously displayed on the display 301 until the next image is displayed on the display 301.
 聴衆は、ディスプレイ301に表示された表示画像を見ながら、プレゼンテーターが提供するプレゼンテーションを聞くことができる。それにより、プレゼンテーション用の配布資料を紙で配布する必要がなくなる。
 表示画像に例えば小さい文字が表示されている等の理由で表示画像が見難い場合には、聴衆は、受信側コンピュータ300が備えているのであれば、ピンチ等の機能を使って表示画像を拡大することにより、小さい文字もはっきりと認識することができるし、また、表示画像のうちの自分が特に着目したい部分を拡大して見ることができる。
 また、聴衆は、ディスプレイ301に表示された表示画像を見ながら、保存したい表示画像がディスプレイ301に表示されたタイミングで、受信側コンピュータ300が備えているのであれば、プリントスクリーン等の表示画像を保存する機能によって、表示画像のデータを受信側コンピュータ300の例えばハードディスクドライブ315に保存することができる。それにより、配布資料を紙で配布する必要が益々なくなる。
 受信側コンピュータ300としても用いられることが予定されている、今時の携帯端末には、表示画像の拡大、表示画像の保存の機能は大抵備えられているが、それら機能の少なくとも一つを、本願発明によるコンピュータを受信側コンピュータ300として機能させるためのコンピュータプログラムに持たせておいても構わない。
The audience can listen to the presentation provided by the presenter while viewing the display image displayed on the display 301. Thereby, it is not necessary to distribute the distribution material for presentation on paper.
If the display image is difficult to see because, for example, small characters are displayed on the display image, the audience can enlarge the display image using a function such as pinch if the receiving computer 300 is equipped. By doing so, small characters can be clearly recognized, and a portion of the displayed image that the user particularly wants to focus on can be enlarged and viewed.
In addition, the audience sees the display image displayed on the display 301, and if the receiving computer 300 has the display image to be stored at the timing when the display image is displayed on the display 301, the audience displays the display image such as a print screen. With the saving function, display image data can be saved in, for example, the hard disk drive 315 of the receiving computer 300. As a result, the need to distribute handouts on paper is increasingly reduced.
The mobile terminals of this time, which are scheduled to be used as the receiving computer 300, are usually provided with functions for enlarging the display image and saving the display image. A computer program for causing the computer according to the invention to function as the receiving computer 300 may be provided.
 以下、第1実施形態の変形例について説明する。以下に説明する各変形例は、事実上、同一性判定部で実行される「その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているかについての判定」方法の変形例である。 Hereinafter, modifications of the first embodiment will be described. Each modification described below is actually executed by the identity determination unit “determination as to whether the image data obtained when the compressed data is expanded has changed from the original image data before compression” Is a variation of the method.
<変形例1>
 第1実施形態の同一性判定部324では、圧縮データの大きさが、その圧縮データを送信側コンピュータ100から受信側コンピュータ300に送信するときにその圧縮データの先頭に付されていたヘッダに書き込まれた容量情報で特定される大きさに一致するか否かによって、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているか否かの判定を行うこととした。
 この手法では、容量情報によって特定される圧縮データの大きさが、圧縮データの大きさに変化があったかを判定するための基準として用いられている。この基準は、例えば、通信装置200と受信側コンピュータ300の間で予め取り決めがなされており、且つその基準を受信側コンピュータ300の同一性判定部324が予め持っているのであれば、受信側コンピュータ300の同一性判定部324はその基準が示す大きさに圧縮データが一致するか否かによって、容量情報に頼らずに、圧縮データの大きさに変化があったか否かを判定することができる。
<Modification 1>
In the identity determination unit 324 of the first embodiment, the size of the compressed data is written in the header attached to the head of the compressed data when the compressed data is transmitted from the transmitting computer 100 to the receiving computer 300. It is determined whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression depending on whether or not it matches the size specified by the capacity information. It was decided.
In this method, the size of the compressed data specified by the capacity information is used as a reference for determining whether the size of the compressed data has changed. For example, if the reference is determined in advance between the communication device 200 and the receiving computer 300 and the identity determining unit 324 of the receiving computer 300 has the reference in advance, the receiving computer The 300 identity determination unit 324 can determine whether the size of the compressed data has changed without depending on the capacity information, depending on whether the compressed data matches the size indicated by the reference.
 例えば、同一性判定部324は、例えば、以下のようにして、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているか、いないかを判定するようになっていてもよい。この場合も、通信装置200から受信側コンピュータ300に送られるデータは、図14に示すようなデータ構造を採ることを前提とする。
 変形例1における同一性判定部324は、以下のD~Fの基準を用いて、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているか、いないかを判定する。以下の内容を基準とするとき、同一性判定部324は、以下のD~Fの基準のいずれについても、その基準に対する回答がYesの場合には、画像データの大きさに変化があったと、その回答がNoの場合には画像データの大きさに変化がないと判定する。同一性判定部324は、以下の基準の少なくとも一つのみを、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているか、いないかを判定するための基準として用いることもできるし、以下の基準のすべてを、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているか、いないかを判定するための基準として用いることもできる。
 D)スタートブロックD2とストップブロックD4の間にある圧縮データD3の大きさが、通信装置200と受信側コンピュータ300との間で予め決められていたデータの大きさと異なる?
 E)あるパケットPに含まれるデータの大きさが、通信装置200と受信側コンピュータ300との間で予め決められていたデータの大きさと異なり、且つそのパケットPにストップブロックD4が含まれていない?
 F)スタートブロックD2以降に、本来であればヘッダD1に含まれるべき情報(この実施形態では圧縮データD3の圧縮形式を示すデータD11)が含まれている?
For example, the identity determination unit 324 determines whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression as follows, for example. It may be. Also in this case, it is assumed that data sent from the communication apparatus 200 to the receiving computer 300 has a data structure as shown in FIG.
The identity determination unit 324 according to Modification 1 uses the following criteria D to F to determine whether the image data obtained when decompressing the compressed data has changed from the original image data before compression: Determine whether. When the following content is used as a reference, the identity determination unit 324 determines that the size of the image data has changed when the answer to the reference is Yes for any of the following criteria D to F. If the answer is No, it is determined that there is no change in the size of the image data. The identity determination unit 324 determines whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression based on at least one of the following criteria: It is also possible to use all of the following criteria to determine whether the image data obtained when decompressing the compressed data has changed from the original image data before compression. It can also be used as a reference.
D) Is the size of the compressed data D3 between the start block D2 and the stop block D4 different from the size of data determined in advance between the communication device 200 and the receiving computer 300?
E) The size of data included in a packet P is different from the size of data determined in advance between the communication apparatus 200 and the receiving computer 300, and the packet P does not include the stop block D4. ?
F) Is information (data D11 indicating the compression format of the compressed data D3 in this embodiment) that should be included in the header D1 after the start block D2 originally included?
<変形例2>
 第1実施形態では、通信装置200の無線LAN制御部225は、圧縮データを送信するために圧縮データの先頭に付すヘッダに、他の情報とともに、容量情報を書き込むようになっていた。
 変形例2の通信装置200の無線LAN制御部225は、圧縮データを送信するために圧縮データの先頭に付すヘッダに、上述の他の情報と、容量情報に代わる、判定用データ特定情報が書き込まれる。判定用データ特定情報は、圧縮データのどこに、どのような判定用データを含めたかを特定するための情報である。判定用データは、それがあるべき位置にあるか否かにより、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているか否かの判定を行えるデータであり、画像データ、或いは圧縮データとは本来的に無関係なデータである。もっと言えば、そのデータの内容は何でも構わない。
 また、変形例2の受信側コンピュータ300の同一性判定部324は、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているか否かの判定を行うが、その具体的な手法は以下のとおりである。
 同一性判定部324は、それをヘッダから読みだした指定情報解析部323から、判定用データ特定情報を受取る。判定用データ特定情報は、圧縮データのどこに、どのような判定用データを含めたかを特定するための情報である。同一性判定部324は、圧縮データに対して、圧縮データの指定情報解析部323から受取った判定用データ特定情報で特定される位置に、判定用データ特定情報で特定される内容のデータが存在するか否かの判定を行う。その結果、圧縮データの予定された位置(判定用データ特定情報で特定される位置)に、予定されていた内容(判定用データ特定情報で特定される内容)の判定用データが存在すれば、同一性判定部324は、その圧縮データには変化がない、つまり、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化していないと判定する。逆に、圧縮データの予定された位置に、予定されていた内容の判定用データが存在しなければ、同一性判定部324は、その圧縮データは変化した、つまり、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化していると判定する。
 例えば、判定用データ特定情報は、「圧縮データには、先頭から○○バイト毎に、「00000000」というデータが書き込まれている。」といった内容である。同一性判定部324は、圧縮データの中にそのようなデータが存在するか否かを判定することにより、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化したか否かを判定することができる。この例が示すように、判定用データは複数であっても良い。なお、判定用データが複数である場合には、判定用データはすべてが同じものである必要はない。
<Modification 2>
In the first embodiment, the wireless LAN control unit 225 of the communication device 200 writes capacity information together with other information in a header attached to the head of the compressed data in order to transmit the compressed data.
The wireless LAN control unit 225 of the communication apparatus 200 according to the second modification writes the above-described other information and determination data specifying information instead of the capacity information in the header attached to the head of the compressed data in order to transmit the compressed data. It is. The determination data specifying information is information for specifying where and what determination data is included in the compressed data. The determination data is data that can be used to determine whether or not the image data obtained when decompressing the compressed data has changed from the original image data before compression, depending on whether or not it is at the position where it should be. It is data that is essentially unrelated to image data or compressed data. In other words, the content of the data is irrelevant.
In addition, the identity determination unit 324 of the reception-side computer 300 according to the second modification determines whether or not the image data obtained when the compressed data is expanded has changed from the original image data before compression. However, the specific method is as follows.
The identity determination unit 324 receives the determination data specifying information from the designation information analysis unit 323 that has read it from the header. The determination data specifying information is information for specifying where and what determination data is included in the compressed data. The identity determination unit 324 has the data specified by the determination data specification information at the position specified by the determination data specification information received from the compressed data designation information analysis unit 323 with respect to the compressed data. It is determined whether or not to do so. As a result, if there is determination data of the planned content (content specified by the determination data specifying information) at the planned position (position specified by the determination data specifying information) of the compressed data, The identity determination unit 324 determines that the compressed data has not changed, that is, the image data obtained when the compressed data is expanded has not changed from the original image data before compression. On the other hand, if there is no data for determination of the planned content at the planned position of the compressed data, the identity determination unit 324 has changed the compressed data, that is, when the compressed data is expanded. It is determined that the obtained image data has changed from the original image data before compression.
For example, in the determination data specifying information, “data“ 00000000 ”is written in the compressed data for each XX byte from the top. ". The identity determination unit 324 determines whether or not such data exists in the compressed data, so that the image data obtained when the compressed data is expanded is obtained from the original image data before compression. It can be determined whether or not it has changed. As shown in this example, the determination data may be plural. When there are a plurality of determination data, the determination data need not all be the same.
<変形例3>
 第1実施形態に対する変形例1と同様の関係が、変形例2と変形例3の間にも成り立っている。
 変形例2の同一性判定部324では、判定用データ特定情報によって特定される、圧縮データのどこに、どのような内容の判定用データが含まれているか、という情報を基準として、圧縮データに変化があったか否かを判定することとしていた。そして、その基準を示す判定用データ特定情報は、ヘッダに書き込まれて、通信装置200から受信側コンピュータ300に送られるようになっていた。
 これに対して、変形例3では、圧縮データのどこに、どのような内容の判定用データが含まれているかという、圧縮データに変化があったか否かを判定するための基準となる情報を、予め通信装置200と受信側コンピュータ300との間で取り決めておく。そしてその情報を予め、同一性判定部324に持たせておく。そうすることにより、受信側コンピュータ300の同一性判定部324は、判定用データ特定情報がなかったとしても、圧縮データの予定された位置に、予定されていた内容の判定用データが存在するか否か、ひいては、圧縮データに変化があったか否か、更には、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化したか否かを判定することができる。
<Modification 3>
The same relationship as that of Modification 1 with respect to the first embodiment is also established between Modification 2 and Modification 3.
In the identity determination unit 324 of the second modification, the compressed data is changed based on the information that is specified by the determination data specifying information and where the content of the determination data is included in the compressed data. It was decided to determine whether or not there was. The determination data specifying information indicating the reference is written in the header and transmitted from the communication device 200 to the receiving computer 300.
On the other hand, in Modification 3, information serving as a reference for determining whether or not there is a change in the compressed data, such as where the compressed data includes what kind of determination data is included, is stored in advance. Arrangements are made between the communication device 200 and the receiving computer 300. The information is given to the identity determination unit 324 in advance. By doing so, even if there is no determination data specifying information, the identity determination unit 324 of the receiving computer 300 has the determination data of the planned contents at the planned position of the compressed data. It is possible to determine whether or not the compressed data has changed, and further whether or not the image data obtained by decompressing the compressed data has changed from the original image data before compression. .
<変形例4>
 第1実施形態では、受信側コンピュータ300の同一性判定部324は、圧縮データの大きさに変化があったか否かをもって、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化したか否かの判定を行うものとなっていた。これに対し、変形例4の受信側コンピュータ300の同一性判定部324は、伸長された後の画像データの大きさに変化があったか否かをもって、画像データに圧縮前の元の画像データから変化が生じたか否かの判定を行う。
 変形例4の通信装置200でも、無線LAN制御部225は、圧縮データを送信するために圧縮データの先頭に付すヘッダに、容量情報を書き込むようになっている。ただし、この容量情報は、第1実施形態の場合の圧縮データの大きさを特定するものであった容量情報とは異なり、そのヘッダが付される圧縮データの元となった圧縮される前の画像データの大きさを特定するためのものである。その書き込みが可能なように、変形例4の通信装置200では、例えば、画像データ生成部223又は圧縮部224から、無線LAN制御部225へ、圧縮前の画像データの大きさが伝えられる。
 他方、変形例4の受信側コンピュータ300に形成される機能ブロックは、図9に示したようなものである。この機能ブロックは、図8で示した機能ブロックと比べると、同一性判定部324と、伸長部325が入れ替わったものとなっている。
 第1実施形態では、指定情報解析部323は、圧縮データのパケットのヘッダに書き込まれていたポート番号と、制御部322から送られてきた、受信側コンピュータ300が受けとった圧縮データを、受信側コンピュータ300にインストールされているどのソフトウエアで処理するかを決定するための数値とを、比較し、それら数値が一致した場合には圧縮データを、同一性判定部324に送るものとなっていた。しかしながら、変形例4の指定情報解析部323は、圧縮データの送り先が、同一性判定部324ではなく、伸長部325になっている。伸長部325は第1実施形態の場合と同様に圧縮データを伸長して画像データに戻す。変形例4の伸長部325は、その画像データを、同一性判定部324に送る。
 同一性判定部324は、ヘッダからそれを読み取っていた指定情報解析部323から予め、容量情報を受けとっている。同一性判定部324はその容量情報で特定されるその画像データの大きさを基準として、画像データに圧縮前の元の画像データから変化が生じたか否かを判定する。同一性判定部324は、画像データに圧縮前の元の画像データから変化が生じなかったと判定すれば、その画像データを表示画像データ生成部326に送り、画像データに圧縮前の元の画像データから変化が生じたと判定すればその画像データを表示画像データ生成部326に送らない。
<Modification 4>
In the first embodiment, the identity determination unit 324 of the reception-side computer 300 determines whether or not the size of the compressed data has changed, and the image data obtained when the compressed data is decompressed is the original data before compression. It is determined whether or not the image data has changed. On the other hand, the identity determination unit 324 of the reception-side computer 300 according to the modified example 4 changes the image data from the original image data before compression depending on whether or not the size of the decompressed image data has changed. It is determined whether or not the error occurred.
Also in the communication apparatus 200 according to the fourth modification, the wireless LAN control unit 225 writes capacity information in a header attached to the head of the compressed data in order to transmit the compressed data. However, this capacity information is different from the capacity information that specifies the size of the compressed data in the case of the first embodiment, and before the compression that is the source of the compressed data to which the header is attached. This is for specifying the size of the image data. In the communication device 200 according to the fourth modification, for example, the size of the image data before compression is transmitted from the image data generation unit 223 or the compression unit 224 to the wireless LAN control unit 225 so that the writing can be performed.
On the other hand, the functional blocks formed in the reception-side computer 300 of the fourth modification are as shown in FIG. Compared with the functional block shown in FIG. 8, this functional block is obtained by replacing the identity determining unit 324 and the extending unit 325.
In the first embodiment, the designation information analysis unit 323 receives the port number written in the header of the compressed data packet and the compressed data received by the receiving computer 300 sent from the control unit 322. A numerical value for determining which software installed in the computer 300 is used for processing is compared, and if the numerical values match, the compressed data is sent to the identity determination unit 324. . However, in the designation information analysis unit 323 of Modification 4, the compressed data destination is not the identity determination unit 324 but the expansion unit 325. The decompressing unit 325 decompresses the compressed data and returns it to the image data as in the first embodiment. The decompression unit 325 according to the modification 4 sends the image data to the identity determination unit 324.
The identity determination unit 324 receives capacity information in advance from the designation information analysis unit 323 that has read it from the header. The identity determination unit 324 determines whether or not the image data has changed from the original image data before compression, based on the size of the image data specified by the capacity information. If the identity determination unit 324 determines that the image data has not changed from the original image data before compression, the identity determination unit 324 sends the image data to the display image data generation unit 326, and the image data is converted to the original image data before compression. If it is determined that a change has occurred, the image data is not sent to the display image data generation unit 326.
<変形例5>
 第1実施形態に対する変形例1への変形と同様の変形を、変形例4に対して行ったのが変形例5である。
 変形例5では、通信装置200と、受信側コンピュータ300の間で画像データの大きさに関する基準について、予め取り決めがなされており、且つその基準を受信側コンピュータ300の同一性判定部324が予め持っている。これにより、ヘッダに容量情報を書き込んで通信装置200から受信側コンピュータ300に送ることをしなくとも、受信側コンピュータ300の同一性判定部324はその基準が示す大きさに画像データが一致するか否かによって、圧縮データの大きさに変化があったか否かを判定することができる。
<Modification 5>
In the fifth modification, the same modification as the modification to the first modification with respect to the first embodiment is performed on the fourth modification.
In the fifth modification example, the communication device 200 and the receiving computer 300 have a predetermined agreement regarding the size of the image data, and the identity determination unit 324 of the receiving computer 300 has the reference in advance. ing. Thus, even if the capacity information is not written in the header and sent from the communication apparatus 200 to the receiving computer 300, the identity determination unit 324 of the receiving computer 300 matches the image data with the size indicated by the reference. Whether or not there is a change in the size of the compressed data can be determined depending on whether or not the compressed data is received.
<変形例6>
 第1実施形態の容量情報を判定用データ特定情報に置換え、受信側コンピュータ300の同一性判定部324に、その圧縮データの大きさが容量情報で特定される大きさと同じかどうかではなく、圧縮データの予定された位置に、予定された内容の判定用データが存在するか否かによって圧縮データに変化があったか否かを判定するようにしていたのが変形例2である。
 変形例6は、第1実施形態を変形例2に変形したときと同じ変形を、変形例5に加えたものである。つまり、変形例6の同一性判定部324は、その画像データの大きさが容量情報で特定される大きさと同じかどうかではなく、画像データの予定された位置に、予定された内容の判定用データが存在するか否かによって画像データに変化があったか否かを判定する。
<Modification 6>
The capacity information of the first embodiment is replaced with determination data specifying information, and the identity determination unit 324 of the receiving computer 300 is not compressed whether the size of the compressed data is the same as the size specified by the capacity information. In the second modification, it is determined whether or not there is a change in the compressed data depending on whether or not determination data having a predetermined content exists at a predetermined position of the data.
In the sixth modification, the same modification as that obtained when the first embodiment is modified into the second modification is added to the fifth modification. That is, the identity determination unit 324 according to the modification 6 determines whether the image data has the same size as that specified by the capacity information, but does not determine whether the image data has a predetermined position. It is determined whether or not there is a change in the image data depending on whether or not the data exists.
<変形例7>
 変形例7は、第1実施形態を変形例1へ変形する際に加えた、又は変形例4を変形例5へ変形する際に加えた変形と同様の変形を、変形例6に加えたものである。
 変形例7では、通信装置200と、受信側コンピュータ300の間で画像データのどこにどのような内容の判定用データが含められるか予め取り決めがなされており、且つその取決められた基準を受信側コンピュータ300の同一性判定部324が予め持っている。これにより、ヘッダに判定用データ特定情報を書き込んで通信装置200から受信側コンピュータ300に送ることをしなくとも、受信側コンピュータ300の同一性判定部324は、それが持っている上述の基準が示す位置にその基準が示す通りの判定用データが存在するか否かによって、画像データの大きさに変化があったか否かを判定することができる。
<Modification 7>
Modified example 7 is the same as the modified example added to the modified example 6 when the first embodiment is transformed into the modified example 1 or when the modified example 4 is transformed into the modified example 5. It is.
In the modified example 7, it is determined in advance between the communication apparatus 200 and the receiving computer 300 where and what kind of determination data is included in the image data, and the determined reference is used as the receiving computer. 300 identity determination units 324 have in advance. As a result, even if the determination data specifying information is not written in the header and sent from the communication apparatus 200 to the receiving computer 300, the identity determining unit 324 of the receiving computer 300 can determine whether the above-mentioned standard is included. Whether or not the size of the image data has changed can be determined based on whether or not the determination data as indicated by the reference exists at the indicated position.
≪第2実施形態≫
 第2実施形態の通信システムを図10に示す。
 通信システムは、ビデオカメラ400と、記録装置500と、受信側コンピュータ300とを含んでいる。受信側コンピュータ300は、第1実施形態の受信側コンピュータ300と同じく、例えば携帯端末である。
 ビデオカメラ400が本願発明でいう送信装置であり、受信側コンピュータ300が本願発明でいう受信装置である。
 この実施形態では、受信側コンピュータ300は、ビデオカメラ400のモニタとして使用される。
<< Second Embodiment >>
A communication system according to the second embodiment is shown in FIG.
The communication system includes a video camera 400, a recording device 500, and a receiving computer 300. The receiving computer 300 is, for example, a portable terminal, like the receiving computer 300 of the first embodiment.
The video camera 400 is a transmitting device referred to in the present invention, and the receiving computer 300 is a receiving device referred to in the present invention.
In this embodiment, the receiving computer 300 is used as a monitor of the video camera 400.
 ビデオカメラ400は、図11に示したように構成されている。
 ビデオカメラは、手持ち可能な筐体401を持つ。筐体401の先端には孔401Aが穿たれている。
 筐体401の内部には、例えばCCD、或いはCMOSである撮像素子402が設けられている。撮像素子402は孔401Aを介して筐体401内に入ってくる像光を撮像するものである。撮像素子402は、撮像を行い、動画の信号を生成する。
 また、撮像素子402と孔401Aの間には拡大レンズ403が設けられている。拡大レンズ403は像光を拡大するものである。
 筐体401の内部には、また、例えばLEDである光源404が配置されている。光源404は、撮像素子402で撮像を行うのに必要な照明光を供給するものである。照明光は、孔401Aを介して供給されるようになっている。
 このビデオカメラ400で撮像を行う場合、その焦点は、孔401Aの内側部分に合うようになっている。孔401Aの周囲を撮像の対象となる対象物に当接させて撮像を行うと、手振れのない状態で、孔401Aの内側に位置する対象物の拡大した像が撮像素子402で撮像される。
 ビデオカメラ400は、また、制御回路405を備えている。制御回路405は、撮像素子402の制御を行う回路である。制御回路405は、撮像素子402と接続線406で接続されており、接続線406を介して撮像素子402の制御を行うようになっている。また、制御回路405は、撮像素子402が生成した動画の信号を撮像素子402から受取るようになっている。制御回路405は、チューブ407の内部の出力線408を介して、記録装置500に接続されている。記録装置500は、出力線408を介して制御回路405から送られてきた動画の信号を記録するものであり、例えばハードディスクドライブを含んでいる。
The video camera 400 is configured as shown in FIG.
The video camera has a housing 401 that can be held by hand. A hole 401 </ b> A is formed at the tip of the housing 401.
An imaging element 402 that is, for example, a CCD or a CMOS is provided inside the housing 401. The image sensor 402 captures image light that enters the housing 401 through the hole 401A. The imaging element 402 performs imaging and generates a moving image signal.
Further, a magnifying lens 403 is provided between the image sensor 402 and the hole 401A. The magnifying lens 403 enlarges image light.
Inside the housing 401, a light source 404, for example, an LED is disposed. The light source 404 supplies illumination light necessary for imaging with the image sensor 402. The illumination light is supplied through the hole 401A.
When imaging is performed with the video camera 400, the focal point is adapted to the inner portion of the hole 401A. When imaging is performed by bringing the periphery of the hole 401 </ b> A into contact with an object to be imaged, an enlarged image of the object positioned inside the hole 401 </ b> A is captured by the image sensor 402 without shaking.
The video camera 400 also includes a control circuit 405. The control circuit 405 is a circuit that controls the image sensor 402. The control circuit 405 is connected to the image sensor 402 via a connection line 406, and controls the image sensor 402 via the connection line 406. The control circuit 405 is configured to receive a moving image signal generated by the image sensor 402 from the image sensor 402. The control circuit 405 is connected to the recording apparatus 500 via an output line 408 inside the tube 407. The recording device 500 records a moving image signal sent from the control circuit 405 via the output line 408, and includes, for example, a hard disk drive.
 制御回路405は、第1実施形態の通信装置200が備えていたのと同様のハードウエア構成となっており、CPU、ROM、RAM、インターフェイス、及びバスを備えている。CPU、ROM、RAM、インターフェイス、及びバスの機能はいずれも第1実施形態の場合におけるそれらと同様である。また、制御回路405は、無線LANでの通信を行う機能を有している。
 制御回路405のインターフェイスは、接続線406と接続され、動画の信号を撮像素子402から受付けるようになっている。また、制御回路405のインターフェイスは、出力線408と接続され、動画の信号を記録装置500に送るようになっている。
The control circuit 405 has the same hardware configuration as that included in the communication device 200 of the first embodiment, and includes a CPU, a ROM, a RAM, an interface, and a bus. The functions of the CPU, ROM, RAM, interface, and bus are all the same as those in the first embodiment. The control circuit 405 has a function of performing communication via a wireless LAN.
The interface of the control circuit 405 is connected to a connection line 406 so as to receive a moving image signal from the image sensor 402. The interface of the control circuit 405 is connected to the output line 408 so as to send a moving image signal to the recording apparatus 500.
 CPUがコンピュータプログラムを実行することにより、ビデオカメラ内部には、図12で示されたような機能ブロックが生成される。なお、以下の機能ブロックは、上述のコンピュータプログラム単体の機能により生成されていても良いが、上述のコンピュータプログラムと、ビデオカメラ400にインストールされたOSその他のコンピュータプログラムとの協働により生成されても良い。
 ビデオカメラ400の中に生成される機能ブロックは、通信装置200の内部に生成された機能ブロックの一部を省略したものであり、具体的には、画像データ生成部223、圧縮部224、及び無線LAN制御部225である。
When the CPU executes the computer program, a functional block as shown in FIG. 12 is generated inside the video camera. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the video camera 400. Also good.
The functional blocks generated in the video camera 400 are obtained by omitting some of the functional blocks generated in the communication device 200. Specifically, the image data generating unit 223, the compression unit 224, and This is a wireless LAN control unit 225.
 画像データ生成部223、圧縮部224、及び無線LAN制御部225は、第1実施形態の通信装置200の中に生成されたそれらとその機能は変わらない。
 画像データ生成部223は、撮像素子402から入力された撮像素子402が撮像した動画についての信号(この信号は、これには限られないが、第1実施形態と同様、アナログ信号であるものとする。)を受取り、それに基いて画像データを生成するものである。画像データの生成方法は、第1実施形態の画像データ生成部223における場合と同様である。
 圧縮部224は、画像データ生成部223から画像データを受取り、画像データを受取る都度、受け取った画像データを圧縮して圧縮データとする。画像データの圧縮は、第1実施形態の圧縮部で行われていたのと同様の方法で行うことができる。圧縮部224は、圧縮データを生成する都度、それを無線LAN制御部225に送る。
 無線LAN制御部225は、受取った圧縮データをパケットに分割し、それにヘッダを付して、それらデータを無線LAN通信部に送るようになっている。その処理は基本的に、第1実施形態の無線LAN制御部225が行なっていたものと同様であるが、ただし、第2実施形態の無線LAN制御部225は、ポート番号に関する情報をヘッダに書き込むことはしない。
 ヘッダと圧縮データについてのパケットは、無線LAN通信部から、各受信側コンピュータ300へ送られることになる。
The functions of the image data generation unit 223, the compression unit 224, and the wireless LAN control unit 225 are the same as those generated in the communication device 200 of the first embodiment.
The image data generation unit 223 receives a signal regarding the moving image captured by the image sensor 402 input from the image sensor 402 (this signal is not limited to this, but is an analog signal as in the first embodiment). The image data is generated based on this. The image data generation method is the same as that in the image data generation unit 223 of the first embodiment.
The compression unit 224 receives the image data from the image data generation unit 223, and compresses the received image data into compressed data each time the image data is received. The image data can be compressed by the same method as that performed by the compression unit of the first embodiment. Each time the compression unit 224 generates compressed data, it sends it to the wireless LAN control unit 225.
The wireless LAN control unit 225 divides the received compressed data into packets, attaches a header to the packet, and sends the data to the wireless LAN communication unit. The processing is basically the same as that performed by the wireless LAN control unit 225 of the first embodiment, except that the wireless LAN control unit 225 of the second embodiment writes information regarding the port number in the header. I won't do that.
Packets for the header and the compressed data are sent from the wireless LAN communication unit to each receiving computer 300.
 第2実施形態の受信側コンピュータ300は、第1実施形態の場合と同じ、図7に示したようなハードウエアを備えている。 The receiving-side computer 300 of the second embodiment has the same hardware as shown in FIG. 7 as in the first embodiment.
 CPUがコンピュータプログラムを実行することにより、受信側コンピュータ300内部には、図13で示されたような機能ブロックが生成される。なお、以下の機能ブロックは、上述のコンピュータプログラム単体の機能により生成されていても良いが、上述のコンピュータプログラムと、受信側コンピュータ300にインストールされたOSその他のコンピュータプログラムとの協働により生成されても良い。
 受信側コンピュータ300の内部には、同一性判定部324、伸長部325、及び表示画像データ生成部326が生成される。
When the CPU executes the computer program, functional blocks as shown in FIG. 13 are generated in the receiving computer 300. The following functional blocks may be generated by the functions of the above-described computer program alone, but are generated by the cooperation of the above-described computer program and the OS and other computer programs installed in the receiving-side computer 300. May be.
Inside the reception-side computer 300, an identity determination unit 324, an expansion unit 325, and a display image data generation unit 326 are generated.
 第2実施形態における同一性判定部324、伸長部325、及び表示画像データ生成部326の各機能は、第1実施形態のそれらがそれぞれ備えていた機能と同じである。唯一異なるのは、同一性判定部324に圧縮データを送ってくるのは、第1実施形態の場合には指定情報解析部323であったが、第2実施形態の場合にはインターフェイスに接続された無線LAN通信部である、という点である。 The functions of the identity determination unit 324, the decompression unit 325, and the display image data generation unit 326 in the second embodiment are the same as those provided in the first embodiment. The only difference is that the compressed data is sent to the identity determination unit 324 in the case of the first embodiment, but it is connected to the interface in the case of the second embodiment. The wireless LAN communication unit.
 第2実施形態のこの通信システムの使用方法、及び動作は、基本的に第1実施形態の使用方法、及び動作に準じる。第2実施形態のこの通信システムの使用方法、及び動作は、ポート番号を利用して見せたい聴衆にのみに表示画像を見せる技術に関連する部分を除き、第1実施形態の使用方法、及び動作に等しい。 The usage method and operation of the communication system of the second embodiment basically conform to the usage method and operation of the first embodiment. The usage method and operation of this communication system of the second embodiment are the same as the usage method and operation of the first embodiment, except for the part related to the technique of showing the display image only to the audience who wants to show using the port number. be equivalent to.
 この通信システムを用いるには、まず、ビデオカメラ400で撮像を行う。
 ビデオカメラ400の撮像素子402は、動画の信号を生成する。動画の信号は接続線406、制御回路405、出力線408を介して記録装置500に送られ、記録装置500で記録される。
 動画の信号は、また、ビデオカメラ400内の画像データ生成部223に送られる。画像データ生成部223は、フレームについての信号が連続したアナログ信号から、コマ落としの作業を行う。画像データ生成部223が生成した画像データは、作られる都度、圧縮部224に送られる。
 圧縮部224は、画像データを受取る都度、受け取った画像データの圧縮を行い圧縮データとする。圧縮部224は、圧縮データを生成する都度、それを無線LAN制御部225に送る。
 無線LAN制御部225は、圧縮データをパケットに分割し、また、それらパケットの先端にヘッダを付ける。これらヘッダと多数の圧縮データについてのパケットは、無線LAN通信部へ送られ、無線LAN通信部から、各受信側コンピュータ300へ送られることになる。
To use this communication system, first, the video camera 400 takes an image.
The image sensor 402 of the video camera 400 generates a moving image signal. The moving image signal is sent to the recording apparatus 500 via the connection line 406, the control circuit 405, and the output line 408, and is recorded by the recording apparatus 500.
The moving image signal is also sent to the image data generation unit 223 in the video camera 400. The image data generation unit 223 performs a frame dropping operation from an analog signal in which signals for frames are continuous. The image data generated by the image data generation unit 223 is sent to the compression unit 224 every time it is created.
Whenever the image data is received, the compression unit 224 compresses the received image data to obtain compressed data. Each time the compression unit 224 generates compressed data, it sends it to the wireless LAN control unit 225.
The wireless LAN control unit 225 divides the compressed data into packets and attaches a header to the leading end of the packets. Packets of these headers and a large number of compressed data are sent to the wireless LAN communication unit, and are sent from the wireless LAN communication unit to each receiving computer 300.
 ヘッダを先頭とした圧縮データについての一連のパケットは、受信側コンピュータ300の無線LAN通信部によって受取られる。
 ヘッダを先頭とした圧縮データについての一連のパケットは、同一性判定部324に送られる。同一性判定部324は、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化しているかについての判定を行う。その手法は、第1実施形態の場合と同様である。
 同一性判定部324は、その圧縮データを伸長した場合に得られる画像データが、圧縮前の元の画像データから変化していないと判定した場合には、その圧縮データを伸長部325に送り、変化していると判定した場合には、その圧縮データを伸長部325に送らない。
 伸長部325は、同一性判定部324から圧縮データを受取ると、その圧縮データを伸長して画像データに戻す。伸長部325は、圧縮データを伸長して得た画像データを、表示画像データ生成部326に送る。
 表示画像データ生成部326は、伸長部325から受付けた画像データに基いて、その画像データに基づく画像を、画像データを受取る都度ディスプレイ301に表示させる。これは、ビデオカメラ400の撮像素子402で撮像されている動画とフレーム数の違いこそあれ略同じものである。
A series of packets of compressed data starting from the header is received by the wireless LAN communication unit of the receiving computer 300.
A series of packets with compressed data starting from the header is sent to the identity determination unit 324. The identity determination unit 324 determines whether the image data obtained when the compressed data is expanded has changed from the original image data before compression. The method is the same as that in the first embodiment.
When it is determined that the image data obtained when the compressed data is expanded has not changed from the original image data before compression, the identity determination unit 324 sends the compressed data to the expansion unit 325, If it is determined that it has changed, the compressed data is not sent to the decompression unit 325.
When receiving the compressed data from the identity determining unit 324, the decompressing unit 325 decompresses the compressed data and returns it to image data. The decompression unit 325 sends image data obtained by decompressing the compressed data to the display image data generation unit 326.
Based on the image data received from the decompression unit 325, the display image data generation unit 326 causes the display 301 to display an image based on the image data every time the image data is received. This is substantially the same regardless of the difference in the number of frames from the moving image captured by the image sensor 402 of the video camera 400.
 ビデオカメラ400の操作者は、受信側コンピュータ300のディスプレイ301をビデオカメラ400のモニタとして利用することができ、例えば、ディスプレイ301に表示された画像を見ながらビデオカメラ400の位置をずらして、撮像を行う位置を調整することができる。 An operator of the video camera 400 can use the display 301 of the reception-side computer 300 as a monitor of the video camera 400. For example, the operator can shift the position of the video camera 400 while viewing the image displayed on the display 301 to capture the image. Can be adjusted.
 第2実施形態の通信システムにおいても、第1実施形態の変形例のすべてを応用できる。 All the modifications of the first embodiment can be applied to the communication system of the second embodiment.

Claims (15)

  1.  動画のデータを処理する機能を有するとともに、処理される動画のデータから適宜抽出された1画面分のデータである画像データを所定の形式に圧縮した圧縮データとする手段と、前記圧縮データを無線LANを介して送信する手段と、を備えている送信装置、
     と組合せて用いられるものであり、前記送信装置と、無線LANを介しての通信を行うことができるようになっている受信装置であって、
     ディスプレイと、
     前記送信装置から前記圧縮データを随時受付ける受付手段と、
     前記受付手段で受付けた前記圧縮データを伸長する伸長手段と、
     前記画像データに圧縮データとされる前の前記画像データから変化がないか判定する判定手段と、
     前記判定手段により元の画像データから変化がないと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示するとともに、前記判定手段により元の画像データから変化があったと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示しないように制御する表示制御手段と、
     を有する受信装置。
    Means for processing moving picture data, means for converting the image data, which is data for one screen appropriately extracted from the moving picture data to be processed, into compressed data, and the compressed data wirelessly Means for transmitting via a LAN,
    A receiving device configured to be able to communicate with the transmitting device via a wireless LAN,
    Display,
    Accepting means for accepting the compressed data from the transmitting device as needed;
    Decompression means for decompressing the compressed data received by the acceptance means;
    Determination means for determining whether there is a change from the image data before the image data is compressed data;
    An image based on the decompressed image data determined to be unchanged from the original image data by the determining means is displayed on the display, and the decompression determined to have changed from the original image data by the determining means Display control means for controlling not to display an image based on the image data that has been displayed on the display;
    A receiving apparatus.
  2.  前記判定手段は、圧縮データを伸長して得られた前記画像データが予定されていた大きさと同じ場合には、元の画像データから変化がないと判定し、圧縮データを伸長して得られた前記画像データが予定されていた大きさと異なる場合には、元の画像データから変化があったと判定するようになっている、
     請求項1記載の受信装置。
    The determination means determines that there is no change from the original image data when the image data obtained by decompressing the compressed data is the same as the expected size, and obtained by decompressing the compressed data When the image data is different from the planned size, it is determined that there is a change from the original image data.
    The receiving device according to claim 1.
  3.  前記送信装置は、前記圧縮データを送信する場合に前記圧縮データに付されるヘッダに当該ヘッダに続く前記圧縮データの元となった画像データの大きさを特定する容量情報を記載するようになっており、
     前記判定手段は、前記容量情報で特定される大きさを、前記画像データの予定されていた大きさとして扱うようになっている、
     請求項2記載の受信装置。
    When transmitting the compressed data, the transmission device describes in the header attached to the compressed data capacity information for specifying the size of the image data that is the source of the compressed data following the header. And
    The determination means treats the size specified by the capacity information as a planned size of the image data.
    The receiving device according to claim 2.
  4.  前記判定手段は、前記圧縮データが予定されていた大きさと同じ場合には、前記圧縮データを伸長して得られる画像データに元の画像データから変化がないと判定し、前記圧縮データが予定されていた大きさと異なる場合には元の画像データから変化があったと判定するようになっている、
     請求項1記載の受信装置。
    The determination means determines that the image data obtained by decompressing the compressed data is unchanged from the original image data when the compressed data has the same size as the planned size, and the compressed data is scheduled. If it is different from the size, the original image data is judged to have changed.
    The receiving device according to claim 1.
  5.  前記送信装置は、前記圧縮データを送信する場合に前記圧縮データに付されるヘッダに当該ヘッダに続く前記圧縮データの大きさを特定する容量情報を記載するようになっており、
     前記判定手段は、前記容量情報で特定される大きさを、前記圧縮データの予定されていた大きさとして扱うようになっている、
     請求項4記載の受信装置。
    The transmitting device is configured to describe capacity information for specifying the size of the compressed data following the header in a header attached to the compressed data when transmitting the compressed data,
    The determination means treats the size specified by the capacity information as the planned size of the compressed data.
    The receiving device according to claim 4.
  6.  前記送信装置は、前記画像データの所定の位置に、前記画像データとは無関係なデータである判定用データを含めるようになっており、
     前記判定手段は、圧縮データを伸長して得られた画像データの予定された位置に、予定されていた内容の前記判定用データが存在する場合には、元の画像データから変化がないと判定し、圧縮データを伸長して得られた前記画像データの予定された位置に、予定されていた内容の前記判定用データが存在しない場合には、元の画像データから変化があったと判定するようになっている、
     請求項1記載の受信装置。
    The transmitting device includes determination data which is data irrelevant to the image data at a predetermined position of the image data.
    The determination unit determines that there is no change from the original image data when the determination data having the predetermined content is present at a predetermined position of the image data obtained by decompressing the compressed data. Then, when the determination data having the planned content does not exist at the planned position of the image data obtained by decompressing the compressed data, it is determined that the original image data has changed. It has become,
    The receiving device according to claim 1.
  7.  前記送信装置は、前記圧縮データを送信する場合に前記圧縮データに付されるヘッダに当該ヘッダに続く前記圧縮データの元となった画像データのどこに、どのような前記判定用データを含めたかを特定するための判定用データ特定情報を記載するようになっており、
     前記判定手段は、前記判定用データ特定情報で特定される位置と、内容を、画像データの予定された位置に、予定されていた内容の判定用データが存在するか否か判定する際の基準として用いるようになっている、
     請求項6記載の受信装置。
    When transmitting the compressed data, the transmission device determines where and what kind of the determination data is included in the header of the compressed data including the image data that is the source of the compressed data following the header. It has come to describe the data identification information for judgment to identify,
    The determination means is a reference for determining whether or not the determination data of the planned content exists at the predetermined position of the image data with respect to the position and the content specified by the determination data specifying information. It has come to be used as
    The receiving device according to claim 6.
  8.  前記送信装置は、前記圧縮データの所定の位置に、前記圧縮データとは無関係なデータである判定用データを含めるようになっており、
     前記判定手段は、圧縮データの予定された位置に、予定されていた内容の前記判定用データが存在する場合には、その圧縮データを伸長して得られる画像データに元の画像データから変化がないと判定し、圧縮データの予定された位置に、予定されていた内容の前記判定用データが存在しない場合には、その圧縮データを伸長して得られる画像データに元の画像データから変化があったと判定するようになっている、
     請求項1記載の受信装置。
    The transmitter is configured to include determination data, which is data irrelevant to the compressed data, in a predetermined position of the compressed data.
    In the case where the determination data having the planned content is present at the planned position of the compressed data, the determination means changes the image data obtained by decompressing the compressed data from the original image data. If the data for determination does not exist at the scheduled position of the compressed data, the image data obtained by decompressing the compressed data is changed from the original image data. It has come to judge that there was,
    The receiving device according to claim 1.
  9.  前記送信装置は、前記圧縮データを送信する場合に前記圧縮データに付されるヘッダに当該ヘッダに続く前記圧縮データのどこに、どのような前記判定用データを含めたかを特定するための判定用データ特定情報を記載するようになっており、
     前記判定手段は、前記判定用データ特定情報で特定される位置と、内容を、圧縮データの予定された位置に、予定されていた内容の判定用データが存在するか否か判定する際の基準として用いるようになっている、
     請求項8記載の受信装置。
    The transmission device, when transmitting the compressed data, determination data for specifying where and what determination data is included in the compressed data following the header in a header attached to the compressed data Specific information is provided,
    The determination means is a criterion for determining whether or not the determination data of the planned content exists at the predetermined position of the compressed data with respect to the position and content specified by the determination data specifying information. It has come to be used as
    The receiving device according to claim 8.
  10.  前記送信装置は、前記圧縮データを送信する場合に前記圧縮データに付されるヘッダに含まれるべき情報が、前記圧縮データに含まれているときに、元の画像データから変化があると判定するようになっている、
     請求項1記載の受信装置。
    The transmission apparatus determines that there is a change from the original image data when information to be included in a header attached to the compressed data is included in the compressed data when transmitting the compressed data. It looks like
    The receiving device according to claim 1.
  11.  前記圧縮データは、1秒間に数回~数十回前記送信装置から前記受信装置に送られるようになっており、
     前記受付手段は、1秒間に数回~数十回前記送信装置から前記圧縮データを受付けるようになっている、
     請求項1記載の受信装置。
    The compressed data is sent from the transmitting device to the receiving device several times to several tens of times per second,
    The accepting means is adapted to accept the compressed data from the transmitting device several times to several tens of times per second.
    The receiving device according to claim 1.
  12.  前記受信装置は携帯端末である、
     請求項1記載の受信装置。
    The receiving device is a mobile terminal;
    The receiving device according to claim 1.
  13.  動画のデータを処理する機能を有するとともに、処理される動画のデータから適宜抽出された1画面分のデータである画像データを所定の形式に圧縮した圧縮データとする手段と、前記圧縮データを無線LANを介して送信する手段と、を備えている送信装置、
     と組合せて用いられるものであり、前記送信装置と、無線LANを介しての通信を行うことができるようになっているとともに、ディスプレイを有する受信装置にて実行される方法であって、
     前記受信装置が実行する、
     前記送信装置から前記圧縮データを随時受付ける受付過程と、
     受付過程で受付けた前記圧縮データを伸長する伸長過程と、
     前記画像データに圧縮データとされる前の前記画像データから変化がないか判定する判定過程と、
     前記判定過程により元の画像データから変化がないと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示するとともに、前記判定過程により元の画像データから変化があったと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示しないように制御する表示制御過程と、
     を有する方法。
    Means for processing moving picture data, means for converting the image data, which is data for one screen appropriately extracted from the moving picture data to be processed, into compressed data, and the compressed data wirelessly Means for transmitting via a LAN,
    And is a method executed by a receiving device having a display and capable of communicating with the transmitting device via a wireless LAN,
    Executed by the receiving device;
    An accepting process for accepting the compressed data from the transmitting device as needed;
    A decompression process for decompressing the compressed data received in the acceptance process;
    A determination process for determining whether there is a change from the image data before the image data is compressed data;
    An image based on the decompressed image data determined to be unchanged from the original image data by the determination process is displayed on the display, and the decompression determined to have changed from the original image data by the determination process A display control process for controlling not to display an image based on the generated image data on the display;
    Having a method.
  14.  動画のデータを処理する機能を有するとともに、処理される動画のデータから適宜抽出された1画面分のデータである画像データを所定の形式に圧縮した圧縮データとする手段と、前記圧縮データを無線LANを介して送信する手段と、を備えている送信装置、
     と組合せて用いられるものであり、前記送信装置と、無線LANを介しての通信を行うことができるようになっているとともに、ディスプレイを有するコンピュータに、
     前記送信装置から前記圧縮データを随時受付ける受付過程と、
     受付過程で受付けた前記圧縮データを伸長する伸長過程と、
     前記画像データに圧縮データとされる前の前記画像データから変化がないか判定する判定過程と、
     前記判定過程により元の画像データから変化がないと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示するとともに、前記判定過程により元の画像データから変化があったと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示しないように制御する表示制御過程と、
     を実行させるためのコンピュータプログラム。
    Means for processing moving picture data, means for converting the image data, which is data for one screen appropriately extracted from the moving picture data to be processed, into compressed data, and the compressed data wirelessly Means for transmitting via a LAN,
    In addition to being able to communicate with the transmission device via a wireless LAN, a computer having a display is used.
    An accepting process for accepting the compressed data from the transmitting device as needed;
    A decompression process for decompressing the compressed data received in the acceptance process;
    A determination process for determining whether there is a change from the image data before the image data is compressed data;
    An image based on the decompressed image data determined to be unchanged from the original image data by the determination process is displayed on the display, and the decompression determined to have changed from the original image data by the determination process A display control process for controlling not to display an image based on the generated image data on the display;
    A computer program for running.
  15.  動画のデータを処理する機能を有するとともに、処理される動画のデータから適宜抽出された1画面分のデータである画像データを所定の形式に圧縮した圧縮データとする手段と、前記圧縮データを無線LANを介して送信する手段と、を備えている送信装置と、
     前記送信装置と、無線LANを介しての通信を行うことができるようになっている受信装置と、
     を含んでなる通信システムであって、
     前記受信装置は、
     ディスプレイと、
     前記送信装置から前記圧縮データを随時受付ける受付手段と、
     前記受付手段で受付けた前記圧縮データを伸長する伸長手段と、
     前記画像データに圧縮データとされる前の前記画像データから変化がないか判定する判定手段と、
     前記判定手段により元の画像データから変化がないと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示するとともに、前記判定手段により元の画像データから変化があったと判定された伸長された前記画像データに基づく画像を前記ディスプレイに表示しないように制御する表示制御手段と、
     を有する、
     通信システム。
    Means for processing moving picture data, means for converting the image data, which is data for one screen appropriately extracted from the moving picture data to be processed, into compressed data, and the compressed data wirelessly Means for transmitting via a LAN, and a transmission device comprising:
    The transmitting device and a receiving device adapted to perform communication via a wireless LAN;
    A communication system comprising:
    The receiving device is:
    Display,
    Accepting means for accepting the compressed data from the transmitting device as needed;
    Decompression means for decompressing the compressed data received by the acceptance means;
    Determination means for determining whether there is a change from the image data before the image data is compressed data;
    An image based on the decompressed image data determined to be unchanged from the original image data by the determining means is displayed on the display, and the decompression determined to have changed from the original image data by the determining means Display control means for controlling not to display an image based on the image data that has been displayed on the display;
    Having
    Communications system.
PCT/JP2014/069408 2013-07-23 2014-07-23 Reception device, method, and computer program WO2015012297A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2015528302A JP6485352B2 (en) 2013-07-23 2014-07-23 Receiving apparatus, method, computer program

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2013153008 2013-07-23
JP2013-153008 2013-07-23

Publications (1)

Publication Number Publication Date
WO2015012297A1 true WO2015012297A1 (en) 2015-01-29

Family

ID=52393330

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2014/069408 WO2015012297A1 (en) 2013-07-23 2014-07-23 Reception device, method, and computer program

Country Status (2)

Country Link
JP (1) JP6485352B2 (en)
WO (1) WO2015012297A1 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005218728A (en) * 2004-02-09 2005-08-18 Olympus Corp Endoscope
JP2006524873A (en) * 2003-04-24 2006-11-02 ネオパス ネットワークス,インク. Transparent file movement using namespace replication
JP2011203790A (en) * 2010-03-24 2011-10-13 Kddi Corp Image verification device
JP2012124586A (en) * 2010-12-06 2012-06-28 Nippon Telegr & Teleph Corp <Ntt> Video reproducing method, video reproducing device, video reproducing program, and recording medium
JP2012204901A (en) * 2011-03-24 2012-10-22 Olympus Imaging Corp Image processor

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006524873A (en) * 2003-04-24 2006-11-02 ネオパス ネットワークス,インク. Transparent file movement using namespace replication
JP2005218728A (en) * 2004-02-09 2005-08-18 Olympus Corp Endoscope
JP2011203790A (en) * 2010-03-24 2011-10-13 Kddi Corp Image verification device
JP2012124586A (en) * 2010-12-06 2012-06-28 Nippon Telegr & Teleph Corp <Ntt> Video reproducing method, video reproducing device, video reproducing program, and recording medium
JP2012204901A (en) * 2011-03-24 2012-10-22 Olympus Imaging Corp Image processor

Also Published As

Publication number Publication date
JPWO2015012297A1 (en) 2017-03-02
JP6485352B2 (en) 2019-03-20

Similar Documents

Publication Publication Date Title
US10419618B2 (en) Information processing apparatus having whiteboard and video conferencing functions
US9602769B2 (en) Timestamp-based audio and video processing method and system thereof
US8659638B2 (en) Method applied to endpoint of video conference system and associated endpoint
US10110849B2 (en) Communication terminal, communication system, communication control method, and non-transitory recording medium
CA2865545C (en) Communication control system and control device
US10044782B2 (en) Terminal device, data transmission method, and computer-readable recording medium
JP6179179B2 (en) Information processing apparatus, information processing method, and program
US9445142B2 (en) Information processing apparatus and control method thereof
TW201104561A (en) Projection system and method thereof
CN110727485A (en) Screen interface selectable sharing method and system
CN102857726A (en) Remote control method, terminal, opposite terminal and system based on synchronous display
TWI740208B (en) Image transmission device, image display system with remote screen capture function, and remote screen capture method
CN102202206A (en) Communication device
CN113556500B (en) Video overlapping method, device and system
JP7200313B2 (en) Playback device, remote playback system, playback method, and computer program
JP6485352B2 (en) Receiving apparatus, method, computer program
JP6499582B2 (en) SENDING COMPUTER, RECEIVING COMPUTER, METHOD EXECUTED BY THE SAME, AND COMPUTER PROGRAM
JP2015023417A (en) Communication device and imaging device, control method thereof, and program
JP6606251B2 (en) SENDING COMPUTER, RECEIVING COMPUTER, METHOD EXECUTED BY THE SAME, AND COMPUTER PROGRAM
KR101392929B1 (en) Video conference system providing data sharing function based on meta data and method thereof
WO2016163557A1 (en) Transmitting device, receiving device, and method implemented thereby, and computer program
JP2016143954A (en) Radio communication device and radio communication method
JP6431301B2 (en) Movie processing apparatus, method, and computer program
US11368743B2 (en) Telestration capture for a digital video production system
US20170374368A1 (en) Video Processor, Method, Computer Program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14828795

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2015528302

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 14828795

Country of ref document: EP

Kind code of ref document: A1