JPH11177948A - Communication equipment, method and system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To attain an optimum picture display in accordance with the state of communication by wirelessly transmitting packet data and a packet including a picture number and a packet number set up in the packet data. SOLUTION: A camera unit 101 supplies a picture signal and a sound signal generated from an optical image of a subject to a compression circuit 102. The circuit 102 applies a specified high efficiency compression coding processing (a JPEG compression method, or the like) to the image signal outputted from the unit 101 in each picture e.g. and supplies the processed data to a memory controller 104, which adds a picture number allocated to each picture and a packet number annexed to each packet data to the packet data of each picture read out from a buffer memory 103 to packetalize the packet. Each packet packetalized by the controller 104 is outputted to a spread sprectrum transmission circuit 105 and successively transmitted through an antenna 110.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a communication apparatus, a method and a system, and more particularly to a technique for communicating image information to a remote display device or recording device.

[0002]

2. Description of the Related Art In recent years, in an image pickup apparatus such as a digital still camera and a digital video camera, a camera section and a display section or a camera section and a recording section are separated, and image information generated by the image pickup section is located at a remote place. A system for wireless transmission to a display unit or a recording unit has been proposed. Then, it is considered that a spread spectrum communication technique is used as one of the wireless communication techniques used for such a system.

One of the modulation schemes used in spread spectrum communication technology is a direct spread modulation scheme. A transmission device using this method performs spread modulation on a transmitted information signal (baseband signal) using a spreading code sequence such as a Pseudo Noise code (PN code), and is much wider than a signal before modulation. Generate a spread spectrum modulated signal. Then, the spread modulated signal is converted into a radio frequency (RF) signal using PSK (phase shift keying), FSK (frequency shift keying), or the like, and wirelessly transmitted to the receiving device.

[0004] The receiving apparatus demodulates the received RF signal into a spread modulated signal before transmission. Then, a correlation with the spread modulation signal is obtained using the spread code sequence used in the transmission device (that is, despread modulation processing is performed), and the spread modulation signal is converted into a baseband signal before transmission.

[0005] However, the bandwidth of a signal spread and modulated by the above-described method is much wider than that of a signal before spread modulation. Therefore, for example, when communication is performed under the condition that the bandwidth of the transmission path is constant, only a very small amount of information can be transmitted as compared with the conventional wireless communication method, and as a result, transmission of image information can be realized. Was difficult.

As a method for solving such a problem, a method called code division multiplex has been proposed. In this method, first, an information signal to be transmitted is divided into a plurality of data strings, and each data string is spread-modulated with a plurality of different spreading code sequences. Next, the spread modulation data is multiplexed, and the multiplexed data is converted into an RF signal and transmitted. By using this method, high-speed data transmission can be realized by changing the number of multiplexes even under conditions where the bandwidth of the transmission path is constant.

[0007]

However, the above-mentioned code division multiplex system has the following problems.

For example, as the number of multiplexes is increased in order to transmit a larger amount of information, a phenomenon called multipath fading is more likely to occur. This phenomenon is a phenomenon in which the power level of a received signal decreases due to interference between a direct wave and a reflected wave having a different phase from the direct wave.
Due to the effect of this phenomenon, when the number of multiplexes is increased, errors occurring in the transmission signal increase, and thus there has been a problem that communication failure or communication interruption occurs.

[0009] The transmission capacity of wireless transmission is lower than that of wired transmission. In particular, when a large amount of data such as moving image information is wirelessly transmitted, the transmitting apparatus performs a large compression coding process on the image information. It is necessary to significantly reduce the amount of data to be transmitted, for example, by cutting out a part of the original image information. In particular, errors in the transmission path are more likely to occur in wireless transmission than in wired transmission due to the effects of the above-described multipath fading. Therefore, if a part of the compressed image information wirelessly transmitted from the transmitting device becomes unreceivable, the receiving device cannot correctly decompress and decode the compressed image information and displays the disturbed image as it is. Or there was a problem of recording.

[0010] In view of the above background, a first object of the present invention is to provide a communication device, a method and a system which solve the above-mentioned problems.

A second object of the present invention is to provide a communication system capable of displaying an image which is optimal according to a communication state of communication when a large amount of data such as a moving image is communicated. It is to provide an apparatus, a method and a system.

[0012]

In order to achieve the above object, a communication apparatus according to the present invention comprises: an image pickup means for generating image information by using an optical image of a captured object; Image processing means for dividing the generated image information for one screen into n packet data; a screen number indicating an order between screens and a packet number indicating an order between packet data for each of the packet data; And a communication unit for wirelessly transmitting a packet including the packet data and the screen number and the packet number set in the packet data.

Further, the communication apparatus of the present invention has an input means for inputting an image signal and an audio signal for one screen, and an image signal and an audio signal for one screen inputted by the input means.
Dividing means for dividing the packet data into packet data; setting means for setting a screen number indicating the order between screens and a packet number indicating the order between the packet data for each of the packet data; Communication means for wirelessly transmitting a packet including the screen number and the packet number set in the packet data.

Further, the communication apparatus of the present invention receives a wirelessly transmitted packet including a part of screen information for one screen, a screen number indicating an order between screens, and a packet number indicating an order between packets. Receiving means, storing means for storing a part of screen information included in the packet received by the receiving means, and using the screen number and the packet number included in the packet received by the receiving means, It is characterized by comprising a discriminating means for discriminating the continuity of packets, and a control means for controlling the storage operation of the storage means according to the discrimination result of the discriminating means.

The communication apparatus according to the present invention receives a wirelessly transmitted packet including a part of screen information for one screen, a screen number indicating the order between screens, and a packet number indicating the order between packets. Receiving means; display means for displaying screen information received by the receiving means; and continuity of the packet is determined using the screen number and the packet number included in the packet received by the receiving means. It is characterized by comprising a determining means, and a control means for controlling screen information displayed by the display means according to a result of the determination by the determining means.

Further, according to the communication method of the present invention, image information is generated using an optical image of a captured object, and the generated image information for one screen is divided into n packet data. , A screen number indicating the order between screens and a packet number indicating the order between packet data are set, and the packet including the packet data and the screen number and the packet number set in the packet data are set. Is transmitted wirelessly.

Further, according to the communication method of the present invention, an image signal and an audio signal for one screen are input, and the input image signal and audio signal for one screen are divided into n packet data. For each of the packet data, a screen number indicating the order between screens and a packet number indicating the order between packet data are set, and the packet data and the screen number and the packet number set in the packet data are set. The wireless communication apparatus is characterized by wirelessly transmitting the packet including the packet.

Further, the communication method of the present invention receives a wirelessly transmitted packet including a part of screen information for one screen, a screen number indicating an order between screens, and a packet number indicating an order between packets. Determining the continuity of the packet using the screen number and the packet number included in the received packet, and controlling a storage operation of a storage device according to the continuity of the packet. .

The communication method of the present invention receives a wirelessly transmitted packet including a part of screen information for one screen, a screen number indicating an order between screens, and a packet number indicating an order between packets. Determining the continuity of the packet using the screen number and the packet number included in the received packet, and controlling screen information displayed by a display device according to the continuity of the packet. Features.

The communication system according to the present invention further comprises: input means for inputting an image signal and an audio signal for one screen; and n image signals and audio signals for one screen input by the input means. Dividing means for dividing the packet data into packet data; setting means for setting a screen number indicating the order between screens and a packet number indicating the order between packet data for each of the packet data; Transmitting means for wirelessly transmitting a packet including the screen number and the packet number set in the receiving means, receiving means for receiving a packet wirelessly transmitted by the transmitting means, and a packet included in the packet received by the receiving means. A storage unit for storing packet data, and using the screen number and the packet number included in the packet received by the reception unit. Characterized by a control means for controlling the determining means for determining continuity of the packet, the storing operation of the storage means in accordance with a discrimination result of said discriminating means Te.

[0021]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a communication device, a method and a system according to the present invention will be described in detail with reference to the drawings.

FIG. 1 is a block diagram showing the configuration of an imaging apparatus (transmitting apparatus) according to an embodiment of the present invention.

In FIG. 1, reference numeral 101 denotes a camera unit that generates a standard television signal (NTSC system, PAL system, etc.) from an optical image of a subject captured by a lens, an image sensor, or the like (FIG. 2). FIG. 2 is a block diagram illustrating a detailed configuration of the camera unit 101. In FIG.
The optical image of the subject condensed by the lens 201 is CC
The image is converted into an image signal by an image sensor 201 such as D. C
The DS / AGC circuit 203 samples and holds the image signal and processes the image signal so as to have an appropriate signal level. The digital signal processing circuit 204 includes the CDS / AGC circuit 2
The digital camera converts the image signal output from the digital camera 03 into a standard television signal (NTSC system, PAL system, etc.). The digital signal processing circuit 204 of the camera unit 101 generates a predetermined audio signal from the external audio collected by the microphone 205.

Reference numeral 102 denotes a compression circuit for compressing and encoding an image signal or an audio signal generated by the camera unit 101 in a predetermined screen unit (frame or field, etc.) by a predetermined high-efficiency compression coding method. Reference numeral 103 denotes a buffer memory that can temporarily store image signals and audio signals that have been compression-encoded by the compression circuit 102, and 104 writes and reads image data of a predetermined unit output from the compression circuit 102 to and from the buffer memory 103. A memory controller 105 controls the image signal and a voice signal generated by the camera unit 101. A spread-spectrum transmission circuit performs spread-spectrum modulation of the image signal and the audio signal by a code division multiplexing method. A spread spectrum receiving circuit 107 for receiving a control signal, a status inquiry signal, and the like, indicates whether or not the next communication is possible based on the state of the wireless band detected by the spread spectrum communication circuit 105 after the communication of the terminal itself is completed. Signal to memory controller 1
A transmission detection unit 108 for supplying to the camera unit 101 includes a microcomputer and a memory capable of storing a predetermined program code, and controls various processing circuits included in the imaging apparatus. An operation key for instructing (focus or the like), 110 is an antenna, and 111 is a switch for switching input / output of the antenna 110.

Hereinafter, the operation of the imaging apparatus (transmitting apparatus) shown in FIG. 1 will be described.

A camera unit 101 compresses an image signal and an audio signal generated from an optical image of a subject into a compression circuit 102.
To supply. The compression circuit 102 includes the camera unit 101
The image signal output from the CPU is subjected to a predetermined high-efficiency compression encoding process (for example, a JPEG compression method) in units of one screen, and supplied to the memory controller 104. Also, the compression circuit 102
Performs predetermined compression encoding on the audio signal output from the camera unit 101, and
04. Note that the compression circuit 102 of the present embodiment
Can change the compression ratio of the image and the audio signal in accordance with the instruction of the operation key 109.

The memory controller 104 includes a compression circuit 1
02, the compressed image data and audio data for one screen output temporarily are written in the buffer memory 103. The buffer memory 103 of this embodiment has a two-bank configuration, and can store one screen of compressed image data and audio data in each bank. Buffer memory 103
The compressed image data and the audio data stored in the storage section are divided for each predetermined data amount in accordance with the transmittable signal from the transmission detection section 107, and are read. In this embodiment, compressed image data and audio data of one screen are divided and read as eight divided data. In this embodiment, this 8
Each of the divided data is data for one transmission packet, and this unit is called packet data.

The memory controller 104 adds the screen number assigned to each screen and the packet number assigned to each packet data to the packet data of each screen read from the buffer memory 103, and performs packetization. I do. Each packet packetized by the memory controller 104 is output to the spread spectrum transmitting circuit 105 and transmitted sequentially via the antenna 110. The screen numbers in this embodiment are numbered in the order of 1, 2, 3,... For each screen, and when a predetermined numerical value is reached, 1, 2, 3,.
Are added in the order of. For example, if the predetermined value of the screen number is 256, the screen numbers are 1, 2, 3,.
56, 1, 2, 3,... The packet numbers are 1, 2, 3 ... 7, 8, 1, 2, 3 for each screen.
... It changes to 7,8.

FIG. 3 is a diagram showing the structure of a packet generated by the memory controller 104.

In FIG. 3, compressed image data of one screen (stored in areas 2 to 8) and audio data (stored in area 1) stored in bank 1 (301) and bank 2 (302) in buffer memory 103. Are read out for each area, and are packetized together with numbers (screen number and packet number) assigned to each screen and packet data for one screen. In this embodiment, the compressed image data and audio data of one screen are divided into eight areas. However, the present invention is not limited to this.
The audio data of the screen may be divided into m areas.

FIG. 4 is a flowchart showing the operation of the memory controller 104.

When the power is turned on, the memory controller 10
4 initializes the memory controller 104 itself and peripheral circuits (S400). Specifically, various registers in the memory controller 104 are initialized, and data reading from the buffer memory 103 whose contents are undefined at power-on is prohibited. After initialization, the memory controller 104 waits for the edge of the vertical synchronization signal of the compressed image data input from the outside, and controls the timing of writing to the buffer memory 103 (S401).

Further, the memory controller 104 waits for generation of the next transmission packet until a transmission enable signal is output from the transmission detection circuit 107 (S402). After the transmission enable signal is input, the memory controller 104 determines whether all packet data for one screen has been generated (S40).
3). When all packet data for one screen is generated,
Next, the memory bank of the buffer memory 103 to be read is changed (S304), and the screen number is incremented (S304).
Together with 405), the packet number is set to an initial value (1 in this embodiment) (S406). If generation of all packets has not been completed in S403, the packet number is incremented without changing the screen number (S403).
407).

After setting the screen number and the packet number, the packet data of the address corresponding to these values is read out from the buffer memory 103 (S408), packetized, and output to the spread spectrum transmitting circuit 105 (S40).
9). When the packetization of all the compressed image data and the audio data is completed, the memory controller 104 ends the generation of the transmission packet.
The process from 1 is repeated (S410).

By controlling as described above, it is possible to divide the image data and the audio data which have been compression-encoded in one screen unit into a plurality of packet data and transmit them.

FIG. 5 is a block diagram showing the configuration of a recording and display device (receiving device) according to an embodiment of the present invention.

In FIG. 5, reference numeral 501 denotes an antenna;
Is a switch for switching the input and output of the antenna 501,
Reference numeral 3 denotes a spread spectrum receiving circuit that receives a transmission packet (including image data and audio data) transmitted from the outside by spread spectrum communication. Reference numeral 504 denotes a control signal or state for controlling the camera unit 101 generated by an instruction of the operation key 514. Spread-spectrum transmission circuit for spread-spectrum communication of an inquiry signal; 505, a buffer memory capable of temporarily recording the packet received by the spread-spectrum receiving circuit 503; 506, a packet held in the buffer memory 505; , An information separating unit for separating the compressed image data and audio data included in each packet from the screen number and the packet number.

Reference numeral 507 denotes a memory controller for controlling writing and reading of a predetermined unit of compressed image data and audio data output from the information separating unit 506 to and from the main memory 508. 508: Compression of each packet separated by the information separating unit 506 A main memory 509 for temporarily storing image data and audio data;
A decompression circuit 51 that performs decompression processing corresponding to the compression and encoding processing of the compression circuit 102 on the image data and audio data output from 7 and converts them into image signals and audio signals before compression;
Reference numeral 0 denotes an NTSC encoder that converts the image signal and the audio signal expanded by the expansion circuit 509 into, for example, a standard television signal of the NTSC system. The NTSC encoder 510 also generates video synchronization signals for even and odd fields and supplies them to the memory controller 507.

Reference numeral 511 denotes a monitor for displaying an image signal output from the NTSC encoder 510, and also includes a speaker for outputting an audio signal. 512 is NTSC
A recording unit for recording the image signal and the audio signal output from the encoder 510 on a recording medium such as a magnetic tape;
A control circuit 13 includes a microcomputer and a memory capable of storing a predetermined program code, and controls various processing circuits included in the receiving apparatus.
And operation keys for instructing various operations (recording, reproduction, variable speed reproduction, etc.) in the recording unit 512. The operation key 514 can also instruct an operation (focus or the like) of the camera unit 101 or a state of the imaging device.

Hereinafter, the operation of the recording and display device (receiving device) shown in FIG. 5 will be described.

Transmission packets (including image data and audio data) wirelessly transmitted from the imaging device are transmitted to the antenna 50.
1. The signal is input to the spread spectrum receiving circuit 403 via the switch 502. Spread spectrum receiving circuit 503
Then, the same spread code sequence as the spread code sequence used in the spread spectrum transmitting circuit 105 of the imaging apparatus is generated, and the received packet is despread modulated using this spread code sequence. Received packets that have been despread modulated and restored to packets before transmission are temporarily stored in buffer memory 505.

The information separation unit 506 is provided in the buffer memory 5 in response to a data request signal from the memory controller 507.
The packet stored in 05 is read. Each packet read from the buffer memory 505 is stored in the information separation unit 50.
The packet data (including compressed image data and audio data in this embodiment) is separated into a screen number and a packet number at 6, and supplied to the memory controller 507.

The memory controller 507 determines the continuity of the screen number and the packet number input together with the packet data, and controls the writing of the packet data to the main memory 508 according to the determination result. The main memory 508 of this embodiment has a two-bank configuration.
One screen of compressed image data and audio data can be written to each bank.

At a predetermined timing, the main memory 50
The compressed image data and audio data for one screen read from 8 are input to a decompression circuit 509. Expansion circuit 50
9 is for compressed image data and audio data for one screen,
An uncompressed image signal is generated using decompression and decoding processes corresponding to the compression encoding method of the compression circuit 102. The expanded image signal and audio signal are transmitted to the NTSC encoder 51.
At 0, the signal is converted into a standard television signal of the NTSC system and supplied to the monitor unit 511 and the recording unit 512. The monitor unit 511 displays the input NTSC image signal on a CRT or a liquid crystal monitor, and outputs the input audio signal to a speaker. The image signal and the audio signal input to the recording unit 412 are converted into a predetermined recording data format and recorded on a recording medium such as a magnetic tape.

FIG. 6 is a block diagram showing a detailed configuration of the memory controller 507.

In FIG. 6, reference numeral 601 denotes a write circuit for writing input packet data and audio data to the main memory 508; 602, a read circuit for reading packet data written to the main memory 508;
Is a microcontroller that determines the continuity of the screen number and the packet number input together with the packet data, and controls the operations of the writing circuit 601 and the writing circuit 502 according to the determination result.

Hereinafter, the memory controller 4 will be described with reference to FIG.
Operation 07 will be described.

The microcontroller 603 outputs a data request signal to the information separating section 506. Information separation unit 50
6 outputs packet data (including compressed image data and audio data in this embodiment) included in the received packet to the writing circuit 501 in response to the request, and outputs the screen number and the packet number included in the received packet to the microcontroller. 503. The write circuit 501 writes the input packet data to the designated bank of the main memory 508 according to the write bank and write address designation data inputted from the microcontroller 503. Each bank of the main memory 508 can store one screen of compressed image data and audio data,
Packet data output from the writing circuit 601 is 1
Bank 1 → Bank 2 → Bank 1 → Bank 2 → ... for each screen
Is written alternately.

The microcontroller 603 selects the next readable bank in response to a timing pulse supplied from the outside, and supplies the read bank and read address designation data to the read circuit 602. The readout circuit 502 reads out compressed image data and audio data for one screen stored in the designated bank according to the readout bank and readout address designation data supplied from the microcontroller 603,
Output to Note that the microcontroller 603 controls the read timing of the read circuit 502 according to a timing pulse (such as a vertical synchronization signal output from the NTSC encoder 510) supplied from the outside.

FIG. 7 is a flowchart showing the operation of the memory controller 507.

When the power is turned on, the memory controller 50
7, initializes the memory controller 507 itself and peripheral circuits (S700). Specifically, various registers in the memory controller 507 are initialized, and reading of data from the main memory 508, whose contents are undefined at power-on, is prohibited. After the initialization, the memory controller 507 outputs a data request pulse to the information separation unit 506 (S
701). The packet number input in response to the data request pulse is stored in the register PN of the memory controller 507 (S702). The screen number input together with the packet number is stored in the register FN (S703).

The memory controller 507 detects the value of the packet number input together with the packet data (including the compressed image data and audio data in this embodiment) and sets the value to “1” (the value of the leading packet number). ) Is determined (S704). If the result of determination in S704 is that the packet number is "1", the value of the screen number FN input together with the packet number is used as the reference screen number in the register F
It is stored in Nref (S705). After storing the reference screen number, the reference packet number “1” is stored in the register PNref in order to detect the continuity of the packet numbers within the same screen number. Further, a discontinuity flag indicating discontinuity of the received packet is initialized (to Lo) (S70).
7). If the packet number is not "1" as a result of the determination in S704, the process of S708 is performed.

After the processing in S704 or S707, the memory controller 507 determines whether the input screen number FN is equal to the reference screen number FNref (S70).
8).

If the screen number FN matches the reference screen number FNref, the memory controller 507 further determines whether the packet number PN matches the reference packet number (S709). If it is determined in S708 and S709 that they match, the received packet is stored in the main memory 50.
8 (S710). Also, S708 and S709
, The memory controller 507 determines that the sequentially received packet data is discontinuous, sets the discontinuity flag to “Hi”, and writes the packet data. No (S711). The memory controller 507 determines in S71
After the processing of 1, the processing of S712 is performed. That is, by detecting the continuity of a plurality of packet data constituting the same screen, the reception status of the received data is determined, and if there is discontinuity, it is determined that the reception is poor.

After the processing of S710 and S711, the memory controller 507 determines whether the packet number PN is “8” (last packet number) (S712). If the packet number PN = 8, the memory controller 50
7 further determines whether the value of the discontinuity flag is "Lo" (S713). When the value of the discontinuity flag is “Lo”, that is, when the continuity of the packet numbers in the same screen number is confirmed, the memory controller 507 reads out the bank in which all of the packet numbers 1 to 8 are stored. Is permitted (S714). Memory controller 50
7 designates a readable bank and then changes the write bank of the next received packet data (S7).
15).

If it is determined in any of S712 and S713 that they do not match, or after the end of S715,
The memory controller 507 stores the reference packet number PNre
The value of f is incremented (S716). After the processing in S716, the memory controller 507 reads the bank in which the packet data for one screen is stored (S717).
That is, in step S717, the memory controller 507
When the continuity of the received packet for one screen is confirmed, the bank storing the received packet is read,
If the discontinuity of the received packet is confirmed, control is performed so that the bank storing the latest screen data that has been normally received in the past is read again. The main memory 5
If the same received packet is read out from step 08, the control circuit 513 is notified of this fact.
Displays only the image signal included in the received packet,
The audio signal is controlled to be muted.

After the processing of S717, when writing of all the received packet data is completed, the memory controller 507 ends the request of the received packet, and when not completed, repeats the processing from S701 (S71).
8).

By controlling as described above, only when all the packet data for one screen can be received, the compressed image data and audio data of that screen can be validated and displayed.

FIG. 8 is a diagram showing an example of changes in the reference screen number FNref and the reference packet number PNref when an error occurs in a packet wirelessly transmitted from the imaging device (transmitting device) to the recording / display device (receiving device). It is.

In FIG. 8, reference numeral 801 denotes a transmission packet on screen 1 (in the present embodiment, image information for one screen is divided into eight packets), and each packet is represented by P1.
1 to P18. 802 indicates that the receiving apparatus has the first packet P
11, the reference screen number FNref set by the memory controller 507. Reference numeral 803 denotes a reference packet number PNref set by the memory controller 507 after the receiving device receives each packet (P11 to P18). Similarly, screens 804 to 806 are screen 2, screens 807 to 809 are screen 3, and screens 810 to 812 are screen 4.
, The reference screen number FNref and the reference packet number PNref.

In FIG. 8, the memory controller 507 of the receiving device receives the packet P12 and
After writing the data in 08, the reference screen number FNref is set to "1" and the reference packet number PNref is set to "2". Then, packet P of screen number 1 and packet number 3
When the packet No. 13 cannot be received and the next packet P14 is received, the memory controller 507 determines whether the packet number 4 of the packet P14 matches the reference packet number PNref. Since the packet P13 is missing, the reference packet number PN of the memory controller 507
The value of ref is “2”. Thereby, the packet number 4 of the packet P14 and the reference packet number PNre
Since f does not match (that is, the packet numbers included in each packet are not consecutive), the memory controller 507 changes the discontinuity flag to “Hi”. As a result, the memory controller 507 does not write the packet data (compressed image data) included in the packet P14 to the main memory 508. Similarly, the memory controller 507 determines that the packet numbers PN and PNref of the packets P15 to P18 received after the packet P14 do not match, and does not write these packets to the main memory 408.

Subsequently, the receiving device receives the transmission packets (P21 to P28) on screen 2. When the memory controller 407 determines that each packet (P21 to P28) has been normally received, that is, when the continuity of the packet number is confirmed, each memory (P21 to P28)
Are sequentially written in the main memory 408.

Further, the receiving apparatus transmits the packet (P31
To P38), if the packet P31 is not normally received, the screen number FN and the packet number PN of the packets (P32 to P38) received after the packet P31 are set by the memory controller 407. Reference screen number FNref and reference packet number PNr
ef is not written to the main memory 408.

Further, when the memory controller 407 determines that the transmission packets (P41 to P48) of the screen 4 have been normally received, that is, when it determines that the reception is good due to the continuity of the packet numbers, the memory controller 407 includes Image data to be written to the main memory 408 sequentially.

FIG. 9 shows another example of changes in the reference screen number FNref and the reference packet number PNref when an error occurs in a packet wirelessly transmitted from the imaging device (transmitting device) to the recording / display device (receiving device). FIG.

In FIG. 9, the receiving apparatus receives transmission packets (P11 to P18) on screen 1. The memory controller 507 determines each packet (P11 to P18)
Are determined to have been received normally, the image data and the audio data included in each packet are sequentially written to the main memory 508.

Subsequently, the receiving apparatus transmits the packet (P
21 to P28) and the packet of the screen 3 are sequentially received. When each of the packets P25 to P34 is not normally received, the memory controller 507 determines that the packet numbers PN of the packets P24 and P35 are continuous, but the screen number F of each packet is
It is determined that N is different. As a result, the memory controller 507 prohibits the writing of the image data and the audio data included in the packet after the packet P35.

Further, the memory controller 507 displays the screen 4
When it is determined that the transmission packets (P41 to P48) are normally received, the image data and the audio data included in the packets are sequentially written to the main memory 508.

As described above, in the present embodiment, the imaging device (transmitting device) generates a plurality of packets from the compressed image data and audio data generated for each screen, and adds a screen number and a packet number to the packets. Wireless transmission. Then, the recording and display device (receiving device) detects the reception status of the received packet from the continuity of the screen number and the packet number of each received packet. Read, display or record again. As a result, it is possible to control to display or record the image data and the audio data of the normally received screen, and to realize a high-quality wireless transmission system.

The memory controller 104 of the present embodiment
Stores a plurality of received packets (compressed image data and audio data for one screen) determined to be discontinuous in the main memory 50.
However, among the received packets for one screen determined to be discontinuous, the packet including the audio data (the packet of the packet number 1 in this embodiment) is always valid and is stored in the main memory 508. It can be controlled to write. As a result, audio data can be output as long as a packet including the audio data is not lost.

In the present embodiment, the microcontroller 603 is used for selecting the write bank and the read bank. However, a logic circuit may be combined instead of the microcontroller 603.

Further, in this embodiment, the image pickup apparatus and the recording and display apparatus wirelessly transmit the compressed image information. However, the present invention is not limited to this. The compressed image information is transmitted synchronously for each packet via a wired path. Is applied to the transmission system
A series of image information can be displayed as a good and stable image.

The present invention can be embodied in various forms without departing from its spirit or its main features.

For example, according to the present invention, a control unit (including a microcomputer) included in the system or the apparatus according to the present embodiment uses a storage medium storing program codes of software for realizing the functions of the above-described embodiment. Alternatively, it can be configured to supply to the device.
Then, the control unit included in the system or the apparatus of the present embodiment reads out the program code stored in the recording medium, and executes various processing circuits included in the system or the apparatus so as to realize the functions of the above-described embodiment. It is also possible to achieve the embodiment of the present invention by operating.

For example, a program code for realizing the processing and functions shown in FIG.
8 is stored in the memory provided. Then, the memory controller 104 may read out the program code and operate each processing circuit of the transmission device shown in FIG. 4 so as to realize the function of the present embodiment. Similarly, a program code for realizing the processing and functions shown in FIG. 7 of this embodiment is stored in a memory provided in the control circuit 513 in FIG. Then, the memory controller 507 may read out the program code and operate each processing circuit of the receiving apparatus shown in FIG. 7 so as to realize the function of each embodiment.

In this case, the program code itself read from the storage medium realizes the function of the above-described embodiment, and the storage medium storing the program code is a part of the present invention. .

As a recording medium for supplying the program code, for example, a floppy disk, hard disk, optical disk, magneto-optical disk, CD-ROM, CD
-R, a magnetic tape, a nonvolatile memory card, a ROM, or the like can be used.

Further, based on an instruction of the program code read from the recording medium by the control unit, an OS (Operating System) or other application software running on the control unit is used as the system of this embodiment. Alternatively, it goes without saying that the present invention includes a case where the functions of the above-described embodiments are realized by controlling the operations of various processing circuits included in the apparatus.

Further, after the program code read from the storage medium is written in the memory provided in the function expansion board or the function expansion unit connected to the control section, the program code is read based on the instruction of the program code. The present invention is also applicable to the case where the functions of the above-described embodiments are realized by controlling the operation of various processing circuits included in the system or apparatus of the present embodiment by a CPU or the like included in the function expansion board or the function expansion unit. Needless to say, it is included.

Therefore, the above-described embodiment is merely an example in every aspect, and should not be construed as limiting.

[0081]

As described above, according to the present invention, for example, in a case where image data and audio data of one screen are transmitted in a plurality of packets, the communication state is determined from the continuity of the packets, and As a result, when it is determined that the communication state is poor, display or recording is performed using normally received image data. Thus, even when a large amount of data such as a moving image is communicated, an optimal image display can be performed according to the communication state of the communication.

Further, according to the present invention, when image data and audio data for one screen are divided into a plurality of packet data and sequentially transmitted, even if some packets are lost due to the condition of the transmission path, the reception is performed. The apparatus can perform image display without significantly deteriorating the image quality of the display screen.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of an imaging apparatus according to an embodiment of the present invention.

FIG. 2 is a block diagram showing a detailed configuration of a camera unit 101.

FIG. 3 is a diagram showing a configuration of a packet generated by a memory controller 104;

FIG. 4 is a flowchart showing the operation of the memory controller 104.

FIG. 5 is a block diagram showing a configuration of a receiving apparatus according to an embodiment of the present invention.

FIG. 6 is a block diagram showing a detailed configuration of a memory controller 407.

FIG. 7 is a flowchart showing the operation of the memory controller 407.

FIG. 8 is a diagram showing an example of changes in a reference screen number FNref and a reference packet number PNref when an error occurs in a packet wirelessly transmitted from a transmitting device to a receiving device.

FIG. 9 is a diagram illustrating another example of changes in the reference screen number FNref and the reference packet number PNref when an error occurs in a packet wirelessly transmitted from the transmitting device to the receiving device.

Claims (26)

[Claims] An imaging unit configured to generate image information by using an optical image of a captured subject; and n image information for one screen generated by the imaging unit.
Image processing means for dividing the packet data into a plurality of pieces of packet data; setting means for setting a screen number indicating an order between screens and a packet number indicating an order between packet data for each of the packet data; A communication unit for wirelessly transmitting a packet including the screen number and the packet number set in the packet data. 2. The communication apparatus according to claim 1, wherein the image processing means compresses and encodes the image information and divides the image information into n pieces of packet data. 3. The communication device according to claim 1, wherein the communication unit divides the packet into one or more data strings,
A communication apparatus, wherein each of the data strings is modulated using one or more different spreading code sequences. 4. The communication device according to claim 1, wherein the communication unit wirelessly transmits the packet using a spread spectrum communication method. 5. An input means for inputting an image signal and an audio signal for one screen, and a dividing means for dividing the image signal and the audio signal for one screen input by the input means into n packet data. Setting means for setting, for each of the packet data, a screen number indicating the order between screens and a packet number indicating the order between packet data; and the packet data and the screen number set in the packet data. And a communication unit for wirelessly transmitting a packet including the packet number and the packet number. 6. The apparatus according to claim 5, wherein the dividing unit divides the audio signal for one screen into m packet data, and converts the image signal for one screen into (nm) packet data. A communication device which is divided. 7. The method according to claim 5, wherein a packet number set in the packet data including the audio signal and a packet number set in the packet data including the image signal are continuous. Communication device. 8. The communication device according to claim 5, wherein the communication unit wirelessly transmits the packet using a spread spectrum communication method. 9. Receiving means for receiving a wirelessly transmitted packet including a part of screen information for one screen, a screen number indicating an order between screens, and a packet number indicating an order between packets, and said receiving means. Storage means for storing a part of screen information included in a packet received by the receiving means, and continuity of the packet is determined using the screen number and the packet number included in the packet received by the receiving means A communication apparatus comprising: a determination unit; and a control unit that controls a storage operation of the storage unit according to a determination result of the determination unit. 10. The screen information according to claim 9, wherein:
A communication device comprising an image signal and a sound signal for one screen. 11. The communication device according to claim 10, wherein the image signal is an image signal compressed and encoded for each screen. 12. The storage unit according to claim 9, wherein, when the continuity of the packet is determined, the storage unit stores a part of the screen information included in the packet. A communication device characterized by controlling. 13. The storage unit according to claim 12, wherein, when the continuity of packets for one screen is determined, the control unit reads the screen information for one screen constituted by the packets. A communication device characterized by controlling. 14. The apparatus according to claim 12, wherein the control unit controls the storage unit so as not to store a part of the screen information included in the packet when the continuity of the packet is not determined. Characteristic communication device. 15. The control unit according to claim 12, wherein the control unit stores the audio signal included in the packet and does not store the image signal even when the continuity of the packet is not determined. A communication device characterized by controlling. 16. The control means according to claim 12, wherein said control means controls said storage means to read out one screen of screen information stored in the past when the continuity of said packet is not determined. Characteristic communication device. 17. The communication apparatus according to claim 9, wherein said receiving means receives the packet subjected to spread spectrum communication from outside. 18. The communication device according to claim 9, wherein the wireless communication device further comprises a display unit for displaying image information stored in the storage unit. 19. Receiving means for receiving a wirelessly transmitted packet including a part of screen information for one screen, a screen number indicating an order between screens, and a packet number indicating an order between packets, and the receiving means Display means for displaying screen information received by the receiving means; determining means for determining continuity of the packet using the screen number and the packet number included in the packet received by the receiving means; and the determining means A control unit for controlling screen information displayed by the display unit in accordance with the result of the determination. 20. The apparatus according to claim 19, wherein the control means controls the display means to display screen information included in the packets when continuity of packets for one screen is determined. Characteristic communication device. 21. The method according to claim 19, wherein the control unit controls the display unit to display screen information received in the past when the continuity of the packet is not determined. Communication device. 22. Image information is generated using an imaged optical image of a subject, and the generated image information for one screen is divided into n pieces of packet data. Setting a screen number indicating the order of the packet data and a packet number indicating the order between the packet data, and wirelessly transmitting a packet including the packet data and the screen number and the packet number set in the packet data. Communication method. 23. An image signal and an audio signal for one screen are input, and the input image signal and audio signal for one screen are divided into n packet data. A screen number indicating an order between screens and a packet number indicating an order between packet data are set, and a packet including the packet data and the screen number and the packet number set in the packet data is wirelessly transmitted. A communication method comprising: 24. A wirelessly transmitted packet including a part of screen information for one screen, a screen number indicating an order between screens, and a packet number indicating an order between packets is received. A communication method, comprising: determining continuity of a packet using the included screen number and the packet number; and controlling a storage operation of a storage device according to the continuity of the packet. 25. A wirelessly transmitted packet including a part of screen information for one screen, a screen number indicating an order between screens, and a packet number indicating an order between packets is received. A communication method comprising: determining continuity of a packet using the included screen number and the packet number; and controlling screen information displayed by a display device according to the continuity of the packet. 26. An input unit for inputting an image signal and an audio signal for one screen, and a dividing unit for dividing the image signal and the audio signal for one screen input by the input unit into n packet data. Setting means for setting, for each of the packet data, a screen number indicating the order between screens and a packet number indicating the order between packet data; and the packet data and the screen number set in the packet data. Transmitting means for wirelessly transmitting a packet including the packet number and the packet number; receiving means for receiving a packet wirelessly transmitted by the transmitting means; and storing means for storing packet data included in the packet received by the receiving means. Continuity of the packet using the screen number and the packet number included in the packet received by the receiving unit. And a control means for controlling a storage operation of the storage means according to a result of the determination by the determination means.