JPH08256325A - Image processing system - Google Patents

Abstract

PURPOSE: To realize an image processing system in which an image at a remote monitor point is acquired at any time at a low cost through a general public line. CONSTITUTION: The image processing system is a system in a monitor system including an image processing unit (electronic still camera 2a) processing an image signal obtained by picking up an object image whose image is formed by an optical system and converting the image into an electric signal by an image pickup means and including a controller controlling remotely the image processing unit through a general public line 5. The image processing unit has a control circuit 34 forming a call reception wait state again by interrupting the general public line 5 when the reception of a control signal cannot be made from the controller 6 for a prescribed time.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image handling system, and more particularly to an electronic still camera having a function of transmitting digital data of a photographed still image via a communication line, and the electronic still camera having the communication line. The present invention relates to an environment monitoring system including a control device that controls via a control device and collects image data.

[0002]

2. Description of the Related Art A conventional surveillance camera transmits an analog video signal through a cable and carries out surveillance at a place relatively close to a place where the camera is installed. Alternatively, a VTR or the like is used to record for a long time, and when an abnormality is detected, the image data at the time of the abnormality is stored.

[0003]

Since the above-mentioned conventional surveillance camera uses an analog video signal, a large-scale dedicated facility is required to send an image of a distant surveillance point. Also, in the case of a large number of stocked images, it is difficult to immediately confirm the image at the time when an abnormality is detected.

Further, it is preferable to use an existing communication line such as a public telephone line in order to reduce the cost. However, in the case of performing a highly reliable system operation using a general line, the following will be described. There was a problem.

(1) State detection and recovery processing cannot be performed when the camera cannot be controlled due to a failure in the communication path or system synchronization. (2) The recovery process cannot be performed when an error occurs in the image data transmission protocol during image data transmission.

(3) A transition control between two states, that is, a state in which the camera independently controls the incoming call and establishes synchronization with the control device after the line is connected, and a state in which the camera operates according to a command from the control device, can be performed. There wasn't.

(4) When the control device controls the state of the camera, there is no method for efficiently notifying the state of the camera. (5) The operating time of the camera for enabling long-time monitoring cannot be extended.

(6) There is no means for collecting environmental data associated with image data. (7) There was no method for collecting the collected environmental data. (8) There was no suitable method for changing the shooting conditions of the camera at the remote location.

The image handling system of the present invention has been made in view of such a problem, and the purpose thereof is to obtain an image of a distant monitoring point at any time at low cost through a general public line. It is to provide an image handling system.

[0010]

In order to achieve the above object, the present invention provides an image for handling an image signal obtained by converting an object image formed by an optical system into an electric signal by an image pickup means. An image handling system in a monitoring system including a handling device and a control device for remotely controlling the image handling device via a public line, wherein the image handling device is a control signal from the control device. When it is impossible to receive the call for a predetermined time, the communication control means is provided for cutting off the connection with the general public line and forming an incoming call waiting state.

According to the present invention, an image handling device for handling an image signal obtained by converting an object image formed by an optical system into an electric signal by an image pickup means, and the image handling device via a general public line. An image handling system in a surveillance system including a control device which is remotely controlled,
When the image handling device receives a control signal from the control device and a failure occurs in the execution of the protocol during the operation of the protocol for transmitting data such as image signals to the control device, It has a communication control means for cutting off the connection with the public line and again forming an incoming call waiting state.

The present invention also relates to an image handling apparatus for handling an image signal obtained by converting an object image formed by an optical system into an electric signal by an image pickup means, and the image handling apparatus via a general public line. An image handling system in a surveillance system including a control device which is remotely controlled,
The image handling apparatus has means for transmitting, to the control apparatus, a set of state parameter information relating to its own state or a set of state parameter information relating to the state of the photographing means.

Further, according to the present invention, an image handling device for handling an image signal obtained by converting an object image formed by an optical system into an electric signal by an image pickup means, and the image handling device via a general public line. An image handling system in a surveillance system including a control device for remotely controlling the image pickup device, wherein the image handling device leads the image pickup means from the control device to obtain information on the situation of the subject in advance. In response to the monitor command signal issued to the device, information compression processing is performed at a relatively high information compression rate on the image representing the situation of the subject, and the compressed image information is transmitted to the control device side. Have means.

Further, according to the present invention, an image handling device for handling an image signal obtained by converting an object image formed by an optical system into an electric signal by an imaging means, and the image handling device via a communication line. An image handling system in a surveillance system including a control device for remote control, wherein the image handling device responds to a control signal from the control device to a sensor provided so as to adapt to the device. It has a trigger signal output means for outputting a trigger signal for taking in information detected by the sensor.

Further, according to the present invention, an image handling apparatus for handling an image signal obtained by converting an object image formed by an optical system into an electric signal by an image pickup means, and the image handling apparatus via a general public line. An image handling system in a surveillance system including a control device for remote control by means of a remote control system, wherein the control device recognizes that a response signal from the image handling device cannot be obtained, and Means for interrupting the connection, waiting for a time longer than the peculiar incommunicable standby time that the image handling apparatus has, and then performing a call process.

[0016]

Embodiments of the present invention will be described in detail below with reference to the drawings. FIG. 1 is a diagram showing a system configuration of an image handling apparatus according to this embodiment. In the figure, the observed object 1 is an animal or plant, a structure, another object, a natural phenomenon, or a display unit of a measuring instrument which is an object of observation by the monitoring system. Specific examples of the object to be observed 1 include a meter of a nuclear power plant, an optical sensor for detecting sewage, a meter of the amount of commercial gas used, and a monitored object at a construction site.
Further, a patient at home or a patient room or a sensor for medical information related to the patient or the like also corresponds to the object to be observed. Reference numeral 2a is an electronic still camera (hereinafter simply referred to as a camera) as an example of an image handling device for capturing an image of the observed object 1 and generating image data. The sensor 3a is connected to the camera 2a and the camera 2a
Non-image data such as environmental data and patient data are collected in synchronization with. Specific examples of the sensor 3a include a thermometer,
Examples include hygrometers, barometers, rain gauges, color temperature measuring instruments, illuminometers, sound level meters, recording devices, gas analyzers, thermometers, electrocardiographs, other medical sensors, microphones, crime prevention intrusion sensors, etc. . The modem 4a has a function of enabling data transmission / reception via the telephone line 5. Here, the telephone line 5 corresponds to a general public telephone line capable of transmitting voice, a digital line such as an ISDN line, or the like. Reference numeral 6 is a control device of the present monitoring system which is composed of, for example, a personal computer. The commercial network 7 is generally accessed via the telephone line 5 to exchange various data within the network. In addition, in such a commercial network 7, it is also possible to use, for example, a mailbox 7a or the like. The wireless base station 8 is a base station for connecting a line to a terminal such as a mobile phone.

As shown in FIG. 1, the observed object is actually n
There are (1, 2, ..., N) electronic still cameras (2a, 2b, 2c, ...) And sensors (3a, 3).
b), 3c, ...), modems (4a, 4b, 4c, ...) And so on. That is, on the controlling side, the control device 6
The number of electronic still cameras is one, but a system in which a plurality of electronic still cameras controlled by the control device 6 via the telephone line 5 are installed can be used. Here, in order that the control device 6 can identify a specific camera, each camera is assigned a telephone number having a different telephone line. In addition, the wireless base station 8
It is also possible to connect to the camera 2c by the mobile phone 9 via. Further, although there are a plurality of cameras, it goes without saying that one camera may be used instead of a plurality.

The overall operation of the above configuration will be described below. An operator controls the entire system by operating the control device 6, and the operation of each component is controlled.
The cameras 2a to 2c connected by the telephone line 5 are installed corresponding to various objects to be observed. Therefore, when a call is made from the control device 6 side to a specific camera (for example, 2a), the called camera 2a is connected to the control device 6 via the telephone line 5 and A synchronization process is performed with the camera 2a.

When the synchronization process is completed, the camera 2a becomes controllable from the control device 6 side. Therefore, after the camera 2a is set to various settings, the camera 2a is instructed to shoot. When a shooting instruction is given, the camera 2a outputs a trigger output to the sensor 3a, and at the same time, shoots an image of the observed object 1. Next, the camera 2a sends the information of the sensor 3a and the image information of the observed object 1 to the control device 6 side via the telephone line 5. The operator can confirm the image based on the sent video information on the spot.

The above-mentioned transmission of information can be performed in the same manner even when the mobile phone 9 is used. Also, as shown in FIG. 1, when there are a plurality of cameras installed in the system, it is possible to assign different identification data numbers or the like to each camera, and the control device 6 When a specific camera is accessed from the side, the ID number of the camera is sent back, so that the sent data can be organized and classified.

FIG. 2 is an external view of the above-mentioned camera (for example, 2a will be described). In the figure, 11 is a lens for photographing and 12 is a strobe device. Reference numeral 13 is a video signal output terminal, which is used when an external monitor is connected and it is desired to check a photographed image. Reference numeral 14 is a connector that constitutes a control interface (I / F) of the modem, and is used to connect the camera 2a to the modem 4a. Reference numeral 15 denotes a control I / F of the sensor 3a, which is a connector that constitutes an I / F for outputting a trigger signal for selecting the sensor to the sensor 3a and receiving measured data from the sensor 3a.

Further, 16 and 17 are IC memory cards applied as a medium for storing recorded (stored) information, and the image data obtained by the camera 2a photographing the object 1 to be observed is stored in this IC. It is used when recording as a file on a memory card, but the image data can also be recorded on a recording medium built in the camera. It is also possible to install a card having a function of a modem (so-called modem card) in the slot in which the IC memory cards 16 and 17 are installed. In this case, a card having a modem function can be used instead of the modem 4a shown in FIG. 1 to exchange data through a telephone line.

Reference numeral 18 denotes a release switch, which is not used when the surveillance camera is operating, and is for triggering photographing when a single camera is used.
Reference numeral 19 denotes a display panel, for example, a liquid crystal display panel for displaying the operating state of the camera. 20 is an operation switch,
Used when manually changing the camera settings.

In order to install the camera 2a toward the object to be observed 1, a screw hole for a tripod is provided at the lower part of the camera 2a so that the camera 2a can be fixed toward the object to be observed 1. FIG. 3 is an internal block diagram of the camera of FIG. In the figure, 21 is a lens for optically photographing a subject as the observed portion 1, 22 is an image pickup circuit for converting an image of the subject into an electric signal, and 23 is a picked-up video signal. Is an A / D converter for converting the digital data into 2
Reference numeral 4 is a frame memory for storing image data converted into digital data, and 25 is a frame memory 2
4 is a D / A converter 25 for converting the image data accumulated in 4 into an analog signal again, 26 is a video encoder for converting the created analog signal into a video signal, and 27 is an external monitor Is a terminal for outputting a video signal to.

Reference numeral 28 is a viewfinder for the operator to reproduce and view the image being photographed or the image already photographed, and 29 is for displaying the operating state of the camera on the viewfinder 28 or an external monitor device. It is a character generator for displaying the characters.

Reference numeral 30 denotes a compression / expansion circuit for compressing the data in the frame memory 24 to generate recording data, and for expanding and reproducing the compressed and recorded data. For this compression / expansion, for example, JP
EG-compliant compression algorithms known per se are used. A card interface (I / F) 31 records and reproduces image data on the IC memory card 16 as an applied information recording medium.
Reference numeral 34 is a system control circuit, which totally controls the system of the camera. A clock 34a is built in the system control circuit 34 and can count and hold date and time data.

Reference numeral 35 denotes an LCD display panel, which is controlled by the system control circuit 34 to display the operating state of the camera 2a. The switch 36 is an operation unit for directly operating the camera 2a, and is for giving a command to the system control circuit 34. Reference numeral 14 denotes the above-mentioned modem control I / F, which controls the modem 4a so that the system control circuit 34 can control the telephone line 5 and communicate with the control device 6 via the modem 4a. / F. Reference numeral 16 is an IC that is attached to the card I / F 31 as described above and holds image data or sensor data.
It is a memory card. This memory card is JE in this example.
IDA Ver. It is based on the standard called 4.2 and is sometimes called a PC card. There are also cards that have the same shape as the recording medium and perform a modem function.

Reference numeral 37 denotes an AF zoom control circuit, which is a control circuit for controlling autofocus (AF) for focusing on a subject image or zooming for changing the magnification of the subject image. Reference numeral 38 denotes a strobe circuit, and by attaching a strobe to the camera 2a, the object 1 to be observed can be photographed even in a dark place. Reference numeral 32 is a power supply block for the entire camera, and the modem 4a is connected to the system control circuit 34 via the modem control I / F 14 to control the telephone line 5 and finally communicate with the control device 6. Do. The sensor 3a is for observing temperature, humidity, noise, etc. as described above, and is connected to the system control circuit 34 through the sensor control I / F 15. Then, according to a command from the system control circuit 34, a trigger signal for designating (selecting) this sensor is output to the sensor 3a, and measurement data is input from the sensor 3a. The command at this time is sent from the controller 6 to the telephone line 5, the modem 4a, the modem control I / F.
It may be configured to be generated based on an image capturing start instruction signal for instructing image capturing by the camera, which is given to the system control circuit 34 via 15.

In the present embodiment, the description has been made with the camera in which the camera image pickup section and the image handling section are integrated, but with the connection section 33 (shown by broken lines) in FIG.
It is also possible to separately configure the camera imaging units of 21, 22, 37, and 38 and other portions.

FIG. 4 is a flow chart for explaining the monitoring operation and recovery processing of the camera (for example, 2a). The camera of this embodiment is set to start a monitoring operation at the time of installation.

First, in step S1, the modem 4a is set. That is, the operating state of the modem 4a is set to the modem 4a by the AT command which is a general command of the modem. That is, the modem is placed in the incoming call waiting state. If the modem 4a generates an error here, step S1
Go to 4 and display an error. On the other hand, when the setting of the modem 4a is normally performed, the process proceeds to step S3, the power supplies other than the system control circuit 34 in the camera are turned off, and the power supply state should be particularly preferentially secured. Power is supplied to only 34. Next, in step S4, the modem 4a sends "CONNECT"
The system waits for a result code (a code indicating that information can be transmitted between both modems on the transmission line) consisting of the character string "T" to be input.
It operates according to the setting of 1, and when a call is received from the control unit 6 through the telephone line 5, the line is automatically controlled, and after the negotiation with the modem 4d on the other side, the connection is made in the optimum state.

When the connection is completed, the result code of "CONNECT" is output. Next, the system control circuit 34
Supplies the power to the parts other than the system control circuit 34 after identifying the "CONNECT" input (step S5). Next, in step S6, a synchronization process with the control device 6 is executed. That is, some character strings are exchanged with the control device 6 to synchronize with the other party. Next, in step S7, it is determined whether or not the synchronization processing is good. If the synchronization process fails here, the process shifts to the recovery process.

On the other hand, when the synchronization process is completed normally, the process proceeds to step S8 and the interval timer is set.
This is for measuring a fixed time with a timer in the control device 6. Next, in step S9, it is checked whether or not the timer set in step S8 overflows. If the timer checked in step S9 overflows, the process proceeds to the recovery process. On the other hand, if the timer does not overflow, step S
Proceed to 10 to check if a command from the controller 6 has been received. Here, if the command is not received, steps S9 and S10 are repeated. If the timer expires or a command is received during this time, this loop is exited.

When the command is received in step S10, the process proceeds to step S11, and it is determined whether the received command is a command for cutting off the connection with the line. If it is determined in step S11 that the line is cut off, the process proceeds to step S12 to cut off the connection with the line. That is, the modem 4a is disconnected from the line and the telephone line 5 is on-hook. When the process of step S12 is completed, the process returns to step S3 and waits again for an incoming call from the next control device. If the command received in the determination at step S11 is not a command related to disconnection of the line, the process proceeds to step S13 to execute the received command, and the process returns to step S9.

In step S15, a process of disconnecting the connection with the line is performed. This is to issue a command to the modem 4a to cut off the connection to the line, and a process usually called an on-hook process is performed. When the process of step S15 is completed, the execution is started again from the setting of the modem 4a in step S1. That is, the modem again waits for an incoming call. The interval timer set in step S8 and the interval timer that determines whether the timer is over in step S9 will be described in detail with reference to FIG.

FIG. 5 is a flowchart showing the steps of the reception interrupt process, in which the camera 2a executes the interrupt process for receiving the command from the control device 6. First, when a camera control command is transmitted from the control device 6, the interval timer used in steps S8 and S9 is reset (step S21). Next, step S2
In step 2, the command is stored in a command buffer (a specific RAM or a specific area in the RAM) set in the microcomputer forming the system control circuit 34. At this time, the control device 6 can perform control so that the interval timer does not overflow by transmitting commands at intervals shorter than the set value of the interval timer. At the same time, by monitoring the interval timer, the camera side can judge the state that no command is received from the control device 6 for a certain time or longer.

Upon reception of the command in step S10 of FIG. 4 described above, it is checked in step S22 of FIG. 5 whether or not the control command from the control device 6 is stored in the command buffer. To execute command processing. Also, FIG.
If there is no command command from the control device 6 within a certain time by checking the timer over in step S9, the process proceeds to the recovery process.

The control procedure of the surveillance camera will be described in more detail below with reference to FIG. The control procedure of the surveillance camera of FIG. 6 is written in the form of a table, and the leftmost column indicates with which arrow the camera (for example, 2a) or the control device 6 is transmitting data. . The middle column is an item related to the communication control operation, and this is the camera 2a.
Shows an operation mainly performed when the robot operates in an autonomous state. The rightmost column is an item related to camera control operation, and represents the operation (controlled operation) when the camera 2a is controlled by a command from the control device 6.

In the figure, X in the table is ASCI.
Indicates one character of the I code. The ID character string indicated by “XXXXXXXXXX” has a variable length. 'XXXXXXX. X
The file name indicated by XX 'has a fixed length. XXX
The size indicated by XXXXXXBYTES is a fixed length of 8 bytes in hexadecimal notation. The number of files indicated by XXFILES has a fixed length of 2 bytes in decimal notation. The symbol ↓ indicates a carriage return CR (0DH).

The communication control operation in the middle will be sequentially described below from the top. First, it is assumed that the camera 2a is in a stand-alone operation, that is, an autonomous operation. After that, the system waits for input of a connect (a code indicating that information can be transmitted between both modems on the transmission path) from the modem 4a, and after the information transmission path is established, for example, 10
Wait for a second. After that, the camera 2a transmits a character string for identification to the control device 6. On the other hand, the control device 6 sequentially transmits a character string for identifying itself and then an ID for identification on the control device 6 side. After that, the control device 6 requests the transmission of the identification number in order to confirm the identification number on the camera side. In response to this, the camera 2a transmits its own identification number in the form of "ID =".

Next, the control device 6 sends to the camera 2a the options of the protocol for sending the photographing data file. The camera 2a selects the protocol used by itself for the option. Here, XMODEM-128
, And two protocols called XMODEM-1K are exemplified as options, but the camera 2a is the second XM.
ODEM-1K shall be selected.

When this operation is completed, the camera 2a shifts to the controlled state (command mode). That is, the operating state shown in the rightmost column of FIG. 6 is entered, and the control device 6 sets the camera setting state (file size, focus mode, strobe mode, white balance setting state, etc.) for the camera 2a. A control command for changing is issued to set the operating state of the camera 2a (various settings after offset No. 12 in FIG. 10). Then, a data read command is issued to read the setting state of the camera 2a in the form of a status packet. This status packet is a collection of setting information related to the camera 2a and a single data packet.

When the state setting of the camera 2a is completed, the control device 6 issues a photographing command to the camera 2a. afterwards,
Issue a file send command to send the captured data. When the file transmission command is issued, the camera 2a autonomously starts the file transmission operation again and enters the file transmission mode.

In the file transmission mode, the control device 6 inquires the file size, and in response to this, the camera 2a returns the file size. Next, the control device 6
Inquires about the file name, and in response to this, the camera 2a returns the file name. At the end of this procedure, the camera 2a will have the previously selected X-modem-
According to the 1K protocol, the captured image data and the sensor detection data are transmitted to the control device 6.
When this transmission is completed, the camera 2a automatically shifts to the command mode which is the controlled mode again.

As described above, by repeating the portions 6a and 6b surrounded by the small squares in FIG. 6 a required number of times, the operator on the control device side receives the required number of photographing data. You can check. Then, when the reception of the required data is completed, the control device 6 side issues a command to cut off the connection with the line. Camera 2 that received the cutoff command
The a starts the autonomous operation again and performs the process of disconnecting the connection with the line.

FIG. 7 shows the camera 2 shown in step S6 of FIG.
6 is a flowchart for explaining in detail the synchronization operation between a and the control device 6. The synchronous operation of the control device 6 shown in FIG. 7 is started when a result code "CONNECT" (a code indicating that information can be transmitted between both modems on the transmission line) is input from the modem 4a. It's time to go. First, in step S31, it stands by for 10 seconds. This is to ensure that the preparation of the other modem and the control device 6 side is completed. Next, in step S32, the process waits until the controller 6 requests the identification number of the camera 2a. Then, when requested, the camera 2a transmits its own identification number (step S33). Next, the process proceeds to step S34, and waits for a list of available protocols from the control device 6 side to be transmitted. Next in step S35
Proceed to step 1 and send the number of the protocol to be applied by itself from the list of protocols that are likely to be executed. Next, in step S36, a command as shown in FIG. 8 is sent to the viewfinder or both the viewfinder and the external monitor to indicate that the autonomous mode has been switched to the controlled mode. Display the mode.

FIG. 9 is a flow chart for explaining the command execution processing of step S13 of FIG. 4 in detail.
In the command execution of FIG. 9, first, it is determined which of the plurality of commands is executed in steps S41 to S45. That is, in step S41, it is determined whether the command is a status transmission command, in step S42 it is determined whether the command is a command for a shooting operation, or step S43.
Then, whether it is a command for changing the setting state in the camera, whether it is a command for transmitting an image file in step S44, and whether it is a command for deleting a file in step S45. judge.

Then, the processing of the command determined in each of the above steps is performed in any of steps S46 to S50. That is, step S46 is status transmission executed by the status transmission command,
Data on the operating state of the camera 2a is transmitted to the control device 6. In this case, the data of the setting state in the camera is collected in the form of a status packet and transmitted as one data block.

FIG. 10 is a diagram showing the structure of such a status packet. In the figure, a packet ID indicating that it is a status packet is recorded in the first offset. At the position of offset 1, the number of data indicating how many data are in the packet is recorded. At the offsets 2 to 7, date-time data indicating the state of the clock in the camera is stored. After that, data such as the power state of the camera, the card state (the state of the applied IC memory card), the frame number, and the number of shootable images are stored as shown in FIG. A checksum is set in the last offset 24 so that the control device 6 can determine whether the data is valid when this status packet is received.

Although the sensor information is not included in FIG. 10, the sensor information and the like can be included therein, and the sensor information can be transmitted as another packet. is there.

Next, returning to step S42 of FIG. 9, if it is determined that the command is a shooting command, the shooting process of FIG. 11 is performed (step S47 of FIG. 9). That is, in FIG. 11, first, in order to determine the data of the sensor (for example, 3a), the trigger output is performed to the corresponding sensor (step S51). Next, in step S52, the sensor 3
a determines whether or not the measurement operation has been completed. That is, it is checked whether or not the sensor 3a is in the BUSY state, step S52 is repeated during the BUSY state, and when the measurement of the sensor 3a is completed, the process proceeds to step S53. In step S53, the detection data detected by the sensor 3a is received from the sensor 3a and temporarily stored in the system control circuit 34 in the camera. Next, in step S54, a compression parameter is set that indicates how large the size of the captured image data obtained by image capturing is to be compressed. By changing the compression parameter, the final image data amount of the captured image can be adjusted. Next, in step S55, exposure related to the optical image of the subject as the observed object 1 is performed. Then step S5
In step 6, the image data obtained as a result of exposure is A / D converted and converted into digital data. Then in step S57
Then, the process proceeds to step 1 to compress the image data by performing data compression in the JPEG-compliant system. Here, the image data of the size desired by the operator on the control device 6 side is compressed according to the compression parameter set in step S54.

Next, in step S58, a header is added to the compressed image data. This header is added before the image data and is stored as data accompanying the image data. Next, the process proceeds to step S59 and step S53.
The detection data received by the sensor in advance is written in the header of the image file.

FIG. 12 is a diagram showing the structure of such an image file. As shown in the figure, the image file has a form in which a header portion 100 is added before the main body of the image data 101. In the header 100, there are cases where the detection data and the like by the sensor are recorded or various parameters of the image data and the like are recorded.

The image file shown in FIG. 12 is one image data, and every time such image data is obtained by photographing, it is sequentially transmitted as an image file to the control device 6 side via the telephone line 5. And is recorded on a recording medium provided on the control device 6 side.

FIG. 13 is a flow chart showing the procedure for transmitting an image file in which the detection data of the sensor is added to the image data obtained by photographing. This is executed when the image file transmission command in step S44 of FIG. 9 is issued.

First, in step S61, the last captured image file is reproduced. Next, in step S62, the control device 6 that actually performs reception waits until a transmission request is made. In the protocol such as XMODEM or XMODEM-1K, the character "C" of the ASCII code is transmitted to mean a transmission request. When the transmission request is sent, the camera side transmits the header in step S63, transmits 1024 bytes of data in step S64, and finally transmits the trailer (step S65). This method is used because the XMODEM protocol requires that the image file be divided into data blocks of 1024 bytes each, and that each block be added with additional data called a header and trailer and transmitted. Is.

Since the control device 6 side transmits an acknowledgment (ACK) when the data is normally received, the camera side can confirm that the data is normally transmitted by receiving the acknowledge (ACK). Steps S66, S67).

Next, it is determined in step S whether an image data file having 1024-byte delimiters still remains.
It is confirmed in 68, and if there is still image data, the process returns to step S63 again to transmit the next 1024 bytes.
If the control device 6 does not return the acknowledge signal in step S67, that is, NAK (negative)
If negative data called "acknowledgement" is returned or if a nack has not been sent within a certain period of time, the process proceeds to step S69, and it is determined whether the same thing has occurred 10 times in succession.

If the number of times is less than 10 times in succession, the process proceeds to step S70, where the same 10 as the one just transmitted is transmitted.
After making a resend setting for resending 24 bytes of data, the process returns to step S63. On the other hand, the acknowledge is 10
If the state cannot be obtained more than once, the process shifts to the recovery process of FIG. In this recovery processing, processing for cutting off the connection with the line and waiting for an incoming call is performed.

FIG. 14 is a flow chart showing the procedure for changing the image file size. The change of the image file size is included in the setting change of step S43 in the command execution of FIG. When the image file size change command is sent from the control device 6 side, the camera determines what the current file size is. In this embodiment, the test size and 32 Kbytes and 6
It is possible to set four file sizes, 4 Kbytes and 96 Kbytes. Therefore, in step S1, it is first determined whether or not the size is the test size. If it is a test size, the process proceeds to step S77, and the file size is set to 32 Kbytes, which is slightly larger than that. The test size is a file size smaller than 32 Kbytes. A size such as 16 Kbytes or 10 Kbytes is assigned as the small file size.

If it is determined in step S71 that the size is not the test size, it is determined in step S72 whether the size is 32 Kbytes. When it is determined that the file size is 32 Kbytes, the process proceeds to step S76 and the file size is set to 64 Kbytes. If it is determined in step S72 that the size is not 32 Kbytes, step S72
At 73, it is determined whether the size is 64 Kbytes. 64K here
If it is determined that the file size is bytes, the process proceeds to step S75 and the file size is reset to 96 Kbytes. If it is determined that the size is not 64 Kbytes, step S
At 74, the file size is set to the test size.

In this way, in combination with the above-mentioned transmission of the status packet, by transmitting the file size change command until the desired size is obtained,
It is possible to set a desired file size.

FIG. 15 is a flowchart showing the procedure of the monitoring process of the control device 6. Up to now, the operation on the camera side has been described as the description of the embodiment, but what kind of processing is being performed on the control device 6 side will be described below with reference to the flowchart in FIG. First, in step S81, designation of a monitoring point is input. This is because the telephone number of the installed surveillance camera is registered on the control device 6 side, and which surveillance point is called to capture the image information,
It specifies whether to collect the captured images. Next, the telephone number of the designated monitoring point is passed to the modem to instruct dialing to this number (step S
82). Next, in step S83, after the modem calls and establishes a connection with the modem connected to the telephone number,
It waits until the above-mentioned result code "CONNECT" is output. Next, in step S84, a synchronization process with the camera (that is, the process described above with reference to FIG. 7 for synchronizing the operations of the control device 6 side and the camera side) is performed. This is a process corresponding to step S6 of FIG. Upon completion of the synchronization processing in step S84, it is determined in step S85 whether the synchronization processing has ended normally. If the synchronization processing with the camera is not successful, the recovery processing (FIG. 16 described below) is performed. Transition.

If the synchronization process with the camera is successful, the process proceeds to step S86 to make a status transmission request. By issuing this status transmission request, it is possible to obtain a status packet indicating the setting state on the camera side. That is, the next step S8
At 7, the status packet is received. And step S
At 88, the operating state of the camera is displayed according to the content of the received status packet to notify the operator. After this, the process proceeds to step S89 to initialize the timer.

This timer monitors the time when no command is input by the operator for a certain period of time,
In step S90, it is determined whether or not the operator has performed an operation within a fixed time, and if no command has been input for a fixed time or more (step S91), the camera side may automatically cut off the connection with the line. Step S
Returning to 86, the status transmission command is automatically transmitted to the camera side.

On the other hand, when the command is input within the fixed time, step S92 is executed. In step S92, it is determined whether the command input by the operator is a command for ending the control operation for the camera currently accessed. If the monitoring operation ends here, step S93.
Proceed to and perform the process to cut off the connection with the line. On the other hand, if the command input by the operator is not the end command, the command selected by the operator is executed.

FIG. 16 is a flow chart showing the procedure of the recovery process on the control device 6 side. This flowchart is controlled so as to perform a process of cutting off the connection to the line when the camera side does not input a command from the control device 6 for a certain period of time. At this time, the control device 6 side controlling the camera It shows how to perform recovery processing.

First, in step S101, the control device 6 side also performs line disconnection processing. Next, in step S102, the process waits for a longer time than the timer for camera abnormality determination. Then, in step S103, a recall process is performed on the camera to be controlled. In step S104, the result code ("C
ONNECT ") is input. Next, step S105.
If the image is synchronized with the camera in OK, and it is OK,
It progresses to step S86 of 5. Here, if the camera synchronization processing in step S105 of FIG. 16 also fails, it is determined that the recovery is impossible and the recovery processing ends.

By combining the processing on the side of the control device of FIG. 16 and the control processing on the side of the camera of FIG. 4, this system recovers the system operation after a certain time even when an abnormality occurs in the line. It is possible to

FIG. 17 is a flow chart showing a procedure for adjusting the camera from the control device 6, that is, a procedure for adjusting the camera in response to a command from the control device. When the operator of the control device 6 instructs the adjustment mode of the camera,
It is determined whether or not the file size of the camera is for the monitor mode (as described in FIG. 14 as the “test mode”) (step S111). In the case of NO here, a file size change command is issued to the camera (step S112). After that, a status transmission request is issued in step S113. After receiving the status in step S114, the process returns to step S111 again to determine whether the file size is the test mode. The file size can be switched to the monitor mode by repeating the loop from step S111 to step S114.

Here, the file size monitor mode is a mode in which the data compression rate is made higher than the other modes, and the file transmission time can be shortened. After that, the process proceeds to step S115 to issue a shooting command, and then in step S116, a transmission request is issued. Next, the image sent in step S117 is received. In the next step S118, the image is reproduced, and in step S119, the operator confirms the image which is compressed at a relatively high compression rate and is sent promptly. Here, in particular, in the image reception in step S117, the mode in which the file size is extremely small is set, and therefore, there is slight distortion in the image, but on the other hand, the image can be received at high speed. The purpose is to quickly confirm the image. In step S119, the operator can recognize the framing state, the exposure state, the color tone state or the white balance adjustment state at the time of shooting.

Next, when the operator determines in step S120 that the setting state is acceptable, the process proceeds to step S121 and the file size is returned to the previous monitor mode state. If it is determined in step S120 that the state of the image is not the desired state, the photographing condition is changed (step S122), and the process returns to step S115 to check the state again.

The embodiment in which the control device accesses the surveillance camera to perform the surveillance operation has been described above. However, when the sensor connected to the surveillance camera detects an abnormality, the surveillance camera is controlled by the control device. Can also be configured to access and send image data.

In this case, the phenomenon that triggers the transmission of image data must be clear. At the same time, there is a case where it is desired to organize the phenomena such as giving priority to each phenomenon that triggers the transmission of image data. Therefore, in this embodiment, when an abnormality is detected by the sensor, a comment indicating the type of the abnormality is written in the header of the image file and transmitted. The control device receiving the image displays the comment and shows it to the observer. The observer can immediately grasp the details of the abnormality that occurred by taking a look at the comment and take appropriate action.

FIG. 18 shows an embodiment in which the present invention is applied to a system for remotely monitoring the condition of a patient. As shown in the figure, the overall structure of the patient 4 lying on the bed 45
4, a monitoring camera 41 for obtaining a video image, a medical sensor 43 for measuring the temperature, blood pressure, heart rate or electrocardiogram of the patient 44, image data obtained by the camera 41,
Medical data detected by the medical sensor 43, and a modem 42 for transmitting comment data relating to these data via a telephone line are configured. When the medical sensor detects an abnormality of the patient 44, the monitoring camera 41 is notified. ,
"Abnormal blood pressure reduction" so that the type of abnormality can be easily recognized
It is possible to send message data such as.

FIG. 19 is a diagram showing an example of a display screen on the control device side. The video data 201 of the patient 44 taken by the surveillance camera 41 and the content 202 of the comment added by the surveillance camera 41 to the header portion of the image file. (Anyone can immediately understand the details of the abnormality from this content), and the surveillance camera 4
1 from the camera ID 203 (this ID allows the user to immediately know at which point the image from the camera installed).

FIG. 20 is a diagram showing in detail the structure of the header portion of the image file shown in FIG. The header has a variable length and has a list structure. As shown in the figure, each data is composed of an ID recorded at the beginning, a pointer to the next data, and a data body recorded after the pointer.

FIG. 21 is a flowchart showing the procedure of the monitoring operation showing a modification of the monitoring operation of the camera shown in FIG. First, in step S131, the operation state of the modem is set by the AT command. Then step S
In 132, the system control circuit (34 in FIG. 3), the modem control I / F (14 in FIG. 3), and the sensor control I / F (1 in FIG. 3).
Power is supplied only to 5) and other circuits are turned off. The following operation is performed under the overall control of the system control circuit.

Next, in step S133, it is checked whether or not there is a call from the control device 6 side based on the "CONNECT" message from the modem. When there is a call, the controlled operation in response to the command from the control device 6 is executed. Next, in step S134, it is determined whether or not the sensor has detected an abnormality, and if so, the control device 6 is notified via the sensor I / F which information the sensor is and which abnormality has occurred. To transmit. Next, in step S135, after the power of the entire camera is turned on, in the next step S136, a sensor message, for example, a message such as "abnormal blood pressure" from the medical sensor described above is received and held, and in step S137. Receive the detection data by the sensor.

Next, after photographing the image of the patient in step S138, the message data is written in the header of the file of the photographed image in step S139, and at the same time, step S138
At 140, the data detected by the sensor is written in the header.
Next, in step S141, the modem is instructed to dial, and the control device 6 is accessed. Then, in step S142, the image data, the above-described sensor message and sensor detection data are transmitted as an image file, and the process returns to step S131. .

In the above embodiment, the sensor and the modem may be integrated with the camera.
Further, a built-in image memory may be used instead of the memory card. In this case, the contents of the image memory can be erased by an instruction from the control device as the host. Alternatively, the memory applied to the camera may be continuously recorded until the memory is full, and automatically transmitted when the memory is full.

Further, when there is an abnormal signal from the sensor, it is sent immediately, but unless a sensor generates an abnormal signal or an instruction from the host, automatic operation such as recording, holding, erasing and recording is performed. May be. It is also possible to continuously transmit a plurality of images in response to an instruction from the host, or to collectively transmit a plurality of header information (not including image data).

[0083]

According to the invention described in claim 1 above, even when an abnormality occurs in the line and the system cannot operate, the control device performs the calling process again after a predetermined time or more. Then, the operation of the system can be restored, and the reliability of the system is improved.

According to the second aspect of the present invention, when an abnormality occurs in the line and the system cannot operate, the control device performs the calling process again after a predetermined time or more. Since the operation can be restored, the reliability of the system is improved.

According to the third aspect of the present invention, the costly line is freely controlled by the control device so that it is used only during the monitoring operation, and the line is disconnected at other times to disconnect the image handling device. Since it is operated autonomously, it is possible to achieve both flexible monitoring operation and low cost.

According to the invention described in claim 4, the autonomous mode for waiting for an incoming call can be performed for a long time by a small power source, so that the installation range can be expanded. Further, according to the invention described in claim 5, when the sensor detects an abnormality, the entire apparatus is activated, and it becomes possible to automatically transmit the image and the environmental data to the host.

According to the invention described in claim 6, the maximum power saving effect can be obtained by supplying power only to the system control circuit and the line control device. Further, according to the invention described in claim 7, when data is transmitted through the line by using the error correction function, data can be transmitted and received at a higher speed than when individual information is transmitted separately.

According to the eighth aspect of the invention, it is possible to accelerate the setting and monitoring of the image confirmation of the apparatus and the feedback loop. Further, according to the invention described in claim 9, it is possible to speedily perform the setting change and the confirmation work by the operator in the framing state, the exposure state, the hue state, and the white balance state, which can be easily confirmed even if the compression rate is increased.

According to the invention described in claim 10,
With a simple configuration, it is possible to capture various sensor data from remote locations. According to the eleventh aspect of the invention, the sensor data is always captured by capturing the sensor data in accordance with the shooting command, and the sensor data can be captured at the same timing.

According to the invention described in claim 12,
By combining the sensor information, the relationship between the sensor information and the image information can be clarified, and the correspondence relationship can be quickly grasped at the time of later organizing and editing work.

According to the invention described in claim 13,
Since the image data and the sensor information are the same data block, transmission / reception is facilitated and editing is facilitated. Further, according to the invention described in claims 14 and 15, even the created data block alone can be utilized for various purposes as measurement data of the environmental condition. One or more types of measurement data can be used.

According to the invention described in claim 16,
Even if the system operation becomes impossible due to an abnormality in the line, the system operation can be restored, and the system reliability is improved. According to the invention described in claim 17, since the type of abnormality that has occurred can be immediately determined, the image information can be effectively used, and the classification and sorting can be automated.

[Brief description of drawings]

FIG. 1 is a system configuration diagram of an image handling system according to an embodiment of the present invention.

FIG. 2 is an external view of an electronic still camera.

FIG. 3 is a configuration diagram of an electronic still camera.

FIG. 4 is a flowchart for explaining a monitoring operation and a recovery process of this embodiment.

FIG. 5 is a flowchart for explaining a reception interrupt operation.

FIG. 6 is a diagram for explaining a control procedure of the surveillance camera.

FIG. 7 is a flowchart for explaining a synchronization operation with a control device.

FIG. 8 is a diagram showing a command mode display.

FIG. 9 is a flowchart illustrating a command execution operation.

FIG. 10 is a diagram showing a structure of a status packet.

FIG. 11 is a flowchart for explaining a shooting operation.

FIG. 12 is a diagram showing a structure of an image file.

FIG. 13 is a flowchart illustrating an image file transmission operation.

FIG. 14 is a flowchart for explaining an image file size changing operation.

FIG. 15 is a flowchart illustrating a monitoring process of the control device.

FIG. 16 is a flowchart for explaining a recovery process of the control device.

FIG. 17 is a flowchart for explaining a camera adjustment operation from the control device.

FIG. 18 is a diagram showing a configuration of another embodiment.

FIG. 19 is a diagram showing a display on the control device side.

FIG. 20 is a diagram showing a structure of a header.

FIG. 21 is a flowchart illustrating a monitoring operation.

[Explanation of symbols]

2a ... Electronic still camera, 3a ... Sensor, 4a ... Modem, 5 ... Telephone line, 6 ... Control device (personal computer), 7 ... Commercial network, 8 ... Wireless base station, 9 ...
Mobile phone, 34 ... System control circuit.

Claims (17)

[Claims] 1. An image handling device for handling an image signal obtained by converting an object image formed by an optical system into an electric signal by an image pickup means, and the image handling device is remotely controlled via a general public line. An image handling system in a surveillance system including a control device for controlling the connection to the general public line when the control signal from the control device cannot be received for a predetermined time. An image handling system comprising communication control means for blocking and forming an incoming call waiting state. 2. An image handling device for handling an image signal obtained by converting an object image formed by an optical system into an electric signal by an image pickup means, and the image handling device is remotely controlled via a general public line. An image handling system in a monitoring system including a control device for controlling the image processing device, wherein the image handling device receives a control signal from the control device and transmits data such as an image signal to the control device. An image handling system comprising communication control means for forming a waiting state for an incoming call by cutting off the connection with the general public line when a failure occurs in the execution of the protocol during operation of the protocol. 3. The image handling device, by accepting an incoming signal from the control device, transitions from an autonomous control mode that does not accept external control that has been maintained until then to a controlled mode that accepts control. 3. The image handling system according to claim 1, wherein the image handling system is configured to operate synchronously in response to a control signal from the control device. 4. When the image handling device is in the autonomous control mode, power is supplied only to a part of the circuit of the image handling device or the circuit of the image pickup means for which a power supply state should be preferentially ensured. The image handling system according to claim 3, further comprising power supply control means for performing. 5. The image handling device further comprises a system control circuit for integrally controlling the operation of each part of the device, and a sensor monitoring circuit for monitoring a sensor provided so as to conform to the present device. The image handling system according to claim 4, wherein 6. The image handling system according to claim 5, wherein the system control circuit corresponds to a circuit system in which power supply is preferentially ensured by the power supply control means. 7. An image handling device for handling an image signal obtained by converting an object image formed by an optical system into an electric signal by an image pickup means, and the image handling device is remotely controlled via a general public line. An image handling system in a monitoring system including a control device for controlling the image processing device, wherein the image handling device packetizes a set of state parameter information relating to its own state or state parameter information relating to the state of the photographing means. An image handling system having means for transmitting to the above-mentioned control device. 8. An image handling device for handling an image signal obtained by converting an object image formed by an optical system into an electric signal by an image pickup means, and the image handling device is remotely operated via a general public line. An image handling system in a surveillance system including a control device for controlling, wherein the image handling device is a monitor issued from the control device to the image pickup means in order to lead information on the situation of the subject. In response to the command signal, a means for performing information compression processing at a relatively high information compression rate on the image representing the situation of the subject and transmitting the compressed image information to the control device side is provided. An image handling system characterized by. 9. A framing state, an exposure state, a hue state or a white balance adjustment state at the time of image pickup can be applicable as a detected event relating to the state of the image pickup unit detected by the monitor command signal. The image handling system according to claim 8. 10. An image handling device for handling an image signal obtained by converting an object image formed by an optical system into an electrical signal by an imaging means, and the image handling device is remotely controlled via a communication line. An image handling system in a monitoring system including a control device for controlling the sensor according to a control signal from the controller, the sensor handling the sensor provided to adapt to the device. An image handling system comprising trigger signal output means for outputting a trigger signal for capturing information. 11. The image handling system according to claim 10, wherein the control signal is generated based on an image pickup start instruction signal for starting image pickup in the image pickup means. 12. The image handling device further comprises storage means for storing an image in the medium to which the image is applied, and the image sensing means captures detection information by the external sensor captured based on the trigger signal. The image handling system according to claim 10 or 11, wherein the image handling system is stored in a medium applied to the storage means in association with the image signal captured by 13. The image handling device, when storing the detection information by the sensor in a medium applied to the storage means, an image including at least one captured image information by the imaging means and its header information. 13. The image handling system according to claim 12, further comprising means for storing in a header area of the file. 14. The sensor is a sensor for detecting environmental information such as date / time, temperature, humidity, atmospheric pressure, rainfall, color temperature, illuminance, noise, voice or degree of air pollution surrounding the device. The image handling system according to any one of claims 10 to 13, which is characterized in that. 15. The temperature sensor, electrocardiographic data,
The image handling system according to claim 13, which is a medical sensor for detecting blood pressure and the like. 16. An image handling device for handling an image signal obtained by converting an object image formed by an optical system into an electric signal by an imaging means, and the image handling device is remotely operated via a general public line. An image handling system in a surveillance system including a control device for controlling, wherein the control device, when recognizing that a response signal from the image handling device cannot be obtained, establishes a connection with the general public line. An image handling system, characterized in that it has means for making a call processing after shutting off and waiting for a time longer than the peculiar incommunicability standby time possessed by the image handling apparatus side. 17. The image handling apparatus comprises a system control circuit for integrally controlling the operation of each part of the apparatus, and the system control circuit optimizes the type of the sensor and a significant change in the sensor output level. 11. The image handling system according to claim 10, wherein the image handling system is configured to transmit the information added with various comments to the control device.