JP2000050239A - Image communication system, device and method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To control remotely the photographed images by means of a 1st device which produces the control and image signals via a bus type transmission line that can perform the time division communication and includes an image- pickup means and a communication means of photographed images and a 2nd device which sets one or more areas for the photographed images and controls the 1st device. SOLUTION: Moving images, which are photographed by a camera subunit 11 of a DVCR 10, are transferred by an isochronous transfer system set based on the IEEE1394 standard. A control command is transferred by an asynchronous transfer system set based on the IEEE1394 standard. A PC 20 consists of a control part 21, a monitor 22, an operating part 23 including a mouse, a keyboard, etc., and a record medium 24 where a control program code of the subunit 11 is recorded. Then the PC 20 transfers a control command corresponding to the operating result to the DVCR 10, and the subunit 11 controls its own operation according to its received contents.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

TECHNICAL FIELD The present invention relates to an image communication system,
The present invention relates to an apparatus and a method, and more particularly to a technique of mixing a moving image signal and a control signal and performing time-division communication.

[0002]

2. Description of the Related Art In recent years, digital video camcorders (hereinafter, DVCR) and personal computers (hereinafter, P
C) as a digital interface for communicating in a time-division manner by mixing moving picture signals and control signals.
A digital interface (hereinafter, 139) conforming to the E1394-1995 standard (hereinafter, IEEE 1394 standard)
4 interfaces) have been proposed.

[0003] Between devices having a 1394 interface, a control command for controlling each device is as follows.
Communication is performed by a communication procedure based on FCP (Function Control Protocol).

[0004] First, a controller (for example, a PC) on the control side is an Asynchro based on the IEEE 1394 standard.
The control command is transferred to a target (for example, a DVCR), which is a controlled side, using a nous transfer. The target returns an acknowledgment for the Asynchronous transfer to the controller.

[0005] Next, the target executes processing corresponding to the control command, and asynchronously transfers the execution result to the controller as a response. The controller returns an acknowledgment for the Asynchronous transfer to the controller.

[0006]

However, the above technique has the following problems.

For example, in the conventional control command, there is no command for controlling the operation of the camera unit provided in the DVCR. In particular, if the controller is a DVCR
There is no command for setting a predetermined area on the captured image and controlling the entire captured image based on the image in that area. Therefore, the user can use the controller to set the DVC
The camera unit of R could not be remotely controlled, and the main unit had to be directly operated.

Further, in a conventional DVCR, only a specific function such as auto focus is set in advance for a fixed area on a captured image. Therefore, the user himself
It has not been possible to set an arbitrary area for a captured image and select and set a desired function for that area. Further, such an operation cannot be remotely controlled.

[0009] In view of the above background, an object of the present invention is to provide an image communication system, apparatus and method capable of setting a predetermined area for a captured image and setting various functions for the area by remote control. To provide.

[0010]

In order to achieve the above-mentioned object, an image communication system according to the present invention is configured using a bus-type transmission line capable of communicating a control signal and an image signal in a time-division manner. Image communication system, a first device including an imaging unit that generates a captured image from an optical image of a subject, a communication unit that transmits the captured image to an external device, and a communication unit that receives the captured image And a second device comprising: control means for setting one or more areas for the captured image and controlling the first device so as to set a predetermined function for the area. It is characterized by doing.

Further, according to the image communication apparatus of the present invention, in the image communication apparatus for performing communication using a bus-type transmission path capable of communicating a control signal and an image signal in a time-division manner, Receiving means for receiving, and control means for setting one or more areas with respect to the captured image, and controlling the imaging device so as to set a predetermined function for the area. I do.

According to the image communication apparatus of the present invention, a captured image is generated from an optical image of a subject in an image communication apparatus that communicates a control signal and an image signal using a bus-type transmission path capable of performing time-division communication. An image capturing unit that transmits the captured image to a management device, and controls the captured image based on a predetermined area set in the captured image by the management device and a function set in the area. And control means.

According to the image communication method of the present invention, in an image communication system configured using a bus-type transmission path capable of communicating a control signal and an image signal in a time-division manner, a captured image transmitted from an imaging device is Received and 1 for the captured image
One or more areas are set, and the imaging device is controlled so as to set a predetermined function for the areas.

According to the image communication method of the present invention, a captured image is generated from an optical image of a subject in an image communication system configured using a bus-type transmission path capable of communicating a control signal and an image signal in a time-division manner. Transmitting the captured image to a management device, based on a predetermined area set in the captured image by the management device and a function set in the area,
The captured image is controlled.

[0015]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an image communication system, apparatus and method of the present invention will be described in detail with reference to the drawings.

(First Embodiment) FIG. 1 is a block diagram showing the configuration of an image communication system according to this embodiment.

In FIG. 1, reference numeral 10 denotes a digital video camcorder (hereinafter, DVCR), reference numeral 20 denotes a personal computer (hereinafter, PC), and reference numeral 30 denotes a communication cable conforming to the IEEE1394 standard. Here, DVCR10 and P
Each of the C20 includes a digital interface 40 conforming to the IEEE 1394 standard. By connecting each device using the communication cable 30, a bus-type network that serially communicates communication data is configured.

In the DVCR 10 shown in FIG. 1, reference numeral 11 denotes a camera subunit 11 for generating an image signal of a predetermined format from an optical image of a subject. DVCR10
The moving image captured by the camera subunit 11 is I
The data is transferred in real time using the Isochronous transfer method based on the EEE1394 standard. DVCR10 and P
The control command transferred asynchronously with the C20 is:
The data is transferred using the Asynchronous transfer method based on the IEEE 1394 standard.

Here, the isochronous transfer method is a communication method that guarantees transfer of a fixed amount of data in each predetermined communication cycle and is suitable for real-time communication of moving images, voices, and the like. The asynchronous transfer method is a communication method that is effective when asynchronously transferring control commands, file data, and the like as needed. Here, the Isochronous transfer method and the Asynchronous transfer method can be mixed in a time-division manner, and in one communication cycle period, the Isochronous transfer method has a higher priority than the Asynchronous transfer method. With this function, communication can be performed without interrupting a real-time information signal such as a moving image or a sound.

In the communication system according to the present embodiment, the communication data of each device can be transmitted serially and bidirectionally by configuring each device using a digital interface conforming to the IEEE 1394 standard. Therefore, the cost of the entire system can be reduced as compared with the conventional parallel communication, and higher-speed communication can be realized.

In the PC 20 of FIG. 1, reference numeral 21 denotes a control unit,
Reference numeral 22 denotes a monitor; 23, an operation unit including a mouse and a keyboard; and 24, a recording medium such as a hard disk. The storage medium 24 stores program codes for implementing an application for controlling the camera subunit 11. The control unit 21 reads the program code from the recording medium 24 and controls the display screen of the monitor 22 and the communication with the DVCR 10 according to the operation of the operation unit 23.

FIG. 2 is a diagram showing an example of a display screen of the monitor 22 provided in the PC 20. The display screen of the monitor 22 is created and controlled based on an application provided in the main body 21.

In FIG. 2, reference numeral 201 denotes a DVCR 101.
5 is a preview screen capable of displaying a moving image of a captured image Isochronous-transferred from the camera.

In FIG. 2, reference numeral 202 denotes a DVCR 10
A wide button for moving the zoom of the DVCR 10 in a wide direction, a tele button 203 for moving the zoom of the DVCR 10 in a tele direction,
204 is a near button for moving the focus of the DVCR 10 in the near direction, 205 is a fur button for moving the focus of the DVCR 10 in the far direction, 206 is an area having various areas and shapes on a captured image of the DVCR 10 (hereinafter, referred to as an area).
Control button for setting a frame. Buttons 202 to 206 are displayed as icons on the screen.

Here, among the control buttons 206, 2061 is a control button for selecting a frame that has already been set, 2062 is a control button for setting a rectangular frame on the imaging screen, 2063 is a control button for setting a circular frame, and 2064 is a control button. A control button 2065 for setting a square frame is a control button for setting a pixel frame.

In FIG. 2, reference numerals 207 to 210 denote frames set on the imaging screen by using the control buttons 206, and 211 denotes a selected camera subunit 11.
Or set various functions for the selected frame,
It is a menu window for making an inquiry.

In this embodiment, the PC 20 is a DVCR.
Various commands for controlling the ten camera subunits 11 can be communicated.

In FIG. 2, the user presses a button 202
Is operated, the PC 20 sends a control command corresponding to the operation result to the DVCR 10 as an Asynchro.
Nous transfer. Camera subunit 11 of DVCR 10
Controls its own operation according to the content of the received control command. FIG. 3A shows an example of a control command for controlling the camera subunit 11.

For example, when the buttons 202 and 203 are operated, the PC 20 sends a control command “ZOOM” for controlling the zoom of the camera subunit 11 to the DVCR 10.
Asynchronous transfer. The DVCR 10 operates the zoom of the camera subunit 11 in the wide direction or the tele direction according to the content of the control command.

The PC 20 can also asynchronously transfer the status command shown in FIG. 3B in order to know the state of the camera subunit 11 of the DVCR 10. The PC 20 can know the current status of the camera subunit 11 by the response to the status command.

For example, when the PC 20 transmits the status command “ZOOM” to the DVCR 10 in an asynchronous manner,
The VCR 10 responds to the PC 20 with zoom position information of the camera subunit 11.

Further, the PC 20 can asynchronously transfer the notify command shown in FIG. 3C to the DVCR 10. When the camera subunit 11 receives the notify command, when the state specified by the notify command changes, the camera subunit 11 notifies the PC 2 of the change in state.
Return to 0.

For example, when the PC 20 asynchronously transmits a notify command “ZOOM” designating the zoom position of the camera subunit 11 to the DVCR 10,
The CR 10 returns a response when the zoom of the camera subunit 11 has reached that position.

In this embodiment, various commands (control command, status command, notify command) shown in FIG.
rotocol). FIG. 4 is a diagram illustrating a communication procedure based on FCP. In this embodiment, a series of communication procedures shown in FIG.
A combination of a command communicated based on this command transaction and a response to the command is called CTS (Command Transaction Set).
Call.

In FIG. 4, first, the PC 20 (controller) is an Asynchronous based on the IEEE 1394 standard.
Using the write transaction, the CTS command 40
1 is written in a predetermined memory space of the DVCR 10 (target). The target returns an acknowledgment 402 for the Asynchronous transfer to the controller.

Next, the target is the CTS command 40
1 and a CTS response 403 is generated from the execution result. Thereafter, the target writes the CTS response 403 to a predetermined memory space provided in the controller by using the Asynchronous Write transaction. The controller has its Asynch
An acknowledgment 404 for the ronous transfer is returned to the controller.

The format of the CTS command transferred from the controller to the target and the format of the CTS response transferred from the target to the controller will be described below in detail with reference to FIGS.

FIG. 5A shows the format of a CTS command transmitted asynchronously from the controller to the target.

In FIG. 5A, an asynchronous transfer packet is composed of a header part, a header CRC, a data part, and a data CRC.

The header section stores a source ID 501, a destination ID 502, and a destination offset 503. This allows Asynchrono
The us transfer packet is transferred from the device (source) indicated by the source ID to the device (destination) indicated by the destination ID, and the contents of the data portion of the packet (that is, the CTS command 504) are stored in the memory of the destination. Destination in space
Data is written to the address specified by the offset.

A CTS command 504 is stored in the data section. In the ctype field of the CTS command, a code specifying the type of the command is stored. FIG.
(B) shows an example of the command type stored in the ctype field.

In the CTS command 504, Subu
The nit_type field and the SubunitID field store data specifying which subunit the target has. The opcode field and the operand [0] to operand [n] fields store data specifying the contents of the actual command.

FIG. 6 shows an opcode field and an operand
FIG. 6 is a diagram illustrating an example of data stored in [0] to operand [n] fields. FIG. 6 illustrates a case where, for example, the controller transfers a CTS command for setting and controlling a frame for a captured image of a target or setting and changing various functions related to the frame.

In FIG. 6, an opcode field includes a command “FRAME” related to frame control.
Is stored. In the operand [0] field, a code indicating the processing performed by this command is stored. The operand [1] field stores a frame number indicating a frame targeted by this command.
The operand [2] to operand [n] fields store various parameters (for example, position information of each coordinate specifying a range of a frame) used in this command.

FIG. 7A shows a format of a CTS response asynchronously transferred from the target to the controller. In FIG. 7, Asynchrono
The header part of the us transfer packet is configured in the same manner as in FIG. Therefore, in FIG. 7, the CT stored in the data section is
The format of the S response will be described.

In FIG. 7A, a code for designating the type of response is stored in the response field. FIG. 7B shows an example of a response type stored in the response field.

In FIG. 7A, in the Subunit_type field and the SubunitID field, data for specifying from which subunit the target has a response is stored. opcode field and operand
In the [0] field to the operand [n] field, data designating the contents of the actual response is stored.

Hereinafter, using the CTS command shown in FIG. 5 and the CTS response shown in FIG. 7, the controller remotely sets a frame for a captured image of a target, makes an inquiry or sets various functions for the frame and makes an inquiry. Will be described.

(1) Inquiry of the Number of Frames In this embodiment, the application of the PC 20 can inquire of the camera subunit 11 about the number of frames that can be set in the image captured by the camera subunit 11. Hereinafter, the inquiry procedure of the number of frames will be described with reference to FIG.

In the PC 20, the user activates the application and displays a screen as shown in FIG.
(801).

After starting the application, the user operates the menu window 211 using the operation unit 23,
An inquiry about the number of frames that can be set is issued (802).

After confirming the user's instruction input, the PC 20
Generates a CTS command for inquiring the number of frames (803). At this time, the CT generated by the PC 20
FIG. 9 shows the S command.

In FIG. 9, a status command “Status” for inquiring about the status of the camera subunit 11 is set in the ctype field 901. Subunit_ty
The pe field 902 and the SubunitID field 903 store data specifying the camera subunit 11 of the DVCR 10.

In FIG. 9, the opcode field 90
4, a code indicating a command “FRAME” related to frame control is set. operand [0] field 9
In 05, a command “Max Frame” for inquiring about the maximum number of frames that can be set in the camera subunit 11 is set. In the operand [1] field 906, dummy data is set.

After generating the CTS command of FIG.
Asynchro 20 shown in FIG.
A nous transfer packet is generated, and the packet is asynchronously transferred to the camera subunit 11 (804).

The camera subunit 11 includes the CTS
After receiving the command, an acknowledgment is returned to the PC 20 (805).

Further, the camera subunit 11 executes a process corresponding to the received CTS command (806) and creates a CTS response corresponding to the CTS command (807). At this time, the camera subunit 1
FIG. 10 shows the CTS response generated in step 1.

In FIG. 10, the response field 10
“Stable” is set in 01. Data specifying the camera subunit 11 of the DVCR 10 is stored in the Subunit_type field 1002 and the SubunitID field 1003.

In FIG. 10, the opcode field 1
004, the operand [0] field 1005 contains PC2
The same code "FRAM" as the CTS command transferred from 0
"E" and "Max Frame" are set. In the operand [1] field 1006, the maximum number of frames that can be set by the camera subunit 11 is set.

After generating the CTS response of FIG. 10,
The camera subunit 11 generates an asynchronous transfer packet shown in FIG. 5 using the CTS response, and transfers the packet to the PC 20 asynchronously (80).
8).

After receiving the CTS response, the PC 20 returns an acknowledgment to the camera subunit 11 (809). Thereafter, the PC 20 visually displays the maximum number of frames included in the CTS response on the monitor 22 (810).

According to the above procedure, the PC 20 can confirm the maximum number of frames that can be set in the captured image of the camera subunit 11 and manage the number of frames that can be set in the camera subunit 11 by the application of the PC 20. be able to.

(2) Setting of Frame In this embodiment, the application of the PC 20 can set a new frame in the image captured by the camera subunit 11 for the camera subunit 11. Hereinafter, the procedure for setting various frames will be described with reference to FIG.

(2-1) Setting of Rectangular Frame In the PC 20, the user starts an application and displays a screen as shown in FIG. 2 on the monitor 22 (1101).

After the application is activated, the user operates the control button 2062 using the operation unit 23 to select a rectangular frame setting mode from a plurality of modes (1102).

In the rectangular frame setting mode, the user operates the operation unit 23 to set the starting point of the rectangular frame on the image pickup screen on the preview screen 201. continue,
The user operates the operation unit 23 to set the end point of the rectangular frame. As a result, a rectangular area having a diagonal line between the start point and the end point is set like the frame 207 in FIG.
103).

After setting a rectangular frame by the application, the PC 20 generates a CTS command for setting a rectangular frame (1104), and asynchronously transfers the CTS command to the camera subunit 11 (1110).
05). At this time, the CTS command generated by the PC 20 will be described with reference to FIG.

In FIG. 12, the ctype field 120
1 is set with a control command “Control” for controlling the camera subunit 11. Subunit_type
Field 1202, SubunitID field 1203
Stores data specifying the camera subunit 11 of the DVCR 10.

In FIG. 12, the opcode field 1
204 includes a command “FRAM” related to frame control.
A code indicating "E" is set. In the operand [0] field 1205, a code indicating an area setting command “Area Set” is set. operand [1] field 12
In 06, a frame number “Frame Number” arbitrarily set on the application is set.

In FIG. 12, data indicating the frame type "Frame Type" is set in the operand [2] field. In the operand [3] field, the value of the X coordinate "X position of left to
"p" is set, and the value of the Y coordinate "Y position of left to
p "is set. In the operand [5] field, the value of the X coordinate of the end point of the rectangular frame “X position of right
bottom ", and the operand [6] field contains
The value of the Y coordinate of the end point of the rectangular frame "Y position of righ
t bottom "is set.

The camera subunit 11 has the above-mentioned CTS.
After receiving the command, an acknowledgment is returned to the PC 20 (1106).

The camera subunit 11 executes a process corresponding to the received CTS command (1107).
At the same time, a CTS response corresponding to the CTS command is created (1108).

At this time, the camera subunit 11
"Frame Number" and "Fr" specified by S command
ame Type ", the DVCR 10
Create a CTS response in which the response type "Rejected" or "Not Implemented" is set in the sponse field. Further, the camera sub-unit 11 determines that the “Frame Number” and “Frame
Type ”, the DVCR 10 responds
Create a CTS response with the response type "Accepted" set in the field.

The camera subunit 11 stores data for specifying the subunit of the target in the Subunit_type field and SubunitID field of the CTS response. opcode field and operand
In the [0] field to the operand [n] field, CT
The same value as the value set in the S command is set respectively.

After creating the CTS response, the camera subunit 11 generates an asynchronous transfer packet shown in FIG.
Asynchronous transfer to C20 (1109). P
C20 returns an acknowledgment to the CTS response to camera subunit 11 (1110).

Thereafter, the PC 20 visually displays on the monitor 22 that the designated rectangular frame has been set in the camera subunit 11 (1111).

With the above communication procedure, the application of the PC 20 can set a rectangular frame area for the image captured by the camera subunit 11.

(2-2) Setting of Circular Frame In the PC 20, the user activates an application and displays a screen as shown in FIG. 2 on the monitor 22 (1101).

After starting the application, the user operates the control button 2063 using the operation unit 23 to select a circular frame setting mode from a plurality of modes (1102).

In the circular frame setting mode, the user operates the operation unit 23 to set the center point of the circular frame on the imaging screen on the preview screen 201. Subsequently, the user operates the operation unit 23 to set a range point of the circular frame. As a result, a circular region having a radius of a straight line connecting the center point and the range point is set as in the frame 208 of FIG. 2 (1103).

After setting the circular frame by the application, the PC 20 generates a CTS command for setting the circular frame (1104), and asynchronously transfers the CTS command to the camera subunit 11 (1110).
05). At this time, the CTS command generated by the PC 20 will be described with reference to FIG.

In FIG. 13, the ctype field 130
1, Subunit_type field 1302, Subunit ID field 1303, opcode field 1304, opran
d [0] field 1305, operand [1] field 1
Various data are set in 306 in the same manner as in FIG.

In FIG. 13, data indicating the frame type "Frame Type" is set in the operand [2] field. In the operand [3] field, the value of the X coordinate of the center point of the circular frame “X position of cente
r ”is set, and the value of the Y coordinate“ Y position of center ”of the starting point of the rectangular frame is set in the operand [4] field.
Is set. The radius [radius] of the circular frame is set in the operand [5] field.

The camera sub-unit 11 has the CTS
After receiving the command, an acknowledgment is returned to the PC 20 (1106).

Further, the camera subunit 11 executes a process corresponding to the received CTS command (1107).
At the same time, a CTS response corresponding to the CTS command is created (1108). The data set in the CTS response is set in the same manner as the rectangular frame CTS response.

After creating the CTS response, the camera subunit 11 generates an Asynchronous transfer packet shown in FIG.
Asynchronous transfer to C20 (1109). P
C20 returns an acknowledgment to the CTS response to camera subunit 11 (1110).

Thereafter, the PC 20 visually displays on the monitor 22 that the designated circular frame has been set in the camera subunit 11 (1111).

With the above communication procedure, the application of the PC 20 can set a circular frame area for the image captured by the camera subunit 11.

(2-3) Setting of Polygon Frame In the PC 20, the user starts an application and displays a screen as shown in FIG. 2 on the monitor 22 (1101).

After starting the application, the user operates the control button 2064 using the operation unit 23 to select a polygon frame setting mode from a plurality of modes (1102).

In the polygon frame setting mode, the user operates the operation unit 23 to set the starting point of the polygon frame on the image pickup screen on the preview screen 201. Subsequently, the user operates the operation unit 23 to set the second point of the polygon frame. Further, the user operates the operation unit 23,
The points after the third point of the polygon frame are set. Thus, a polygonal region in which the starting point and the second and subsequent points are sequentially connected by a straight line is set as in the frame 209 in FIG.
03).

After setting the polygon frame by the application, the PC 20 sets the CTS for setting the polygon frame.
A command is generated (1104), and the CTS command is asynchronously transferred to the camera subunit 11 (1105). At this time, the CT generated by the PC 20
The S command will be described with reference to FIG.

In FIG. 14, the ctype field 140
1, Subunit_type field 1402, SubunitID field 1403, opcode field 1404, opran
d

Various data are set in the [0] field 1405 and the operand [1] field 1406 in the same manner as in FIG.

In FIG. 14, data indicating the frame type "Frame Type" is set in the operand [2] field. In the operand [3] field, the number of sides of the polygon frame "Number of sides (n)" is set, and in the field after operand [4], the X coordinate value of each vertex "X position nth apex" , Y coordinate value "Y posit
ion nth apex "is set.

The camera subunit 11 has the above-mentioned CTS.
After receiving the command, an acknowledgment is returned to the PC 20 (1106).

The camera subunit 11 executes a process corresponding to the received CTS command (1107).
At the same time, a CTS response corresponding to the CTS command is created (1108). The data set in the CTS response is set in the same manner as the rectangular frame CTS response.

After creating the CTS response, the camera subunit 11 uses the CTS response to generate an asynchronous transfer packet shown in FIG.
Asynchronous transfer to C20 (1109). P
C20 returns an acknowledgment to the CTS response to camera subunit 11 (1110).

Thereafter, the PC 20 visually displays on the monitor 22 that the designated polygon frame has been set in the camera subunit 11 (1111).

With the above communication procedure, the application of the PC 20 can set a polygonal frame area for the image captured by the camera subunit 11.

(2-4) Setting of Pixel Frame In the PC 20, the user activates an application and displays a screen as shown in FIG. 2 on the monitor 22 (1101).

After the application is started, the user operates the control button 2065 using the operation unit 23 to select a pixel frame setting mode from a plurality of modes (1102).

In the pixel frame setting mode, the user operates the operation unit 23 to set a pixel frame of one pixel on the imaging screen on the preview screen 201. The pixel frame is set, for example, like the frame 210 in FIG. 2 (1103).

After setting the pixel frame by the application, the PC 20 generates a CTS command for setting the pixel frame (1104), and transfers the CTS command to the camera subunit 11 asynchronously (1110).
05). At this time, the CTS command generated by the PC 20 will be described with reference to FIG.

In FIG. 15, the ctype field 150
1, Subunit_type field 1502, Subunit ID field 1503, opcode field 1504, opran
d [0] field 1505, operand [1] field 1
Various data are set in 506 in the same manner as in FIG.

In FIG. 15, data indicating the frame type "Frame Type" is set in the operand [2] field. In the operand [3] field, the value “X position” of the X coordinate of the pixel frame is set, and op
The value “Y position” of the Y coordinate of the pixel frame is set in the erand [4] field.

The camera subunit 11 has the above-mentioned CTS.
After receiving the command, an acknowledgment is returned to the PC 20 (1106).

Further, the camera subunit 11 executes a process corresponding to the received CTS command (1107).
At the same time, a CTS response corresponding to the CTS command is created (1108). The data set in the CTS response is set in the same manner as the rectangular frame CTS response.

After creating the CTS response, the camera subunit 11 generates an Asynchronous transfer packet shown in FIG.
Asynchronous transfer to C20 (1109). P
C20 returns an acknowledgment to the CTS response to camera subunit 11 (1110).

Thereafter, the PC 20 visually displays on the monitor 22 that the designated pixel frame has been set in the camera subunit 11 (1111).

By the above communication procedure, the application of the PC 20 can set the pixel frame area for the image captured by the camera subunit 11.

(3) Inquiry of Frame Area In this embodiment, the application of the PC 20 can inquire the camera subunit 11 about the area of the frame set in the image captured by the camera subunit 11. Hereinafter, the frame region inquiry procedure will be described with reference to FIG.

In the PC 20, the user starts the application and displays a screen as shown in FIG.
(1601).

After starting the application, the user selects a desired frame from preset frames using the operation unit 23 (1602). After selecting the frame, the user instructs to inquire about the area of the frame using the operation unit 23 (1603).

After confirming the user's instruction input, the PC 20
Generates a CTS command for inquiring of a frame area (1604), and asynchronously transfers the CTS command to the camera subunit 11 (1605). At this time, the CTS command generated by the PC 20 is
It is shown in FIG.

In FIG. 17, the ctype field 170
1 is set with a status command “Status” for inquiring about the state of the camera subunit 11. Subuni
t_type field 1702, SubunitID field 1
703 stores data specifying the camera subunit 11 of the DVCR 10.

Also, in FIG. 17, the opcode field 1
704 includes a command “FRAM” related to frame control.
A code indicating "E" is set. In the operand [0] field 1705, a code indicating an area setting command “Area Set” is set. operand [1] field 17
In 06, the number "Frame Number" of the frame to be inquired of the area information is set.

The camera subunit 11 has the above-mentioned CTS.
After receiving the command, an acknowledgment is returned to the PC 20 (1606).

The camera subunit 11 executes a process corresponding to the received CTS command (1607).
At the same time, a CTS response corresponding to the CTS command is created (1608).

At this time, the camera sub-unit 11
If the “Frame Number” specified by the S command is not supported, the PC 20 creates a CTS response with “Rejected” set in the response field. When the camera subunit 11 supports “Frame Number” and “Frame Type” specified by the CTS command, the PC 20 creates a CTS response in which “Stable” is set in the response field.

The camera subunit 11 stores data for specifying the subunit of the target in the Subunit_type field and SubunitID field of the CTS response. opcode field and operand
In the [0] to operand [1] fields, the same values as those set in the CTS command are set.

In the field after the operand [2] of the CTS response, the area of the designated frame is shown in FIG.
To the data format shown in FIG. If the area of the designated frame is not set, for example, F
Dummy data such as F (hexadecimal) is set in the operand [2] field.

After creating the CTS response, the camera subunit 11 generates an Asynchronous transfer packet shown in FIG.
Asynchronous transfer to C20 (1609).

The PC 20 returns an acknowledgment to the CTS response to the camera subunit 11 (1610). After that, the PC 20 visually displays the area of the selected frame on the monitor 22 using the parameter information included in the CTS response (1611).

According to the above procedure, the PC 20 can confirm the area of the frame set in the image captured by the camera subunit 11, and can manage the area of the frame by the application of the PC 20.

(4) Switching display / non-display of the target frame In this embodiment, the application of the PC 20 sends the display / display of the target frame set in the image captured by the camera sub-unit 11 to the camera sub-unit 11. You can also switch off the display. The procedure for switching the display / non-display of the target frame will be described below with reference to FIG.

In the PC 20, the user activates the application and displays a screen as shown in FIG.
(1801).

After starting the application, the user selects a target frame by using the operation unit 23 (18).
02). After selecting the frame, the user operates the operation unit 23
Is used to instruct display / non-display of the frame (180)
3).

After confirming the user's instruction input, the PC 20
Generates a CTS command for switching display / non-display (1804), and asynchronously transfers the CTS command to the camera subunit 11 (1805). At this time, the CTS command generated by the PC 20 is
Shown in

In FIG. 19, a ctype field 190
1 is set with a control command “Control” for controlling the camera subunit 11. Subunit_type
Field 1902, SubunitID field 1903
Stores data specifying the camera subunit 11 of the DVCR 10.

In FIG. 19, the opcode field 1
904 includes a command “FRAM related to frame control”.
A code indicating "E" is set. In the operand [0] field 1905, a code designating display / non-display "Show / Hide" is set. operand [1] field 1
906 includes a frame number “Frame Numbe” of the target frame.
r "is set.

The camera subunit 11 has the above-mentioned CTS.
After receiving the command, an acknowledgment is returned to the PC 20 (1806).

The camera subunit 11 executes a process corresponding to the received CTS command (1807).
At the same time, a CTS response corresponding to the CTS command is created (1808).

At this time, the camera sub-unit 11
If the “Frame Number” specified by the S command is supported and no area is set in the target frame, P
C20 creates a CTS response in which "Rejected" is set in the response field. In addition, the camera subunit 11 transmits the “Frame” specified by the CTS command.
If the target frame supports the “Number” and the area is set in the target frame, the PC 20 sets “Accece” in the response field.
Create a CTS response with "pted" set.

The camera subunit 11 stores data for specifying the target subunit in the Subunit_type field and SubunitID field of the CTS response. opcode field and operand [0] to oper
In the and [1] field, the same value as the value set in the CTS command is set.

After the creation of the CTS response, the camera subunit 11 generates an asynchronous transfer packet shown in FIG.
Asynchronous transfer to C20 (1809).

The PC 20 returns an acknowledgment to the CTS response to the camera subunit 11 (1810). Thereafter, the PC 20 visually displays on the monitor 22 the captured image transferred isochronously from the camera subunit 11 and the display / non-display of the target frame (1811).

Here, the CTS in which “Accepted” is set
When transferring the response, the camera subunit 11
Switches display / non-display of the target frame.

For example, the target frame is a rectangular frame, a circular frame, a polygonal frame, and the CTS command
When the code “Show” for instructing the display of the frame is set in the operand [0] field, the camera subunit 11 superimposes the outer frame of the target frame on the captured image, and transfers the captured image isochronously. In the case of a pixel frame, a frame such as a crosshair display, a circular frame display, or a rectangular frame display centering on the designated pixel is displayed so as to be superimposed on the captured image.

As a result, the camera subunit 11
An image in which the outer frame of the target frame is superimposed on the captured image in advance can be supplied to the PC 20. Also, DVCR
When the display 10 includes a display unit such as a viewfinder or a liquid crystal panel, an image in which a target frame is superimposed on a captured image is displayed.

When the code "Hide" for instructing non-display of a frame is set in the operand [0] field of the CTS command, the camera subunit 11 multiplexes the frame of the target frame with the captured image. Not
The captured image is transmitted to the PC 20 in an isochronous manner.

According to the above procedure, the PC 20 can instruct the display / non-display of the frame set in the image captured by the camera subunit 11, and manages the display / non-display of the frame by the application of the PC 20. be able to.

(5) Function Setting of Target Frame In this embodiment, the application of the PC 20 sets various functions for the camera subunit 11 for the frame set in the image captured by the camera subunit 11. You can also. The function setting procedure for the target frame will be described below with reference to FIG.

In the PC 20, the user activates the application and, as shown in FIG.
(2001).

After starting the application, the user operates the control button 2061 using the operation unit 23, and
A desired frame is selected (2002). For example, after clicking the control button 2061 using a mouse,
A desired frame is selected by double-clicking a frame 209 displayed on the preview screen 201 so as to be superimposed on the captured image.

After the selection of the frame, the application of the PC 20 displays the menu window 211 and allows the user to select various functions to be set for the target frame (2003). Here, the menu window 21
Functions that can be selected in 1 include auto focus, automatic exposure, white balance, electronic zoom, and the like.

After confirming the user's instruction input, the PC 20
Generates a CTS command for setting a predetermined function in the target frame (2004), and asynchronously transfers the CTS command to the camera subunit 11 (200).
5). At this time, the CTS command generated by the PC 20 is shown in FIG.

In FIG. 21, the ctype field 210
1 is set with a control command “Control” for controlling the camera subunit 11. Subunit_type
Field 2102, SubunitID field 2103
Stores data specifying the camera subunit 11 of the DVCR 10.

In FIG. 21, the opcode field 2
104, a command “FRAM” related to frame control.
A code indicating "E" is set. The operand [0] field 2105 contains a function setting command “Function Set”
Is set. operand
In the [1] and operand [2] fields 2106, a code indicating the number “Frame Number” of the target frame and a code indicating the function “FunctionType” to be set in the target frame are set. Here, the “Function Type” includes, for example, the functions shown in FIG.

[0149] The camera sub-unit 11
After receiving the command, an acknowledgment is returned to the PC 20 (2006).

The camera subunit 11 executes a process corresponding to the received CTS command (2007).
At the same time, a CTS response corresponding to the CTS command is created (2008).

At this time, the camera sub-unit 11
“Frame Number” and “Fu” specified by the S command
nction Type "is not supported, PC20
Is C with "Rejected" set in the response field
Create a TS response. Also, camera subunit 1
1 is the “Frame Numbe” specified by the CTS command.
r "and" Function Type "
C20 creates a CTS response in which "Accepted" is set in the response field.

The camera subunit 11 stores data specifying the target subunit in the Subunit_type field and SubunitID field of the CTS response. opcode field and operand [0] to oper
In the and [1] field, the same value as the value set in the CTS command is set.

After creating the CTS response, the camera subunit 11 sends the CTS response to the PC 20 asynchronously.
Perform chronous transfer (2009). The PC 20 uses its CT
After receiving the S response, an acknowledgment to the CTS response is returned to the camera subunit 11 (2
010).

Here, the camera subunit 11 sets the function of the target frame according to the received CTS command. For example, “Function T
If “ype” is the autofocus “Auto Focus”, the camera subunit 11 autofocuses the entire captured image based on the image of the target frame area, and transfers the result in an isochronous manner. When the “Function Type” included in the CTS command is the electronic zoom “Zoom”, the camera subunit 11 zooms up the entire captured image based on the image of the target frame area, and transmits the result in an isochronous manner. .

After returning the acknowledgment to the camera sub-unit 11, the PC 20 visually displays on the monitor 22 that the desired function has been set for the target frame, and generates the image based on the function. The captured image is displayed (2011).

For example, the application of this embodiment is
The color for displaying the outer frame of the target frame can be changed according to the function selected and set by the user. In FIG. 2, when the function set to the frames 207 to 210 is autofocus, the application can display the outer frame of the frame in red, and in the case of white balance, the application can display the outer frame of the frame in yellow. . By performing such processing for each frame, the function set for each frame can be visually displayed, and the user interface can be further improved.

When the user selects another frame and wants to set a desired function for that frame, various functions can be set for a plurality of frames by repeating the above procedure. .

By the above procedure, the PC 20 can set various functions for the frames set in the image captured by the camera subunit 11, and can manage the functions for each frame with the application of the PC 20. .

In this embodiment, the case where one function is set for the target frame has been described. However, the present invention is not limited to this. Multiple CTS commands for function setting or multiple Function T in one CTS command
A configuration may be adopted in which ype is set and transferred, and a plurality of functions are set for the target frame.

(6) Inquiry about Function of Target Frame In this embodiment, the application of the PC 20 can inquire the camera subunit 11 about the function of the frame set in the image captured by the camera subunit 11. . Hereinafter, the procedure for inquiring the function in the target frame will be described with reference to FIG.

In the PC 20, the user activates the application and, as shown in FIG.
(2301).

After the application is started, the user operates the control button 2061 or the like of the operation unit 23 to select a target frame (2302). For example, after clicking the control button 2061 using a mouse, a desired frame is selected by double-clicking the frame 209 displayed on the preview screen 201 so as to be superimposed on the captured image.

After selecting the target frame, the user operates the operation unit 23 to instruct the frame to inquire about the frame function (2303).

After confirming the user's instruction input, the PC 20
Generates a CTS command for inquiring about the function of the target frame (2304), and asynchronously transfers the CTS command to the camera subunit 11 (230).
5). At this time, the CTS command generated by the PC 20 is shown in FIG.

In FIG. 24, the ctype field 240
1 is set with a control command “Control” for controlling the camera subunit 11. Subunit_type
Field 2402, SubunitID field 2403
Stores data specifying the camera subunit 11 of the DVCR 10.

In FIG. 24, the opcode field 2
404 includes a command “FRAM” related to frame control.
A code indicating "E" is set. The operand [0] field 2405 contains a function setting command "Function Set"
Is set. operand
In the [1] and operand [2] fields 2406, a code indicating the number “Frame Number” of the target frame and dummy data “FF (hexadecimal)” are set.

The camera subunit 11 has the above-mentioned CTS.
After receiving the command, an acknowledgment is returned to the PC 20 (2306).

Further, the camera subunit 11 executes a process corresponding to the received CTS command (2307).
At the same time, a CTS response corresponding to the CTS command is created (2308).

At this time, the camera sub-unit 11
If the “Frame Number” specified by the S command is not supported, the PC 20 creates a CTS response with “Rejected” set in the response field. If the camera subunit 11 supports “Frame Number” specified by the CTS command, the PC 20 creates a CTS response in which “Stable” is set in the response field.

[0170] Further, the DVCR 10 transmits the CTS response.
In the Subunit_type field and SubunitID field,
Stores data identifying the target subunit. opcode field and operand [0] to operand [1]
The same value as the value set in the CTS command is set in each field.

The DVCR 10 transmits the CTS response.
In the operand [2] field, set a code indicating the function set in the target frame. This code is, for example, data shown in FIG. When the function is not set in the target frame, FF (hexadecimal) which is dummy data is set.

After creating the CTS response, the camera subunit 11 generates an asynchronous transfer packet shown in FIG.
Asynchronous transfer to C20 (2309).

The PC 20 returns an acknowledgment to the CTS response to the camera subunit 11 (2310). Thereafter, the PC 20 visually displays the function of the target frame on the monitor 22 based on the CTS response (1611).

By the above procedure, the PC 20 can check the functions of the frames set in the image captured by the camera subunit 11 and manage the functions that can be set in each frame by the application of the PC 20. .

The present invention can be embodied in various forms without departing from its spirit or its main features.

For example, in this embodiment, the storage medium 24 is described as a hard disk, but the present invention is not limited to this. The program code for realizing the present embodiment is
If the recording medium can be supplied to a floppy disk, optical disk, magneto-optical disk, CD-ROM, CD-R,
It may be a magnetic tape, a nonvolatile memory card, a ROM, or the like.

Further, the program code stored in the storage medium 24 of the present embodiment is
After being supplied from the outside via the digital interface 40, it may be recorded on the recording medium 24.

Therefore, the above-described embodiment is merely an example in every aspect, and should not be construed as limiting.

[0179]

As described above, according to the present invention, it is possible to remotely control the setting and inquiry of a frame for a captured image of a target and the setting and inquiry of various functions for the frame from a controller.

In particular, the controller can confirm the maximum number of frames that can be set in the captured image of the target by remote control.

The controller can remotely set a plurality of frames having different regions and shapes with respect to the captured image of the target.

Further, the controller can remotely confirm the region of the frame set in the captured image of the target.

The controller can remotely instruct the display / non-display of the frame set in the captured image of the target.

The controller can remotely set various functions for the frame set in the captured image of the target.

The controller can confirm the function of the frame set in the captured image of the target by remote control.

[Brief description of the drawings]

FIG. 1 is a block diagram showing the configuration of a communication system according to an embodiment.

FIG. 2 is a view showing an example of a display screen of a monitor provided in the PC 10.

FIG. 3 is a view showing various commands (control command, status command, notify command).

FIG. 4 is a diagram illustrating a communication procedure based on FCP.

FIG. 5 is a diagram showing a format of a CTS command transmitted asynchronously from a controller to a target.

FIG. 6 shows an opcode field and operand [0] to operand
The figure which shows an example of the data stored in the [n] field.

FIG. 7 is a diagram showing a format of a CTS response transmitted asynchronously from a target to a controller.

FIG. 8 is a sequence chart showing a procedure for inquiring the number of frames.

FIG. 9 is a view showing a format of a CTS command for inquiring the number of frames.

FIG. 10 is a diagram showing a format of a CTS response to an inquiry about the number of frames.

FIG. 11 is a sequence chart showing a procedure for setting various frames.

FIG. 12 shows a format of a CTS command for setting a rectangular frame.

FIG. 13 shows a format of a CTS command for setting a circular frame.

FIG. 14 shows a format of a CTS command for setting a polygon frame.

FIG. 15 shows a format of a CTS command for setting a pixel frame.

FIG. 16 is a sequence chart showing a procedure for inquiring a frame area.

FIG. 17 is a diagram showing a format of a CTS command for inquiring a frame area.

FIG. 18 is a sequence chart showing a procedure for instructing display / non-display of a target frame.

FIG. 19 is a CT for instructing display / non-display of a target frame.
The figure which shows the format of an S command.

FIG. 20 is a sequence chart showing a procedure for setting a function for a target frame.

FIG. 21 is a CTS for setting a function for a target frame.
The figure which shows the format of a command.

FIG. 22 is a diagram showing an example of functions that can be set by a CTS command.

FIG. 23 is a sequence chart showing a procedure for inquiring about a function of a target frame.

FIG. 24 is a view showing the format of a CTS command for inquiring about the function of a target frame.

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 5B047 AA30 EB17 EB20 5C022 AA00 AB02 AB22 AB65 AB66 AC00 AC01 AC13 AC31 AC69 AC79 5C054 DA01 DA09 EA03 EG04 EJ01 FC12 FE12 FE19 HA00 5K032 BA08 DA01 DB22

Claims (19)

[Claims] 1. An image communication system configured using a bus-type transmission line capable of communicating a control signal and an image signal in a time-division manner, wherein: an imaging unit that generates a captured image from an optical image of a subject; A communication device for transmitting the captured image to an external device; a communication device for receiving the captured image; setting one or more areas for the captured image; An image communication system comprising: a second device including a control unit that controls the first device so as to set a function. 2. The image communication system according to claim 1, wherein the area is a predetermined area set on the captured image. 3. The image communication system according to claim 1, wherein the control unit can set one or more frames having different shapes for the captured image. 4. The apparatus according to claim 1, wherein the control means further comprises: a settable number of frames for the first device;
An image communication system capable of inquiring at least one of a region of a selected frame and a function set in the selected frame. 5. The method according to claim 1, wherein the predetermined function is:
An image communication system comprising at least one of autofocus, automatic exposure, white balance, and electronic zoom. 6. The device according to claim 5, wherein the first device comprises:
An image communication system, wherein the entire captured image is controlled based on a function set in the area. 7. The image communication system according to claim 1, wherein the control unit controls the first device based on a predetermined program code. 8. The image communication system according to claim 1, wherein said second device further comprises display means for multiplexing and displaying said captured image and said frame. 9. The image communication system according to claim 1, wherein the first device and the second device are connected via a bus-type transmission line capable of serially communicating data. . 10. The image communication system according to claim 1, wherein the communication unit of the first device performs the isochronous transfer of the captured image. 11. The image communication system according to claim 1, wherein the communication unit of the second device asynchronously transfers the control command generated by the control unit to the first device. 12. The image communication system according to claim 11, wherein the communication unit of the first device asynchronously transfers a response corresponding to the control command to the second device. 13. The communication device according to claim 1, wherein the communication unit of the first device and the communication unit of the second device are connected to an IEEE 1
An image communication system characterized by a digital interface conforming to the 394 standard. 14. The image communication system according to claim 1, wherein said first device is a digital video camera. 15. The image communication system according to claim 1, wherein said second device is a personal computer. 16. An image communication apparatus for performing communication using a bus-type transmission path capable of communicating a control signal and an image signal in a time-division manner, comprising: a receiving unit for receiving a captured image transmitted from an imaging device; An image communication apparatus comprising: a control unit that sets one or more areas for an image and controls the imaging device so as to set a predetermined function for the area. 17. An image communication apparatus for performing communication using a bus-type transmission path capable of communicating a control signal and an image signal in a time-division manner, comprising: an imaging unit configured to generate a captured image from an optical image of a subject; And a control unit for controlling the captured image based on a predetermined area set in the captured image by the management device and a function set in the area. Characteristic image communication device. 18. An image communication system configured by using a bus-type transmission path capable of communicating a control signal and an image signal in a time-division manner, comprising: receiving an image transmitted from an imaging device; An image communication method, wherein one or more areas are set by using the control unit and the imaging device is controlled so as to set a predetermined function for the area. 19. An image communication system configured using a bus-type transmission path capable of communicating a control signal and an image signal in a time-division manner, wherein a captured image is generated from an optical image of a subject, and the captured image is managed by a management device. And transmitting the captured image based on a predetermined area set in the captured image by the management device and a function set in the area.