JP4336574B2 - Control device and control program - Google Patents

Description

The present invention relates to a control instrumentation 置及 beauty control program for receiving moving image data from the image processing apparatus.

  A USB interface is known as a digital interface capable of transmitting moving image data. The USB interface is a digital interface that conforms to the USB standard (see Non-Patent Document 1). The USB standard defines a synchronous transfer method called isochronous in order to guarantee real-time moving image data transmission.

  In addition, the USB standard stipulates that the host controller transmits a synchronization signal called start of frame (SOF) to each connected device. A device that transmits moving image data can transmit moving image data that guarantees real-time performance by transmitting moving image data on a bus in synchronization with the SOF.

  In addition, devices that transmit isochronous data need to secure a bandwidth for transmission. According to the USB standard, each device indicates a bandwidth required for isochronous data transmission. The host controller requests Set_Interface for each device and selects an alternative setting interface to secure the bandwidth.

  FIG. 1 is a schematic diagram of descriptors held by a device that performs isochronous transmission of moving image data. 101 is a device descriptor for notifying a vendor ID, product ID, etc., 102 is a configuration descriptor for notifying a configuration that can be taken by the device, and 103 is an alternative setting 0 of interface # 1 used in the configuration 102. The descriptor 104 is an endpoint descriptor used in the interface 103. In this example, MaxPayload indicating the bandwidth is 0 in the isochronous transfer type.

  Reference numeral 105 denotes an interface descriptor indicating the alternative setting 1 of the interface # 1, and reference numeral 106 denotes an endpoint descriptor when the interface # 1 is selected as the alternative setting 1. Here, MaxPayload indicating the bandwidth in the isochronous transfer type is 512. is there.

  Therefore, when the host controller selects the alternative setting 1 of the interface # 1 by the Set_Interface request shown in FIG. 2, the cycle for each SOF (1 ms for the USB standard full speed, 125 μsec cycle for the high speed) is set. 512-byte data transmission is guaranteed, and a device holding this descriptor can transmit data isochronously.

  In the USB standard, there is no regulation regarding data in isochronous transmission, and any data may be transmitted. That is, it is necessary to exchange data between devices regarding the data format and the like. For example, in the USB standard, the stream data format transmitted by isochronous can be notified to the transmission destination host controller device by the descriptor.

  FIG. 3 shows an example of a descriptor for notifying the stream data format to be transmitted to the host controller. Reference numeral 301 denotes a descriptor length, and 302 and 303 denote descriptors for notifying a descriptor type, that is, a stream format. Reference numerals 304 and 305 denote identifiers indicating stream formats to be transmitted as isochronous data. The host controller can process the received stream data by reading this value and recognizing the stream format transmitted by the device holding the descriptor of FIG.

  FIG. 4 is a diagram simply showing a data flow when moving image data is flowed on the USB standard. The host acquires a descriptor indicating the stream format from the device by using the Get Descriptor (401), and changes the substitute setting to 1 by using the Set Interface (402). After that, for each SOF, the host sends an In Token packet (403-405) to the device, and if there is data to be transmitted, the device sends the actual isochronous data (406-408) after receiving the In Token packet. Send.

  FIG. 5 shows the data flow according to the USB standard in time series. The SOF (501) is transmitted from the host every 1 ms (125 μs in the case of High Speed) (504), and then the In Token (502) is similarly transmitted from the host to the isochronous endpoint of the device.

When there is data to be transmitted following the In Token (502), the device transmits a data packet (503) via the isochronous endpoint. The device can transmit data according to In Token every cycle, but if it is in a state where data transmission is impossible at the time of 505, it does not transmit data and transmits data in the next cycle. Is also possible.
Universal Serial Bus Specification Revision 2.0, April 27, 2000

  An image capturing device such as a digital video camera or a digital camera has a function of transferring moving image data and a function of capturing and transferring still image data, and a control device such as a PC transfers a moving image transferred from the image capturing device. It has a function of receiving data, audio data, and still image data.

  Here, in order to perform still image data transfer, a first method for acquiring one frame of moving image data as still image data, a second method for transferring high-definition still image data by synchronous transfer, and high-definition still image A third method for transferring image data by asynchronous transfer is conceivable.

  The first method can easily acquire still image data as long as the moving image data is transferred. However, the second and third methods require a large bandwidth to transfer the still image data. Therefore, it may be difficult to obtain still image data depending on the situation.

Control equipment according to the present invention, the first still picture to get a receiving means for images processing device or we receive the video data from the video data received from the image processing apparatus, a plurality of still image data Data acquisition means , second still image data acquisition means for acquiring still image data captured during transfer of the moving image data from the image processing device, and still image data captured during transfer of the moving image data. Display control means for controlling the plurality of still image data to be displayed on the display means when the image data cannot be acquired from the image processing apparatus, and recording still image data selected from the plurality of still image data And recording means for recording on a medium .

A control program according to the present invention includes a receiving step of receiving moving image data from an image processing device, and a first still image data acquiring step of acquiring a plurality of still image data from the moving image data received from the image processing device; A second still image data acquisition step for acquiring still image data captured during the transfer of the moving image data from the image processing device; and the still image data acquired during the transfer of the moving image data as the image processing device. Display control step for controlling the plurality of still image data to be displayed on the display means, and still image data selected from the plurality of still image data is recorded on a recording medium. The recording step is a program that causes a computer to execute the recording step .

According to the onset bright, a method of acquiring still image data captured during the moving image data transferred from the image processing apparatus (e.g., corresponding to the second or third method) can obtain the still image data by even if no, method for acquiring still image data from the moving image data (e.g., corresponding to the first method) can get the still image data by.

Examples of the present invention are as follows:

  A preferred embodiment 1 of the present invention will be described below with reference to FIG. Here, FIG. 7 is a schematic block diagram showing an electrical configuration of a digital video camera 900 which is an example of the image processing apparatus of the present embodiment. The digital video camera 900 is a device having a function of operating as a device in the USB standard.

  First, a recording operation at the time of shooting by the digital video camera 900 will be described.

  The imaging control unit 801 controls the imaging unit 808 to shoot moving image data and still image data of the subject, and the moving image data and still image data captured from the imaging unit 808 are converted into appropriate moving image data by the image processing unit 805. The compressed data is compressed to a still image data format, and the compressed data is transferred to the detachable recording unit 809 by the recording control unit 804 and recorded.

  Next, the operation of the digital video camera 900 during recording will be described. The moving image data and still image data recorded in the detachable recording unit 809 are read by the reproduction control unit 803 and expanded according to the appropriate moving image data and still image data format by the image processing unit 805, and the expanded data is displayed. It is transferred to the part 810 and displayed.

  When an external device is connected to the digital interface 807, the moving image data and still image data recorded in the removable recording unit 809 are read by the DIF control unit 806 and output via the digital interface 807. Is done.

  The digital interface 807 is compliant with the USB standard. The control units 801 to 806 are connected by a data / address bus 820, data transfer is performed via the data / address bus 820, and control of each control unit is performed by the main control unit 802.

  Here, it is assumed that the digital video camera 900 is connected to a PC (personal computer) 902 which is an example of a control device via a USB network 901 as shown in FIG. The PC 902 is a device having a host controller function in the USB standard. In accordance with the procedure shown in the background art, the PC 902 acquires moving image data captured by the digital video camera 900 via the USB network 901 in real time.

  The PC 902 can also send a still image data shooting request to the digital video camera 900 via the USB network 901. At this time, the PC 902 needs to change the command to be transmitted in accordance with the still image data transfer method supported by the digital video camera 900.

  For example, as shown in FIG. 6, when only one isochronous endpoint 605 for real-time video data transmission is supported as a USB standard, the logical transmission path is one transmission path 606. And moving image data cannot be transmitted simultaneously (first transfer method).

However, as shown in FIG. 9, by providing the bulk endpoint 1002 for bulk transfer with isochronous endpoint 1001 of the real-time video data for transmission as the USB standard, second transmission path 1003 and transmission path 1004 the logical transmission path It can be a book, and can simultaneously transmit still image data and moving image data (second transfer method).

  As described above, the PC 902 needs to know the transfer method supported by the device in advance. For example, the device side supports the first transfer method in the descriptor defined by the USB standard, or This can be realized by describing that the second transfer method is supported and by reading the transfer method described in the descriptor by the PC 902.

  After reading the transfer method, the PC 902 transmits a still image shooting request command corresponding to each transfer method to the digital video camera 900, thereby realizing still image data shooting and acquisition.

  FIG. 10 shows an example of a still image data transmission request from the PC 902. The request structure shown in FIG. 10 is defined by the USB standard, and is transmitted to the device via the control endpoint. The request structure includes bmRequestType (1101), bRequest (1102), wValue (1103), wIndex (1104), wLength (1105), and Data (1106).

  When requesting still image data shooting to the device, 0x0010001 indicating that the request is a class-specific request is bmRequestType (1101), and SET_CUR indicating that control is to be performed indicates bRequest (1102), indicating a still image data request. The value is wValue (1103), the value indicating the interface to which the endpoint that transfers the still image data belongs is wIndex (1104), the value indicating the number of additional information data is wLength (1105), the first transfer method or A value indicating whether it is a still image data shooting transfer request according to the second transfer method is set as Data (1106).

  As shown in the table of FIG. 11, the data 1106 is set to 0x01 indicating the first transfer method, 0x02 indicating the second transfer method, and a value 0x03 indicating interruption of still image data shooting transfer. It can be set.

Example 1 of the present invention will be described in more detail with reference to FIG. A digital video camera 900 that is an imaging device is connected to a PC 902 via a USB network 901, and still image data and moving image data captured by the digital video camera 900 are transmitted to the PC 902.

  In addition, the digital video camera 900 transfers a still image data using an end point provided to capture still image data during moving image data transfer and send the still image data for synchronous transfer. Either the transfer function or the second still image transfer function for transferring still image data using an endpoint provided to capture still image data during moving image data transfer and send the still image data by asynchronous transfer It has one function.

  The PC 902 has a still image acquisition function A (first still image acquisition function) for acquiring still image data from each frame of the moving image data during reception of the moving image data, and isochronous transfer by the first still image transfer function. Still image acquisition function B (second still image acquisition function) for acquiring the still image data thus obtained and still image acquisition function C (second image acquisition function) for acquiring still image data bulk-transferred by the second still image transfer function (Still image acquisition function). Note that the endpoint used for real-time transfer of moving image data may be either bulk or isochronous.

  Next, the control method of the control apparatus of Example 1 in this invention is demonstrated using FIG. Here, FIG. 12 is a flowchart showing a control method of the control device.

The digital video camera 900 and the PC 902 are connected via a USB network 901. The digital video camera 900 uses the isochronous endpoint 1001 assigned to the PC 902 for streaming video data for real-time transfer of the video data. Either asynchronous transfer or asynchronous transfer using the bulk endpoint 1002 (S001). Note that the PC 902 is provided with a touch panel type operation screen for operating the digital video 900 (see FIG. 13). By operating the operation screen in advance, the still image acquisition function B and the still image acquisition function C are controlled. Decide which one to choose.

  By operating the PC 902, an instruction to shoot still image data is issued to the digital video camera 900 (S002). When this issuance is completed, each frame of the moving image data transferred from the digital video camera 900 is acquired as still image data by the still image acquisition function A and stored in a temporary storage area (not shown) provided in the PC 902.

When the still image acquisition function B is selected, the digital video camera 900 captures an image using an isochronous endpoint assigned for still image data different from the endpoint assigned for moving image data in real time. still image data is Ru are transferred to the PC902.

  If the bandwidth for transferring still image data cannot be secured (S003), a list of still image data stored in the temporary storage area is displayed as shown in FIG. The image selected by the above is stored in a recording medium (S008).

  Also, when a still image data transmission request interruption command (0x03) as shown in FIG. 11 is transmitted from the PC 902 (S004), a list of still image data stored in the temporary storage area is as shown in FIG. An image selected by the user from the displayed images is stored in a recording medium (S008).

  If still image data cannot be transferred due to an error on the device side, the digital video camera 900 notifies the PC 902 that the still image data could not be transferred normally using an interrupt (S005). . Upon receiving the notification, the PC 902 displays a list of still image data stored in the temporary storage area as shown in FIG. 14, and saves an image selected by the user from the displayed images in a recording medium ( S008).

  Also, when the error notification is not transmitted from the digital video camera 900 and a part of the packet is lost and normal still image data is not transmitted (S006), the still image stored in the temporary storage area is also the same. A list of data is displayed as shown in FIG. 14, and an image selected by the user from the displayed images is stored in a recording medium (S008).

  If the cable is disconnected halfway, the PC 902 detects a bus reset (S007), displays a list of still image data stored in the temporary storage area as shown in FIG. The image selected by the user is stored in a recording medium (S008). If the above error does not occur, the data in the temporary storage area is deleted (S009).

When the still image acquisition function C is selected, the digital video camera 900 takes an image using a bulk endpoint assigned for still image data different from the endpoint assigned for moving image data in real time. still image data is Ru are transferred to the PC902.

  If the bandwidth for transferring still image data cannot be secured (S003), a list of still image data stored in the temporary storage area is displayed as shown in FIG. The selected image is stored in a recording medium (S008).

  Also, when a still image data transmission request (0x03) interruption command as shown in FIG. 11 is transmitted from the PC 902 (S004), a list of still image data stored in the temporary storage area is also shown in FIG. The image selected by the user from the displayed images is stored in the recording medium (S008).

  If still image data cannot be transferred due to an error on the device side, the digital video camera 900 notifies the PC 902 that the still image data could not be transferred normally using an interrupt (S005). .

  Upon receiving the notification, the PC 902 displays a list of still image data stored in the temporary storage area as shown in FIG. 14, and saves an image selected by the user from the displayed images in a recording medium. (S008).

  Also, when no error notification is transmitted from the digital video camera 900 but normal still image data is not transmitted due to loss of some packets (S006), the still image data stored in the temporary storage area is also the same. 14 is displayed, and an image selected by the user from the displayed images is stored in the recording medium (S008).

  If the cable is disconnected halfway, the PC 902 detects a bus reset (S007) and displays a list of still image data stored in the temporary storage area as shown in FIG. An image selected by the user from the displayed images is stored in a recording medium (S008). If the above error does not occur, the data in the temporary storage area is deleted (S009).

  As described above, in this embodiment, when still image data cannot be acquired by the still image acquisition function B or C for some reason, the still image acquisition function A is obtained from each frame of the moving image data transferred from the digital video camera 900. Thus, still image data selected by the user from among the still image data acquired in the temporary storage area can be acquired. Thereby, still image data can be acquired reliably.

  In the first embodiment, the endpoint for transferring still image data and the endpoint for transferring moving image data are divided as shown in FIG. 9, but in this embodiment, the endpoints of moving image data and still image data are the same. .

A digital video camera 900 that is an imaging device has a function of capturing still image data and moving image data, and a function of transferring still image data and moving image data captured via the USB network 901, and a PC 902 is a digital video. It has a function of receiving still image data and moving image data transferred from the camera 900.

  The digital video camera 900 also includes an endpoint that synchronously transfers either moving image data or still image data, and an endpoint that performs bulk transfer (asynchronous transfer) of either moving image data or still image data. I have one of them.

Next, operation control of the control device of this embodiment will be described with reference to FIG. Here, FIG. 15 is a flowchart showing a control procedure of the control device. The digital video camera 900 and the PC 902 are connected via the USB network 901, and the digital video camera 900 performs streaming of moving image data to the PC 902 using a synchronous transfer using an isochronous endpoint or a bulk endpoint. Asynchronous transfer is performed (S101).

  That is, the PC 902 is bulk-transferred by the still-image acquisition function B (second still-image acquisition function) that acquires the still-image data that is isochronously transferred by the first still-image transfer function and the second still-image transfer function. Still image data is acquired by one of the still image acquisition functions C (second still image acquisition function) for acquiring still image data.

  By operating a touch panel type operation screen provided in the PC 902, a command for instructing the digital video camera 900 to shoot still image data is issued (S102). The device that has received the command temporarily stops the streaming transfer of the moving image data (S103), and receives the captured still image data.

  The PC 902 obtains still image data from a frame of moving image data (first still image acquisition function) before issuing a still image capture command and before streaming stops, and stores it in a temporary storage area of the PC 902.

  If a bandwidth for transferring still image data cannot be secured (S104), a list of still image data stored in the temporary storage area is displayed as shown in FIG. The still image data selected by the above is stored in a recording medium (S109).

  Also, when a still image data transmission request interruption command (0x03) as shown in FIG. 11 is transmitted from the PC 902 (S105), a list of still image data stored in the temporary storage area is also shown in FIG. The image selected by the user from the displayed images is stored in the recording medium (S109).

  If still image data cannot be transferred due to an error on the device side, the digital video camera 900 notifies the PC 902 that the still image data could not be transferred normally using an interrupt (S106). . Upon receiving the notification, the PC 902 displays a list of still image data stored in the temporary storage area as shown in FIG. 14, and saves an image selected by the user from the displayed images in a recording medium ( S109).

  In addition, when the error notification is not transmitted from the digital video camera 900 but a part of the packet is lost and normal still image data is not transmitted (S107), it is also stored in the temporary storage area. A list of still image data is displayed as shown in FIG. 14, and an image selected by the user from the displayed images is stored in a recording medium (S109).

  If the cable is disconnected halfway, the PC 902 detects a bus reset (S108) and displays a list of still image data stored in the temporary storage area as shown in FIG. The image selected by the user is stored in the recording medium (S109). If the above error does not occur, the data in the temporary storage area is deleted (S110).

As can be easily understood from the above description, according to this embodiment, in case of failure to obtain a high-definition image, it becomes possible to perform acquisition of the still image data reliably.

It is the structure schematic of the descriptor prescribed | regulated by USB specification. This is the structure of the SET_INTERFACE request specified by the USB standard. It is an example of a descriptor held by a USB standard device. It is a communication flow figure of isochronous transfer between a host and a device. It is the figure which showed the state of the bus | bath at the time of isochronous communication in time series. FIG. 3 is a connection relationship diagram between a USB standard logical device and a host. It is the schematic block diagram which showed the electric constitution of the digital video camera. It is a connection diagram of a digital video camera having a function of the present invention and a control device. FIG. 5 is a connection relationship diagram of a USB standard logical device and a host, and shows that there are two logical transfer paths. It is an example of a request structure for still image data shooting and transfer. 12 is an example of values set in a request structure for still image data shooting and transfer in FIG. 11. 3 is a flowchart illustrating a communication control procedure according to the first embodiment. It is the figure which showed the touchscreen type operation screen. It is a list screen of the still image data stored in the temporary storage area. 10 is a flowchart illustrating a communication control procedure according to the second embodiment.

Claims (6)

And images processing device or we receive receiving means video data,
From the moving image data received from the image processing apparatus, the first still picture data acquisition means for acquiring a plurality of still image data,
Second still image data acquisition means for acquiring still image data captured during transfer of the moving image data from the image processing device;
Display control means for controlling to display the plurality of still image data on a display means when still image data captured during transfer of the moving image data cannot be acquired from the image processing device;
Recording means for recording still image data selected from the plurality of still image data on a recording medium;
Control apparatus characterized by having a. A transmission means for transmitting a command for instructing to take a still image to the image processing apparatus;
2. The control device according to claim 1, wherein the first still image data acquisition unit acquires the plurality of still image data from the moving image data after the command is transmitted to the image processing device. . The display control unit controls the display unit to display the plurality of still image data even when transfer of still image data captured during transfer of the moving image data is interrupted. The control device according to claim 1 or 2. A receiving step of receiving moving image data from the image processing device;
A first still image data acquisition step of acquiring a plurality of still image data from the moving image data received from the image processing device;
A second still image data acquisition step of acquiring still image data captured during transfer of the moving image data from the image processing device;
A display control step for controlling to display the plurality of still image data on a display means when still image data captured during transfer of the moving image data cannot be acquired from the image processing device;
A control program that causes a computer to execute a recording step of recording still image data selected from the plurality of still image data on a recording medium . A transmission step of transmitting a command for instructing to take a still image to the image processing apparatus;
5. The control program according to claim 4, wherein the first still image data acquisition step acquires the plurality of still image data from the moving image data after the command is transmitted to the image processing apparatus. . The display control step controls to display the plurality of still image data on the display means even when transfer of still image data captured during transfer of the moving image data is interrupted. The control program according to claim 4 or 5.

Images