JPH11355587A - Device and method for processing image - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a device and a method for processing image with which suitable color space transformation is performed corresponding to the photographic state of image data. SOLUTION: A host computer 10 receives image data depending on the color space of a device such as a digital video camera 11 from that device and based on a parameter showing the photographic state of that device added to the received image data and color space transformation characteristics corresponding to prepared plural photographic conditions, color space transformation is performed to the received image data.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image processing apparatus and method, and more particularly to an image processing apparatus and method for performing color space conversion on image data in a device-dependent color space.

[0002]

2. Description of the Related Art With the development of digital image encoding technology in recent years, a method of encoding and compressing image data to digitally record and transmit the image data has been established. It has become possible to record and transmit as it is. In addition, it has become possible to easily take a photographed image into a computer as digital data.

On the other hand, in a multimedia system mainly including a host computer, a color matching system (CMS) for matching colors between an input device and an output device for image data has been developed. A typical CMS uses a unique color space (Device
Dependent Color Space) to device independent color space
Conversion of image data to (Device Independent Color Space) or vice versa is performed based on a profile (Profile) that is data representing the conversion characteristics of each device stored in the host computer in advance, and color matching is performed. Has been realized.

FIG. 1 is a diagram showing a relationship between an image transmission technique and a CMS. Parity data for correcting data errors occurring on the transmission path is added to the digital image data input from the terminal 91 on the transmission side by the parity addition circuit 92, and then packetized for transmission to the transmission path. And processing such as modulation is performed by the transmission line coding circuit 93,
The signal is sent from the terminal 94 to the transmission line.

[0005] In the host computer 101 on the receiving side, the transmission data supplied from the terminal 95 connected to the transmission path is subjected to processing such as decoding and data block extraction from the transmission packet by the decoding circuit 96. Error correction circuit
At 97, a transmission error correction process is performed. And
The restored digital image data is output from the terminal 98. Since the profile 99 for the CMS is prepared in advance on the host computer 101, it does not dynamically reflect the characteristics of the digital image data received by the host computer 101.

FIGS. 2 and 3 are views for explaining exposure control in a video camera. As shown in FIG. 2, the average brightness L of the subject is compared with the reference value Th (step S
1) If L> Th, the exposure is reduced in step S2, and if L <Th, the exposure is increased in step S3, so that the exposure is adjusted to the optimum. The exposure is adjusted by the aperture of the optical system, the gain of the circuit, and the like.

FIG. 3 shows the brightness of the subject and the S / N ratio of the image data.
It is a figure showing the relation of a ratio. When the brightness of the subject is sufficient, the aperture is used to control the exposure. If the aperture is not enough to obtain sufficient exposure, the exposure is controlled by increasing the circuit gain. Increases, the S / N ratio of the image data deteriorates proportionately.

[0008]

If digital image data to which the CMS is applied is directly connected to the host computer 101 such as a flatbed scanner and the characteristics thereof are obtained by a device having stable characteristics, the host computer By using the profile 99 provided in the 101 in advance, a sufficient color matching effect can be expected. However, when performing color matching processing on image data whose characteristics at the time of actual acquisition cannot be specified, such as digital image data encoded and compressed by a digital video camera, a profile 99 prepared in advance in the host computer 101 is used.
Therefore, a sufficient color matching effect cannot be expected. In addition, when the characteristics of the profile do not match, the image quality may be degraded by the color matching processing.

More specifically, color matching based on a profile for image data with a good S / N ratio is applied to image data with a poor S / N ratio, such as image data taken in a state where sufficient illumination cannot be obtained. When the processing is performed, the color matching processing is a non-linear processing, so that the S / N ratio is greatly deteriorated. Also, S
If color matching processing is performed with a profile that does not deteriorate the / N ratio, there is a problem that good color matching results cannot be obtained.

An object of the present invention is to solve the above-mentioned problem, and an object of the present invention is to provide an image processing apparatus and a method for performing an appropriate color space conversion according to a shooting state of image data.

[0011]

The present invention has the following configuration as one means for achieving the above object.

[0012] An image processing apparatus according to the present invention comprises: storage means for storing color space conversion characteristics corresponding to a plurality of photographing conditions; and image data which is photographed by an image input device and depends on the color space of the device. Receiving means for receiving from an image input device, and converting means for performing color space conversion on received image data based on color space conversion characteristics corresponding to the plurality of shooting conditions, wherein the converting means The color space conversion is controlled based on a parameter indicating a shooting state of the image input device added to the image data.

A photographing means for photographing the image; an adding means for adding a parameter indicating the photographing state of the image to the image data of the image; and an image processing for performing color space conversion on the image data to which the parameter has been added. Supply means for supplying to the apparatus.

[0014] An image processing method according to the present invention comprises: receiving image data taken by an image input device, which depends on the color space of the device, from the image input device;
Based on a parameter indicating the shooting state of the image input device added to the received image data, and a color space conversion characteristic corresponding to a plurality of shooting conditions stored in advance in the storage unit, the image data has a color space. The conversion is performed.

[0015] Further, the present invention is characterized in that an image is photographed, a parameter indicating a photographing state of the image is added to the image data of the image, and the image data to which the parameter has been added is supplied to an image processing device which performs color space conversion. Features.

[0016]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, an image processing apparatus according to an embodiment of the present invention will be described in detail with reference to the drawings.

FIG. 4 is a block diagram showing an example of the configuration of an image processing system according to an embodiment of the present invention. The digital video camera 11 and the flatbed scanner 12 are used as input devices, and control of input / output devices and image processing are performed. It includes a host computer 10 and a color monitor 13 and a color printer 14 as output devices. Note that a digital still camera can be provided instead of or in addition to the digital video camera 11.

The digital video camera 11 is provided with a recording device (not shown), and has a function of recording a photographed image in the recording device. Accordingly, the digital video camera 11 shoots an image while being separated from the host computer 10, and thereafter, when the output terminal 15 is connected to the input terminal 16 of the host computer 10, the recorded video is transmitted to the host computer 10. Can be transferred. For this reason, the environment at the time of shooting and the adjustment state of the camera are various, and the input characteristics of the image input device can vary from video to video, and thus cannot be uniquely determined. On the other hand, the flatbed scanner 12 obtains image data by illuminating the original placed on the stage with illumination light and reading the reflected light with a light receiving element, so that the reading environment can be regarded as almost constant. , Input characteristics can be specified in advance.

The color monitor 13 is, for example, a CRT,
A color image is reproduced and displayed by additive color mixture of phosphor emission of each color. The color printer 14 reproduces and forms a color image on a recording medium such as paper by subtractive color mixing of ink or toner of each color of CMY or CMYK. The color monitor 13 and the color printer 14 can specify output characteristics in advance based on the light emission characteristics of the phosphor and the light absorption characteristics of ink and toner.

The host computer 10 executes an application program for image processing, image editing, and the like stored on a fixed disk (not shown) with respect to image data input from the input terminal 16 or 18, and converts the processed image data. The data is output to the output device of the color monitor 13 or the color printer 14 via the output terminal 19 or 21.

When inputting / outputting image data with the host computer 10, a CMS processing routine 31 as shown in FIG. 5 is executed to change from a color space unique to the input device to a common color space and to a common color space. The conversion of the image data from the color space to the color space unique to the output device is performed. The CMS processing routine 31 and the profile of each input / output device are stored on a fixed disk in the host computer 10 as in the case of the application program described above.

In the present system, as the combination of the input device and the output device, for example, the following combinations shown in FIG. 6 can be considered. (1) Image input device → Color monitor 13 (2) Image input device → Color printer 14 (3) Color printer 14 → Color monitor 13 (so-called preview processing) (4) Color monitor 13 → Color printer 14

The CMS processing routine 31 shown in FIG. 5 corresponds to the combination of the above input / output devices. That is, the CMS processing routine 31 includes the input device-compatible CMS processing unit 32 and the output device-compatible CMS processing unit 33. These CMS processing units,
Profiles 34 and 35 corresponding to each input / output device
, The image data is converted between a color space unique to the device and a common color space. The input device profile 34 includes a common color space from a color space unique to the input device, for example,
Data representing mapping to CIE XYZ, CIE Luv, or the like is stored, and the output device profile 35 stores data representing mapping from a common color space to a device-specific color space.

The CMS processing routine 31 reads a profile from the corresponding input device profile 34 and output device profile 35 based on the combination of input / output devices. Then, based on the read profiles, the image data input from the input device is converted, and the converted image data is output. As described above, the flatbed scanner 12, the color monitor 13, and the color printer
In No. 14, since the color reproduction characteristics can be specified in advance, a good color matching result can be obtained by such processing.

On the other hand, the digital video camera 11
However, it is difficult to specify the color reproducibility in advance because the shooting characteristics change automatically depending on the environment (brightness, illumination temperature, etc.) of the subject or by a manual operation of the user. Also, for example, in a method of preparing a plurality of profiles corresponding to typical environmental conditions and selecting one of the profiles for processing, it is difficult to cope with continuous changes in environmental conditions, and a good color matching result is obtained. Is always difficult to get.

Therefore, in the present embodiment, various parameters (hereinafter, referred to as camera parameters) in the signal processing of the digital video camera 11, such as a white balance coefficient, a circuit gain, and a gamma coefficient, are transmitted to the host computer 10 together with image data. The host computer 10 executes CMS processing using these parameters, thereby performing CMS processing suitable for the environment of the subject.
The digital image data targeted by this embodiment may be uncompressed data or data encoded and compressed by a compression technique such as MPEG.

FIG. 7 is a diagram showing an example of the digital image transmission system of the present embodiment.

On the transmitting side (digital video camera 11), digital image data is supplied to a terminal 41, and camera parameters are supplied to a terminal 42. The data multiplexing circuit 43 multiplexes the camera parameters in the digital image data transmission format. FIG. 8 shows an example of data multiplexing. In the example of FIG. 8, camera parameters are inserted in the subcode area of the transmission format. The multiplexed data is added with parity for correcting a data error occurring on the transmission line in a parity addition circuit 44, and is subjected to processing such as modulation and packetization for transmission to the transmission line in a transmission line coding circuit 45. Receiving, terminal 46
Is transmitted to the transmission path. The camera parameters stored in the subcode area are not coded and compressed.

On the receiving side (host computer 10), transmission data supplied from a terminal 47 is subjected to processing such as data extraction and decoding from a transmission packet in a transmission line decoding circuit 48, and then transmitted in an error correction circuit 49. An error correction process is performed. Then, the multiplexed image data and the camera parameters are separated by the separation circuit 50, and the image data is output via the terminal 51 and the camera parameters are output via the terminal 52, respectively.

FIG. 9 is a view for explaining the CMS processing in this embodiment.

The image data supplied from the terminal 61 is N C
The data is input to the MS processing units 62a to 62n. Note that N CMS processing units may be actually prepared, or one CMS processing unit may be used in a time-division manner to provide N CMS processing units. each
The CMS processing unit has the configuration shown in FIG. 5, and performs color matching processing using different input profiles 64a to 64n and a common output profile 65. The input device profiles 64a to 64n used here are selected from N typical photographing environments by the camera, and are created based on the color space characteristics in those photographing environments. In other words, the image data output from the N CMS processing units 62a to 62n has been subjected to the color matching processing according to the typical N photographing environment profiles.

Next, the image data output from the N CMS processing units 62a to 62n are weighted and added by the weighted averaging unit 70, the average value is obtained, and the color matching processing is performed from the terminal 72. Output as image data. The weighting coefficients of the weighted averager 70 are supplied by a control signal generator 71 to which camera parameters are input.

FIG. 10 shows an example in which the control signal generator 71 generates a weighting coefficient from a white balance coefficient.
In FIG. 10, the vertical axis represents the B channel coefficient (B gain) in white balance, and the horizontal axis represents the R channel coefficient (R gain).
Gain). In addition, a mark indicated by reference numeral 75 represents an environment in which the profile # 1 was created, a sign indicated by reference numeral 77 represents an environment in which the profile # 2 was created, and a cross indicated by a reference numeral 78 represents an environment in which the profile # 3 was created. The □ mark indicated by reference numeral 76 is a plot of the white balance coefficient of the shooting environment of the image data to be subjected to the color matching process. That is, the values of the white balance coefficients multiplexed with the image data to be processed and transmitted correspond to α and β in FIG. When the Euclidean distance between ●-□, △-□ and ×-□ on the white balance coefficient plane is r1, r2 and r3, respectively, if there is a relation of r3>r1> r2, a control signal is generated. The weighting factors k1 and k2 to be generated by the unit 71 are obtained by the following equations. k1 = r2 / (r1 + r2)… (1) k2 = r1 / (r1 + r2)… (2)

Assuming that the image data converted based on the profile # 1 is y1 and the image data converted based on the profile # 2 is y2, the image data Y output from the weighted averager 70 is expressed by the following equation. Is done. Y = k1 · y1 + k2 · y2… (3)

That is, on the white balance coefficient plane,
Two profiles having a white balance coefficient close to the white balance coefficient of the image data to be processed are selected.
Then, a weighting coefficient is set using the ratio of the distance between the white balance coefficient of the selected profile and the white balance coefficient of the image data to be processed. In addition, it is also possible to obtain a weighting coefficient by a function defined in advance.

In the above description, an example has been described in which the weighting coefficient is set using the white balance coefficient as the evaluation value. However, when the camera gains such as the circuit gain and the gamma coefficient are used as the evaluation values, the same as the white balance coefficient is used. It is possible to set a weighting coefficient by a method.

FIG. 11 is a block diagram showing a configuration example of the weighted averaging unit 70, and shows a case where a white balance coefficient, a circuit gain, and a gamma coefficient are adopted as camera parameters.

N output from the N CMS processing units 62a to 62n
The sets of image data are added by weighting adders 81 to 83 according to weighting coefficients set for each camera parameter. By averaging the addition results by the averaging circuit 84, it is possible to obtain image data that has been subjected to color matching processing in conformity with the image data shooting environment. The averaging process by the averaging circuit 84 is simple averaging (see FIG.
1 / 3n in the example of 11) or weighted averaging by a predetermined coefficient.

As described above, profiles corresponding to typical n kinds of photographing environments are prepared, and the image data photographed based on those profiles is subjected to the CMS processing to obtain n sets of image data. Weighting factor according to the camera parameters added to the image data
By weighting and adding the n sets of image data, averaging the result of the addition and outputting the result as color-matched image data, it is possible to obtain image data that has been subjected to appropriate color-matching processing according to various shooting environments. be able to.

That is, when performing color matching processing on image data whose characteristics at the time of acquisition cannot be specified, such as image data captured by a digital video camera or a digital still camera, sufficient color matching is performed with a prepared profile. If the effect cannot be expected, or if the characteristics of the profile do not match, the image quality may be degraded by the color matching process. However, according to the present embodiment, for example, the image was shot in a state where sufficient illumination was not obtained. For image data with a poor S / N ratio such as image data, color matching processing based on a profile for image data with a poor S / N ratio will be executed, and the S / N ratio will be extremely deteriorated. Can be prevented. Also, for image data having a good S / N ratio, such as image data taken outdoors during the day, color matching processing based on a profile for image data having a good S / N ratio will be performed, Good color matching results are obtained.

[0041]

[Data Transfer Method] An example of the data transfer method in the above embodiment will be described below. In the above-described embodiment, it is preferable that the parameter indicating the shooting state is transferred by asynchronous transfer described later, and that the image data is transferred by isochronous transfer described later. However, the present invention is not limited to this.

FIG. 12A is a diagram showing a general configuration example of a system to which the present invention is applied, in which a PC 103, a printer 102 and a digital video camera (DVC) 101 are connected using a 1394 serial bus. Therefore, the outline of the 1394 serial bus will be described in advance.

[Overview of 1394 serial bus] With the advent of consumer digital video cam recorders (VCRs) and digital video disc (DVD) players, video data and audio data (hereinafter collectively referred to as "AV data")
There is a need to transfer data with a large amount of information in real time, such as in real time. To transfer AV data to a personal computer (PC) or other digital devices in real time, an interface capable of high-speed data transfer is required. The interface developed from such a viewpoint is the 1394 serial bus.

FIG. 12B shows an example of a network system configured using a 1394 serial bus. This system is equipped with devices A, B, C, D, E, F, G and H, between AB, AC, B-
139 each between D, DE, CF, CG, and CH
4 Connected with a twisted pair cable for serial bus. Examples of these devices A to H include a host computer device such as a personal computer and computer peripheral devices. Computer peripherals include digital VCRs, DVD players, digital still cameras, storage devices using media such as hard disks and optical disks, CRT and LCD monitors, tuners, image scanners,
It covers all computer peripherals such as film scanners, printers, MODEMs, and terminal adapters (TAs).

The recording method of the printer is an electrophotographic method using a laser beam or LED, an ink jet method,
Any method such as an ink melting type, a sublimation type thermal transfer method, and a thermal recording method may be used.

The connection between the devices can be a mixture of the daisy chain system and the node branch system, and a highly flexible connection can be made. Each device has an ID, and recognizes each other to form one network within a range connected by a 1394 serial bus. For example, a single 13
By simply daisy-chaining with a 94 serial bus cable, each device plays the role of relay, so that one network can be configured as a whole.

The 1394 serial bus is plug and play.
It has a function to automatically recognize the device just by connecting the cable to the device and recognize the connection status. Further, in a system as shown in FIG. 12A, when a device is removed from the network or newly added, the bus is automatically reset (the network configuration information up to that point is reset) and the new bus is reset. Rebuilding a good network. With this function, the configuration of the network at that time can be constantly set and recognized.

The data transfer speed of the 1394 serial bus is defined as 100/200/400 Mbps, and the device having the higher transfer speed supports the lower transfer speed.
Compatibility is maintained. As the data transfer mode, there are an asynchronous transfer mode (ATM) for transferring asynchronous data such as a control signal) and an isochronous transfer mode for transferring synchronous data such as real-time AV data. The asynchronous data and the synchronous data are used to indicate the start of a cycle in each cycle (typically 125 μs / cycle).
Following the transfer of the packet (CSP), the transfer of the synchronous data is prioritized, and the transfer is performed in a mixed manner within the cycle.

FIG. 13 shows the structure of the 1394 serial bus. The 1394 serial bus has a layer structure. As shown in Figure 13, cable for 1394 serial bus
There is a connector port 810 to which the connector at the end of 813 is connected. Above the connector port 810, the hardware section 8
There is a physical layer 811 and a link layer 812 composed of 00. The hardware unit 800 is configured by an interface chip. The physical layer 811 performs coding and connection-related control, and the link layer 812 performs packet transfer and cycle time control.

The transaction layer 814 of the firmware unit 801 manages data to be transferred (transacted), and issues read (Read), write (Write), and lock (Lock) instructions. The management layer 815 of the firmware unit 801 manages the connection status and ID of each device connected to the 1394 serial bus, and manages the configuration of the network. The above hardware and firmware are the substantial configuration of the 1394 serial bus.

The application layer 816 of the software unit 802 differs depending on the software used, and how data is transferred on the interface is defined by a protocol such as a printer or an AV / C protocol. .

FIG. 14 is a diagram showing an address space in the 1394 serial bus. Each device (node) connected to the 1394 serial bus must have a unique 64-bit address for the node. And this address is the memory M of the device
And by always recognizing the node address of the user and the other party, the data communication with the designated communication partner can be performed.

The addressing of the 1394 serial bus is based on the IE
The address is set according to the EE1212 standard. The first 10 bits are used for specifying the bus number, and the next 6 bits are used for the node ID.
Used to specify.

The 48-bit address used in each device is also divided into 20 bits and 28 bits.
It is used with a structure of 256 MB. 0 to 0xFFFFD of the first 20-bit address space is memory space, 0x
FFFFE is called a private space, and 0xFFFFF is called a register space. The private space is an address that can be used freely within the device, and the register space stores information common to devices connected to the bus and is used for communication between the devices.

In the first 512 bytes of the register space, a command / status register (Command / Status Register:
Registers that are the core of CSR) architecture (CSR core)
However, the next 512 bytes contain the serial bus registers, the next 1024 bytes contain the configuration ROM, and the rest contain unit-specific registers in the unit space.

In general, to simplify the design of heterogeneous bus systems, nodes should only use the first 2048 bytes of the initial unit space, which results in the CSR core, serial bus registers, configuration ROM and It is desirable that the first 2048 bytes of the unit space be composed of 4096 bytes.

The above is the outline of the 1394 serial bus.
Next, the features of the 1394 serial bus will be described in more detail.

[Electrical Specifications of 1394 Serial Bus] FIG.
FIG. 2 is a diagram showing a cross section of a cable for a 1394 serial bus.
The 1394 serial bus cable has a power supply line in addition to the two twisted pair signal lines. As a result, power can be supplied to a device having no power supply or a device whose voltage has been reduced due to a failure or the like. The voltage of the DC power supplied by the power supply line is 8 ~ 40V, the current is the maximum current 1.
Specified in 5A. In the standard called DV cable, it is composed of four wires omitting a power supply line.

[DS-Link System] FIG. 16 shows a DS link (Data / St) of the data transfer system adopted in the 1394 serial bus.
FIG. 3 is a diagram for explaining a robe link) method.

The DS link system is suitable for high-speed serial data communication and requires two sets of signal lines. In other words, the data signal is transmitted by one of the two pairs of twisted pairs, and the strobe signal is transmitted by the other pair. The receiving side has a feature that a clock can be generated by taking an exclusive OR of this data signal and the strobe signal. Therefore, when using the DS-Link method, there is no need to mix a clock signal into the data signal, so transfer efficiency is higher than other serial data transfer methods, and a clock signal can be generated, so a phase locked loop (PLL)
This eliminates the need for a circuit, which makes it possible to reduce the circuit size of the controller LSI. Further, there is no need to send information indicating that the device is idle when there is no data to be transferred. Can be put into a sleep state, and power consumption can be reduced.

[Bus Reset Sequence] Each device (node) connected to the 1394 serial bus has a node ID.
Are given, and are recognized as nodes constituting the network. For example, connection and disconnection of network equipment and power supply
When the number of nodes increases or decreases due to ON / OFF, etc., that is, the network configuration changes, and it is necessary to recognize a new network configuration, each node that detects the change sends a bus reset signal on the bus and Enter the mode to recognize the network configuration. The detection of the change in the network configuration is performed by detecting a change in the bias voltage at the connector port 810.

When a bus reset signal is transmitted from a certain node, the physical layer 811 of each node receives the bus reset signal and, at the same time, transmits the occurrence of a bus reset to the link layer 812 and transmits the bus reset signal to another node. To communicate. After all the nodes finally receive the bus reset signal, the bus reset sequence is started. Note that the bus reset sequence is started when a cable is connected or disconnected, or when hardware detects a network error or the like, and is also provided by directly giving an instruction to the physical layer 811 such as host control using a protocol. Is activated. When the bus reset sequence is activated, the data transfer
The bus is temporarily suspended, waited during the bus reset, and resumed under the new network configuration after the bus reset is completed.

[Node ID Determination Sequence] After the bus reset, each node starts an operation of giving an ID to each node in order to construct a new network configuration. The general sequence from the bus reset to the determination of the node ID at this time will be described with reference to the flowcharts shown in FIGS.

FIG. 17 is a flowchart showing a series of sequences from the generation of the bus reset signal until the node ID is determined and data transfer can be performed.

Each node constantly monitors the generation of the bus reset signal in step S101, and when the bus reset signal is generated, the process proceeds to step S102, where the nodes are directly connected to each other to obtain a new network configuration in a state where the network configuration is reset. A parent-child relationship is declared between the nodes that are set. Then, in step S102, until the determination in step S103 determines that the parent-child relationship has been determined between all the nodes.
Is repeated.

When the parent-child relationship is determined, the process proceeds to step S104, where the root is determined.
Setting of the node ID that gives Node IDs are set in the order of predetermined nodes from the root, and step S106
Step S105 is repeated until it is determined that IDs have been given to all nodes.

When the setting of the node ID is completed, the new network configuration has been recognized by all the nodes, so that data transfer between the nodes can be performed.
The data transfer is started in step S107, and the sequence returns to step S101, and the occurrence of the bus reset signal is monitored again.

FIG. 18 is a flowchart showing details from the monitoring of the bus reset signal (S101) to the determination of the route (S104).
19 is a flowchart showing details of the node ID setting (S105, S106).

In FIG. 18, the generation of a bus reset signal is monitored in step S201, and when the bus reset signal is generated, the network configuration is reset once. Next, in step S202, as a first step of re-recognizing the reset network configuration, each device resets the flag FL with data indicating a leaf (node). Then, in step S203, each device checks the number of ports, that is, the number of other nodes connected to itself, and in step S204
Then, according to the result of step S203, the number of undefined (parent-child relationship is not determined) ports is checked in order to start the declaration of the parent-child relationship from now on. Here, the number of undefined ports is equal to the number of ports immediately after the bus reset, but as the parent-child relationship is determined, the number of undefined ports detected in step S204 decreases.

The declaration of the parent-child relationship immediately after the bus reset is limited to actual leaves. Whether it is a leaf or not can be known from the result of checking the number of ports in step S203. That is, if the number of ports is "1", it is a leaf. In step S205, the leaf declares a parent-child relationship “I am a child and the other is a parent” with respect to the connection partner node, and ends the operation.

On the other hand, the node whose number of ports is “2 or more” in step S203, that is, the branch has “undefined port number> 1” immediately after the bus reset, so that step S206
Go to and set the data indicating the branch to the flag FL,
In step S207, the process waits for another node to declare a parent-child relationship. A parent-child relationship is declared from another node, and the branch that has received the declaration returns to step S204 to check the number of undefined ports, but if the number of undefined ports is "1", the branch connected to the remaining port Step S205 for the node
You can declare a parent-child relationship of "I am a child and my partner is a parent." Further, the branch having the undefined port number “2 or more” waits for another node to declare a parent-child relationship again in step S207.

Any one branch (or exceptionally,
If the number of undefined ports on the leaf that did not work quickly, even though child declarations can be made, becomes "0", the declaration of parent-child relationship for the entire network has ended,
The only node for which the number of undefined ports has become “0”, that is, the node that has been determined to be the parent of all nodes, sets the data indicating the route to the flag FL in step S208, and proceeds to step S2
Recognized as root at 09.

Thus, the procedure from the bus reset to the declaration of the parent-child relationship between all the nodes in the network is completed.

Next, a procedure for assigning an ID to each node will be described. First, the leaf can set the ID. Then, an ID is set in the order of leaf → branch → root in ascending order (node number: 0).

In step S301 of FIG. 19, the process branches to processing according to the type of node, that is, leaf, branch, and route, based on the data set in the flag FL.

First, in the case of a leaf, the number (natural number) of leaves existing in the network is set to a variable N in step S302, and then in step S303 each leaf requests a node number from the root. If there are multiple requests for this,
The root performs arbitration in step S304, assigns a node number to one node in step S305, and notifies another node of a result indicating that acquisition of the node number has failed.

The leaves for which the node number could not be obtained by the determination in step S306 repeat the request for the node number again in step S303. On the other hand, the leaf from which the node number has been acquired includes the acquired node number in step S307.
Notify all nodes by broadcasting ID information. After the broadcast of the ID information ends, step S308
Then, the variable N representing the number of leaves is decremented. Then, the procedure of steps S303 to S308 is repeated until the variable N becomes “0” according to the determination of step S309, and after the ID information of all the leaves has been broadcast, step S3
Proceed to step 10 to move to branch ID setting.

The setting of the branch ID is performed in substantially the same manner as that of the leaf. First, in step S310, the number of branches (natural number) existing in the network is set as a variable M, and then in step S311, each branch requests a node number from the root. In response to this request, the root performs arbitration in step S312, gives a small number following the leaf to one branch in step S313, and notifies the branch that could not acquire the node number a result indicating acquisition failure.

The branch that has learned that the acquisition of the node number has failed by the determination in step S314 is performed again in step S314.
The request for the node number is repeated in S311. On the other hand, in step S315, the branch from which the node number has been obtained is notified to all nodes by broadcasting ID information including the obtained node number. When the broadcast of the ID information ends, in step S316, the variable M representing the number of branches is decremented. Then, according to the determination in step S317, the variable M
The procedure from steps S311 to S316 is repeated until is becomes “0”, and after the ID information of all the branches has been broadcast, the process proceeds to step S318 to shift to the root ID setting.

At this point, since the root node is the only node that has not finally obtained an ID, in step S318, the lowest node number that has not been given to another node is set as its own node number. Broadcast ID information.

Thus, the procedure until all node IDs are set is completed. Next, a specific procedure of a sequence for determining a node ID will be described using the network example shown in FIG.

In the network shown in FIG. 20, a node A and a node C are directly connected below a node B which is a root, a node D is directly connected below a node C, and a node E and a node below the node D. F has a directly connected hierarchical structure. The procedure for determining the hierarchical structure, the root node, and the node ID is as follows.

After a bus reset occurs, a parent-child relationship is declared between the directly connected ports of each node in order to recognize the connection status of each node. Here, the parent and child means that the upper level of the hierarchical structure is “parent” and the lower level is “child”. In FIG. 20, it is the node A that first declared the parent-child relationship after the bus reset. As described above, the declaration of the parent-child relationship can be started from a node (leaf) to which only one port is connected. If the number of ports is “1”, the end of the network tree, that is, the leaf is recognized, and the parent-child relationship is determined from the node that operates first among the leaves. The port of the node that declared the parent-child relationship in this way is the "child" of the two nodes connected to each other.
Is set, and the node of the partner node is set as “parent”. Thus, nodes AB, ED, FD
A "child-parent" relationship is set between them.

Further, the parent-child relationship is declared for the higher-order node sequentially from the node having a plurality of ports, that is, the node that has received the declaration of the parent-child relationship from another node among the branches. In FIG. 20, first, the node DE
After the parent-child relationship between DFs is determined, node D
A parent-child relationship is declared to C, and as a result, a "child-parent" relationship is set between the node DCs. Node C, which has received a parent-child relationship from node D, declares a parent-child relationship to node B connected to another port, thereby establishing a "child-parent" relationship between nodes CB. You.

In this way, a hierarchical structure as shown in FIG. 20 is formed, and the node B that has become the parent in all finally connected ports is determined as the root.
Note that there is only one route in one network configuration. Further, when the node B whose parent-child relationship is declared from the node A promptly declares the parent-child relationship to another node, there is a possibility that another node such as the node C becomes a root. That is, depending on the timing at which the declaration of the parent-child relationship is transmitted, there is a possibility that any node may become the root, and even if the network configuration is the same, a specific node does not always become the root.

When the route is determined, the process enters a mode for determining each node ID. All nodes have a broadcast function of notifying the determined ID information to all other nodes. The ID information includes a node number, information on a connected position, the number of ports having the number, the number of connected ports, information on a parent-child relationship of each port, and the like.
Broadcast as ID information.

As described above, the assignment of the node numbers is started from the leaf, and the node numbers = 0, 1, 2,... Are assigned in order. And by broadcasting ID information,
It is recognized that the node number has been assigned.

When all the leaves have acquired the node numbers, the process proceeds to the branch and the node numbers following the leaves are assigned. Like the leaf, the ID information is broadcast in order from the branch to which the node number is assigned, and finally the root broadcasts its own ID information. Therefore, the root always owns the highest node number.

As described above, the ID setting of the entire hierarchical structure is completed, the network configuration is constructed, and the bus initialization is completed.

[Control Information for Node Management] As a basic function of the CSR architecture for performing node management, a CSR core shown in FIG. 14 exists on a register. The positions and functions of these registers are shown in FIG. 21A, where the offsets are relative to 0xFFFFF0000000.

In the CSR architecture, 0xFFFFF0000200
And registers related to the serial bus.
FIG. 21B shows the positions and functions of these registers.

[0092] In a location starting from 0xFFFFF0000800, information on the node resources of the serial bus is arranged. FIG. 21C shows the positions and functions of these registers.

The CSR architecture has a configuration ROM for representing the function of each node.
This ROM has a minimum format and a general format, 0xFFFFF000040
Arranged from 0. In the minimum format, only the vendor ID is represented as shown in FIG. 21D, and this vendor ID is a globally unique value represented by 24 bits.

The general format has information on nodes in a format as shown in FIG. 21E. In this case, the vendor ID can be stored in a root directory (root_directory). Also, bus_info_block and root & unit_leaves
Has a 64-bit globally unique device number, including the vendor ID. This device number is used for continuously recognizing a node after a reconfiguration such as a bus reset.

[Serial Bus Management] The protocol of the 1394 serial bus is, as shown in FIG.
811, link layer 812 and transaction layer 81
Consists of four. Among them, bus management provides basic functions for node control and bus resource management based on the CSR architecture.

A node that performs bus management (hereinafter, referred to as a “bus management node”) exists solely on the same bus and provides a management function to other nodes on the serial bus. Control, performance optimization, power management, transmission speed management, configuration management, etc.

The bus management function is roughly divided into three functions: a bus manager, a synchronous (isochronous) resource manager, and a node control. Node control is CS
R is a management function that enables communication between nodes in the physical layer 811, the link layer 812, the transaction layer 814, and the application. The synchronous resource manager is a management function necessary for performing synchronous data transfer on the serial bus, and manages the transfer bandwidth of synchronous data and the assignment of channel numbers. To perform this management, a bus management node is dynamically selected from nodes having a synchronous resource manager function after the bus is initialized.

In a configuration in which a bus management node does not exist on a bus, a node having a synchronous resource manager function performs a part of bus management functions such as power management and cycle master control. Further, the bus management is a management function for performing a service of providing a bus control interface to an application. The control interface includes a serial bus control request (SB_CONTROL.request) and a serial bus event control confirmation (SB_CONTROL.confirmation). ), And serial bus event notification (SB_EVENT.indication).

The serial bus control request is used when an application requests the bus management node for bus reset, bus initialization, bus status information, and the like. The serial bus event control confirmation is notified to the application from the bus management node as a result of the serial bus control request. The serial bus event notification is for notifying an event generated asynchronously from the bus management node to the application.

[Data Transfer Protocol] In data transfer on the 1394 serial bus, synchronous data (synchronous packets) that need to be transmitted periodically and asynchronous data (asynchronous packets) that allow data transmission and reception at an arbitrary timing are simultaneously transmitted. It exists and guarantees the real-time property of synchronous data. In data transfer, prior to the transfer, a bus use right is requested, and bus arbitration for obtaining a bus use permission is performed.

In the asynchronous transfer, the transmitting node ID and the receiving node ID are transmitted as packet data together with the transfer data. When the receiving node confirms its own node ID and receives the packet, it returns an acknowledge signal to the transmitting node, thereby completing one transaction.

In the synchronous transfer, the transmitting node requests a synchronous channel together with the transmission speed, and the channel ID is sent as packet data together with the transfer data. The receiving node confirms the desired channel ID and receives the data packet. The required number of channels and transmission speed are determined by the application layer 816.

These data transfer protocols are defined by three layers: a physical layer 811, a link layer 812, and a transaction layer 814. The physical layer 811 performs a physical / electrical interface with a bus, automatic recognition of node connection, bus arbitration of a bus use right between nodes, and the like. Link layer 81
2 performs cycle control for addressing, data check, packet transmission / reception, and synchronous transfer. The transaction layer 814 performs processing related to asynchronous data. Hereinafter, processing in each layer will be described.

[Physical Layer] Next, the bus arbitration in the physical layer 811 will be described.

The 1394 serial bus always performs arbitration of the right to use the bus prior to data transfer. 13
94 Each device connected to the serial bus forms a logical bus network that transmits the signal to all devices in the network by relaying the signals transmitted on the network. Bus arbitration is necessary in order to prevent this. This allows only one node to transfer at a given time.

FIGS. 22A and 22B are diagrams for explaining bus arbitration. FIG. 22A shows an operation for requesting the right to use the bus, and FIG. 22B shows an operation for permitting the use of the bus.

When the bus arbitration starts, one or a plurality of nodes respectively request the right to use the bus toward the parent node. In FIG. 22A, nodes C and F request a bus use right. The parent node (node A in FIG. 22A) receiving this request further requests the parent node for the right to use the bus, thereby relaying the request for the right to use the bus by the node F. This request is finally delivered to the arbitration route.

The route receiving the request for the right to use the bus determines to which node the right to use the bus is given. This arbitration work can be performed only by the route, and the node that wins the arbitration is given permission to use the bus. FIG. 22B shows a state in which the node C has been given the bus use permission and the node F request for the bus use right has been rejected.

The route sends a DP (data prefix) packet to a node that has lost bus arbitration,
Notifies that the request for the right to use the bus has been denied.
The request for the right to use the bus of the node that has lost the bus arbitration is kept waiting until the next bus arbitration.

As described above, the node which has won the bus arbitration and has obtained the bus use permission can start transferring data thereafter.

Here, a series of flows of the bus arbitration will be described with reference to a flowchart shown in FIG.

In order for a node to be able to start data transfer, the bus must be idle. In order to recognize that the bus is in an idle state after the previous data transfer is completed, a gap length of a predetermined idle time individually set in each transfer mode (for example, By detecting the progress of the action gap, each node determines that the bus has become idle.

Each node determines in step S401 whether a predetermined gap length corresponding to the asynchronous data or synchronous data to be transferred has been obtained. Unless the predetermined gap length is obtained, the node cannot request the right to use the bus required to start the transfer, and thus waits until the predetermined gap length is obtained.

When the predetermined gap length is obtained in step S401, each node determines whether there is data to be transferred in step S402, and if so, in step S403, sends a signal requesting the right to use the bus to the route. To send. The signal indicating the request for the right to use the bus is finally delivered to the route while being relayed to each device in the network, as shown in FIG. 22A. If it is determined in step S402 that there is no data to be transferred, the process returns to step S401.

When the root receives at least one signal requesting the right to use the bus in step S404, the number of nodes requesting the right to use in step S405 is checked. If it is determined in step S405 that only one node has requested the usage right,
The node is immediately given a bus use permission. Also, if there are multiple nodes requesting usage rights,
In step S406, an arbitration operation is performed to reduce the number of nodes to which the bus use permission is immediately given to one. This arbitration work does not always give the same node the use of the bus only, but equally gives the use of the bus (fair arbitration).

The route process branches in step S407 according to one node that has won the arbitration in step S406 and another node that has lost the arbitration. If one node that has won the arbitration or one node that has requested the right to use the bus is used, a permission signal indicating permission to use the bus is sent to the node in step S408. The node receiving this permission signal starts transferring data (packets) to be transferred immediately (step S410). In step S409, a DP (data prefix) packet indicating that the request for the right to use the bus has been rejected is sent to the node that has lost the arbitration. The processing of the node that has received the DP packet returns to step S401 again to request the right to use the bus. The processing of the node that has completed the data transfer in step S410 is also performed in step S401.
Return to

[Transaction Layer] There are three types of transactions: read transactions, write transactions, and lock transactions.

In a read transaction, an initiator (request node) reads data from a specific address in a memory of a target (response node). In a write transaction, an initiator writes data to a specific address of a target memory. In the lock transaction, reference data and update data are transferred from the initiator to the target. The reference data is combined with the data of the target address to become a designated address indicating a specific address of the target. Then, the data at the specified address is updated with the update data.

FIG. 24A is a diagram showing a request / response protocol for each command of read, write, and lock based on the CSR architecture in the transaction layer 814. The request, notification, response, and confirmation shown in FIG. Is a unit.

Transaction request (TR_DATA.request)
Is the transfer of the packet to the response node, the transaction notification (TR_DATA.indication) is the notification that the request has arrived at the response node, the transaction response (TR_DATA.response) is the transmission of the acknowledgment, and the transaction confirmation (TR_DATA.confirmation) is the reception of the acknowledgment It is.

[Link Layer] FIG. 24B shows a link layer 812.
Is a link request (LK_DATA.requeue) requesting transfer of a packet to a response node.
st), a link notification (LK_DATA.indication) that notifies the response node of packet reception, and a link response (LK_DATA.respons) for acknowledgment transmission from the response node.
e), link confirmation of acknowledgment transmission of request node (LK_DA
TA.confirmation) is divided into service units. One packet transfer process is called a subaction, and there are two types of asynchronous subactions and synchronous subactions. Hereinafter, the operation of each sub-action will be described.

[Asynchronous Subaction] The asynchronous subaction is an asynchronous data transfer.

FIG. 25 shows a temporal transition state in asynchronous transfer. The first sub-action shown in Figure 25
The gap indicates the idle state of the bus. When the idle time reaches a predetermined value, a node desiring to transfer data requests a right to use the bus, and bus arbitration is executed.

When the use of the bus is permitted by the bus arbitration, the data is then transferred to a packet, and the node receiving this data returns a return code ACK for confirmation of reception after a short gap called ACK gap. The data transfer is completed by responding or sending a response packet. The ACK is composed of 4 bits of information and 4 bits of a checksum, and includes information indicating success, a busy state, or a pending state, and is immediately returned to the data transmission source node.

FIG. 26 is a diagram showing a packet format for asynchronous transfer. The packet has a header part in addition to the data part and the data CRC for error correction, and in the header part, a destination node ID, a source node ID, a transfer data length, various codes, and the like are written.

Asynchronous transfer is one-to-one communication from the own node to the partner node. The packet sent from the transfer source node is distributed to each node in the network, but since each node ignores packets other than its own, only the node designated as the destination receives the packet.

[Split Transaction] The service in the transaction layer 814 is performed by a set of a transaction request and a transaction response shown in FIG. 24A. Here, if the processing in the link layer 812 and the transaction layer 814 of the target (response node) is sufficiently fast, the request and the response are not processed by independent subactions of the link layer 812, but are processed by one subaction. It becomes possible. However, if the processing speed of the target is slow, it is necessary to process the request and response in separate transactions. This operation is called a split transaction.

FIG. 27A is a diagram showing an example of the operation of a split transaction. In response to a write request from the controller of the initiator (request node), the target returns “pending”. As a result, the target can return confirmation information for the write request from the controller, and can gain time for processing the data. Then, after a sufficient time has elapsed for data processing, the target notifies the controller of a write response and terminates the write transaction. At this time, the operation of the link layer 812 by another node is possible between the request and the response sub-action.

FIG. 27B is a diagram showing an example of a temporal transition of a transfer state when a split transaction is performed. Sub-action 1 represents a request sub-action, and sub-action 2 represents a response sub-action.

In sub-action 1, the initiator sends a data packet indicating a write request to the target, and the target receiving this returns the pending indicating the confirmation information by an acknowledge packet, thereby completing the request sub-action.

Then, after the sub-action gap is inserted, in sub-action 2, the target sends a write response in which the data packet has no data, and the initiator receiving the response returns a complete response in an acknowledgment packet. The action ends.

The minimum time from the end of sub-action 1 to the start of sub-action 2 is the time corresponding to the sub-action gap, and the maximum can be extended to the maximum waiting time set in the node. .

[Synchronous Subaction] This isochronous transfer, which can be said to be the greatest feature of the 1394 serial bus, is particularly suitable for the transfer of multimedia data that requires real-time transfer such as AV data.

In contrast to the asynchronous transfer, which is a one-to-one transfer, the isochronous transfer can uniformly transfer data from one transfer source node to all other nodes by a broadcast function.

FIG. 28 is a diagram showing a temporal transition state in the isochronous transfer. The isochronous transfer is executed at regular intervals on the bus, and this time interval is called an isochronous cycle. The isochronous cycle time is
125 μs. It indicates the start of this synchronization cycle, and is responsible for synchronizing the operation of each node.
Start packet (CSP). Sending the CSP is
This node is called a cycle master, and after a transfer in the previous cycle is completed and after a predetermined idle period (subaction gap), a CSP notifying the start of this cycle is transmitted. That is, the time interval at which this CSP is transmitted is 125 μs.

Further, as shown in FIG. 28 as channel A, channel B and channel C, it is possible to transfer a plurality of types of packets in a single synchronization cycle by assigning a channel ID to each of the packets to distinguish them. it can. As a result, real-time transfer can be performed substantially simultaneously between a plurality of nodes, and the receiving node only needs to receive data of the channel ID desired by itself. This channel ID does not represent the address of the receiving node or the like, but is merely a logical number for data. Therefore, a transmitted packet is distributed from one source node to all other nodes, that is, broadcasted.

Prior to packet transmission in isochronous transfer, bus arbitration is performed in the same manner as in asynchronous transfer. However, since the communication is not one-to-one communication as in the asynchronous transfer, there is no ACK of the return code for reception confirmation in the isochronous transfer.

The iso gap (isochronous gap) shown in FIG. 28 indicates an idle period necessary to confirm that the bus is in an idle state before performing isochronous transfer. After the lapse of the predetermined idle period, bus arbitration is performed for a node that wants to perform isochronous transfer.

FIG. 29A is a diagram showing a packet format for isochronous transfer. Each packet divided into each channel has a header portion in addition to a data portion and data CRC for error correction, and the header portion has a transfer data length, a channel number, and a like as shown in FIG. 29B. In addition, various codes and a header CRC for error correction are written.

[Bus Cycle] Actually, in the 1394 serial bus, isochronous transfer and asynchronous transfer can be mixed, and FIG. 30 shows a state of a temporal transition of a transfer state on the bus at that time.

Here, the isochronous transfer is executed prior to the asynchronous transfer. The reason is that after the CSP, the isochronous transfer can be started with a gap length (isochronous gap) shorter than the gap length (subaction gap) of the idle period required to start the asynchronous transfer. Therefore, the isochronous transfer is executed with priority over the asynchronous transfer.

In the general bus cycle shown in FIG. 30, CSP is transferred from the cycle master to each node at the start of cycle #m. The operation of each node is synchronized by the CSP, and a node that attempts to perform isochronous transfer after waiting for a predetermined idle period (isochronous gap) participates in bus arbitration and starts packet transfer. In FIG. 30, channel e, channel s, and channel k are sequentially subjected to isochronous transfer.

After the operations from the bus arbitration to the packet transfer are repeatedly performed for the given channel, when all the isochronous transfers in the cycle #m are completed, the asynchronous transfer can be performed. That is, when the idle time reaches the subaction gap in which the asynchronous transfer is possible, the node that wants to perform the asynchronous transfer participates in the bus arbitration. However, asynchronous transfer can be performed after completion of isochronous transfer.
This is limited to a case where a sub-action gap for starting asynchronous transfer is obtained before the time (cycle synch) at which the next CSP should be transferred.

In a cycle #m shown in FIG. 30, after isochronous transfer for three channels, two packets (packet 1 and packet 2) including ACK are transferred by asynchronous transfer. After this asynchronous packet 2,
Since it is time to start cycle m + 1 (cycle synch), the transfer in cycle #m ends here. However, when the time (cycle synch) to transmit the next CSP is reached during asynchronous or synchronous transfer, the transfer is not forcibly interrupted, and after the transfer is completed, the CSP of the next cycle is transmitted after an idle period. That is, one cycle is 125
If it lasts for more than μs, the next cycle will be shorter than the standard 125 μs by that amount. In this way, isochronous
The cycle can be exceeded or shortened on the basis of 125 μs.

However, the isochronous transfer is executed every cycle if necessary to maintain the real-time transfer, and the asynchronous transfer may be postponed to the next and subsequent cycles due to the shortened cycle time.

The cycle master also manages such delay information.

[FCP] The AV / C protocol uses the function control protocol FC to control devices on the 1394 serial bus.
P (Functional Control Protocol) is prepared. FC
An asynchronous packet defined by IEEE1394 is used for transmission and response of the P control command. In FCP, the controlling node is called a controller, and the controlled node is called a target.An FCP packet frame sent from the controller to the target is an AV / C command frame, and an FCP packet frame returned from the target to the controller is called an AV. Called the / C response frame.

FIG. 31 shows that node A is a controller and node B
Indicates the target case.Of the register addresses prepared, 512 bytes from address 0x0000B00 are the command register, and 512 bytes from address 0x0000D00 are the response register, each specified by a packet frame using asynchronous transfer. Data is written to the register at the designated address. At this time, the controller sends the AV / C command frame and the target
The relationship between the responses of the AV / C response frame is called an AV / C transaction. In a general AV / C transaction, the target needs to respond to the controller with a response frame within 100 ms after receiving the command frame.

FIG. 32 is a diagram showing a packet format of an asynchronous transfer including an FCP packet frame. A command frame or a response frame is inserted into the data area of the asynchronous data packet shown in FIG. Be executed.

FIG. 33 is a diagram showing the structure of an AV / C command frame, and FIG. 34 is a diagram showing the structure of an AV / C response frame.
Ctype and response of header as FCP packet frame
The structure is such that the data part of FCP is connected after e, subunit_type, and subunit_ID.

Also, subunit_type is the classification of the device, su
bunit_ID indicates an instance number.

The data portion of the FCP has an operation code + operand configuration, and can control a target by using various AV / C commands and can provide an AV / C response.

An operation code (opc) in the command frame
ode) is one of the command groups shown in the command column shown in FIG. 35, and each command is executed according to the command type set in ctype.

For each command, the contents required for each command are set in the operands and written in the command frame.

A response code shown in the response column of FIG. 35 is set in the operation code in the response frame. Each response has an operand corresponding to each response. In the response operand, information indicating whether the execution of the command has been normally completed or ended in error is set, so that error processing can be performed according to this operand.

[0156]

[Other Embodiments] Even if the present invention is applied to a system including a plurality of devices (for example, a host computer, an interface device, a reader, a printer, etc.), an apparatus (for example, a copying machine) Machine, facsimile machine, etc.).

An object of the present invention is to provide a storage medium storing a program code of software for realizing the functions of the above-described embodiments to a system or an apparatus, and to provide a computer (or a CPU or M
Needless to say, this can also be achieved by the PU) reading and executing the program code stored in the storage medium. In this case, the program code itself read from the storage medium implements the functions of the above-described embodiment, and the storage medium storing the program code constitutes the present invention. When the computer executes the readout program code, not only the functions of the above-described embodiments are realized, but also the OS running on the computer based on the instructions of the program code.
It goes without saying that an (operating system) performs a part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

Further, after the program code read from the storage medium is written into a memory provided in a function expansion card inserted into the computer or a function expansion unit connected to the computer, based on the instructions of the program code, It goes without saying that the CPU included in the function expansion card or the function expansion unit performs part or all of the actual processing, and the processing realizes the functions of the above-described embodiments.

[0159]

As described above, according to the present invention,
An image processing apparatus and method for performing appropriate color space conversion according to a shooting state of image data can be provided.

[Brief description of the drawings]

FIG. 1 is a diagram showing a relationship between an image transmission technology and a CMS;

FIG. 2 is a diagram illustrating exposure control in a video camera.

FIG. 3 is a diagram illustrating exposure control in a video camera.

FIG. 4 is a block diagram showing a configuration example of an image processing system according to an embodiment of the present invention;

FIG. 5 is a diagram showing an example of a CMS processing routine.

FIG. 6 is a diagram showing a combination example of an input device and an output device;

FIG. 7 is a diagram showing an example of a digital image transmission system according to the embodiment;

FIG. 8 is a view showing an example of data multiplexing in the embodiment;

FIG. 9 is a view for explaining CMS processing in the embodiment;

FIG. 10 is a diagram showing an example of generating a weighting coefficient from a white balance coefficient,

FIG. 11 is a block diagram showing a configuration example of a weighted averager shown in FIG. 9;

FIG. 12A is a diagram showing a general configuration example of a system for performing data communication;

FIG. 12B is a diagram showing an example of a network system configured using an IEEE1394 serial interface;

FIG. 13 is a diagram showing a configuration example of an IEEE1394 serial interface;

FIG. 14 is a diagram showing an example of an address space in an IEEE1394 serial interface;

FIG. 15 is a diagram showing a cross-sectional example of a cable for an IEEE1394 serial interface;

FIG. 16 is a diagram for explaining the DS-Link method;

FIG. 17 is a flowchart showing an example of a network construction procedure in an IEEE1394 serial interface;

FIG. 18 is a flowchart showing an example of a network construction procedure in an IEEE1394 serial interface;

FIG. 19 is a flowchart showing an example of a network construction procedure in an IEEE1394 serial interface;

FIG. 20 is a diagram showing an example of a network;

FIG. 21A is a diagram showing a function example of a CSR architecture of a 1394 serial bus;

FIG. 21B is a diagram showing registers related to the 1394 serial bus.

FIG. 21C is a diagram showing registers relating to node resources of the 1394 serial bus.

FIG. 21D is a diagram showing a minimum format of the configuration ROM of the 1394 serial bus;

FIG. 21E is a diagram showing a general format of a configuration ROM of a 1394 serial bus.

FIG. 22A is a diagram for explaining bus arbitration;

FIG. 22B is a diagram for explaining bus arbitration;

FIG. 23 is a flowchart showing an example of a bus arbitration procedure;

FIG. 24A is a diagram showing a request / response protocol of each command of read, write, and lock based on a CSR architecture in a transaction layer,

FIG. 24B is a diagram showing a service in a link layer.

FIG. 25 is a diagram showing an example of a temporal transition state in asynchronous transfer;

FIG. 26 is a diagram showing an example of a packet format for asynchronous transfer;

FIG. 27A is a diagram showing an operation example of a split transaction.

FIG. 27B is a diagram showing an example of a temporal transition of a transfer state when performing a split transaction;

FIG. 28 is a diagram showing an example of a temporal transition state in isochronous transfer;

FIG. 29A is a diagram showing an example of a packet format for isochronous transfer,

FIG. 29B is a diagram showing a detailed example of a field of a packet format of synchronous transfer in the 1394 serial bus;

FIG. 30 is a diagram showing a state of a temporal transition of a transfer state on a bus when isochronous transfer and asynchronous transfer are mixed.

FIG. 31 is a diagram showing an operation example of an AV / C transaction in the 1394 serial bus.

FIG. 32 is a diagram showing an example of a packet format of an asynchronous transfer including an FCP packet frame;

FIG. 33 is a diagram showing an example of the structure of an AV / C command frame;

FIG. 34 is a diagram showing a structure example of an AV / C response frame;

FIG. 35 is a diagram showing a list of commands and responses to the commands.

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FI H04N 11/04 H04N 1/46 Z

Claims (30)

[Claims] A receiving unit configured to receive, from the image input device, image data captured by an image input device and that depends on a color space of the device; and a color space conversion characteristic corresponding to the plurality of imaging conditions. Conversion means for performing color space conversion on received image data, wherein the conversion means controls the color space conversion based on a parameter added to the received image data and indicating a shooting state of the image input device. An image processing apparatus comprising: 2. The image processing apparatus according to claim 1, wherein said receiving means receives the image data via a serial bus. 3. The image processing apparatus according to claim 2, wherein the serial bus is a bus conforming to the IEEE 1394 standard. 4. The parameter indicating the shooting state is the IE
4. The image processing apparatus according to claim 3, wherein the image is received by asynchronous transfer based on the EE1394 standard. 5. The image processing apparatus according to claim 3, wherein the image data is received by isochronous transfer of the IEEE1394 standard. 6. The color conversion device according to claim 6, wherein the conversion unit combines the plurality of converted image data obtained by converting the received image data with the color space conversion characteristics corresponding to the plurality of photographing conditions based on the parameters. The image processing apparatus according to claim 1, wherein the image processing apparatus obtains spatially transformed image data. 7. The method according to claim 6, wherein the plurality of converted image data are linearly combined based on the parameters.
An image processing apparatus according to claim 1. 8. The image processing apparatus according to claim 1, wherein the receiving unit obtains image data by demodulating and decoding data transmitted from the image input device. Image processing device. 9. The image processing apparatus according to claim 1, further comprising a separating unit configured to separate the parameter added to the received image data. 10. An image capturing means for capturing an image, an adding means for adding a parameter indicating an image capturing state to image data of the image, and an image processing for performing color space conversion on the image data to which the parameter has been added. An image processing apparatus comprising: a supply unit that supplies the image processing apparatus. 11. The image processing apparatus according to claim 10, wherein the supply unit encodes and modulates the image data and transmits the encoded image data.
An image processing apparatus according to claim 1. 12. The image processing apparatus according to claim 1, wherein a photographing state of the image is adjusted automatically or manually according to ambient light of a subject. 13. The image processing apparatus according to claim 1, wherein the parameter is added to a subcode area in a transmission format of the image data. 14. The image processing apparatus according to claim 1, wherein the image data is encoded and compressed, and the parameters are not encoded and compressed. 15. The apparatus according to claim 1, wherein the parameter is information indicating a setting state of a shooting state adjusted automatically or manually when shooting an image. An image processing apparatus according to claim 1. 16. An image captured by an image input device,
Receiving image data depending on the color space of the device from the image input device, adding a parameter indicating a shooting state of the image input device added to the received image data, and a plurality of parameters stored in the storage means in advance. An image processing method, wherein color space conversion is performed on the image data based on a color space conversion characteristic corresponding to a shooting condition. 17. The image processing apparatus according to claim 17, wherein said receiving means receives image data via a serial bus. 18. The image processing apparatus according to claim 17, wherein said serial bus is a bus complying with the IEEE1394 standard. 19. The parameter indicating the shooting state is
19. The image processing apparatus according to claim 18, wherein the image processing apparatus receives the data by asynchronous transfer based on the IEEE1394 standard. 20. The image processing apparatus according to claim 18, wherein the image data is received by isochronous transfer of the IEEE1394 standard. 21. The color space conversion, wherein a plurality of converted image data obtained by converting received image data by a color space conversion characteristic corresponding to the plurality of shooting conditions is combined based on the parameters. 17. The image processing method according to claim 16, wherein: 22. The method according to claim 22, wherein the plurality of converted image data are linearly combined based on the parameters.
The image processing method according to any one of claims 16 to 21. 23. An image processing apparatus, comprising the steps of: taking an image, adding a parameter indicating a shooting state of the image to image data of the image, and supplying the image data to which the parameter has been added to an image processing apparatus that performs color space conversion. Characteristic image processing method. 24. A recording medium on which a program code for image processing is recorded, the code including a step of receiving, from the image input device, image data which is taken by an image input device and depends on a color space of the device. Based on a parameter indicating the shooting state of the image input device added to the received image data and a color space conversion characteristic corresponding to a plurality of shooting conditions stored in advance in the storage means, And a code for performing a spatial transformation. 25. The recording medium according to claim 24, wherein said receiving means receives image data via a serial bus. 26. The image processing apparatus according to claim 25, wherein the serial bus is a bus complying with the IEEE1394 standard. 27. The parameter indicating the shooting state is
27. The image processing apparatus according to claim 26, wherein the image is received by asynchronous transfer based on the IEEE1394 standard. 28. The image processing apparatus according to claim 26, wherein the image data is received by isochronous transfer of the IEEE1394 standard. 29. The recording medium according to claim 24, wherein color space conversion characteristics corresponding to the plurality of photographing conditions are recorded. 30. A recording means in which a program code for image processing is recorded, wherein: a code for photographing an image; a code for adding a parameter indicating a photographing state of the image to image data of the image; Supplying the image data to which the parameter has been added to an image processing apparatus that performs color space conversion.