WO2017043501A1 - Système de serveur av, et serveur av - Google Patents

Système de serveur av, et serveur av Download PDF

Info

Publication number
WO2017043501A1
WO2017043501A1 PCT/JP2016/076236 JP2016076236W WO2017043501A1 WO 2017043501 A1 WO2017043501 A1 WO 2017043501A1 JP 2016076236 W JP2016076236 W JP 2016076236W WO 2017043501 A1 WO2017043501 A1 WO 2017043501A1
Authority
WO
WIPO (PCT)
Prior art keywords
server
input
compressed
clip data
data
Prior art date
Application number
PCT/JP2016/076236
Other languages
English (en)
Japanese (ja)
Inventor
後田　薫
衛 水上
康公 市中
伊藤　明
健太 安部
吉秀 藤本
孝 星
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP2016003059A external-priority patent/JP6819041B2/ja
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Priority to US15/741,312 priority Critical patent/US10887636B2/en
Publication of WO2017043501A1 publication Critical patent/WO2017043501A1/fr

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/10—Program control for peripheral devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/14—Handling requests for interconnection or transfer
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • G06F13/38—Information transfer, e.g. on bus
    • G06F13/42—Bus transfer protocol, e.g. handshake; Synchronisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/21—Server components or server architectures
    • H04N21/218—Source of audio or video content, e.g. local disk arrays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/765—Interface circuits between an apparatus for recording and another apparatus

Definitions

  • the present technology relates to an AV server system and an AV server, and more particularly to an AV server system configured by connecting a plurality of AV servers to a network.
  • Patent Document 1 describes a technique for expanding the number of IO ports of an AV server.
  • the number of IO ports is expanded by separating the AV storage unit and the input / output devices and increasing only the input / output devices.
  • the purpose of this technology is to make it possible to easily expand the number of IO ports and the storage amount.
  • the concept of this technology is A plurality of AV servers having IP (Internet Protocol) input / output ports for connecting to other AV servers independent of the input / output ports with the outside of the system;
  • a client controller for controlling the plurality of AV servers;
  • a manager that stores AV clip data recorded in the plurality of AV servers and information related to AV clip data input to the plurality of AV servers;
  • the AV server system includes a frame synchronization unit that performs frame synchronization of the plurality of AV servers.
  • the AV server system includes a plurality of AV servers, a client controller, a manager, and a frame synchronization unit.
  • the AV server has an IP input / output port for connecting to another AV server independent of the input / output port with the outside of the system.
  • the plurality of AV servers use IP input / output ports and are connected to each other by an IP network (IP switch).
  • IP network IP switch
  • the AV server is controlled by the client controller.
  • Information on AV clip data recorded in a plurality of AV servers and AV clip data input to the plurality of AV servers is stored by the manager.
  • the client controller can grasp the contents of the AV clip in each AV server based on the storage information of the manager, and controls the AV server based on the grasped contents.
  • the AV server may output compressed AV clip data for a predetermined frame at a predetermined number of frame periods from the IP input / output port. Further, for example, the AV server may output compressed AV clip data for one frame from the IP input / output port in one frame cycle.
  • the AV server may process the compressed AV clip data input to the IP input / output port at a predetermined number of frame periods as compressed AV clip data for a predetermined frame. Further, for example, the AV server may process the compressed AV clip data input to the IP input / output port at a cycle of one frame as compressed AV clip data for one frame.
  • the AV server may process compressed AV clip data input to the IP input / output port in a period shorter than one frame from the frame start time as compressed AV clip data for one frame. .
  • the AV server may reproduce the missing compressed AV clip data from the input compressed AV clip data by forward error correction.
  • the AV server may output compressed AV clip data corresponding to normal video data or compressed AV clip data corresponding to RAW data from a single-panel camera to the IP input / output port.
  • metadata for demosaic processing may be added to the compressed AV clip data corresponding to the RAW data.
  • the AV server has a decoding unit that obtains non-compressed AV clip data by decoding the compressed AV clip data input to the IP input / output port, and the delay time in the decoding unit is input.
  • the compressed AV clip data may be constant regardless of the compressed data format.
  • the AV server may arbitrarily change the number of input ports and the number of output ports among the total number of IP input / output ports.
  • a plurality of AV servers are connected by an IP network, and the number of IO ports and the storage amount can be easily expanded.
  • the AV server performs compression encoding processing on the storage for recording the compressed AV clip data and the high frame rate RAW data input from the single-panel camera.
  • a first recording unit that records clip data in a storage with metadata for performing demosaic processing added may be provided.
  • the high frame rate may be 120P or higher.
  • the AV server converts the high frame rate input from the single-panel camera into RAW data at the normal frame rate, and then performs demosaic processing to obtain normal video data at the normal frame rate. It may be configured to further include a second recording unit that records the second AV clip data obtained by performing the conversion process in the storage.
  • the normal video data with the normal frame rate is frequently used, and recording on the storage beforehand reduces the load on the system.
  • the number of IO ports and the storage amount can be easily expanded. Note that the effects described in the present specification are merely examples and are not limited, and may have additional effects.
  • FIG. 1 shows a configuration example of an AV server system 10 as an embodiment.
  • the AV server system 10 includes N (N is a plurality) AV servers 100-1, 100-2,..., 100-N, and M client controllers 200-1, 200-2,. , 200-N, a manager 300, and a time synchronization server 400.
  • M is usually the same as N, but may be different.
  • the AV servers 100-1, 100-2,..., 100-N have input / output ports (external IO) to the outside of the system and IP (Internet Protocol) input / output for connecting to other AV servers. Has a port.
  • AV servers 100-1, 100-2,..., 100-N are connected to a dedicated IP network (hereinafter referred to as “inter-server network” as appropriate) 500 using IP input / output ports. .
  • the client controllers 200-1, 200-2, ..., 200-M control the AV servers 100-1, 100-2, ..., 100-N based on the operation of the operator.
  • the client controllers 200-1, 200-2,..., 200-M are connected to the AV servers 100-1, 100-2,..., 100-N via the controller / server network 600, respectively. Has been.
  • the client controllers 200-1, 200-2,..., 200-M for example, grasp AV clip data stored in or input to each AV server, play request, JOG / SHUTTLE / shifted playback operation. Used to perform operations such as editing playlists.
  • the manager 300 performs database management (DB management) of AV clip data stored or input to the entire system, management of bandwidth guarantee when performing data transmission, and management of usage status of each AV server.
  • the manager 300 is connected to the AV servers 100-1, 100-2,..., 100-N and the client controllers 200-1, 200-2,. It is connected to the.
  • the time synchronization server 400 is connected to the AV servers 100-1, 100-2,..., 100-N and the client controllers 200-1, 200-2,. Connected to M.
  • the time synchronization server 400 is connected to the AV servers 100-1, 100-2,..., 100-N via the inter-server network 500.
  • the time synchronization server 400 operates as a master according to IEEE 1588 or JP 2010-190653 A and JP 2010-197320 A, so that the AV servers 100-1, 100-2,.
  • the time is synchronized within a predetermined error range.
  • the time synchronization server 400 constitutes a frame synchronization unit that performs frame synchronization of each AV server.
  • each AV server can be achieved using a house sync supplied to the place where each AV server is installed.
  • the house sync is a frame signal that is supplied everywhere in a broadcasting station or the like to synchronize the devices in the station.
  • the time synchronization server 400 measures the amount of transmission delay between arbitrary nodes by periodically measuring the transmission delay between nodes. Considering the JOG / SHUTTLE response, it is desirable that the inter-node transmission delay amount be suppressed to 1 frame or less. If the system is built on the assumption that the inter-node transmission delay amount is suppressed to 1 frame or less, the inter-node data transmission delay amount measurement by the time synchronization server 400 is not necessary. In addition, it is not necessary to measure the inter-node data transmission delay amount as described above, and if the frame synchronization of each AV server is obtained by the input of the house sync, the time synchronization server 400 is not necessary.
  • server-to-server network 500 to which the AV servers 100-1, 100-2,..., 100-N are connected, data transmission is mainly performed, and the AV servers 100-1, 100-2,. -N, in the controller / server network 600 to which the client controllers 200-1, 200-2,..., 200-M and the manager 300 are connected, command transmission, storage in each AV server, or input Information transmission of AV clip data is performed.
  • FIG. 2 shows a configuration example of the AV server 100 that can be used as the AV servers 100-1, 100-2,..., 100-N.
  • the AV server 100 includes an input / output IO (external IO) for the outside of the AV server system 10.
  • input / output IO external IO
  • only SDI input / output is shown as the external IO, but IP input / output, HDMI input / output, or other various IOs may coexist.
  • HDMI is a registered trademark.
  • the AV server 100 includes a system controller 101, an encoder 102, a storage 103, a decoder 104, an IP output unit 105, and an IP input unit 106.
  • the system controller 101 controls the operation of each unit of the AV server 100.
  • the system controller 101 is connected to a controller / server network 600.
  • the IP output unit 105 configures an IP output port for connecting to the inter-server network 500.
  • the IP input unit 106 constitutes an IP input port for connecting to the server-to-server network 500.
  • the encoder 102 performs an encoding process using a predetermined codec (Codec) on the AV clip data input to the external IO to generate compressed AV clip data.
  • the storage 103 stores the compressed AV clip data obtained by the encoder 102.
  • the decoder 104 decodes the compressed AV clip data read from the storage 103 or input to the IP input unit 106 from another AV server to generate uncompressed AV clip data, and sends it to the external IO. Output.
  • FIG. 3 shows a configuration example of the decoder 104.
  • the decoder 104 is capable of decoding H.264 so that various codecs can be decoded.
  • H.264 decoder H.264 A plurality of types of decoders such as a 262 decoder are provided.
  • the use decoder is selected by the demultiplexer and the multiplexer.
  • the demodulated data is subjected to demosaic processing to obtain a normal video data decoder output.
  • the encoder 102 also includes a plurality of types of encoders, like the decoder 104.
  • AV clip data input to the external IO is supplied to the encoder 102.
  • the AV clip data is encoded and compressed, and compressed AV clip data is generated. This compressed AV clip data is stored in the storage 103.
  • the compressed AV clip data stored in the storage 103 is read from the storage 103 and supplied to the decoder 104 in accordance with the reproduction request.
  • the decoder 104 the compressed AV clip data is subjected to a decoding process corresponding to the codec and decompressed to generate AV clip data.
  • This AV clip data is output from the external IO.
  • JOG / SHUTTLE if the system is a 60P system, 60 frames of AV clip data per second is subjected to processing such as thinning according to the commanded speed when read from the storage 103, for example, from an external IO. Is output.
  • the compressed AV clip data stored in the storage 103 is read from the storage 103 in accordance with a playback request from another AV server, and is output from the IP output unit (IP output port) 105 to the server-to-server network 500.
  • IP output unit IP output port
  • JOG / SHUTTLE if the system is a 60P system, 60 frames per second of AV clip data is read out from the storage 103 and subjected to processing such as thinning according to the commanded speed, so that other AV servers Is transmitted.
  • Compressed AV clip data input from another AV server to the IP input unit (IP input port) 106 via the inter-server network 500 is supplied to the decoder 104.
  • JOG / SHUTTLE in JOG / SHUTTLE, in a 60P system, AV clip data of 60 frames per second is subjected to processing such as thinning out according to the speed commanded from another AV server and transmitted.
  • the decoder 104 the compressed AV clip data is subjected to a decoding process corresponding to the codec and decompressed to generate AV clip data. This AV clip data is output to the external IO.
  • FIG. 4 shows a data flow in broken lines when data is transmitted from the AV server 100 of “B” to the AV server 100 of “A”.
  • the frame buffer 107 is actually provided before the encoder 102 and after the decoder 104, that is, between the external IO and the encoder 102 and decoder 104.
  • a bank 108 exists between the storage 103, the encoder 102, and the decoder 104.
  • an output interface for outputting AV clip data in a predetermined interface format that is, an SDI formatter 109 in the illustrated example, is present at the subsequent stage of the frame buffer 107.
  • both AV servers 100 of “A” and “B” operate as follows.
  • AV clip data is input to SDIin, compressed by the encoder 102 via the frame buffer 107, and stored in the storage 103 via the bank 108.
  • the data is read from the storage 103 to the bank 108, decompressed by the decoder 104, and then output to the SDIout via the frame buffer 107.
  • the urgent replay operation is looped back at the bank 108 or looped back at the frame buffer 107, and so-called “shooting out” is performed.
  • the compressed AV clip data read from the storage 103 of the “B” AV server 100 is read to the bank 108, and the server-to-server network (IP switch) 500 through the IP output unit (IP output port) 105. Is output. Then, it is input from the server-to-server network (IP switch) 500 to the IP input unit (IP input port) 105 of the AV server 100 of “A”, decompressed by the decoder 104, and then to the SDIout via the frame buffer 107. Is output.
  • IP switch IP input unit
  • AV clip data passes through a route of a, b, c.
  • the transmission delay amount of a and c is a predetermined value
  • the transmission delay amount of b is the configuration of the network 500 between servers and the distance on the network between the “A” and “B” AV servers 100.
  • the traffic on the server-to-server network will have a different value.
  • the time synchronization server 400 periodically measures the amount of transmission delay between the nodes to output it at a predetermined time, it is necessary to start reading compressed clip data from the storage 103 In some cases, it is possible to know that the data cannot be output at a predetermined time. As described above, if the system configuration is such that the transmission delay amount between the nodes is always within a predetermined value, for example, within one frame, the transmission delay amount measurement by the time synchronization server 400 is not necessary.
  • the data transmission delay relating to the file sharing reproduction between arbitrary nodes is determined by the transmission delay amount of the routes a and c in the AV server 100 and the transmission delay of the route b measured by the time synchronization server 400.
  • the reading time from the storage 103 for outputting AV clip data to the outside of the system at the correct time is determined.
  • the AV server 100 supports various image frames and various codecs.
  • the transmission delay amount of the path c is a constant value for all supported image frames and codecs.
  • the decoder 104 is configured such that the delay time from the decoder input to the decoder output (see FIG. 3) is constant for all codecs. In this case, in the case of a codec that finishes decoding in a short time, it is realized by delaying output.
  • the data path when it is desired to output the compressed AV clip data currently recorded in the storage instead of the compressed AV clip data stored in the storage 103 of the AV server 100 from another AV server by file sharing is as follows:
  • the route is SDIin ⁇ frame buffer 107 ⁇ encoder 102 ⁇ bank 108 ⁇ IP output unit (IP output port) 105 ⁇ inter-server network (IP switch) 500.
  • FIG. 5 shows a special configuration example of the AV server 100. 5, parts corresponding to those in FIG. 2 are denoted by the same reference numerals, and detailed description thereof will be omitted as appropriate.
  • the AV server 100 is a baseband processor unit (BPU) connected to the rear stage of the system camera.
  • the BPU is normally used for demosaicing RAW data from a single-panel camera to convert it into normal video data, or storing high-speed image data from a high-frequency frame (HFR) camera for slow playback.
  • HFR high-frequency frame
  • the return video input for operating the system camera is omitted. If a three-panel camera is connected, the AV clip data input from the outside is normal video data, and thus the operation is the same as that of the AV server 100 of FIG.
  • the RAW data is encoded by the encoder 102 and compressed, and then stored (recorded) in the storage 103 as compressed AV clip data. Since RAW data does not become normal video data unless it is demosaiced, the decoder 104 performs demosaicing in addition to decompression by decoding processing.
  • the decoder 104 in the AV server 100 as the BPU in FIG. 5 has the same configuration as the decoder 104 in the AV server 100 in FIG. 2 (see FIG. 3).
  • the paint information added thereto is also read at the same time, and is sent to its own decoder 104 in a single operation, and the shared reproduction operation is performed via another network 500 between servers. It is sent to the decoder 104 of the AV server 100.
  • the decoder 104 performs demosaicing in addition to decompression by decoding processing, and further performs processing such as gamma correction and white balance adjustment based on the paint information.
  • FIG. 6 shows a configuration example of the AV server 100 for connecting clips during playback of a playlist. 6, parts corresponding to those in FIG. 2 are denoted by the same reference numerals, and detailed description thereof is omitted.
  • two systems of decoders 104 a and 104 b, two systems of IP input units (IP input ports) 106 a and 106 b, and an effector 110 are provided.
  • the system controller 101 is not shown.
  • Play list playback is playback that performs playback according to a playlist that describes the editing procedure for cut editing and applying effects. It is necessary to switch AV clip data by switching or applying an effect appropriately on the AV server 100 that performs simple output in combination with simple reproduction.
  • compressed AV clip data before and after linking is read from the storage 103 of a predetermined AV server 100 stored at an appropriate timing, and both are sent to the AV server 100 designated as an output port via the inter-server network 500. , And the AV server 100 performs switching / effecting by the effector 110 after decoding.
  • FIG. 6 shows a configuration for switching from AV clip data ⁇ to AV clip data ⁇ .
  • Two IP input units (IP input ports) 106a and 106b are prepared for the inter-server network 500, and transmission between the inter-server network 500 is performed so that AV clip data ⁇ and ⁇ are input respectively.
  • the AV clip data ⁇ and ⁇ are appropriately switched by the effector 110 after being decoded by the decoders 104a and 104b, respectively.
  • the paint information includes white balance setting information, white balance offset setting information, black setting information, flare correction setting information, gain setting information, electronic shutter operating condition setting information, and slow shutter setting information.
  • Setting information iris control setting information, slow & quick motion setting information, flicker correction setting information, gamma correction setting information, black gamma setting information, knee correction setting information, white clip setting information, detail adjustment
  • setting information for aperture correction setting information for skin detail correction
  • setting information for matrix correction setting information for multi-matrix correction, etc.
  • the HFR camera is a camera capable of shooting at a frame rate larger than the normal frame rate, that is, a high frame rate. For example, when the normal frame rate is 60P (shooting 60 frames per second), the high frame rate is 120P or more.
  • Slow playback is possible by reading frame data captured at high speed with an HFR camera at a normal frame rate. For example, if data shot at 480P is read at a rate of 60P, slow playback is performed at a speed of 1/8 speed.
  • FIG. 7 shows a configuration example of the decoder 104 including an addition processing unit that adds consecutive k frames and multiplies the result by 1 / k. In this case, slow reproduction at various rates is possible depending on n at the time of shooting and k at the time of reproduction.
  • FIG. 8 shows a configuration example of the AV server 100 in that case. 8, parts corresponding to those in FIG. 5 are denoted by the same reference numerals, and detailed description thereof will be omitted as appropriate.
  • N-times high-speed RAW data input from a single-panel camera is encoded by the encoder 102 (compression encoding process) to obtain compressed RAW data, and paint information is added to the compressed RAW data. It is stored (recorded) in the storage 103 as compressed AV clip data (first AV clip data).
  • compressed AV clip data first AV clip data
  • N frames of consecutive N frames are added to the RAW data of N-times high speed frame rate input from the single-panel camera, and the result is further multiplied by 1 / N to obtain a normal frame of 1-times speed.
  • Rate RAW data is obtained.
  • the demosaic unit 118 performs demosaic processing on the RAW data at the normal frame rate to obtain normal video data (1 ⁇ speed video data) at the normal frame rate.
  • the normal video data at the normal frame rate is encoded (compressed and encoded) by the encoder 119 to obtain compressed normal video data.
  • the compressed normal video data is compressed AV clip data (second AV clip data).
  • the storage 103 stores normal video data as if it were shot at the normal frame rate, as well as the high frame rate RAW data.
  • the normal video data with the normal frame rate is frequently used, and by recording in the storage 103 in advance, the load on the system can be reduced.
  • FIG. 9 shows the connection between the AV server 100 and the IP switches constituting the inter-server network 500.
  • one AV server 100 is connected to the inter-server network 500 with four IO ports, and two inputs and two outputs are set. Further, in the illustrated example, there are a total of four input / output IOs to the outside of the system, and two inputs and two outputs.
  • the AV server 100 outputs compressed AV clip data for a predetermined number of frames with a predetermined number of frame periods, in this embodiment, for one frame with one frame period, from one IP output port. . Further, in this embodiment, the AV server 100 processes the compressed AV clip data input at a predetermined number of frame periods to one IP input port as compressed AV clip data for a predetermined frame. Compressed AV clip data input at a cycle of one frame is processed as compressed AV clip data for one frame. This facilitates bandwidth management in the inter-server network 500 of the AV server system 10 and facilitates implementation.
  • the AV server 100 processes the compressed AV clip data input in a period of one frame or less from the frame start time, for example, a period of 0.5 frame as compressed AV clip data for one frame.
  • the response of JOG / SHUTTLE can be enhanced.
  • the response can be improved as the period is shortened, but the number of unreceived IP packets increases accordingly.
  • the compressed AV clip data that is insufficient due to the unreceived IP packet is reproduced by forward error correction (FEC: ForwardForError Correction) processing.
  • FEC ForwardForError Correction
  • the manager 300 has a database of information related to AV clip data stored in all AV servers 100.
  • This information includes, for example, a storage ID (Storage ID), clip ID (Clip ID), clip name (Clip Name), start time code (Start Time Code), duration, video format / codec (Video Format / Codec), keywords, etc. are included.
  • the contents of the manager 300 database are updated based on commands from the client controller 200.
  • the client controller 200 has the same database as the manager 300. Each time the manager 300 is updated, the manager 300 distributes the update data to the client controller 200, whereby the database in the client controller 200 is also updated.
  • the operator grasps the contents of the database on a monitor screen (not shown) connected to the client controller 200 and inputs a command using a keyboard, mouse, JOG dial, or the like.
  • a monitor screen (not shown) connected to the client controller 200 and inputs a command using a keyboard, mouse, JOG dial, or the like.
  • a clip is selected from a plurality of clips displayed on the monitor screen
  • a list of names assigned to characteristic scenes in the clip is displayed.
  • thumbnails corresponding to the scene are displayed.
  • the operator inputs to the client controller 200 a playback request indicating which AV clip from which to where is output to which output port of the AV server 100 and at which time.
  • the time is based on a time code based on a frame rate defined in the operation of the AV server system 10.
  • the reproduction request input to the client controller 200 is transmitted to the manager 300.
  • the manager 300 schedules to execute the playback request. That is, the manager 300 is requested to use a device in the AV server 100 storing AV clip data, to use a bandwidth in the inter-server network 500, and to use a device in the AV server 100 having an output port. Allocate playback output to the specified output port at the specified time.
  • the band utilization schedule and the device utilization schedule are hereinafter referred to as “bandwidth reservation” and “device reservation” as appropriate.
  • the manager 300 confirms the availability of the reservation made as described above. That is, the manager 300 confirms whether a necessary device can be used for the AV server 100 and whether a bandwidth can be guaranteed for the inter-server network 500 based on the schedule set up as described above.
  • the bandwidth of the inter-server network 500 is usually determined by the capability of the IP switch that forms the network.
  • the manager 300 confirms whether or not the bandwidth used in the reproduction request is over all the moments during the data transmission period on the network 500 between servers required for the reproduction request. That is, the manager 300 subtracts the current used bandwidth from the remaining bandwidth consumed by the network 500 between the servers during the current data transmission period, which is scheduled before the current reproduction request, to obtain a predetermined bandwidth amount. To see if it remains.
  • the server-to-server network 500 and the controller / server network 600 are integrated without using a V-LAN, it is considered necessary to reduce the bandwidth used for the communication between the controller / server network 600.
  • the communication data amount of the controller / server network 600 is very small compared to the data amount of the compressed AV clip data, and can be ignored.
  • the manager 300 performs the device availability check in the same manner as the bandwidth guarantee check. That is, the manager 300 confirms whether or not the device related to the current reproduction request can be used for all the moments during the data transmission period.
  • the device means an inter-server network IO, a system external IO, a decoder, and the like.
  • the manager 300 When the manager 300 confirms that the reservation of this time can be used in the presence of the reservation of the previous time, the manager 300 sends an external output port to the AV server 100 that stores the AV clip to be reproduced according to the reservation. A command is transmitted so as to transfer data to the AV server 100 designated by. Thus, data transmission from the AV server 100 that stores the AV clip to be played back to the AV server 100 designated as the external output port is started.
  • the manager 300 when the manager 300 confirms that there is no availability of the current reservation in the presence of the previous reservation, the manager 300 notifies the operator of the rejection of the reproduction request through the client controller 200.
  • the manager 300 schedules the playback request from the client controller 200, confirms the availability of the schedule, and sends a command to the AV server 100 according to the schedule.
  • the client controller 200 has a database that is updated at any time in the same manner as the manager 300. Therefore, the client controller 200 is responsible for making a schedule for a reproduction request and confirming the availability of the schedule. It is possible to do it.
  • the client controller 200 sends the schedule of finally confirmed availability to the AV server 100 designated as the external output port through the manager 300. Then, in accordance with the reservation, the AV server 100 sends a command to the AV server 100 that stores the AV clip to be reproduced so as to transfer data to the AV server 100 designated as the external output port. Thus, data transmission from the AV server 100 that stores the AV clip to be played back to the AV server 100 designated as the external output port is started.
  • forward error correction (Forward Error Correction) is performed for data transmission between the AV servers 100, and the transmission data can be received with sufficient redundancy. Provide a function to reproduce the part that could not be received from the data.
  • the IP output unit (IP output port) 105 in FIGS. 2, 4, 5, 6, and 8 has a function of providing redundancy for forward error correction, and an IP input unit (IP input port) 106, 106a and 106b have a function of reproducing by forward error correction when there is an insufficient part in the transmitted data.
  • FIG. 10 shows an example of a playlist creation screen in the client controller 200.
  • the operator creates a playlist using the playlist creation screen based on the clip information displayed on the monitor screen. Select the clip you want to play along the timeline showing the playback time, enter the clip name, specify the timecode of the time you want to start the clip as the timecode you want to play, the screen thumbnail at the start will appear, When the time code to be ended is designated, a screen thumbnail at the end point and a display indicating the playback period appear on the timeline.
  • a rectangle written with “A”, a start thumbnail, and an end thumbnail are displayed for the clip with the clip name A.
  • an example in which a clip with the clip name B, a clip with the clip name C, and a clip with the clip name B is designated is shown.
  • “B ′” is written in the rectangle corresponding to the designation of the clip with the clip name B for the second time.
  • it is defined as a playlist that playback continues as A ⁇ B ⁇ C ⁇ B ′.
  • effect name The part of the clip that overlaps in time indicates that there is an effect in switching screens.
  • the effect name By specifying the effect name, the effect is selected (indicated by effect names 1 and 3 in the figure). ing).
  • effect name 2 On the other hand, if the clips do not overlap in time, it is a simple scene change (shown as effect name 2 in the figure).
  • the playlist is defined in this way, and its reproduction is requested to the manager 300.
  • the manager 300 Upon receiving the request, the manager 300 performs bandwidth reservation and device reservation along the playlist and confirms the availability. Note that it is also conceivable that the client controller 200 itself makes a bandwidth reservation and a device reservation for the playlist created in this way instead of the manager 300 and confirms its availability.
  • FIG. 11 shows an example in which the device can be used by dynamically setting IN / OUT reversely if possible when there are not enough IO ports with the inter-server network 500 as devices to be used. .
  • the IO ports of the three AV servers 100-1, 100-2 and AV server 100-3 with the inter-server network 500 have two inputs and two outputs.
  • This playback request is a request to externally output the AV clip data stored in the AV server 100-1 from the AV server 100-2.
  • the AV server 100-1 has already received a request from the AV server 100-1. It is assumed that two inter-server network output ports and two inter-server network input ports to the AV server 100-2 have been reserved.
  • the manager 300 sets the respective ports in the reverse direction so as to execute the reproduction request.
  • the IO port with the outside of the system has two inputs and two outputs, but the input port of the AV server 100-2 is changed to one output port. Yes.
  • Playlist playback In the playlist reproduction, the reproduction request itself is reserved for a plurality of reproduction requests.
  • the manager 300 performs scheduling for special operations such as scene changes due to frame breaks or scene changes with effects.
  • a reproduction request that does not define an end time (end frame) can be considered.
  • the bandwidth reservation and device reservation are determined based on the assumption that the bandwidth and device will continue to be used until the playback end command is received, and the playback possibility is determined by considering the bandwidth and device schedule. If so, both the bandwidth and the device will continue to be reserved until a playback end command is received. This is the same even with a playback request accompanied by an arbitrary command of the operator such as JOG or SHUTTLE.
  • FIG. 12 shows an example of playlist reproduction.
  • the AV clip [ ⁇ ] stored in the storage of the AV server 100-1 is output to the AV server 100-3 from time t2 to time t4, and the AV clip stored in the storage of the AV server 100-2 at time t4.
  • the playlist that switches to [ ⁇ ] and outputs until time t7 for example, the following device reservation and bandwidth reservation are performed.
  • the network output port between servers of the AV server 100-1 is from t1 to t5.
  • AV server 100-2 inter-server network output port from t3t3 to t7,
  • One of the server-to-server network output ports of the AV server 100-3 is set from t1 to t5.
  • One of the server-to-server network output ports of the AV server 100-3 is set from t3 to t7.
  • the output port to the outside of the AV server 100-3 is from t2 to t7. (Other necessary decoders in the server) Make a reservation.
  • the bandwidth of the network 500 between servers for sending the compressed data of the AV clip [ ⁇ ] and AV clip [ ⁇ ] is reserved in a corresponding time zone.
  • the AV server system 10 shown in FIG. 1 is configured by connecting a plurality of AV servers 100 via an IP network, and can easily expand the number of IO ports and the storage amount. Become.
  • the server-to-server network 500 between the AV servers 100 can be configured with a general-purpose IP switch and is not specialized for AV products, not only is it easy to obtain in the future, but also high performance is expected. Therefore, it is possible to establish a connection that can satisfy a higher reproduction request.
  • time synchronization server 400 the manager 300, and the client controllers 200-1, 200-2,..., 200-M are provided independently.
  • these do not need to exist physically independently, and other functions may exist on the AV servers 100-1, 100-2,..., 100-N.
  • each AV server may have a client controller function, any one AV server may have a manager function, and any AV server also serves as a time synchronization server. It doesn't matter.
  • this technique can also take the following structures.
  • a plurality of AV servers having IP (Internet Protocol) input / output ports for connecting to other AV servers, independent of input / output ports with the outside of the system;
  • a client controller for controlling the plurality of AV servers;
  • a manager that stores AV clip data recorded in the plurality of AV servers and information related to AV clip data input to the plurality of AV servers;
  • An AV server system comprising a frame synchronization unit that performs frame synchronization of the plurality of AV servers.
  • the AV server The AV server system according to (1), wherein compressed AV clip data for a predetermined frame is output from the IP input / output port at a predetermined number of frame periods.
  • the AV server The AV server system according to (1), wherein compressed AV clip data for one frame is output from the IP input / output port at a cycle of one frame.
  • the AV server The AV server system according to (1), wherein the compressed AV clip data input to the IP input / output port at a predetermined number of frame periods is processed as compressed AV clip data for a predetermined frame.
  • the AV server The AV server system according to (1), wherein the compressed AV clip data input to the IP input / output port at a cycle of one frame is processed as compressed AV clip data for one frame.
  • the AV server The AV server system according to (1), wherein compressed AV clip data input to the IP input / output port in a period of one frame or less from a frame start time is processed as compressed AV clip data for one frame.
  • the AV server The AV server system according to (6), wherein the compressed AV clip data that is insufficient is reproduced from the input compressed AV clip data by forward error correction.
  • the AV server The AV server according to any one of (1) to (7), wherein compressed AV clip data corresponding to normal video data or compressed AV clip data corresponding to RAW data from a single-panel camera is output to the IP input / output port. system.
  • An AV server including an IP (Internet Protocol) input / output port for connecting to another AV server.
  • the compressed AV clip data for a predetermined frame is output from the IP input / output port at a predetermined number of frame periods.
  • the AV server according to (12) (14) The AV server according to (12), wherein the compressed AV clip data input at a frame period is processed as compressed AV clip data for a predetermined frame.
  • the compressed AV clip data corresponding to the normal video data or the compressed AV clip data corresponding to the RAW data from the single-panel camera is output to the IP input / output port.
  • AV server including an IP (Internet Protocol) input / output port for connecting to another AV server.
  • a decoding unit that performs decoding processing on the compressed AV clip data input to the IP input / output port to obtain uncompressed AV clip data;
  • a plurality of AV servers having IP (Internet Protocol) input / output ports for connecting to other AV servers, independent of input / output ports to / from the outside of the system;
  • a client controller for controlling the plurality of AV servers;
  • a manager that stores AV clip data recorded on the plurality of AV servers and information on AV clip data input to the plurality of AV servers;
  • the AV server An AV server system for outputting compressed AV clip data for a predetermined number of frames at a predetermined number of frame periods from the IP input / output port.
  • the AV server First AV clip data obtained by performing compression encoding processing on high frame rate RAW data input from a single-panel camera is recorded in storage with metadata for performing demosaic processing added.
  • the AV server system according to any one of (1) to (18), including one recording unit.
  • (20) The AV server After converting the high frame rate RAW data input from the single panel camera to the normal frame rate RAW data, the demosaic process is performed to obtain the normal frame rate normal video data, and the normal video data is compressed and encoded.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Databases & Information Systems (AREA)
  • Television Signal Processing For Recording (AREA)

Abstract

La présente invention permet d'exécuter facilement une augmentation du nombre de ports d'E/S et du volume de stockage. La présente invention comprend : une pluralité de serveurs AV ayant chacun un port d'entrée/sortie IP utilisé pour la connexion à un autre serveur AV et indépendant d'un port d'entrée/sortie extérieur au système ; un contrôleur client qui contrôle chacun de la pluralité de serveurs AV ; un gestionnaire qui stocke des informations se rapportant à des données de clip AV enregistrées dans la pluralité de serveurs AV et des données de clip AV devant être entrées dans la pluralité de serveurs AV ; et une unité de synchronisation de trames qui synchronise des trames de la pluralité de serveurs AV.
PCT/JP2016/076236 2015-09-10 2016-09-07 Système de serveur av, et serveur av WO2017043501A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/741,312 US10887636B2 (en) 2015-09-10 2016-09-07 AV server system and AV server

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
JP2015-178213 2015-09-10
JP2015178213 2015-09-10
JP2016-003059 2016-01-08
JP2016003059A JP6819041B2 (ja) 2015-09-10 2016-01-08 サーバシステムおよびサーバ

Publications (1)

Publication Number Publication Date
WO2017043501A1 true WO2017043501A1 (fr) 2017-03-16

Family

ID=58239771

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/076236 WO2017043501A1 (fr) 2015-09-10 2016-09-07 Système de serveur av, et serveur av

Country Status (1)

Country Link
WO (1) WO2017043501A1 (fr)

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63128832A (ja) * 1986-11-19 1988-06-01 Fuji Electric Co Ltd 多重伝送システムの主局入出力ポ−ト可変設定方法
US20020021708A1 (en) * 2000-08-15 2002-02-21 Katsuhiro Ishiai Audio/video data transfer system, audio/video data transfer method, and audio/video server
JP2004246614A (ja) * 2003-02-13 2004-09-02 Sony Corp Ａｖデータファイルの転送システム及び転送方法
US20070248313A1 (en) * 2004-06-23 2007-10-25 Matsushita Electric Industrial Co., Ltd. Archive Management Device, Archive Management System, and Archive Management Program
US20080088858A1 (en) * 2006-10-13 2008-04-17 Apple Inc. System and Method for Processing Images Using Predetermined Tone Reproduction Curves
JP2012133615A (ja) * 2010-12-22 2012-07-12 Nippon Hoso Kyokai <Nhk> リモート編集システム、編集処理装置およびそのプログラム
US20150116554A1 (en) * 2012-07-06 2015-04-30 Fujifilm Corporation Color imaging element and imaging device
WO2015076277A1 (fr) * 2013-11-22 2015-05-28 ソニー株式会社 Dispositif d'émission, procédé d'émission, dispositif de réception et procédé de réception
JP2015216601A (ja) * 2014-05-13 2015-12-03 キヤノン株式会社 撮像装置およびその制御方法ならびにプログラム

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63128832A (ja) * 1986-11-19 1988-06-01 Fuji Electric Co Ltd 多重伝送システムの主局入出力ポ−ト可変設定方法
US20020021708A1 (en) * 2000-08-15 2002-02-21 Katsuhiro Ishiai Audio/video data transfer system, audio/video data transfer method, and audio/video server
JP2004246614A (ja) * 2003-02-13 2004-09-02 Sony Corp Ａｖデータファイルの転送システム及び転送方法
US20070248313A1 (en) * 2004-06-23 2007-10-25 Matsushita Electric Industrial Co., Ltd. Archive Management Device, Archive Management System, and Archive Management Program
US20080088858A1 (en) * 2006-10-13 2008-04-17 Apple Inc. System and Method for Processing Images Using Predetermined Tone Reproduction Curves
JP2012133615A (ja) * 2010-12-22 2012-07-12 Nippon Hoso Kyokai <Nhk> リモート編集システム、編集処理装置およびそのプログラム
US20150116554A1 (en) * 2012-07-06 2015-04-30 Fujifilm Corporation Color imaging element and imaging device
WO2015076277A1 (fr) * 2013-11-22 2015-05-28 ソニー株式会社 Dispositif d'émission, procédé d'émission, dispositif de réception et procédé de réception
JP2015216601A (ja) * 2014-05-13 2015-12-03 キヤノン株式会社 撮像装置およびその制御方法ならびにプログラム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
TOYOFUKU, T. ET AL.: "DVCPRO Server", MATSUSHITA TECHNICAL JOURNAL, vol. 46, no. 5, 18 October 2000 (2000-10-18), pages 54 - 61, ISSN: 1343-9529 *

Similar Documents

Publication Publication Date Title
US9462195B2 (en) System and method for distributed video and or audio production
JP4229127B2 (ja) 映像処理装置及びタイムコードの付加方法
US11895352B2 (en) System and method for operating a transmission network
US8509605B2 (en) Synchronized reproduction system and synchronized reproduction method
WO2017179593A1 (fr) Serveur av et système de serveur av
JP2013532432A (ja) 単一の復号器でチャンネル変更を可能にする受信機および該受信機での方法
WO2017043501A1 (fr) Système de serveur av, et serveur av
JP2007158432A (ja) 映像記録装置
JP6128329B2 (ja) 映像記録装置およびカメラデコーダ
JP6819041B2 (ja) サーバシステムおよびサーバ
WO2020170659A1 (fr) Système d&#39;édition
JP4967402B2 (ja) 多重化ストリーム変換装置および方法
JP2003333551A (ja) メディア多重装置およびこれを用いる符号化装置
Devlin et al. Nuggets and MXF: Making the networked studio a reality
JP2016076884A (ja) マルチメディア同期再生装置及びマルチメディア同期再生方法
JP2006094415A (ja) 映像装置及び映像ストリーミング方法
JP4187040B2 (ja) 記録再生装置
JP2011103617A (ja) 映像処理装置
JP2017055378A5 (fr)
JP2005217609A (ja) 映像情報再生装置
Barral et al. Nuggets & MXF: making the networked studio a reality
JP2005236466A (ja) 情報処理装置および情報処理方法
JP2009302792A (ja) データ記録装置、データ記録制御方法、データ再生装置、データ読み出し制御方法およびデータ記録／再生装置
JP2001285891A (ja) 信号変換装置
JPH10308915A (ja) 編集装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16844362

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16844362

Country of ref document: EP

Kind code of ref document: A1