JP2021016080A - Image/sound control device, image/sound processing device, image/sound control method, and image/sound control program - Google Patents

Abstract

To provide an image/sound processing device, an image/sound processing method, and an image/sound processing program which suppress abnormal operation.SOLUTION: An image/sound control device 10 for transmitting control data in image/sound control to a controlled circuit comprises: a memory 120 for temporarily storing the control data for first processing and second processing; an abnormal value detection unit 11 which detects an abnormal value that is a value of the control data for first processing and second processing being out of a proper range; and a correction unit 12 which, when the abnormal value is detected, corrects the abnormal value to the upper limit value of the proper range in a case of the first processing but to the lower limit value of the proper range in a case of the second processing.SELECTED DRAWING: Figure 3

Description

The present invention relates to a video / audio control device, a video / audio processing device, a video / audio control method, and a video / audio control program.

The broadcast transmission equipment master switcher device, which is a broadcast device of a television, controls video / audio synthesis processing (hereinafter, may be referred to as SUP) that controls video / audio output (Patent Document 1). For example, a master switcher device synthesizes video and audio, and outputs a subtitle superimpose such as a time display as shown in FIG. 7. The control central circuit transmits control data to the controlled circuit and performs video / audio processing such as subtitle superimpose.

JP-A-2009-267478

However, there was a problem that this subtitle super (time display) flashed.

Therefore, the present invention has been made in view of the above points, and an object of the present invention is to provide a video / audio control device, a video / audio processing device, a video / audio control method, and a video / audio control program that suppress such abnormal operations. And.

The video / audio control device according to the first aspect of the present invention is a video / audio control device for transmitting control data in video / audio control to a controlled circuit.
A memory that temporarily stores control data for the first or second process,
In the memory, an abnormal value detection unit that detects an abnormal value whose control data for the first process and the second process is out of the appropriate range, and
When the abnormal value is detected, in the case of the first process, it is corrected to the upper limit value of the appropriate range, and in the case of the second process, it is corrected to the lower limit value of the appropriate range.
To be equipped.

The video / audio control method according to the second aspect of the present invention is a video / audio control method for transmitting control data in video / audio control to a controlled circuit.
A step of temporarily storing control data for the first process or the second process,
In the memory, a step of detecting an abnormal value in which the control data for the first process and the second process is out of the appropriate range, and
When the abnormal value is detected, in the case of the first process, the step is corrected to the upper limit value of the appropriate range, and in the case of the second process, the step is corrected to the lower limit value of the appropriate range.

The video / audio control program according to the third aspect of the present invention is a video / audio control program for transmitting control data in video / audio control to a controlled circuit.
A process for temporarily storing control data for the first process or the second process,
In the memory, a process of detecting an abnormal value in which the control data for the first process and the second process is out of the appropriate range, and
When the abnormal value is detected, in the case of the first process, the computer is corrected to the upper limit value of the appropriate range, and in the case of the second process, the process is corrected to the lower limit value of the appropriate range. ..

The present invention can provide a video / audio control device, a video / audio processing device, a video / audio control method, and a video / audio control program that suppress abnormal operations.

It is a block diagram which shows the structure of a video-audio processing apparatus. It is a figure explaining the defect of the internal data in a memory. It is a block diagram which shows the structure of a video-audio control device. It is a table explaining the type of fader processing. It is a flowchart explaining operation of a video-audio control device. It is a figure explaining the processing operation of a non-volatile memory and a volatile memory. It is a figure explaining the trouble of the subtitle super.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing a configuration of a video / audio processing device. The video / audio processing device is preferably applied to a master switcher installed in a master facility of a broadcasting station. Here, the master switcher is a device that switches and processes a program signal sent from a studio, a program signal stored in a VTR, a server, or the like, and a CM signal, and then sends the signal. As shown in FIG. 1, the video / audio processing device receives control data from the video / audio control device 10 and the video / audio control device 10 and performs various video / audio processing (for example, video / audio synthesis processing). The circuit 20 is provided. In FIG. 1, the video / audio control device 10 is shown as a CONT (Control) card, and the controlled circuit 20 is shown as an MK / DSK card. MK is an abbreviation for Mixer / Keyer, and DSK is an abbreviation for Down Stream Keyer. Both MK and DSK are devices that synthesize various video and audio supermarkets, but while MK is used for supermarkets prepared in advance, DSK broadcasts the contents of contents such as breaking news and clock supermarkets. It is used to supermarket items that are not closely related to operation data. Although one controlled circuit 20 is shown in FIG. 1, a plurality of controlled circuits 20 may be provided.

The video / audio control device 10 mainly includes a Main CPU (Central Processing Unit) 100, a memory 120, and an ASI (Asynchronous Serial Interface) control FPGA unit 130, and transmits control data to the controlled circuit 20.

The memory 120 includes a non-volatile memory 121 and a volatile memory 122. In FIG. 1, a ferroelectric memory (FeRAM) is shown as the non-volatile memory 121, but the present invention is not limited to this, and for example, in addition to the ferroelectric memory (FeRAM), a flash memory and a magnetoresistive memory (MRAM). ), Phase change memory (PRAM), resistance change memory (ReRAM) and the like can be used. Further, as the volatile memory 122, DDR SDRAM (Double-Data-Rate SDRAM) is shown in FIG. 1, but the present invention is not limited to this, and for example, RAM (random access memory), synchronous RAM (SRAM), and the like. Dynamic RAM (DRAM), synchronous DRAM (DDR), direct RAM bus RAM (DRRAM) and the like can be used.

The video / audio control device 10 includes LAN 101 and BS-NET 102 connected to the Main CPU 100, a clock control FPGA (Field-Programmable Gate Array) unit 140 connected to the synchronization separator 115, and a Main control FPGA unit 131. Further prepare.

The reference clock signal (REF CLOCK) 105 is separated by the synchronization separator 115 and input to the clock control FPGA unit 140. Further, the Main CPU 100 transmits the address to the ASI control FPGA unit 130. In addition, data is bidirectionally communicated between the Main CPU 100 and the ASI control FPGA unit 130. The ASI control FPGA unit 130 generates 1-bit control data and transmits it to the ASI decoding circuit 211 in the controlled circuit 20. Further, the clock control FPGA unit 140 generates a frame pulse and transmits it to the timing signal generation unit 212 in the controlled circuit 20.

The controlled circuit 20 includes an FPGA unit 210 and an FPGA unit 250. The FPGA unit 210 includes an ASI decoding circuit 211, a timing signal generation unit 212, and a memory 215.

Further, the FPGA unit 250 includes an S / P 221 to which an external SUP signal is input, an AVDL (Automatic Variable Delay Line) 222, an S / P 231 to which an external KEY signal is input, an AVDL232, and an external KEY detection unit 241. It includes a super KEY generation circuit 251 and.

By the way, as described above with reference to FIG. 7, in such a video / audio processing device, an event has occurred in which the subtitle super (time display) blinks unintentionally. In response to this, we temporarily responded by making a system change to switch from the current system to the backup system (backup machine). After that, the inventors investigated the cause and found that the internal data of the memory in the CONT card (CPU board) that synthesizes video and audio was changed due to various external factors.

A memory defect will be described in detail with reference to FIG.
FIG. 2 represents a fader value variable in memory in hexadecimal.
The fader value variable indicating that the subtitle (or clock) super is placed on the video is 800 h, that is, 100% display. On the other hand, the fader value variable indicating that the subtitle (or clock) super is not placed on the video is 000 h, that is, 0% display. Originally, the fader value variable contains only a numerical value between 000h and 800h (a numerical value within a predetermined range). However, this time, due to an external factor, a larger value (outlier value) was stored in the memory. Further, the video / audio control device 10 transmits only 0% or 100% of control data to the controlled circuit 20. However, as shown in FIG. 2, when a numerical value (outlier value) outside the predetermined range is entered as in this case, a phenomenon occurs in which the fader value variable moves back and forth between 100% and 0%. (That is, the data in memory is garbled). As a result, it is probable that the above-mentioned problem of blinking the time display occurred.

For each process on the above memory (firmware), the detailed contents of the parts that may cause a malfunction are shown.
(A) Confirmation of abnormal value of fader value variable on the work memory It was confirmed that when the fader value variable has the following value, the subtitle superimpose flashes.
・ A value smaller than the lower limit "000h" (minus value) during fade-in
In this case, it was confirmed that the cutout and fade-in fader processing operations occur once when the fader value variable shifts from minus to plus (different from the defect phenomenon this time).
-A value larger than "800h" during fade-out (a bit higher than "800h" is valid)
In the implementation verification, the fade-out and cut-in fader processing operations are repeated until the control value becomes 0.
Under the fade-out condition, the variable of the fader value on the work memory is about 1.17 × 10 ^ (-38) to about 1.17 × 10 ^ (-38) as a value of 32 bit float type (most significant 1 bit = code, 8 bit = exponent, 23 bit = mantissa). It can take a range of 3.40 × 10 ^ (+38). However, once this variable becomes a value larger than 800h for some reason, it continues to count down endlessly until the fader value variable reaches 000h (see FIG. 2). As a result, the fader value variable continues to change for a long period of time and then eventually stops spontaneously.

Therefore, in order to detect the occurrence of the above-mentioned memory corruption,
-A function to detect and correct abnormal values in memory (limit judgment),
-A function that automatically corrects data when an intermediate value is detected without fader control, and-Doubles the memory into non-volatile memory and volatile memory, and is correct among non-volatile memory and volatile memory. A circuit with a function to correct to the other value was added.

In addition, in order to check the statistics of the degree of occurrence of these or defects,
-A function to compress and store alarm logs in non-volatile memory (internal storage),
-A function to perform unmanned alarm control by automatically monitoring and analyzing the alarm log,
-A function to add an automatic check circuit for all data with a detection circuit for a huge amount of SUP control data,
-A function to control by adding a flag indicating that fader processing is in progress to the volatile memory 122 (DDR-SDRAM) side at the time of receiving the upper control (the flag is turned ON when the higher control is received and the flag is turned OFF when the fader processing is completed. As a result, it operates only once with one-time control (does not repeat).
The circuit with was added.

As described above, when an abnormal value occurs in the internal data of the memory, the phenomenon of repeating ON / OFF occurs with a very low probability in the control of the audio-video composition processing. Normally, the control data is temporarily stored in the internal memory which is a buffer, and is read when the control data is used. However, the accumulated data changes due to the influence of foreign factors on the memory, and the changed video / audio SUP control data controls the unintended video / audio SUP.

Therefore, as shown in FIG. 3, the video / audio control device 10 has an abnormal value detection unit 11 that detects an abnormal value of a fader value outside a predetermined appropriate range in the memory, and an abnormality based on the current processing state. A correction unit 12 for correcting the value to a value within an appropriate range is provided. More specifically, the video / audio control device 10 for transmitting the control data in the video / audio control to the controlled circuit has a memory 120 for temporarily storing the control data for the first process or the second process, and the memory. An abnormal value detection unit 11 that detects an abnormal value whose control data for the first process and the second process is out of the appropriate range, and when an abnormal value is detected, it is corrected to the upper limit value of the appropriate range in the case of the first process. In the case of the second process, a correction unit 12 for correcting the lower limit value in an appropriate range is provided. Further, the first process may be a process in which the control data finally becomes the upper limit value of the appropriate range, and the second process may be a process in which the control data finally becomes the lower limit value of the appropriate range. The first process may be a cut-in or fade-in process, and the second process may be a cut-out or fade-out process. Here, various fader processes will be described with reference to FIG. The horizontal axis of the graph indicates time. The cut-in is a process of switching the fader value from the lower limit value to the upper limit value in an instant (processing time is 0). Further, the fade-in is a process of changing the fader value from the lower limit value to the upper limit value in a predetermined time. On the other hand, the cutout is a process of switching the fader value from the upper limit value to the lower limit value in an instant (processing time is 0). Further, the fade-out is a process of changing the fader value from the upper limit value to the lower limit value in a predetermined time.

Further, when the video / audio control device 10 does not perform fader control on the video / audio (for example, the subtitle or the clock super is not blinked and displayed), the video / audio control device 10 sets an intermediate value other than the upper limit value and the lower limit value of the fader value in the memory. If detected, no fader processing is performed. Further, the video / audio control device 10 has a circuit that automatically corrects data when an intermediate value is detected in the absence of such control. Specifically, when the intermediate value is detected when the fader processing is not executed, the data correction is corrected to the upper limit value (100%) if the fader processing processed last time is fade-in, and the fader processing processed last time is If it fades out, correct it to the lower limit (0%).

Further, the video / audio control device 10 may further include an alarm output unit that outputs an alarm when an abnormal value is detected. Further, the output alarm may be compressed and stored in the non-volatile memory 121 as an alarm log. The analysis of the log accumulated when the alarm occurs may be performed automatically instead of being performed by the user. That is, a warning unit may be provided to warn the user of some important alarms by selecting the alarms requested by the user in advance. With such an automatic alarm monitoring (monitoring method, classification, priority) function, unmanned alarm control can be performed.

It may have a circuit that automatically checks all the huge amount of SUP control data. The control data detection circuit corresponds to an aptitude value determination unit for control values in the non-volatile memory.

With reference to FIG. 5, the control flow of the video / audio control device for preventing the above-mentioned internal data of the memory from being garbled will be described.

At startup, the Main CPU 100 clears all work areas for calculating the fader value in the non-volatile memory area to 0 (step S101). The Main CPU 100 uses the fader value calculation work area in the volatile memory (step S103). As shown in FIG. 6, the Main CPU 100 copies the fader value variable stored in the non-volatile memory area to the volatile memory area (step S105). After that, the Main CPU 100 performs processing using the fader variable in the volatile memory area. By using the volatile memory area as the fader value calculation work area in this way, even if an abnormal value occurs, the abnormal value does not remain in the volatile memory area once the power is turned off. Therefore, it is possible to prevent the trouble caused by the abnormal value from continuing for a long period of time.

As shown in FIG. 6, the non-volatile memory 121 includes control data, a tally (OA (OnAir)), and a DVE (Digital Video Effect) pattern. The volatile memory 122 also includes control data, tally (OA), and DVE patterns.

Next, using an interrupt by a V pulse (period of about 16 ms) as a trigger, the Main CPU processes the control message stored in the memory and sets a task (step S107). The Main CPU 100 calculates the control value (control data) in the control value calculation work area in the volatile memory described above (step S109). The Main CPU 100 fills up to the high-order bit by assigning it to the fader value variable.

The Main CPU 100 determines whether the fader value referred to during the fader processing is out of the appropriate range (000h to 800h) among the calculated control values (control data) (step S111). When the fader value is out of the appropriate range (NO in step S111), the Main CPU 100 corrects the fader value to an appropriate value based on the current processing state by the flag of the volatile memory 122 (step S113). The Main CPU 100 can recognize the current processing state by the flag indicating that the fader processing is in progress. Here, as an appropriate value, the Main CPU 100 changes to an upper limit value (800 h) at the time of cut-in or fade-in processing, and changes to a lower limit value (000 h) at the time of cut-out or fade-out processing. The cut-in or fade-in process can be said to be an example of a process in which the control data finally reaches the upper limit of the appropriate range. Further, the cutout or fade-out process can be said to be an example of a process in which the control data finally becomes the lower limit value of the appropriate range. When the Main CPU 100 detects a fader value outside the proper range (when a problem occurs due to a fader value outside the proper range in any of all super circuits including the controlled circuit 20), the Main CPU 100 displays an LED. .. Further, the Main CPU 100 does not change the fader value except when the fader mode is changed by control.

The Main CPU 100 outputs an alarm when the fader value is out of the appropriate range (000 to 800 h) (step S115). Further, when the fader value is set to an abnormal value even though the Main CPU 100 does not have APS (Automatic Program Control System) control, the LED is turned on and an alarm is output.

The Main CPU 100 transmits control data in the volatile memory area to the controlled circuit 20 to control video and audio (step S117).

As shown in FIG. 5, during higher control, the Main CPU 100 writes back the control data (fader value, etc.) of the volatile memory (DDR-SDRAM) 122 to the non-volatile memory (FeRAM) 121 (step S119). At this time, the Main CPU 100 can also compress the alarm log described above in step S115 and store it in the non-volatile memory 121. Further, the Main CPU 100 can automatically select an alarm predetermined by the user from the accumulated log by the warning unit and warn the user. The higher-level control referred to here refers to the control of the broadcasting system including the video / audio control device. For example, in the host control, time management (video / audio switching timing) of a broadcasting program is controlled. That is, the broadcasting system that controls the upper control sends control instructions such as fade-in / out and cut-in / out to the video / audio control device by using BS-NET or LAN communication according to the video / audio switching timing. introduce. According to the instruction, the present video / audio control device performs control such as fade-in / out and cut-in / out (this is referred to as lower control).

According to the above-described embodiment, even if an abnormal value occurs inside the memory, it is possible to suppress the abnormal operation accompanying the abnormal value. Therefore, it is possible to prevent the occurrence of a problem that the subtitle super (time display) blinks unintentionally.

Further, as described in the processing procedure in the video / audio control device in the various embodiments described above, the present disclosure is a form as a video / audio control method for transmitting control data in the video / audio control to a controlled circuit. Can also be taken. This video / audio control method includes the following steps. A step of temporarily storing control data for the first process or the second process, a step of detecting an abnormal value in which the stored control data for the first process and the second process are out of an appropriate range, and the abnormal value. When is detected, in the case of the first process, the upper limit value of the appropriate range is corrected, and in the case of the second process, the lower limit value of the appropriate range is corrected. The other examples are as described in the various embodiments described above. Further, the video / audio control program is a program for causing a computer to execute such a video / audio control method.

In the above example, the program can be stored and supplied to a computer using various types of non-transitory computer readable media. Non-transitory computer-readable media include various types of tangible storage media. Examples of non-temporary computer-readable media include magnetic recording media (eg, flexible disks, magnetic tapes, hard disk drives), magneto-optical recording media (eg, magneto-optical disks), CD-ROMs (Read Only Memory), CD-Rs, CD-R / W, DVD (Digital Versatile Disc), BD (Blu-ray (registered trademark) Disc), semiconductor memory (for example, mask ROM, PROM (Programmable ROM), EPROM (Erasable PROM), flash ROM, RAM ( Random Access Memory)) is included. The program may also be supplied to the computer by various types of transient computer readable media. Examples of temporary computer-readable media include electrical, optical, and electromagnetic waves. The temporary computer-readable medium can supply the program to the computer via a wired communication path such as an electric wire and an optical fiber, or a wireless communication path.

The present invention is not limited to the above embodiment, and can be appropriately modified without departing from the spirit. For example, the present invention is implemented for garbled data in the control value storage memory for SUP control data of video / audio control of the TV video transmission matrix device, but other broadcasting device control parameters (GAIN value, fader inclination / time). It is effective for constants, etc.) and temporarily stored data. In addition to broadcasting, it can also be applied to a control board having a memory that is temporarily stored.

10 Video / audio control device 11 Outlier detection unit 12 Correction unit 20 Controlled circuit 100 Main CPU
101 LAN
102 BS-NET
120 Memory 121 Non-volatile memory 122 Volatile memory 130 ASI control FPGA section 131 Main control FPGA section 140 Clock control FPGA section 210 FPGA section 211 ASI decoding circuit 212 Timing signal generator section 215 Memory 221 S / P
222 AVDL
231 S / P
241 External KEY detection unit 250 FPGA unit 251 Super KEY generation circuit

Claims (10)

A video / audio control device for transmitting control data in video / audio control to a controlled circuit.
A memory that temporarily stores control data for the first or second process,
In the memory, an abnormal value detection unit that detects an abnormal value whose control data for the first process and the second process is out of the appropriate range, and
When the abnormal value is detected, in the case of the first process, it is corrected to the upper limit value of the appropriate range, and in the case of the second process, it is corrected to the lower limit value of the appropriate range.
A video / audio control device. A claim that the first process and the second process are not performed when the outlier detection unit detects an intermediate value within the appropriate range when the first process and the second process are not performed. The video / audio control device according to 1. The first process is a process in which the control data finally becomes the upper limit value of the appropriate range, and the second process is a process in which the control data finally becomes the lower limit value of the appropriate range. The video / audio control device according to 1 or 2. The video / audio control device according to any one of claims 1 to 3, wherein the first process is a cut-in or fade-in process, and the second process is a cut-out or fade-out process. The memory includes a volatile memory including an area for calculating the control data and a non-volatile memory for storing the calculated control data.
The video / audio control device according to any one of claims 1 to 4. The video / audio control device according to any one of claims 1 to 5, further comprising an alarm output unit that outputs an alarm when the abnormal value is detected. The video / audio control device according to claim 6, wherein the alarm output from the alarm output unit is recorded in a non-volatile memory as a log. The video / audio control device according to any one of claims 1 to 7.
A video / audio processing device including a controlled circuit for displaying a video / audio supermarket. It is a video / audio control method for transmitting control data in video / audio control to a controlled circuit.
A step of temporarily storing control data for the first process or the second process,
A step of detecting an abnormal value in which the stored control data for the first process and the second process are out of the appropriate range, and
When the abnormal value is detected, in the case of the first process, it is corrected to the upper limit value of the appropriate range, and in the case of the second process, it is corrected to the lower limit value of the appropriate range. Method. A video / audio control program for transmitting control data in video / audio control to a controlled circuit.
A process for temporarily storing control data for the first process or the second process,
A process for detecting an abnormal value in which the stored control data for the first process and the second process are out of the appropriate range, and a process for detecting an abnormal value.
When the abnormal value is detected, in the case of the first process, the computer is corrected to the upper limit value of the appropriate range, and in the case of the second process, the process is corrected to the lower limit value of the appropriate range. , Video and audio control program.

Images