JP7467098B2 - Super synthesis device and super synthesis program - Google Patents

Description

This embodiment relates to a super synthesis device and a super synthesis program.

Current digital broadcasting stations use a superimposition function that overlays information containing images and text, such as weather forecasts, and text information, such as breaking news, onto the main video signal. The superimposition information used in the superimposition function, such as information for weather forecasts and breaking news, is generated by a device called a picture creation device. The superimposition information generated by these picture creation devices is converted into an SDI (Serial Digital Interface) signal and superimposed onto the main video signal by a superimposition device.

Japanese Patent Application Laid-Open No. 11-341355

When it is necessary to overlay multiple pieces of super information, such as weather, breaking news, emergency earthquake alerts, and weather maps, a separate drawing device is required to output each piece of super information as an SDI signal. In this case, each drawing device and the super compositor must be connected with a cable that transmits the SDI signal. Therefore, the connections between the drawing devices and the super compositor can easily become complicated.

This embodiment provides a super synthesis device and a super synthesis program that can realize super functions with a simple configuration.

A super-compositing device according to one embodiment inputs a video signal from a video server in an SDI format signal, inputs a super file containing super information to be superimposed on the video signal from a drawing device in a text file format or an image file format, and superimposes the super information on the video signal, and has a recording unit, a drawing processing unit, and a super processing unit. The recording unit records the super file sent from the drawing device. The drawing processing unit reads out the super file recorded in the recording unit, and generates an SDI format super signal from the super file for each super file to be superimposed on the video signal. The super processing unit superimposes the super signal generated by the drawing processing unit on the SDI format video signal sent from the video server for each super signal, and outputs the result.

FIG. 1 is a diagram showing an example of a broadcast master system including a super synthesizer according to each embodiment. FIG. 2 is a diagram showing the configuration of the super synthesis device. FIG. 3 is a flowchart showing the process of the super synthesis device in the first embodiment. FIG. 4 is a diagram showing the operation of the super combiner according to the process of FIG. FIG. 5 is a diagram for explaining an example to which the second embodiment is applied. FIG. 6 is a diagram showing an example of a partial image. FIG. 7 is a diagram showing an example of a scenario file. FIG. 8 is a flowchart showing the process of the super synthesis device in the second embodiment. FIG. 9 is a diagram showing an example of characters to be scrolled as an example to which the second embodiment is applied. FIG. 10 is a diagram showing an example of a text file in the third embodiment. FIG. 11 is a flowchart showing the process of the super synthesis device in the third embodiment.

The following describes the embodiment with reference to the drawings.

[First embodiment]
FIG. 1 is a diagram showing an example of a broadcast master system including a super synthesizer according to each embodiment.

The broadcast master system 1 includes a video server 10, a drawing device 20, a super-compositing device 30, an output control device 40, and a transmitter 50.

The video server 10 is connected to the super-compositor 30 via, for example, an SDI cable. The video server 10 stores video data that is the material for broadcasting. The video server 10 converts the video data into an SDI signal and sends this SDI signal to the super-compositor 30 as a main line video signal.

The drawing device 20 is connected to the superimposing device 30 via, for example, a LAN cable. The drawing device 20 generates materials necessary for the superimposing function. The drawing device 20 has an image file generating unit 21. The image file generating unit 21 generates a superimposing file containing superimposing information necessary for various superimposing such as weather forecasts, breaking news, and emergency earthquake alerts. This superimposing file is an image file such as a JPEG file if the superimposing information is image superimposing, and a text file if the superimposing information is text superimposing. As will be explained later, the image contained in the image file does not need to be the same size as the video signal, and may be a small-sized image with only the effective area required for superimposing. The drawing device 20 generates multiple types of superimposing files such as weather forecasts, breaking news, and emergency earthquake alerts with a single drawing device.

The super combiner 30 realizes the super function by overlaying a super signal, as necessary, on the video signal sent from the video server 10. The super combiner 30 will be explained in detail later.

The output control device 40 is connected to the super-combiner 30 via, for example, an SDI cable. The output control device 40 causes the transmitter 50 to broadcast the super-combined video signal. Although not shown in FIG. 1, the broadcast master system 1 may have a redundant configuration in which the same video signal is transmitted over multiple systems. In this case, the output control device 40 also switches systems, such as switching to a sub-system when a failure occurs in the main system.

Here, the connections between the video server 10, the drawing device 20, the superimposing device 30, and the output control device 40 are not limited to wired connections, but may be wireless.

Figure 2 is a diagram showing the configuration of the super synthesis device. The super synthesis device 30 is, for example, a server device equipped with a processor such as a CPU and a memory. The super synthesis device 30 has a recording unit 31, drawing processing units 321, 322, ..., 32n, and super processing units 331, 332, ..., 33n. Here, the drawing processing units 321, 322, ..., 32n and the super processing units 331, 332, ..., 33n are each configured by software executed by a processor. Of course, the drawing processing units 321, 322, ..., 32n and the super processing units 331, 332, ..., 33n may also be configured by hardware.

The recording unit 31 is a recording unit for storing various super files sent from the drawing device 20. The recording unit 31 is a type of storage such as a hard disk or a solid state drive. As described above, the super file is generated by the drawing device 20. This super file is transmitted as a packet via, for example, a LAN cable and recorded in the recording unit 31.

The drawing processing units 321, 322, ..., 32n read the super file recorded in the recording unit 31 and perform drawing processing to generate a super signal in, for example, SDI format from the read super file. The super signal includes, for example, a FILL data signal and a KEY data signal. The FILL data signal is a signal representing the data of the main image to be superimposed. The KEY data signal is a signal representing the cut-out position for cutting out the part of the image to be superimposed from the main line video signal. The drawing processing units 321, 322, ..., 32n each generate a super signal from a different super file. For example, the drawing processing unit 321 generates a super signal for a weather forecast. The drawing processing unit 322 generates a super signal for breaking news. The drawing processing unit 323 generates a super signal for an emergency earthquake warning. In other words, the number of drawing processing units provided in the super synthesis device 30 is determined according to the number of supers that can be superimposed on the main line video signal.

The super processors 331, 332, ..., 33n perform superimposing the superimposed signals generated by the drawing processors 321, 322, ..., 32n on the main line video signal sent from the video server 10. For example, the superimposed signal processor 331 superimposes a superimposed signal for a weather forecast on the main line video signal and transfers it to the superimposed signal processor 332. The superimposed signal processor 332 superimposes a superimposed signal for breaking news on the main line video signal and transfers it to the superimposed signal processor 333. The superimposed signal processor 333 superimposes a superimposed signal for an emergency earthquake warning on the main line video signal and sends it to the output control device 40. In other words, the number of superimposed signal processors provided in the superimposed signal synthesizer 30 is determined according to the number of superimposed signals that can be superimposed on the main line video signal.

Figure 3 is a flowchart showing the processing of the super synthesis device 30 in the first embodiment. The processing of Figure 3 is performed, for example, by the processor of the super synthesis device 30 executing a super synthesis program stored in memory.

In step S1 of FIG. 3, the super-compositor 30 determines whether or not a main line video signal has been input. If it is determined in step S1 that a main line video signal has not been input, the process in FIG. 3 ends. If it is determined in step S1 that a main line video signal has been input, the process proceeds to step S2.

In step S2, the super combiner 30 determines whether or not a super file has been recorded in the recording unit 31. When a super, such as a weather forecast, is implemented, a super file is recorded in the recording unit 31 at the same time as or before the main line video signal. In step S2, it is determined whether or not this is recorded. If it is determined in step S2 that a super file has not been recorded, the process proceeds to step S3. If it is determined in step S2 that a super file has been recorded, the process proceeds to step S4.

In step S3, the super-compositor 30 sends the main video signal to the output control device 40. Then, the process returns to step S1. In other words, when a super file is not recorded in the recording unit 31, the super-compositor 30 does not perform any particular process.

In step S4, the super composition device 30 performs drawing processing. That is, the drawing processing units 321, 322, ..., 32n of the super composition device 30 each read a corresponding super file, and generate an SDI signal of FILL data and an SDI signal of KEY data as a super signal from the read super file. When the super file is a text file, the drawing processing unit converts the text contained in the text file into an image, and generates an SDI signal of FILL data and an SDI signal of KEY data from the converted image.

In step S5, the super combiner 30 performs super processing. That is, the super processing units 331, 332, ..., 33n of the super combiner 30 superimpose the SDI signal of the FILL data and the SDI signal of the KEY data as super signals generated by the drawing processing units 321, 322, ..., 32n on the main line video signal.

In step S6, the super combiner 30 determines whether the super processing is complete. When the super processing in the final stage super processing unit is complete, the super processing is determined to be complete. When it is determined in step S6 that the super processing is not complete, the process returns to step S5. In this case, the super processing continues. When it is determined in step S6 that the super processing is complete, the process proceeds to step S3. In this case, the super combiner 30 sends the main line video signal on which the super signal has been superimposed to the output control device 40.

Figure 4 shows the operation of the superimposing device 30 according to the process of Figure 3. Figure 4 shows an example in which superimposing for a weather forecast, superimposing for breaking news, and superimposing for a tsunami warning are performed on the main line video signal Vin.

When performing superimposition, superfiles SF1, SF2, and SF3 are sent from the drawing device 20 to the superimposition device 30. Superfile SF1 is a superfile for a weather forecast. Superfile SF2 is a superfile for breaking news. Superfile SF3 is a superfile for a tsunami warning. As mentioned above, the size of the images contained in superfiles SF1, SF2, and SF3 need only be the size required for superimposition. In other words, the size of the images contained in superfiles SF1, SF2, and SF3 may be smaller than the size of the video signal Vin.

The video server 10 also sends the main video signal Vin, which is an SDI signal, to the superimposing device 30. The superimposing device 30 generates a superimposing signal, which is an SDI signal, from each superimposing file and superimposes the generated superimposing signal on the main video signal Vin. The superimposing device 30 then sends out the main video signal Vout on which each superimposing has been superimposed. In this manner, superimposing is performed.

As described above, in this embodiment, information for superimposing is generated as an image file or a text file. The superimposing file is then sent as a file from the drawing device 20 to the super compositing device 30, rather than as an SDI signal. The superimposing device 30 then generates a super signal for performing the superimposing process, and the superimposing process is carried out. For this reason, the drawing device 20 does not need to have the function of generating an SDI signal. Furthermore, even if multiple superimposing processes need to be carried out, only one drawing device is required. This makes it possible to reduce the number of drawing devices and the number of cables required for carrying out the superimposing process. In other words, in this embodiment, the superimposing function can be realized with a simple configuration.

When sending super information in the form of an SDI signal, due to the limitations of the SDI signal standard, it is necessary to send it at the same full screen size as the main video signal. In contrast, when recording super information in a file and transmitting this file in packets, the limitations of the SDI signal standard do not need to be taken into consideration. Therefore, by limiting the size of the image included in the super file to only the size of the required effective area, the load on the drawing device 20 is reduced. In addition, in recent years, broadcasting stations have been considering an operation in which SDI signals are IP packetized and transmitted. In this embodiment, by limiting the size of the image included in the super file to only the size of the required effective area, it is possible to transmit information for supers with a small amount of data, so it is also suitable for an operation in which SDI signals are IP packetized and transmitted.

Second Embodiment
Next, a second embodiment will be described. The second embodiment is an application example to animated image superimposition as shown in FIG. 5. The upper part of FIG. 5 shows an example of displaying an animated image superimposition of tsunami information accompanying an earthquake. The upper part of FIG. 5 shows a case where an animation is displayed in which a one-second large tsunami warning display, one-second wait (no warning or advisory), a one-second tsunami warning display, one-second wait, a one-second tsunami warning display, and one-second wait are repeated. If such an animation display is to be realized simply by exchanging files, in the case of a frame rate of 30 fps, a large number of files are required, such as 30 images for displaying a large tsunami warning, 30 images of only a map, and 30 images for displaying a tsunami warning, as shown in the lower part of FIG. 5.

In the second embodiment, the image included in the super file includes multiple partial images I41, I42, I43, and I44, as shown in FIG. 6. The partial images are images that can be combined to generate the required image super. For example, partial image I41 is an image of a map of Japan that forms the basis of the super. Partial image I42 is an image that represents a coastline that is the subject of a large tsunami warning. Partial image I43 is an image that represents a coastline that is the subject of a tsunami warning. Partial image I44 is an image that represents a coastline that is the subject of a tsunami advisory. Partial images I41, I42, I43, and I44 may be recorded in separate image files or in a single image file.

Furthermore, in the second embodiment, together with the superfile, a scenario file shown in FIG. 7 is also sent from the drawing device 20 to the supercompositing device 30. The scenario file has a header section H and a data section D.

The header section H records file attribute information and pointers. The file attribute information is various information indicating the attributes of the scenario file, such as the file name. The pointers are information indicating, for example, the start position of each piece of data in the data section D. In the example of Figure 4, six image supers are switched in sequence. Therefore, the pointers shown in Figure 7 have six pointers 1, 2, 3, 4, 5, and 6 that indicate the positions of the data for displaying each image super. Pointer 1 indicates the start position of data 1 in the data section D. Similarly, pointers 2, 3, 4, 5, and 6 indicate the start positions of data 2, 3, 4, 5, and 6 in the data section D, respectively.

Data section B records information indicating the combination of partial images and their display timing. For example, in FIG. 7, data 1 indicates that a one-second large tsunami warning will be displayed. Data 2 is blank, indicating that no warning or advisory will be displayed.

Figure 8 is a flowchart showing the processing of the super synthesis device 30 in the second embodiment. The processing in Figure 8 is performed during the drawing processing in Figure 3.

In step S11, the super synthesis device 30 determines whether or not a scenario file is recorded in the recording unit 31. If it is determined in step S11 that a scenario file is not recorded, the drawing process described in FIG. 3 is performed. That is, the drawing processing unit generates a super signal from the super file recorded in the recording unit 31. If it is determined in step S11 that a scenario file is recorded, the process proceeds to step S12.

In step S12, the drawing processing unit superimposes images according to the scenario file. The drawing processing unit sequentially refers to the pointers to identify the combination of partial images and their display timing, and generates an image superimposition by superimposing images according to the identified result. For example, when the drawing processing unit refers to pointer 1 and accesses data 1, the drawing processing unit generates 30 image superimpositions in which partial image I42 is superimposed on partial image I41. Similarly, for example, when the drawing processing unit refers to pointer 2 and accesses data 2, the drawing processing unit generates 30 image superimpositions using only partial image I41. The 30 image superimpositions are generated, for example, by copying one image superimposition. The 30 image superimpositions may be generated all at once, or may be generated one by one in accordance with the display timing. After that, the drawing processing described in FIG. 3 is performed. That is, the drawing processing unit generates a superimposition signal from the generated image superimpositions.

As described above, in the second embodiment, the drawing device 20 generates a file containing the partial images required to generate the image superimposition. This file is sent from the drawing device 20 to the superimposition device 30. The superimposition device 30 then generates the actual image superimposition according to the scenario file. This makes it possible to display animated superimpositions without having to exchange large amounts of files between the drawing device 20 and the superimposition device 30.

[Third embodiment]
Next, a third embodiment will be described. The third embodiment is an example of application to scroll-displayed character superimposition. Fig. 9 is a diagram showing an example of scroll-displayed characters. Fig. 9 shows an example of scroll-displayed superimposition of an earthquake report.

As shown in FIG. 9, when a character string that does not fit on one screen is displayed as a superimposition, the entire text is displayed while scrolling. If such character superimpositions were to be realized by exchanging files, a large number of files would be required, as in the second embodiment.

In the third embodiment, the super file is a text file T as shown in FIG. 10. That is, the scenario file T shown in FIG. 10 includes text data T1 of the entire character string of the superimposed text, and text data T2 indicating the scroll speed and display range of the superimposed text.

Figure 11 is a flowchart showing the processing of the super synthesis device 30 in the third embodiment. The processing of Figure 11 is performed during the drawing processing of Figure 3. Here, both the processing of Figure 11 and the processing of Figure 8 may be performed.

In step S21, the super synthesis device 30 determines whether or not a text file has been recorded as a super file in the recording unit 31. If it is determined in step S21 that a text file has not been recorded, the drawing process described in FIG. 3 is performed. That is, the drawing processing unit generates a super signal from the super file recorded in the recording unit 31. If it is determined in step S21 that a text file has been recorded, the process proceeds to step S22.

In step S22, the drawing processing unit converts the text data T1 contained in the text file into a character image. This character image is an image that includes all the characters represented by the text data. Note that the size of the character image is not limited by the size of the main line video signal. In other words, the size of the character image may be larger than the full size of the main line video signal.

In step S23, the drawing processing unit cuts out the necessary areas as text superimposition from the character image generated in step S22 in accordance with the text data T2 included in the text file. For example, as shown in FIG. 9, the drawing processing unit first cuts out the area of "27th, around 8:08 PM" from the image. Then, at the next display timing, the drawing processing unit cuts out the area of "7th, around 8:08 PM, XX" from the character image. This is the same for the following areas. After each area is cut out, the drawing processing described in FIG. 3 is performed. In other words, the drawing processing unit generates a superimposition signal from the cut-out text superimposition.

As described above, in the third embodiment, the drawing device 20 generates a file that contains the entire text data required to generate the superimposed text. This file is sent from the drawing device 20 to the superimposed text device 30. The superimposed text device 30 then generates the actual superimposed text according to the display range and scroll speed. This makes it possible to display scrolling superimposed text without having to exchange large amounts of files between the drawing device 20 and the superimposed text device 30.

The present invention is not limited to the above-described embodiment as it is, and in the implementation stage, the components can be modified and embodied without departing from the gist of the invention. In addition, various inventions can be formed by appropriately combining the multiple components disclosed in the above-described embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, components from different embodiments may be appropriately combined.

The processes according to the above-described embodiments can also be stored as a program that can be executed by, for example, the processor of the super synthesis device 30. Alternatively, they can be stored in a storage medium of an external storage device such as a magnetic disk, optical disk, or semiconductor memory and distributed. The processor can then read the program stored in the storage medium of the external storage device, and the processor's operation is controlled by the read program, thereby executing the above-described processes.

1 Broadcast master system, 10 Video server, 20 Drawing device, 21 Image file generation unit, 30 Super composition device, 31 Recording unit, 321, 322, ..., 32n Drawing processing unit, 331, 332, ..., 33n Super processing unit, 40 Output control device, 50 Transmitter.

Claims (5)

A superimposing device which receives a video signal from a video server as an SDI format signal, receives a superimposing file including superimposing information to be superimposed on the video signal from a drawing device in a text file format or an image file format, and superimposes the superimposing information on the video signal,
a recording unit for recording the super file sent from the drawing device;
a drawing processing unit that reads out the super file recorded in the recording unit and generates an SDI format super signal from the super file to be superimposed on the video signal;
a super signal processing unit that outputs the super signal by superimposing the super signal on the video signal ,
A superimposing device in which the number of drawing processing units and superimposing processing units is set corresponding to the number of superimposing units to be superimposed on the video signal . The super synthesis device according to claim 1, wherein the super information is information on only the effective area that needs to be superimposed. The superimposition information is an image superimposition including an image, the image including a plurality of partial images;
From the image creation device, scenario information indicating a combination of the partial images to be superimposed on the video signal and a display timing is further transmitted,
The super synthesis device according to claim 1 or 2 , wherein the drawing processing unit generates the super signal using the partial images of a combination specified by the scenario information at a display timing according to the scenario information . the superimposition information is a superimposition including characters, and character information including a display range of the characters and a scroll speed of the characters is further transmitted from the drawing device;
3. The super composition device according to claim 1, wherein the drawing processing unit converts the characters into a character image, and extracts the character image from the character image in accordance with the display range and the scroll speed to generate the super signal. A superimposing program readable by a computer of a superimposing device for inputting a video signal from a video server in an SDI format signal, inputting a superimposing file in a text file format or an image file format from a drawing device, the superimposing file including superimposing information to be superimposed on the video signal, and superimposing the superimposing information on the video signal, comprising:
recording a superimposition file sent from the drawing device, the superimposition file including superimposition information to be superimposed on the video signal, in a recording unit;
reading the superfile recorded in the recording unit, and generating an SDI format supersignal for superimposing the superinformation on the video signal from the superfile for each superfile;
outputting the super signal by superimposing the super signal on the video signal for each super signal;
A super synthesis program for causing the computer to execute the above.