JP2017063392A - Video processing device and video processing system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To securely reduce a temporal display deviation in the case of using a plurality of monitors.SOLUTION: A karaoke device 10 includes: a video output control circuit 54; an internal monitor 14 that performs video display based on a video signal; and a video input terminal 43 through which an imaging signal including an imaged external monitor 13 is input. A CPU 45 detects the external monitor 13's display delay with respect to the internal monitor 14 on the basis of an input result of the imaging signal; on the basis of the detected display delay, identifies a time difference with respect to a video signal to be output to the internal monitor 14; at first output timing, outputs a video signal from the video output control circuit 54, to the external monitor 13; and, at second output timing obtained by adding the time difference to the first output timing, outputs a video signal from the video output control circuit 54, to the internal monitor 14.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a video processing apparatus and a video processing system that perform predetermined processing on a generated video signal.

  A video processing apparatus that displays video on a plurality of monitors using a common video signal is already known (see, for example, Patent Document 1). In this video processing device (karaoke performance device), by managing the time difference (delay value) of the video display timing specific to each of the plurality of monitors, the temporal display deviation in the plurality of monitors is reduced and synchronized with each other. Display is performed.

JP 2010-262072 A (paragraphs 0048-0051 etc.)

  However, the following problems exist in the above-described conventional technology. That is, since the time difference fixed in advance for each of the plurality of monitors is used, for example, when using a monitor purchased by the user according to his / her preference or a monitor made by the user, the display deviation is reduced. It was difficult.

  An object of the present invention is to provide a video processing apparatus and a video processing system that can reliably reduce a temporal display shift when a plurality of monitors are used.

  In order to achieve the above object, a first invention is a video processing apparatus comprising: a video control circuit that generates a video signal; and an in-device monitor that performs video display based on the video signal. An imaging signal input unit that inputs an imaging signal captured by an external monitor that performs video display based on the display, and a display of the external monitor with respect to the internal monitor based on an input result of the imaging signal by the imaging signal input unit Delay detection means for detecting a delay; time difference calculation means for specifying a time difference relating to a video signal output from the video control circuit to the in-device monitor based on the display delay detected by the delay detection means; A first video signal output means for outputting the video signal from the video control circuit to the external monitor at an output timing; and the first output timing. Second video signal output means for outputting the video signal from the video control circuit to the in-device monitor at a second output timing to which the time difference specified by the time difference calculation means is given. It is characterized by that.

  In the first invention of the present application, based on a common video signal, a plurality of monitors (an in-device monitor provided in the video processing device and an external monitor provided outside the video processing device) display the same content video. Do. At that time, due to the difference in the characteristics of the two monitors and the difference in signal path length and transmission speed due to the difference between the inside and outside of the device as described above, temporal display deviation (display delay) between the monitors. May occur.

  Therefore, in the first invention of the present application, imaging is performed with respect to the monitor outside the apparatus, and the imaging signal is input by the imaging signal input means. Based on this input result, the delay detection means detects the display delay (delay generated with respect to the display of the internal monitor in the display of the external monitor), and further, the video output to the internal monitor based on this display delay The time difference to be given to the signal is specified by the time difference calculation means. Thus, after the video signal is output from the first video signal output means to the external monitor at a certain timing (first output timing), the second time is determined when the specified time difference elapses (second output timing). The video signal can be output from the two video signal output means to the in-device monitor. In this way, by outputting the video signal in the order of the monitor outside the apparatus → the monitor inside the apparatus with a time difference corresponding to the detected display delay, the temporal display deviation due to the above-described reason can be greatly reduced.

  In particular, by using the time difference specified based on the actual measurement through imaging as described above (instead of the time difference fixed in advance), for example, a monitor purchased by the user according to his / her preference or a monitor made by the user Even when using the above, the above-mentioned display deviation can be surely reduced.

  In a second aspect based on the first aspect, the imaging signal input means switches the external monitor from the first video display state to the second video display state based on the video signal for display delay detection. The first imaging signal before switching and the second imaging signal after switching are input, and the delay detection means is based on the input results of the first imaging signal and the second imaging signal by the imaging signal input means. The display delay is detected.

  In the second invention of this application, when the external monitor is switched from the first video to the second video using the video signal for display delay detection, the imaging signal input to the imaging signal input means by the imaging at that time is The first imaging signal is switched to the second imaging signal. Then, when the delay detection unit detects the display delay in response to this, the time difference calculation unit can calculate the time difference.

  In a third aspect based on the second aspect, the imaging signal input means sequentially inputs a plurality of the imaging signals generated by imaging the monitor outside the apparatus at a predetermined imaging interval, and the delay detection means Detects the display delay when the imaging signal sequentially input by the imaging signal input unit is switched from the first imaging signal to the second imaging signal, and the time difference calculating unit includes the time difference calculating unit, The time difference is specified using the display delay detected by the delay detection means and the imaging interval.

  In the third invention of the present application, the external monitor is imaged at a predetermined imaging interval. Then, triggered by the switching from the first imaging signal to the second imaging signal, the delay detection unit detects the display delay, and the time difference calculation unit calculates the corresponding time difference. By outputting the video signal in the order of the monitor outside the apparatus and the monitor inside the apparatus with the time difference calculated by such a method, the temporal display deviation can be surely made equal to or less than the imaging interval.

  According to a fourth aspect of the present invention, in any one of the first to third aspects of the present invention, the audio control circuit further controls an output of a sound source signal for reproducing karaoke music, and the external monitor is synchronized with the sound source signal. A background video corresponding to the karaoke music is displayed based on the video signal.

  Thereby, the shift | offset | difference of the background image | video displayed with the monitor inside an apparatus and a monitor outside an apparatus at the time of reproduction | regeneration of a karaoke music can be reduced reliably, and the convenience for a user can be improved.

  In order to achieve the above object, the fifth aspect of the present invention provides a device main body provided with a video control circuit for generating a video signal and an in-device monitor for displaying a video based on the video signal, and the device main body. And a video processing system comprising: at least one external monitor for displaying video based on the video signal; and a camera capable of imaging the at least one external monitor, wherein An imaging signal input unit that inputs an imaging signal of the at least one external monitor, and a display delay of the at least one external monitor with respect to the internal monitor based on an input result of the imaging signal by the imaging signal input unit Delay detection means for detecting, and a first output type for outputting the video signal from the video control circuit to the at least one external monitor. And a second output timing for outputting the video signal from the video control circuit to the in-device monitor, a time difference providing means for giving a time difference based on the display delay detected by the delay detecting means It is characterized by having.

  A sixth invention is the above-mentioned fifth invention, wherein a plurality of the outside monitors are provided, the imaging signal input means inputs imaging signals of the plurality of outside monitors by the camera, and the delay detection means , Based on the input result of the imaging signal by the imaging signal input means, the display delay of the plurality of external monitors with respect to the internal monitor is individually detected for each external monitor, and the time difference providing means is The time difference is individually determined for each external monitor between the first output timing of the video signal to the plurality of external monitors and the second output timing of the video signal to the internal monitor. It is characterized by giving.

  According to the present invention, it is possible to reliably reduce temporal display deviation when using a plurality of monitors.

It is explanatory drawing which shows the main structures of the karaoke apparatus concerning one Embodiment of this invention. It is a functional block diagram which shows the main structures of the control system of the control apparatus with which the karaoke apparatus was equipped. It is a flowchart which shows the processing content performed by CPU at the time of reproduction | regeneration of music data. It is explanatory drawing showing the example which has imaged the 1st image and 2nd image which were displayed on the external monitor 13 with the camera in the case of a display shift reduction process, respectively. It is explanatory drawing showing the technique principle of the detection of the display delay in the external monitor 13, and the identification of the time difference which should be given to the output of the video signal to the internal monitor 14 corresponding to this in a display shift reduction process. It is a flowchart which shows the processing content performed by CPU at the time difference specific processing. It is a flowchart showing the detailed procedure of step S40 when the flow of FIG. 3 is performed after a time difference is specified by a time difference specification process. It is explanatory drawing which shows the main structures of the karaoke apparatus in the modification which provided multiple external monitors. It is a functional block diagram which shows the main structures of the control system of the control apparatus with which the karaoke apparatus was equipped.

  Hereinafter, an embodiment in which the present invention is applied to a karaoke apparatus will be described with reference to the drawings.

<Main configuration>
FIG. 1 is an explanatory diagram showing the main configuration of the karaoke apparatus according to the present embodiment. As shown in FIG. 1, a karaoke apparatus 10 (corresponding to a video processing system) includes a control device 20, an amplifier 16, a floor type set of speakers 11 and 11, and a set of speakers for hanging the ceiling. 12, a remote controller 30 for remotely operating the control device 20, a floor-mounted (in this case, wall-mounted) monitor 13 in this example, and a monitor 14 incorporated in the housing 20A of the control device 20 And a camera 25 (details will be described later).

  The control device 20 is a server for request signals indicating the selection of music for karaoke (karaoke music; hereinafter referred to as “song” as appropriate), music selection control such as reservation of music playback, and the transmission request for the music selected. 58, and communication control such as reception of music data (corresponding to karaoke music data) corresponding to the music indicated by the request signal.

  The amplifier 16 includes a mixing circuit 9 (see FIG. 2 to be described later) that mixes the audio signal input from the microphone 17 and the reproduction signal of the music, and the volume balance between the audio and the music, echo adjustment, delay adjustment, Amplification of the mixing signal, pitch control (key control) of the tune to be played, control of treble and bass (tone control), etc.

  The speakers 11 and 12 reproduce the amplified signal output from the amplifier 16 as sound. A monitor 13 (corresponding to a monitor outside the apparatus; hereinafter referred to as “external monitor 13” as appropriate) displays a lyrics telop indicating lyrics, a background video displayed on the background of the lyrics telop, a video indicating a music selection number, and the like. A monitor 14 (corresponding to an in-apparatus monitor; hereinafter referred to as “internal monitor 14” as appropriate) displays an equivalent video (see illustration) with a video signal (described later) common to the external monitor 13. Note that the internal monitor 14 may be incorporated in the housing of the amplifier 16.

<Control system>
The configuration of the control system of the control device 20 will be described with reference to FIG. FIG. 2 is a functional block diagram showing the main configuration of the control system of the control device 20. The control device 20 includes a communication terminal 40 for connecting the LAN line 15 to the server 58, an audio output terminal 41 connected to the audio input terminal of the amplifier 16, and a video input terminal of the external monitor 13 (in this example, cable connection). The housing 20A includes a video output terminal 42 to be connected, the internal monitor 14, and a video input terminal 43 (corresponding to an imaging signal input means) connected to the camera 25.

  The control device 20 is provided with a CPU 45 that executes various controls according to the control program. The CPU 45 includes a RAM 46 for temporarily storing data transmitted from the remote controller 30, music selection number data indicating the music selection number of the selected music, music selection number data of the reserved music, a program executed by the CPU 45, and the like. A ROM 47 in which necessary data tables are stored is connected.

  The CPU 45 also has a video RAM 48 in which character video data for displaying lyrics telop and various message videos is stored on the external monitor 13 and the internal monitor 14, and music data, lyrics data, and video transmitted from the server 58. A LAN board 50 for receiving data and the like via the communication terminal 40; a hard disk (hereinafter referred to as HDD) 49 for temporarily storing music data and lyrics data received by the LAN board 50; Is connected.

  Further, a MIDI sound source board 51 and an audio control circuit 52 are connected to the CPU 45. The MIDI sound source board 51 inputs MIDI data included in the music data read from the HDD 49 and outputs a sound source signal from a sound source specified by the input MIDI data. The sound control circuit 52 receives the sound source signal output from the MIDI sound source board 51 and converts it into a signal that can be amplified by the amplifier 16.

  In addition, a video output control circuit 54 (corresponding to a video control circuit) and a video input control circuit 53 are connected to the CPU 45. The video output control circuit 54 inputs general background video data read from the HDD 49, song-specific background data, lyrics telop data included in the song data, and the like, and displays them on the external monitor 13 and the internal monitor 14. A video signal in which the lyrics telop is superimposed in the background video or a video signal that changes the color of the lyrics telop according to the progress of the song (common to the external monitor 13 and the internal monitor 1) is generated. Each is output to the internal monitor 14. At this time, the CPU 45 controls the output timing of the video signal to the internal monitor 14 to be delayed from the output timing of the video signal to the external monitor 13 (details will be described later). The video input control circuit 53 inputs an imaging signal of the camera 25 through the video input terminal 43 and outputs it to the CPU 45. The buffers 13a and 14a of the external monitor 13 and the internal monitor 14 will be described later.

  Further, the housing 20A of the control device 20 has a light receiving unit 38 that receives an optical signal from the remote controller 30, various buttons and keys 39 (tenkeys, music selection buttons, etc.), and when the various buttons and keys 39 are pressed. LED 37 that is lit on is provided. Correspondingly, the CPU 45 includes a conversion circuit 55 that converts an optical signal from the remote controller 30 received by the light receiving unit 38 into a digital signal, a display circuit 56 that outputs a display signal to the LED 37, and the various buttons. , And an input circuit 57 for inputting a switching signal generated when the key 39 is pressed.

  1 and 2, the control device 20 and the amplifier 16 correspond to the karaoke device main body described in each claim and also to the video processing device.

<Basic processing when playing karaoke music>
Processing contents executed by the CPU 45 of the karaoke apparatus 10 when the user reproduces karaoke music as described above will be described with reference to the flowchart of FIG.

  In FIG. 3, this flow is started when, for example, the user presses the power button of the control device 20 of the karaoke device 10 to turn on the power of the control device 20. In conjunction with the rising of the power supply of the control device 20, the power supply of the amplifier 16, the external monitor 13, and the internal monitor 14 is started up.

  First, in step S10, the CPU 45 determines whether or not the music selection by the user is finished. In the music selection, for example, when the user inputs the music selection number of the music that the user wants to sing with the numeric keypad of the remote controller 30 and presses the music selection button, the music selection ends. Until the music selection is completed, the determination in step S10 is not satisfied (step S10: NO), and a loop standby is performed. When the music selection is completed, the determination in step S10 is satisfied (step S10: YES), and the process proceeds to step S15.

  In step S15, the CPU 45 temporarily stores music selection number data indicating the music selection number in the RAM 46 corresponding to the music selection result in step S10, and transmits the music data corresponding to the music selection number via the LAN board 50. Is sent to the server 58 via the LAN line 15. Thereby, the server 58 stores the music data corresponding to the music selection number indicated in the request signal, the chord information corresponding to the music data, the chord score information, the lyrics data, and the data from a storage device (not shown). The video data is searched and read out, and the read music data and the like are transmitted to the control device 20 via the LAN line 15. When step S15 ends, the process proceeds to step S20.

  In step S <b> 20, the CPU 45 receives music data and the like transmitted from the server 58 via the LAN line 15 via the LAN board 50. Thereafter, the process proceeds to step S25.

  In step S25, the CPU 45 temporarily stores the music data received in step S20 in the HDD 49. Thereafter, the process proceeds to step S30.

  In the processes in steps S15, S20, and S25, the music data associated with the music selection number is processed on demand from the server 58 for each music selection. In addition to this method, music data or the like is stored in advance in a large-capacity auxiliary storage means (for example, the HDD 49) in the control device 20 of the karaoke apparatus 10, and the music associated with the music selection number for each music selection. Processing corresponding to Step S15, Step S20, and Step S25 of reading information groups such as data (MIDI data) from the auxiliary storage means and acquiring the target information may be performed.

  In step S30, the CPU 45 starts reading the MIDI data, which is the music data stored in the HDD 49 in step S25, and writes the read MIDI data to the MIDI tone generator board 51. When step S30 ends, the process proceeds to step S35.

  In step S35, the MIDI data is reproduced. That is, the CPU 45 outputs a control signal to the MIDI sound source board 51 and causes the MIDI sound source board 51 to output a sound source signal corresponding to the MIDI data written in step S30. The sound source signal output from the MIDI sound source board 51 is output to the sound control circuit 52 and converted into a music signal that can be amplified by the amplifier 16, and the converted music signal is transmitted from the sound output terminal 41 to the amplifier 16. Is output. Also, the audio signal input from the microphone 17 by the user's singing is mixed with the music signal in the mixing circuit 9 built in the amplifier 16. The mixed signal thus mixed is amplified by an amplifier circuit (not shown) built in the amplifier 16 and then output to the speaker 11 and the speaker 12, and is emitted from both the speakers 11 and 12. When step S35 ends, the process proceeds to step S40.

  In step S40, the CPU 45 outputs a video signal to the external monitor 13 in synchronization with the reproduction of the MIDI data in step S35 (in other words, the output of the sound source signal) (the time difference Δ described later for the internal monitor 14). The video signal is output after being delayed by T. Details will be described later, and the lyrics and the like stored in step S25 are displayed on the external monitor 13 and the internal monitor 14. Thereby, the user can enjoy singing while watching the lyrics displayed on the external monitor 13 and the internal monitor 14. The detailed procedure of step S40 will be described later. Thereafter, the process proceeds to step S80.

  In step S80, the CPU 45 determines whether or not the reproduction of the music data has been completed (in other words, whether or not the reading of the MIDI data in step S30 has been completed up to the last MIDI data of the music data). If the reproduction of the music data is finished, the determination is satisfied (step S80: YES), and this flow is finished. Until the reproduction of the music data is completed, the determination is not satisfied (step S80: NO), the process returns to step S30, and the procedure of steps S30 to S80 is repeated.

<Features of this embodiment>
In the above, the feature of this embodiment is the processing of the video signal output to the external monitor 13 and the internal monitor 14. Hereinafter, the details will be described in order.

<Display misalignment>
In the karaoke apparatus 10 of the present embodiment, as described above, the external monitor 13 and the internal monitor 14 are the same based on the common (= same content) video signal output from the video output control circuit 54. Display the video content. The external monitor 13 is provided with a buffer 13a (see FIG. 2), and after the video signal is temporarily stored in the buffer 13a, a corresponding display is performed. Similarly, the internal monitor 14 is provided with a buffer 14a, and after the video signal is temporarily stored in the buffer 14a (see FIG. 2), a corresponding display is performed. At that time, the difference between the characteristics of the monitors (for example, the capacities of the buffers 13a and 14a, etc.), and further, the arrangement location of the internal monitor 14 in the housing 20A of the control device 20 and the external monitor 13 outside the control device 20 The display delay (temporal display shift) may occur due to the difference in the signal path length (in other words, the difference in the signal transmission speed) due to the difference between the display and the display on the external monitor 13 that is delayed from the display on the internal monitor 14. is there.

<Reduction of display deviation>
Therefore, in the present embodiment, before being used by the user as the karaoke apparatus 10 as described above (for example, a predetermined operation performed by a construction company installing the apparatus or a sales company operating using the apparatus) The process for reducing the display deviation (hereinafter, as appropriate, the display deviation reduction process) is performed. The outline of the processing will be described with reference to FIGS.

  That is, when the common video signal is output to the internal monitor 14 and the external monitor 13 for display as described above, the screen of the external monitor 13 (that is, the display content) is imaged by the camera 25, and the imaging signal is This is input to the video input control circuit 54 via the video input terminal 43. Based on this input result, the display delay (delay generated with respect to the display of the internal monitor 14 in the display of the external monitor 13) is detected.

  Specifically, first, a video signal (a yellow video signal in this example) for displaying the first video Ye (a video whose entire surface is yellow in this example; see FIG. 4A) is displayed on the internal monitor 14 and Simultaneously output to the external monitor 13. Thereafter, when a predetermined period (for example, 1 second) elapses, a video signal (in this example, a red video signal) for displaying the second video Re (in this example, a video whose entire surface is red in color, see FIG. 4B). Are simultaneously output to the internal monitor 14 and the external monitor 13. At this time, in this embodiment, since the internal monitor 14 is in the control device 20, there is almost no display delay due to the difference in the buffer 14a or the signal path length, while the external monitor 13 is outside the control device 20 and is A display delay (larger than the internal monitor 14) due to the difference in signal path length and the buffer 13a occurs. Therefore, when the yellow video signal → the red video signal is switched as described above, the display on the internal monitor 14 is switched almost simultaneously from the first video Ye → the second video Re, but the display on the external monitor 14 is switched accordingly. Is switched from the first video Ye to the second video Re with a certain delay.

  Therefore, before and after switching from the yellow video signal to the red video signal, (1) when the yellow video signal is output: both the internal monitor 14 and the external monitor 13 display yellow (first video Ye), and (2) the red video signal. Immediately after switching: the internal monitor 14 displays red (second video Re), the external monitor 13 displays yellow (first video Ye), and (3) when more time has elapsed since switching to the red video signal: yellow video signal output Time: Both the internal monitor 14 and the external monitor 13 have a display behavior such as red display (second image Re). The yellow video signal and the red video signal correspond to the display delay detection video signal described in each claim.

  The camera 25 intermittently captures the display content of the external monitor 13 based on this display behavior at a predetermined frame rate f (the number of frames of the imaging screen per second, which corresponds to the imaging interval). Then, the CPU 45 detects the display delay based on the corresponding imaging signals.

  That is, as shown in FIG. 5A, the imaging result (that is, the display content of the external monitor 13) input at each frame rate f and the video signal output to the internal monitor 14 and the external monitor 13 are displayed. The CPU 45 determines whether the content (in other words, the content displayed on the internal monitor 14) matches or does not match. In the example shown in the figure, after the yellow video signal is output, the display is not yet performed on the external monitor 13 due to the display delay at the first imaging (refer to the circled numbers, the same applies hereinafter) and at the second imaging. . Therefore, the determination results are inconsistent (indicated by “x” in the figure). After that, at the time of the third imaging, as a result of the yellow image Ye being displayed on the external monitor 13, the determination results are the same for the first time (represented by “◯” in the figure). In this embodiment, the count of the check counter ck is started when the first match is made in this way, and ck = 1 is set. Thereafter, even during the fourth imaging (when ck = 2), the determination results continue to match (marked with “◯” in the figure) as described above.

  Then, after the fourth imaging, the video signal output to the internal monitor 14 and the external monitor 13 is switched from the yellow video signal to the red video signal. Then, at the time of the fifth imaging immediately after that (ck = 3), the yellow image Ye is still displayed on the external monitor 13 due to the display delay, and as a result, the determination results again become inconsistent (see FIG. Medium “×”). In the present embodiment, the check counter value (ck = 3 in this example) when a mismatch occurs for the first time after the count of the check counter ck is started is substituted into the variable A. Thereafter, even at the time of the sixth imaging (ck = 4), the determination results continue to be inconsistent (marked with “X” in the figure) as described above. Note that the image pickup signal of the camera 25 that picks up the yellow image Ye of the external monitor 13 corresponds to the first image pickup signal recited in each claim.

  After that, at the time of the seventh imaging, as a result of the red video Re being displayed on the external monitor 13, the determination results coincide again (represented by “◯” in the figure). In this embodiment, after starting the counting of the check counter ck in this way, the check counter value (in this example, ck = 5) when the determination results coincide again is substituted into the variable B. Thereafter, even at the time of the eighth imaging (ck = 6), the determination results are the same (marked with “◯” in the figure) as described above. Note that the image pickup signal of the camera 25 that picks up the red image Re of the external monitor 13 corresponds to the second image pickup signal described in each claim.

As can be seen from the above, B−A, which is the difference between B and A in accordance with the coincidence / non-coincidence when imaging at the frame rate f, is a display delay that occurs in the actual external monitor 13. It corresponds to the size of. Therefore, in the present embodiment, the output timing of the video signal to the internal monitor 14 is adjusted in order to reduce the display shift that occurs between the external monitor 13 and the internal monitor 14 due to the display delay. That is, the time difference ΔT to be given from the timing when the video signal is output to the external monitor 13 to the timing when the video signal is output to the internal monitor 14 is
ΔT = f × (BA) (1)
To specify (calculate). Then, the video signal is output to the internal monitor 14 after the calculated time difference ΔT has elapsed from the timing at which the video signal is output to the external monitor 13, as shown in FIG. The display delay generated in the external monitor 13 can be reduced (at least smaller than the frame rate f).

  In the above, for the detection of the display delay, an image whose entire surface is yellow is displayed as the first video Ye, and an image whose entire surface is red is displayed as the second video Re. Not limited. That is, other colors that can be distinguished at the time of switching, such as other different colors, may be used. Further, the present invention is not limited to an aspect in which the entire surface has a specific color, and a predetermined pattern or pattern may be used. In any case, it is sufficient if the video screen before switching and the video screen after switching can be identified by imaging of the camera 25.

  Further, in the karaoke apparatus 10, when a known camera for capturing a movie of a user singing and posting it to the server 58 is provided, the camera for capturing the movie is used as the camera 25. May be.

<Time difference identification processing>
The contents of the process (time difference specifying process) executed by the CPU 45 to realize the above method will be described with reference to the flowchart of FIG.

  First, in step S100, the values of the check counter ck, variable A, and variable B (which will be described later) are initialized to zero.

  In step S105, the CPU 45 controls the video output control circuit 54 to start outputting a common video signal (preset to be switched after a predetermined period as described above) to the external monitor 13 and the internal monitor 14. To do.

  Thereafter, the process proceeds to step S110, where the CPU 45 controls the video input control circuit 54, and inputs an imaging signal obtained by the camera 25 imaging the external monitor 13.

  In step S115, based on the input result in step S110, the CPU 45 displays the color of the screen displayed on the external monitor 13 as the video signal output from the video output control circuit 54 at this time. It is determined whether or not it matches the color of the screen. If they do not match, the determination in step S115 is not satisfied (S115: NO), and the process returns to step S110 and the same procedure is repeated. If they match, the determination in step S115 is satisfied (S115: YES), and the process proceeds to step S120.

  In step S120, the value of the check counter ck is set to 1. Thereafter, the process proceeds to step S125.

  In step S125, as in step S110, the CPU 45 controls the video input control circuit 54 and inputs an imaging signal obtained by the camera 25 imaging the external monitor 13.

  Thereafter, in step S130, the CPU 45 adds 1 to the value of the check counter ck, and proceeds to step S135.

  In step S135, based on the input result in step S125, the CPU 45 should display the color of the screen displayed on the external monitor 13 as the video signal output from the video output control circuit 54 at this time. It is determined whether or not there is a mismatch with the screen color. If they match, the determination in step S135 is not satisfied (S135: NO), and the process returns to step S125 and the same procedure is repeated. If not, the determination in step S135 is satisfied (S135: YES), and the process proceeds to step S140.

  In step S140, the CPU 45 substitutes the value of the check counter ck at this time for the variable A. Thereafter, the process proceeds to step S145.

  In step S145, as in steps S110 and S125, the CPU 45 controls the video input control circuit 54, and inputs an image signal obtained by the camera 25 imaging the external monitor 13.

  Thereafter, in step S150, the CPU 45 adds 1 to the value of the check counter ck as in step S130, and proceeds to step S155.

  In step S155, as in step S115, based on the input result in step S145, the CPU 45 determines that the screen color displayed on the external monitor 13 is the video output from the video output control circuit 54 at this time. It is determined whether or not it matches the color of the screen to be displayed by the signal. If they do not match, the determination in step S155 is not satisfied (S155: NO), and the process returns to step S145 and the same procedure is repeated. If they match, the determination at step S155 is satisfied (S155: YES), and the routine goes to step S160.

  In step S160, the CPU 45 substitutes the value of the check counter ck at this time for the variable B. Thereafter, the process proceeds to step S165.

  In step S165, the CPU 45 controls the video output control circuit 54, and ends the output of the common video signal started in step S105 to the external monitor 13 and the internal monitor 14. In addition, CPU45 which performs said step S100-step S165 functions as a delay detection means as described in each claim.

  Thereafter, the process proceeds to step S170, where the frame rate f (predetermined) at the time of photographing with the camera 25 described above, the value of the variable A substituted in step S140, and the variable B substituted in step S160 are set. The time difference ΔT to be given from the timing when the video signal is output to the external monitor 13 to the timing when the video signal is output to the internal monitor 14 is specified (calculated) by the above formula (1). To do.

  Thereafter, in step S175, when the video signal is output in step S40 when the karaoke piece data is played according to the flow of FIG. 3, the internal monitor 14 starts from the timing of outputting the video signal to the external monitor 13. The time difference until the video signal output timing is set to ΔT specified (calculated) in step S170, and this flow is ended. Note that the CPU 45 that executes the above steps S170 and S175 functions as a time difference calculating unit described in each claim and also functions as a time difference providing unit.

<Detailed settings for video signal output>
As described above, after the time difference ΔT is set in the time difference specifying process of FIG. 6, the video signal is output to the external monitor 13 when the video signal is output in step S40 in the flow of FIG. After that, the video signal is output to the internal monitor 14. The detailed procedure of step S40 is shown in FIG.

  In FIG. 7, first, in step S <b> 40 a, the CPU 45 controls the video output control circuit 54 and outputs a video signal for representing the lyrics and the like stored in step S <b> 25 to the external monitor 13. The CPU 45 executing step S40a functions as the first video signal output means described in each claim, and the execution timing of step S40a corresponds to the first output timing described in each claim.

  Thereafter, in step S40b, the CPU 45 determines whether or not ΔT described above has elapsed after the output of the video signal in step S40a. If ΔT has not elapsed, the determination in step S40b is not satisfied (S40b: NO), and a loop is waited for. When ΔT has elapsed, the determination in step S40b is satisfied (S40b: YES), and the process proceeds to step S40c.

  In step S40c, the CPU 45 controls the video output control circuit 54 to supply the internal monitor 14 with a video signal (in terms of content, equivalent to the signal output in step S40a) for expressing the lyrics stored in step S25. Output. The CPU 45 executing step S40c functions as the second video signal output means described in each claim, and the execution timing of step S40c corresponds to the second output timing described in each claim. Thereafter, this routine is ended, and the process proceeds to step S80 in FIG.

  In the above description, the output timing of the video signal to the external monitor 13 is not delayed, but only the output timing of the video signal to the internal monitor 14 is delayed by the time difference ΔT. It is not limited to this. That is, while delaying both the output timing of the video signal to the external monitor 13 and the output timing of the video signal to the internal monitor 14, the time difference between the delay timings may be set to ΔT. In this case, the same effect can be obtained.

<Effect of embodiment>
As described above, in the present embodiment, imaging with respect to the external monitor 13 is performed by the camera 25. Based on the input result of the imaging signal, a display delay that occurs with respect to the display on the internal monitor 14 is detected in the display on the external monitor 13, and is further added to the video signal output to the internal monitor 14 based on this display delay. A power time difference ΔT is specified (see step S170 and step S175). Thus, after the video signal is output to the external monitor 13, the video signal is output to the internal monitor 14 at the timing when the time difference ΔT has elapsed (see Step S40a and Step S40c). In this way, by outputting the video signal in the order of the external monitor 13 → the internal monitor 14 with the time difference ΔT commensurate with the detected display delay, the temporal display deviation due to the above-described reason can be greatly reduced. it can.

  In particular, at this time, by using the time difference ΔT specified based on the actual measurement through imaging as described above instead of the time difference fixed in advance, for example, a monitor or user purchased by the user according to his / her own preference Even when a self-made monitor is used as the external monitor 13, the display deviation can be reliably reduced.

  In the present embodiment, the display on the external monitor 13 is changed from the first video Ye to the second video Re using the video signal for detecting the display delay (yellow video signal and red video signal in the above example) (described above). In the example, switching from yellow video to red video) causes the imaging signal from the camera 25 at that time to switch from an imaging signal obtained by imaging the yellow video Ye to an imaging signal obtained by imaging the red video Re. Then, when the display delay is detected in response to this, the time difference ΔT can be specified.

  In the present embodiment, in particular, the external monitor 13 is imaged by the camera 25 at a certain predetermined frame rate (for example, 0.017 seconds). Then, the display delay is detected in response to the switching of the imaging signal, and the corresponding time difference ΔT is specified. By outputting the video signal in the order of the external monitor 13 → the internal monitor 14 with the time difference ΔT specified by such a method, the temporal display deviation can be reliably made equal to or less than the frame rate.

  In the present embodiment, in particular, the internal monitor 14 displays a background video corresponding to karaoke music based on the video signal (see step S40) output in synchronization with the sound source signal output from the MIDI sound source board 51. indicate. Thereby, the shift | offset | difference of the background image | video displayed on the internal monitor 14 and the external monitor 15 at the time of reproduction | regeneration of karaoke music can be reduced reliably, and the convenience for a user can be improved.

  Specifically, in the karaoke apparatus 10, the playback timing of karaoke music and the video signal output timing of the internal monitor 14 are matched in advance. Therefore, when the karaoke apparatus 10 detects the connection of the external monitor 13 (if the video output terminal 42 detects the connection of the external monitor 13 if the video output terminal 42 is HDMI (registered trademark)), the above-described implementation is performed. After the method according to the form is executed, the display timing of the internal monitor 14 changes by the time difference ΔT. Accordingly, in response to this, the CPU 10 as the control means of the karaoke apparatus 10 detects the connection of the external monitor 13 via the video output terminal 42 (or the user connects the connection of the external monitor 13 via the key 39). The voice control circuit 52 is controlled so that the playback timing of the karaoke music piece is also played back after the lapse of the time difference ΔT at the timing when step S175 is executed. Thereby, even when the external monitor 13 is connected to the karaoke apparatus 10, the progress of the karaoke performance sound from the audio output terminal 43 and the video from the internal monitor 14 and the external monitor 13 before and after the connection are established. It is possible to reduce the influence of the progress of the signal and the deviation of the progress of each other.

  The present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the spirit and technical idea of the present invention. Hereinafter, such modifications will be described in order.

(1) When there are a plurality of external monitors That is, as shown in FIG. 8 corresponding to FIG. 1 and FIG. 9 corresponding to FIG. 2, a plurality of external monitors 13 (in this example, two, the same applies hereinafter). , 13 'may be provided. In this case, in the external monitor 13 ′, a display delay larger than that of the external monitor 13 may occur due to the above-described difference in signal path length, the function of the buffer 13a ′, and the like. Accordingly, the time difference specifying process shown in the flow of FIG. 6 is individually executed for each of the external monitors 13 and 13 ′ (each external monitor 13 and 13 ′ is imaged by one camera 25), and each of the external monitors 13 and 13 ′ is detected. Based on the display delay, the time difference Δ (which is different between the external monitor 13 and the external monitor 13 ′) is specified by the above-described method, and the images to the external monitors 13 and 13 ′ in step S40 in FIG. At the time of signal output, the specified time difference Δ may be individually applied to output a video signal. Also in this case, the same effect as the above embodiment is obtained.

(2) Others In the above, the flowcharts shown in FIG. 3, FIG. 6, FIG. 7 and the like do not limit the present invention to the procedure shown in the above-described flow, and the procedure is not deviated from the spirit and technical idea of the invention. You may add / delete or change the order.

  In addition to those already described above, the methods according to the above-described embodiments and modifications may be used in appropriate combination.

  In addition, although not illustrated one by one, the present invention is implemented with various modifications within a range not departing from the gist thereof.

10 Karaoke equipment (video processing system)
13 External monitor (monitor outside equipment)
14 Internal monitor (in-device monitor)
16 amplifier 20 control device 20A housing 25 camera 43 video input terminal (imaging signal input means)
45 CPU
54 Video output control circuit (Video control circuit)

Claims (6)

A video control circuit for generating a video signal;
An in-device monitor that performs video display based on the video signal;
A video processing apparatus comprising:
An imaging signal input means for inputting an imaging signal obtained by imaging an external monitor that performs video display based on the video signal;
Delay detection means for detecting a display delay of the external monitor with respect to the in-apparatus monitor based on the input result of the imaging signal by the imaging signal input means;
A time difference calculating means for specifying a time difference relating to a video signal output from the video control circuit to the in-device monitor based on the display delay detected by the delay detecting means;
First video signal output means for outputting the video signal from the video control circuit to the external monitor at a first output timing;
Second video signal output means for outputting the video signal from the video control circuit to the in-device monitor at a second output timing obtained by adding the time difference specified by the time difference calculation means to the first output timing. When,
A video processing apparatus comprising: The video processing apparatus according to claim 1,
The imaging signal input means includes
The first imaging signal before switching and the second imaging signal after switching when the external monitor switches from the first video display state to the second video display state based on the video signal for display delay detection. type in,
The delay detection means includes
The video processing apparatus, wherein the display delay is detected based on input results of the first and second imaging signals by the imaging signal input means. The video processing apparatus according to claim 2, wherein
The imaging signal input means includes
A plurality of the imaging signals generated by imaging the external monitor at a predetermined imaging interval are sequentially input,
The delay detection means includes
The display delay is detected when the imaging signal sequentially input by the imaging signal input means is switched from the first imaging signal to the second imaging signal,
The time difference calculating means includes
The video processing apparatus characterized in that the time difference is specified by using the display delay detected by the delay detection means and the imaging interval. The video processing apparatus according to any one of claims 1 to 3,
A voice control circuit for controlling the output of a sound source signal for playing karaoke music;
The outside monitor is
A video processing apparatus that displays a background video corresponding to the karaoke song based on the video signal synchronized with the sound source signal. An apparatus main body provided with an image control circuit for generating an image signal, and an in-apparatus monitor for displaying an image based on the image signal, in a housing;
At least one external monitor that is provided separately from the device main body and displays video based on the video signal;
A camera capable of imaging the at least one external monitor;
A video processing system comprising:
Imaging signal input means for inputting an imaging signal of the at least one external monitor by the camera;
Delay detection means for detecting a display delay of the at least one external device monitor with respect to the in-device monitor based on an input result of the imaging signal by the imaging signal input device;
Between a first output timing for outputting the video signal from the video control circuit to the at least one external monitor and a second output timing for outputting the video signal from the video control circuit to the internal monitor. A time difference giving means for giving a time difference based on the display delay detected by the delay detecting means,
A video processing system comprising: The video processing system according to claim 5, wherein
A plurality of the outside monitors are provided,
The imaging signal input means includes
Input imaging signals of the plurality of external monitors by the camera,
The delay detection means includes
Based on the input result of the imaging signal by the imaging signal input means, the display delay of the plurality of external monitors with respect to the internal monitor is individually detected for each external monitor,
The time difference giving means is
The time difference is individually determined for each external monitor between the first output timing of the video signal to the plurality of external monitors and the second output timing of the video signal to the internal monitor. A video processing system characterized by providing the information.

Images