WO2010134482A1 - 動画像再生システムおよび動画像再生方法 - Google Patents
動画像再生システムおよび動画像再生方法 Download PDFInfo
- Publication number
- WO2010134482A1 WO2010134482A1 PCT/JP2010/058266 JP2010058266W WO2010134482A1 WO 2010134482 A1 WO2010134482 A1 WO 2010134482A1 JP 2010058266 W JP2010058266 W JP 2010058266W WO 2010134482 A1 WO2010134482 A1 WO 2010134482A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- data
- moving image
- communication
- synchronization signal
- vertical synchronization
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G5/006—Details of the interface to the display terminal
- G09G5/008—Clock recovery
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/4104—Peripherals receiving signals from specially adapted client devices
- H04N21/4122—Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2370/00—Aspects of data communication
- G09G2370/16—Use of wireless transmission of display information
Definitions
- the present invention relates to a technique for transmitting data representing a moving image by communication and reproducing (displaying) the moving image on the receiving side. More specifically, the present invention relates to a technique for suppressing a delay time generated on the receiving side.
- Moving image reproduction is realized by sequentially displaying still images (frames) at regular time intervals (hereinafter referred to as “frame intervals”) in an image reproduction apparatus such as a display.
- the play screen is a real-time moving image created according to the operation of the player. And even if this play screen itself is played back at a fixed frame interval (even if the play screen itself is played smoothly and continuously), if it is displayed with a delay from the player's operation, the player Operation feels uncomfortable and operability decreases. That is, in a specific technical field, it is not sufficient that the moving image is simply played back continuously on the playback side, and real-time performance when playing back the moving image is further required.
- the conventional technique has a problem in that a signal for determining the timing for creating a moving image frame is not synchronized with a signal for determining the timing for reproducing a moving image frame.
- FIG. 26 is a diagram for explaining a conventional technique.
- T indicates the frame interval
- Fa and Fb indicate the time required for processing the frame data of the frames FA and FB, respectively.
- Processing here refers to processing for creating frame data, processing for compressing and encoding frame data, communication processing for transmitting / receiving frame data from the creation side to the playback side, processing for decoding frame data on the playback side, etc. Is included.
- the “time required for processing” is the time from when the creation of frame data is started until the frame data can be reproduced (displayed).
- D1” and “D2” indicate the delay times of the frames FA and FB, respectively.
- the vertical synchronization signal at the time of moving image creation is a signal indicating the creation timing of each frame data, and each frame data is created at the time when the vertical synchronization signal is turned on. That is, the creation of the frame FA is started at time t1, and when the time Fa elapses, the frame FA can be displayed at time T1. On the other hand, the creation of the frame FB is started at time t2, and when the time Fb elapses, the frame FB can be displayed at time T2.
- the frame that can be displayed is played back when the vertical synchronization signal at the time of moving picture playback is turned on. Therefore, the frame FA is reproduced at the time (time ⁇ 1) when the vertical synchronization signal during moving image reproduction is turned on after time T1, and the delay time is the time from time t1 to ⁇ 1 (delay time D1). On the other hand, the frame FB is reproduced at the time (time ⁇ 3) when the vertical synchronization signal at the time of moving image reproduction is turned on after time T2, and the delay time is the time from time t2 to ⁇ 3 (delay time D2). As is apparent from FIG. 26, the delay time D2 is larger than the delay time D1.
- the vertical synchronization signal at the time of reproduction is turned on immediately after all the processing for one frame data is completed. It is desirable to become. In other words, it is ideal that the reproduction timing comes when the preparation for reproducing the frame data is completed.
- the vertical synchronization signal when creating a moving image and the vertical synchronization signal when reproducing the moving image are not synchronized. Therefore, as in the example of the frame FB shown in FIG. 26, the relationship between the vertical synchronization signal at the time of creation and the vertical synchronization signal at the time of reproduction is such that the reproduction timing arrives immediately before the frame data is ready for reproduction. There is a problem that the delay time increases (there is a problem that so-called jitter occurs).
- the present invention has been made in view of the above problems, and aims to improve the real-time property by reducing the delay time of a reproduced moving image in a technique for transmitting and reproducing moving image data by communication.
- the invention of claim 1 is characterized in that the communication clock provided in the transmission means for transmitting communication data and the communication clock provided in the reception means for receiving the communication data are synchronized with the transmission means.
- a moving image reproduction system for reproducing a moving image while transmitting / receiving moving image data representing a moving image to / from the receiving unit, wherein a first vertical synchronization signal is received according to a communication clock of the transmitting unit.
- the transmission means includes start timing data indicating a start timing of creation of the moving image data by the image creation means and the image creation means.
- a second signal for transmitting the received moving image data as communication data and generating a second vertical synchronization signal in accordance with the start timing data received as communication data by the receiving means and the communication clock of the receiving means Based on the moving image data received as communication data by the generating unit and the receiving unit, the frame data included in the moving image data is displayed according to the second vertical synchronization signal generated by the second signal generating unit.
- the image processing apparatus further includes image reproduction means for reproducing a moving image represented by the moving image data.
- the invention of claim 2 is the moving picture reproduction system according to the invention of claim 1, wherein the transmission means transmits the communication data of the start timing data and the communication data of the moving picture data as separate communication data. It is characterized by transmitting as.
- the invention of claim 3 is the moving picture reproduction system according to the invention of claim 2, wherein the transmission means sets the priority of the communication data of the start timing data to the priority of the communication data of the moving picture data. It is characterized by transmitting while setting higher than the rank.
- a moving image for reproducing the moving image while transmitting / receiving moving image data representing a moving image between a transmitting unit for transmitting communication data and a receiving unit for receiving the communication data.
- An image reproduction system that expresses a moving image by creating first signal generating means for generating a first vertical synchronizing signal and frame data in accordance with the first vertical synchronizing signal generated by the first signal generating means.
- Image creating means for creating moving image data, and the transmitting means transmits frame timing data indicating the timing of starting creation of each frame data by the image creating means and the moving image data as communication data
- a second signal generator for generating a second vertical synchronization signal in accordance with the frame timing data received as communication data by the receiving means.
- an image reproducing means for reproducing the moving image to be reproduced.
- the invention of claim 5 is the moving picture reproduction system according to the invention of claim 4, wherein the transmission means transmits the communication data of the frame timing data and the communication data of the moving picture data as separate communication data. It is characterized by transmitting as.
- the invention of claim 6 is the moving picture reproduction system according to the invention of claim 5, wherein the transmitting means sets the priority of the communication data of the frame timing data to the priority of the communication data of the moving picture data. It is characterized by transmitting while setting higher than the rank.
- the invention according to claim 7 is the moving image reproduction system according to the invention of claim 4, wherein the moving image data received as communication data by the receiving means is also used as the frame timing data, and the second signal
- the generating means generates a second vertical synchronizing signal in accordance with the reception timing of the moving image data.
- the invention according to claim 8 is the moving image reproduction system according to the invention of claim 7, wherein the moving image data used as the frame timing data is data at a head portion of the moving image data.
- the ninth aspect of the present invention is the moving image reproduction system according to the fourth aspect of the present invention, wherein the image reproduction means is configured to change the moving image even if the number of clocks per frame in the second vertical synchronization signal is changed.
- Frame data included in the data can be displayed, and the second signal generation unit controls the second vertical synchronization signal by increasing or decreasing the number of clocks for each frame in the second vertical synchronization signal. It is characterized by producing
- the invention of claim 10 is the moving image reproduction system according to the invention of claim 4, further comprising a transmission side timer and a reception side timer, wherein the frame timing data includes a value of the transmission side timer,
- the second signal generating means generates a second vertical synchronization signal in accordance with a value of the transmitting timer and a value of the receiving timer included in the frame timing data.
- the invention of claim 11 is a moving image reproducing method for reproducing a moving image, wherein (a) a step of synchronizing a communication clock of a transmitting means and a communication clock of a receiving means, and (b) said (a) A step of generating a first vertical synchronization signal in accordance with a communication clock of the transmission means after executing the step; and (c) a moving image representing a moving image by generating frame data in accordance with the first vertical synchronization signal.
- a step of creating data and (d) a step of transmitting start timing data indicating the timing of starting creation of moving image data and the moving image data as communication data to the receiving unit by the transmitting unit; e) receiving the communication data transmitted by the transmitting means by the receiving means; and (f) the communication clock of the receiving means and the start data received as communication data by the receiving means.
- Generating a second vertical synchronizing signal according to the ming data and (g) displaying frame data included in the moving image data received as communication data by the receiving means according to the second vertical synchronizing signal.
- a step of reproducing a moving image represented by the moving image data and
- a moving image reproducing system for reproducing moving images, wherein (a) a step of generating a first vertical synchronizing signal, and (b) generating frame data in accordance with the first vertical synchronizing signal.
- the communication clock included in the transmission unit that transmits communication data and the communication clock included in the reception unit that receives communication data are synchronized between the transmission unit and the reception unit.
- a moving image reproduction system that reproduces a moving image while transmitting / receiving moving image data representing a moving image, the start timing data indicating the timing of starting the creation of moving image data by the image creating unit and the image creating unit Is transmitted as communication data, and a second vertical synchronization signal is generated according to the start timing data received as communication data and the communication clock of the receiving means, so that the first vertical synchronization signal And the second vertical synchronizing signal are in a synchronized state, so that the delay time is shortened.
- the invention according to claim 2 transmits the start timing data together with the moving image data having a relatively large delay time by transmitting the communication data of the start timing data and the communication data of the moving image data as separate communication data. Compared to the case, the delay time of the start timing data can be shortened. Therefore, the accuracy of the second vertical synchronization signal that should satisfy the predetermined condition is improved.
- the invention according to claim 3 can further reduce the delay time of the start timing data by setting the priority of the communication data of the start timing data while setting it higher than the priority of the communication data of the moving image data. . Therefore, the accuracy of the second vertical synchronizing signal that should satisfy the predetermined condition is further improved.
- frame timing data indicating the timing for starting creation of each frame data by the image creating means and moving image data are transmitted as communication data, and frame timing data received as communication data is transmitted.
- the invention according to claim 6 can shorten the delay time of the frame timing data by transmitting the communication data of the frame timing data while setting the priority of the communication data higher than the priority of the communication data of the moving image data. Therefore, the accuracy of the second vertical synchronizing signal that should satisfy the predetermined condition is further improved.
- the moving image data received as communication data by the receiving unit is also used as frame timing data
- the second signal generating unit is configured to output the second vertical synchronization signal according to the receiving timing of the moving image data. Therefore, it is not necessary to separately transmit frame timing data as communication data.
- the moving image data that is also used as frame timing data is data at the head portion of the moving image data, a portion with a small delay time error can be used as frame timing data. , Improve accuracy.
- inexpensive hardware can be employed to control the second vertical synchronization signal by increasing or decreasing the number of clocks for each frame in the second vertical synchronization signal.
- the second vertical synchronization signal can be easily controlled.
- the invention according to claim 10 further includes a transmission timer and a reception timer, wherein the frame timing data includes a value of the transmission timer, a value of the transmission timer included in the frame timing data, and a value of the reception timer.
- the invention according to claim 11 is the step of synchronizing the communication clock of the transmission means and the communication clock of the reception means, the step of generating a first vertical synchronization signal in accordance with the communication clock of the transmission means, A step of transmitting start timing data indicating moving start timing and moving image data as communication data to a receiving unit by a transmitting unit, and a communication clock of the receiving unit and start timing data received as communication data by the receiving unit And generating the second vertical synchronization signal according to the above, the first vertical synchronization signal and the second vertical synchronization signal are synchronized with each other, so that the delay time is shortened.
- Video playback system Game body 23 Communication unit (transmission means) 230 Timer (Sender timer) 24, 24a Image processing unit 25 Encoder 26, 34 clock (communication clock) 27, 37, 38 clock 3, 3a expansion unit 310 setting data 33 communication unit (reception means) 330 timer (receiver timer) 35, 35a, 35b, 35c Decoder 355 Timer 356, 359 Comparator 39 Liquid crystal display 4 Television receiver 5 Video data 50 Frame data 50 Frame data
- FIG. 1 is a diagram showing a configuration of a moving image reproduction system 1 according to the present invention.
- the moving image reproduction system 1 includes a game main body 2, an expansion unit 3, a television receiver 4, and a cable 9, and transmits and receives moving images between the game main body 2 and the expansion unit 3 wirelessly while receiving a television image.
- the device 4 is configured as a system for reproducing the moving image.
- FIG. 2 is a block diagram showing a configuration of the game main body 2 in the first embodiment.
- the game body 2 includes a CPU 20 that calculates various data and generates control signals, a read-only ROM 21 that stores data such as a startup program, and a RAM 22 that is used as a temporary working area of the CPU 20. Yes.
- the game main body 2 has a reading unit for reading a game program (data supplied in a state stored in a medium such as a CD-ROM, cartridge, or memory card), An input unit such as a controller used by a player (operator) to input data, a display unit for displaying various data on the player, and the like are provided. Therefore, the game main body 2 has a function as a general computer.
- the game main body 2 includes a communication unit 23, an image processing unit 24, and an encoder 25.
- the communication unit 23 includes a clock 26.
- the clock 26 is a circuit (clock generator) that generates a signal that is a source of the frequency of the radio wave transmitted by the communication unit 23 for communication. That is, the clock 26 is a communication clock of the transmission means in the present invention.
- the clock 26 In wireless communication, communication is performed while synchronizing between the transmission side and the reception side. Therefore, the clock 26 needs to be synchronized with the communication clock (FIG. 3: clock 34) of the extension unit 3, and includes an oscillator that can change the oscillation frequency and a control circuit that controls the oscillator. .
- a voltage controlled variable oscillator (Voltage Controlled Oscillator) can be used.
- the clock 26 in the present embodiment includes a VCXO (Voltage Controlled Xtal Oscillator) employing a crystal resonator as a resonator, but is not limited to this.
- VCXO Voltage Controlled Xtal Oscillator
- an oscillator including a ceramic vibrator or a SAW (Surface (Acoustic Wave) vibrator may be used. That is, any configuration that can control the oscillation frequency may be used.
- the technique for synchronizing between the clock 26 of the game main unit 2 and the clock 34 of the expansion unit 3 can adopt a technique conventionally proposed in wireless communication as appropriate, and therefore will be described in detail here. Is omitted. In the following description, it is assumed that the clock 26 and the clock 34 are already synchronized unless otherwise specified.
- the communication unit 23 has a function of wirelessly transmitting communication data (described later) toward the extension unit 3. That is, the communication unit 23 mainly corresponds to the transmission unit in the present invention.
- the moving image reproduction system 1 according to the present embodiment employs a configuration that realizes a conventionally proposed WiFi (Wireless Fidelity) standard.
- the image processing unit 24 includes a circuit that generates a first vertical synchronization signal that is synchronized with a clock signal input from the clock 26 and that has a cycle of a frame interval. More specifically, the circuit generates the first vertical synchronization signal by dividing the clock signal input to the image processing unit 24 so that the period becomes a frame interval. As a result, the clock 26 and the first vertical synchronization signal are synchronized (synchronization is ensured). That is, the image processing unit 24 has a function of generating a first vertical synchronizing signal in accordance with a clock signal from the clock 26, and has a function as a first signal generating unit in the present invention.
- the image processing unit 24 creates frame data 50 (each data representing one frame) at a constant time interval (frame interval) according to the first vertical synchronization signal generated by the circuit.
- frame data 50 that is sequentially created at a constant frame interval is uncompressed stream data.
- a frame is a still image displayed on one screen of the television receiver 4. Therefore, each frame data 50 which is data before being encoded by the encoder 25 described later is data having the same data amount.
- the moving image data 5 is configured by arranging a plurality of frame data 50 in the order in which they are created. That is, the image processing unit 24 has a function as an image creating unit in the present invention.
- the first (first in the time series order) frame data 50 is referred to as frame data 51
- frame data other than the frame data 51 is displayed. 50 may be referred to as frame data 52.
- the moving image data 5 is shown as being stored and stored in the image processing unit 24, but actually, the moving image data 5 is generated by the generated partial image.
- Each data (amount of data corresponding to various processes to be executed) is sequentially output to the encoder 25.
- the image processing unit 24 in the present embodiment outputs the timing for creating the frame data 51 (the first frame data 50 of the moving image data 5) to the communication unit 23.
- the image processing unit 24 starts the creation of the moving image data 5 according to the first vertical synchronization signal, and simultaneously notifies the communication unit 23 of the timing at which the creation of the moving image data 5 is started.
- the communication unit 23 creates start timing data indicating the timing at which the image processing unit 24 starts creating the moving image data 5 as communication data.
- the communication data of the start timing data is wirelessly transmitted to the extension unit 3 separately from the communication data created from the moving image data 5.
- the communication unit 23 sets the priority of communication data related to the start timing data (priority) higher than the priority of communication data related to the moving image data 5, and transmits the communication data.
- the delay time of the communication data of the start timing data is shortened compared to the delay time of the communication data of the moving image data 5 and is received by the expansion unit 3 after the first vertical synchronization signal is generated.
- the reproducibility of the time required until is improved. Therefore, the predicted delay time can be predicted with high accuracy.
- the encoder 25 sequentially encodes the moving image data 5 generated by the image processing unit 24 and outputs the encoded data to the communication unit 23.
- Examples of encoding by the encoder 25 include MPEG2, MPEG4, or H.264. 263, H.M. Although a method such as H.264 has been proposed, it is not limited to such a method.
- the encoding by the encoder 25 the data amount of the moving image data 5 is compressed.
- the moving image data 5 created by the encoder 25 and input to the communication unit 23 is wirelessly transmitted to the extension unit 3 as communication data by the communication unit 23.
- FIG. 3 is a block diagram showing a configuration of the extension unit 3 in the first embodiment.
- the expansion unit 3 includes a CPU 30 that calculates various data and generates control signals, a read-only ROM 31 that stores data such as a startup program and setting data 310, and a RAM 32 that is used as a temporary working area of the CPU 30. And.
- the setting data 310 shown in FIG. 3 is a predicted value of the time (processing time) from the start of creation in the image processing unit 24 to the completion of decoding in the decoder 35 for one frame data 50.
- the setting data 310 is obtained in advance by an experiment or the like according to the image quality of the moving image data 5 or the communication speed of wireless communication, and is stored in the ROM 31.
- the expansion unit 3 includes an operation unit such as a controller or a button operated by a player (operator), a display unit such as a lamp or LED for displaying various data to the player. I have.
- the expansion unit 3 has a function as a general computer.
- the extension unit 3 includes a communication unit 33, a decoder 35, and a connection terminal 36.
- the communication unit 33 includes a clock 34.
- the clock 34 has the same configuration and function as the clock 26 of the game main body 2 and is synchronized with the clock 26 as described above.
- the communication unit 33 provides a function for the expansion unit 3 to perform data communication with the game main body 2.
- the communication unit 33 has a function of receiving communication data wirelessly transmitted from the communication unit 23 of the game main body 2.
- the communication unit 33 corresponds to the receiving means in the present invention
- the clock 34 corresponds to the communication clock of the receiving means in the present invention.
- a configuration that realizes the conventionally proposed WiFi standard is adopted as the communication unit 33 as in the communication unit 23 described above.
- the output destination of the communication data received by the communication unit 33 is classified by the CPU 30 according to the classification result, and the CPU 30 determines according to the classification result and controls the communication unit 33. Therefore, it is assumed that the CPU 30 classifies whether the communication data received by the communication unit 33 is start timing data, moving image data 5, or other data.
- the communication unit 33 or the decoder 35 is provided with a dedicated determination circuit for determining whether or not the communication data is start timing data, and the communication data is stored in the reception buffer of the communication unit 33 or the input buffer of the decoder 35. The determination may be made at the time when the determination is made.
- the CPU 30 When the communication unit 33 receives the communication data of the start timing data, the CPU 30 outputs a signal (hereinafter referred to as “timing signal”) to the decoder 35 at that timing.
- the communication unit 33 also outputs the encoded moving image data 5 received as communication data to the decoder 35 under the control of the CPU 30.
- the decoder 35 in this embodiment includes a delay circuit (not shown) that generates a delay signal obtained by delaying the timing signal input from the CPU 30 by the predicted value indicated in the setting data 310. Then, a signal having a frequency corresponding to the frame interval is generated as a provisional vertical synchronization signal at the timing when the delay signal is turned on (only once in this embodiment). Further, the temporary vertical synchronization signal is synchronized with the clock signal of the clock 34 to generate a second vertical synchronization signal.
- the decoder 35 generates a second vertical synchronization signal according to the start timing data received as communication data by the communication unit 33 and the clock signal of the clock 34 of the communication unit 33. Therefore, the decoder 35 has a function as the second signal generating means in the present invention.
- an intermediate signal such as a “delay signal” or a “provisional vertical synchronization signal” is generated by the decoder 35.
- the timing signal start timing data
- the setting data 310 predicted value
- the frame interval are input, and at the same frequency as the first vertical synchronization signal (becomes a signal at the frame interval) and according to the predicted value
- a signal that is delayed from the first vertical synchronization signal by a predetermined time and that is synchronized with the clock signal of the clock 34 (clock signal of the clock 26) may be generated as the second vertical synchronization signal.
- the decoder 35 generates the second vertical synchronizing signal by dividing the clock signal of the clock 34 in accordance with the above condition. In this way, the clock 34 and the second vertical synchronization signal are synchronized (synchronization is ensured).
- the decoder 35 has a function of decoding communication data (encoded moving image data 5) input from the communication unit 33 into moving image data 5 representing a game play screen (moving image). ing.
- the moving image data 5 is shown as being stored and stored in the decoder 35, but in actuality, the moving image data 5 is represented in accordance with the second vertical synchronization signal,
- Each frame data 50 is sequentially output from the connection terminal 36 to the television receiver 4 via the cable 9.
- connection terminal 36 has a structure in which a plug provided at one end of the cable 9 is inserted, and forms a signal output terminal from the expansion unit 3. That is, the extension unit 3 and the television receiver 4 are electrically connected to each other by the dedicated cable 9, and the moving image data 5 is transmitted from the extension unit 3 to the television receiver 4.
- the television receiver 4 in the present embodiment is a general home television and has a configuration and a function for receiving and viewing a television broadcast, although detailed description is omitted.
- the television receiver 4 includes an input terminal (not shown), and is configured such that a plug provided at one end of the cable 9 is inserted into the input terminal.
- the moving picture data 5 decoded by the decoder 35 is input from the expansion unit 3 to the television receiver 4 via the cable 9.
- the television receiver 4 reproduces (displays) the moving image represented by the moving image data 5 on the screen based on the moving image data 5 input from the extension unit 3.
- FIGS. 4 and 5 are flowcharts showing the operation of the game main body 2 in the first embodiment.
- FIGS. 4 and 5 for convenience of illustration, each process is shown to be executed sequentially. However, in reality, each process is appropriately executed in parallel in each hardware as appropriate. The same applies to the following flowcharts.
- step S1 when the power is turned on, the game main body 2 executes a predetermined procedure and synchronizes the clock signal of the clock 26 and the clock signal of the clock 34 (step S1). As described above, the conventional technique can be used as appropriate for the processing in step S1.
- the image processing unit 24 is synchronized with the clock signal of the clock 26 in accordance with the clock signal input from the clock 26.
- the 1st vertical synchronizing signal which becomes an ON state for every frame interval (time T) is produced
- step S3 When the first vertical synchronization signal is generated, the image processing unit 24 is in a state of monitoring the ON state of the first vertical synchronization signal (step S3).
- step S2 When step S2 is executed, the encoder 25 is in a state of monitoring whether or not a predetermined amount of frame data 50 has been input from the image processing unit 24 (step S11).
- step S2 when step S2 is executed, the communication unit 23 enters a state of monitoring whether or not a predetermined amount of frame data 50 has been input from the encoder 25 (step S13).
- the image processing unit 24 determines Yes in step S3, and further determines whether or not the detected ON state is the first time (step S4).
- step S4 the image processing unit 24 notifies the communication unit 23 of this timing. Thereby, the communication unit 23 is notified of the timing for starting the creation of the moving image data 5, and the communication unit 23 creates communication data of the start timing data and transmits it to the extension unit 3 (step S5). In step S3, the communication unit 23 sets a higher priority for the communication data to be transmitted.
- the image processing unit 24 creates frame data 50 (step S6). More specifically, the creation of one frame data 50 is started in step S6. As a result, the frame data 50 created by the image processing unit 24 is input to the encoder 25.
- step S6 is executed every time the first vertical synchronization signal is turned on.
- the first vertical synchronization signal is a signal that is turned ON at the frame interval
- the frame data 50 is generated by the image processing unit 24 at the frame interval.
- the image processing unit 24 creates the moving image data 5 representing the moving image by creating the frame data 50 according to the first vertical synchronization signal.
- step S11 When the frame data 50 is generated by the image processing unit 24 and a predetermined amount of frame data 50 is input to the encoder 25, the encoder 25 determines Yes in step S11, and the input predetermined amount of frame data 50 ( That is, the moving image data 5) is encoded (step S12).
- the encoder 25 in the present embodiment performs encoding with data representing an image composed of 16 pixels ⁇ 16 pixels in the frame data 50 as one unit (hereinafter referred to as “macroblock”), The data is output to the communication unit 23.
- the predetermined amount is not limited to such a size.
- the communication unit 23 determines Yes in step S13, and communicates the input moving image data 5 to the communication unit 23. Data is transmitted to the extension unit 3 (step S14).
- the communication unit 23 transmits frame data 50 of one macroblock from the encoder 25 every time it is input as communication data.
- the CPU 20 of the game main body 2 monitors whether or not an end is instructed by the user's operation or the like (step S15), and performs the processes of steps S3 to S6 and steps S11 to S15 until the end is instructed. repeat.
- the CPU 20 of the game main body 2 determines Yes in step S15 and ends all processing.
- the above is the operation of the game main body 2 that executes the moving image reproduction method according to the first embodiment. Next, the operation of the extension unit 3 will be described.
- 6 and 7 are flowcharts showing the operations of the extension unit 3 and the television receiver 4 in the first embodiment.
- the expansion unit 3 executes a predetermined procedure with the game body 2 and synchronizes the clock signal of the clock 26 and the clock signal of the clock 34 (step S21).
- the conventional technique can be appropriately used for the processing in step S21.
- the expansion unit 3 When the clock signal of the reception side clock 34 is synchronized with the clock signal of the transmission side clock 26, the expansion unit 3 is in a standby state until it receives communication data (step S22).
- the communication unit 33 receives the transmitted communication data (step S23).
- step S24 the CPU 30 determines whether or not the communication data received by the communication unit 33 in step S23 is start timing data (step S24). If the communication data is not communication data of the start timing data, the process returns to step S22 and is processed. repeat. On the other hand, if the received communication data is start timing data, the CPU 30 outputs a timing signal to the decoder 35.
- the decoder 35 When the CPU 30 outputs the timing signal, the decoder 35 generates a second vertical synchronization signal according to the input timing signal, the predicted value indicated by the setting data 310, and the clock signal of the clock 34 (step S25). ). Thereby, the decoder 35 thereafter generates a second vertical synchronization signal synchronized with the clock signal while dividing the clock signal of the clock 34.
- the first vertical synchronization signal is generated by dividing the clock signal of the clock 26
- the clock signal of the clock 26 and the first vertical synchronization signal are signals that are synchronized.
- the second vertical synchronization signal is generated by dividing the clock signal of the clock 34
- the clock signal of the clock 34 and the second vertical synchronization signal are signals that are synchronized.
- the clock signal of the clock 26 and the clock signal of the clock 34 are synchronized by the procedure of wireless communication. Therefore, the first vertical synchronization signal and the second vertical synchronization signal are synchronized with each other.
- the moving image reproduction system 1 cannot reproduce the frames of the moving image data 5 at frame intervals unless the second vertical synchronization signal is generated by executing step S25. Accordingly, until the start timing data as the communication data is received (until determined as Yes in step S24), the moving image reproduction system 1 stands by while repeating the processes of steps S22 to S24.
- the moving image reproduction system 1 cannot reproduce the moving image data 5.
- the start timing data is created at the timing when the creation of the moving image data 5 is started, and the data size is small and the time required for communication is short.
- the start timing data is transmitted / received with priority over other communication data. Accordingly, the waiting time is generally short, and it is expected that the extension unit 3 receives the start timing data before the moving image data 5 is received. Note that even during this standby period, an image or a moving image prepared in the extension unit 3 may be displayed on the television receiver 4 by a unique vertical synchronization signal.
- Step S25 When Step S25 is executed and the second vertical synchronization signal is generated, the communication unit 33 again enters a state of monitoring incoming communication data (Step S26).
- the decoder 35 monitors whether or not a predetermined amount of communication data has been input from the communication unit 33 (step S31) and whether or not the decoding of the predetermined amount of frame data has been completed (step S33). It becomes.
- step S27 the communication unit 33 receives the received communication data (step S27). More specifically, reception of communication data is started in step S27 and output of the received communication data to the decoder 35 is started.
- the communication data received in step S27 is mainly the encoded moving image data 5, but it is not limited to this.
- the decoder 35 determines Yes in step S31, and decodes the input moving image data 5 (step S32). ).
- the decoder 35 determines Yes in step S31 when the moving image data 5 corresponding to the macroblock corresponding to the horizontal width of the frame is input, and performs decoding for each macroblock.
- the predetermined amount of communication data in step S31 is the moving image data 5 for 16 lines. That is, every time 16 lines of moving image data 5 are input from the communication unit 33, the decoder 35 executes step S32, and for a plurality of macroblocks included in the input 16 lines of moving image data 5, Sequentially, decoding is started.
- the decoded moving image data 5 is temporarily stored in a memory (not shown) in the decoder 35.
- the decoder 35 monitors the data amount of the frame data 50 that has been decoded in step S33 as described above.
- step S34 the state is waiting for the second vertical synchronization signal to be turned on.
- the decoder 35 outputs the frame data 50 (moving image data 5) in the memory to the television receiver 4 via the connection terminal 36. Thereby, the television receiver 4 reproduces the moving image data 5 from the expansion unit 3 (decoder 35) by displaying it on the screen.
- step S34 is determined Yes at the frame interval.
- Data necessary for display at a frame interval is data for one frame. Therefore, the predetermined amount of frame data 50 in step S33 is frame data 50 for one frame (that is, one frame data 50).
- the frame data 50 is output from the extension unit 3 to the television receiver 4 at frame intervals according to the second vertical synchronization signal and displayed on the television receiver 4.
- each frame data 50 included in the moving image data 5 is displayed according to the second vertical synchronization signal, thereby reproducing a moving image represented by the moving image data 5.
- the process for synchronization is a process that is repeated at an appropriate timing or continuously.
- the process of synchronizing the clock 26 and the clock 34 (steps S1 and S21) is not performed only at the time of startup, but is performed as needed.
- FIG. 8 is a diagram showing the timing of each signal in the first embodiment.
- T shown in FIG. 4 is a frame interval.
- ⁇ is a delay time of start timing data as communication data, and “ ⁇ ” is a predicted value shown in the setting data 310.
- the timing signal is a signal that is turned ON only once.
- the start timing data is transmitted as communication data different from the moving image data 5, and the priority is set high. That is, the communication data of the start timing data has a small data amount, and is transmitted first in preference to other communication data (the transmission waiting time is short). Therefore, the delay time ⁇ is sufficiently smaller than the time required for processing the frame data 50 (that is, the predicted value ⁇ ), and may be ignored when the predicted value ⁇ is theoretically obtained.
- the clock 26 and the first vertical synchronization signal in the game main body 2 are synchronized by the encoder 25. Further, the clock 26 in the game main body 2 and the clock 34 in the expansion unit 3 are synchronized by the procedure of wireless communication. Therefore, the clock 34 and the first synchronization signal in the expansion unit 3 are synchronized.
- the communication unit 23 creates and transmits start timing data according to the timing.
- a delay time ⁇ occurs while the communication unit 33 receives this as communication data. Therefore, the timing signal input to the decoder 35 is turned ON when the time lapses by the delay time ⁇ from the timing when the creation of the moving image data 5 is started.
- the decoder 35 generates a delay signal in accordance with the predicted value ⁇ indicated in the setting data 310 for the timing signal, and generates a provisional vertical synchronization signal whose period is the frame interval T in synchronization with the delay signal. That is, as shown in FIG. 8, the provisional vertical synchronization signal is started with a delay of time “ ⁇ + ⁇ ” from the timing when the creation of the moving image data 5 is started, and becomes a signal with a period T. However, since the timing signal is turned on only once, the provisional vertical synchronization signal is not synchronized with the first vertical synchronization signal (generally, shifts with time).
- the decoder 35 generates a second vertical synchronizing signal synchronized with the first vertical synchronizing signal by synchronizing the clock 34 already synchronized with the first vertical synchronizing signal with the temporary vertical synchronizing signal. To do.
- each frame data 50 of the moving image data 5 is created at a timing when the first vertical synchronization signal is turned on. Therefore, the processing for each frame data 50 is started at the timing when the first vertical synchronization signal is turned ON.
- the processing for each frame data 50 is completed in a time within the predicted value ⁇ after the creation of the frame data 50 is started (the predicted value ⁇ is determined in this way). Accordingly, it is possible to prevent the second vertical synchronization signal from being turned ON before the processing for each frame data 50 is completed. That is, the delay time for each frame is about the predicted value ⁇ , and an increase in the delay time due to display timing waiting is suppressed.
- the moving image data 5 representing moving images is transmitted and received between the communication unit 23 and the communication unit 33 in a state where the clock 26 included in the communication unit 23 and the clock 34 included in the communication unit 33 are synchronized.
- the moving image reproduction system 1 according to the first embodiment for reproducing the moving image generates the first vertical synchronization signal in accordance with the clock 26 of the communication unit 23 and the generated first vertical synchronization signal.
- the data and the moving image data 5 created by the image processing unit 24 are transmitted as communication data, and the start data received by the communication unit 33 as communication data.
- the decoder 35 generates a second vertical synchronization signal according to the ming data and the clock 34 of the communication unit 33, and the decoder 35 generates frame data 50 included in the moving image data 5 received as communication data by the communication unit 33.
- the first vertical synchronizing signal and the second vertical synchronizing signal are provided. Since it is in a synchronized state, the delay time of moving image data is shortened.
- the communication unit 23 transmits the communication data of the start timing data and the communication data of the moving image data 5 as separate communication data, so that the communication unit 23 transmits the moving image data with relatively large delay time, as compared with the case of transmitting the moving image data.
- the delay time of the start timing data can be shortened. Therefore, the accuracy of the second vertical synchronizing signal that should satisfy the predetermined condition is further improved.
- the communication unit 23 transmits the start timing data while setting the priority of the communication data higher than the priority of the communication data of the moving image data 5, whereby the delay time of the start timing data can be further shortened. Therefore, the accuracy of the second vertical synchronizing signal that should satisfy the predetermined condition is further improved.
- the second vertical synchronization signal is generated so that the period of the second vertical synchronization signal is the frame interval.
- moving image data 5 is output to the television receiver 4 for each data (frame data 50) corresponding to one frame.
- the size of the image output toward the television receiver 4 is not necessarily limited to the frame size.
- the period of the second vertical synchronization signal may be determined so that the line data (not necessarily one line) is output to the television receiver 4. The period in this case is naturally shorter than the frame interval. The same applies to the following embodiments.
- the clock signal of the clock 26 is divided to generate the first vertical synchronization signal, and the clock signal of the clock 26 and the first vertical synchronization signal are synchronized.
- the clock signal of the clock 34 is divided to generate the second vertical synchronizing signal, and the clock signal of the clock 34 and the second vertical synchronizing signal are synchronized.
- the method of synchronizing the clock signal of the clock 26 and the first vertical synchronizing signal and the method of synchronizing the clock signal of the clock 34 and the second vertical synchronizing signal are limited to “frequency division”. It is not something. That is, a known method for synchronizing two different signals may be employed as appropriate.
- Second Embodiment> for creating moving image data using two communication clocks (clocks 26 and 34) provided on the moving image data creating side and the reproducing side and synchronized.
- the example in which the vertical synchronization signal (first vertical synchronization signal) and the vertical synchronization signal for reproducing moving image data (second vertical synchronization signal) are synchronized has been described.
- the method of synchronizing the first vertical synchronization signal and the second vertical synchronization signal is not limited to the example shown in the first embodiment.
- FIG. 9 is a block diagram showing a configuration of the game main body 2 in the second embodiment.
- the game main body 2 in the second embodiment differs from the game main body 2 in the first embodiment in that an image processing unit 24a is provided instead of the image processing unit 24.
- an image processing unit 24a is provided instead of the image processing unit 24.
- the same reference numerals are given to the same components as those in the moving image reproduction system 1 according to the first embodiment, and description thereof will be omitted as appropriate.
- the image processing unit 24a in the second embodiment is different from the image processing unit 24 in the first embodiment in that a clock 27 is provided.
- the clock 27 is configured as a circuit including an oscillator (not shown) that generates a signal at a predetermined frequency, and has a function of generating a first vertical synchronization signal having a frame interval as a cycle.
- the clock 27 may be a clock that can change the frequency of the signal to be generated, such as the clocks 26 and 34.
- the image processing unit 24 a creates the moving image data 5 representing the moving image by creating the frame data 50 according to the first vertical synchronization signal generated by the clock 27. Accordingly, also in the second embodiment, creation of the frame data 50 is started each time the first vertical synchronization signal is turned on, as in the first embodiment.
- the image processing unit 24 a outputs the first vertical synchronization signal generated by the clock 27 to the communication unit 23.
- the first vertical synchronization signal indicating the timing for starting the creation of each frame data 50 constituting the moving image data 5 is input to the communication unit 23.
- the communication unit 23 creates frame timing data according to the timing at which the input first vertical synchronization signal is turned on, and transmits this to the extension unit 3 as communication data.
- the frame timing data is transmitted separately from the communication data of the moving image data 5 and at a higher priority than the communication data of the moving image data 5.
- FIG. 10 is a block diagram showing the configuration of the extension unit 3 in the second embodiment.
- the extension unit 3 in the second embodiment is different from the extension unit 3 in the first embodiment in that a decoder 35 a is provided instead of the decoder 35.
- the setting data 310 stores a threshold value (described later) in addition to the predicted value.
- the timing signal in the second embodiment is a signal that is turned on many times.
- FIG. 11 is a diagram showing a configuration of the decoder 35a in the second embodiment.
- the decoder 35 a has a timing signal from the CPU 30, setting data 310 (threshold value) read from the ROM 31, and communication data received by the communication unit 33 (related to the frame data 50 of the communication data). Communication data).
- the decoder 35a in the second embodiment includes a clock 37, an input buffer 350, an output buffer 351, a data processing unit 352, a timer 355, a comparator 356, and an output circuit 357.
- the hardware configuration shown here is an example, and the present invention is not limited to this.
- communication data (communication data 330) related to the moving image data 5 (frame data 50) is input from the communication unit 33 and stored in the input buffer 350.
- the output buffer 351 has a storage capacity that can store at least two pieces of decoded frame data 50.
- the data processing unit 352 When a predetermined amount of communication data 330 (encoded frame data 50) is stored in the input buffer 350, the data processing unit 352 reads out, decodes, and stores it in the output buffer 351. For the frame data 50 encoded by the difference from the past frame data 50, the past frame data 50 is read from the output buffer 351 and decoded.
- the clock 37 has the same configuration as the clocks 26 and 34, for example, and can change the frequency of the output signal.
- the oscillator of the clock 37 starts a self-oscillation according to the timing when the expansion unit 3 is activated, and thereby the clock 37 outputs a signal whose cycle is a frame interval.
- the signal output from the clock 37 is output to the output circuit 357. That is, in the second embodiment, the output signal of the clock 37 is the second vertical synchronization signal. The second vertical synchronization signal output from the clock 37 is also output to the timer 355.
- the timer 355 starts when the second vertical synchronization signal input from the clock 37 is turned on, and outputs a value (corresponding to the elapsed time) to the comparator 356 when the timing signal is turned on. To do.
- the timer 355 has a function of measuring a delay (time difference) of the timing signal with respect to the second vertical synchronization signal and outputting it to the comparator 356.
- the comparator 356 compares the “delay” input from the timer 355 with the threshold value (setting data 310) input to the decoder 35a.
- the output signal of the comparator 356 is a signal for transmitting to the clock 37 whether or not “delay” is within the range between the upper limit value and the lower limit value indicated by the threshold value.
- the timing signal in the second embodiment is a signal that constantly notifies the first vertical synchronization signal. Therefore, the comparator 356 has a function of determining whether or not the delay of the second vertical synchronization signal that should be a signal delayed by the predicted value with respect to the timing signal (first vertical synchronization signal) is within an allowable range. Have. However, since the “delay” measured by the timer 355 in the second embodiment is a delay of the timing signal with respect to the second vertical synchronization signal, the threshold in the second embodiment is “frame interval ⁇ predicted value”. The upper limit value and the lower limit value are set according to the allowable range.
- the comparator 356 has an upper limit determination signal that is turned on when the “delay” is larger than the upper limit value of the threshold (when the delay is smaller than the predicted value), and when the “delay” is smaller than the lower limit of the threshold ( When the delay is larger than the predicted value, the lower limit determination signal that is turned ON is output to the clock 37 as an output signal.
- the upper limit determination signal or the lower limit determination signal output from the comparator 356 is turned on.
- the control circuit of the clock 37 controls the oscillator in the direction of decreasing the frequency by decreasing the control voltage.
- the frequency of the second vertical synchronization signal is lowered, so that the delay of the second vertical synchronization signal with respect to the timing signal can be increased. Therefore, the “delay” of the timing signal with respect to the second vertical synchronization signal is reduced. Such control is continued until the “delay” becomes equal to or less than the upper limit value of the threshold.
- the control circuit of the clock 37 controls the oscillator in the direction of increasing the frequency by increasing the control voltage.
- the frequency of the second vertical synchronization signal is increased, so that the delay of the second vertical synchronization signal with respect to the timing signal can be reduced. Therefore, the “delay” of the timing signal with respect to the second vertical synchronization signal is increased. Such control is continued until the “delay” becomes equal to or greater than the lower limit value of the threshold.
- the second vertical synchronization signal whose deviation from the first vertical synchronization signal (timing signal) is large is detected by the clock 37 according to the output signal from the comparator 356. It is corrected in the direction to suppress.
- the output circuit 357 is a circuit that controls the timing at which the frame data 50 stored in the output buffer 351 is output to the television receiver 4 via the connection terminal 36. Specifically, at a timing when a predetermined amount of frame data 50 is prepared in the output buffer 351 and the second vertical synchronization signal input from the clock 37 is turned on, the output circuit 357 outputs the frame data 50. Output.
- step S41 the image processing unit 24a of the game main body 2 in the second embodiment generates a first vertical synchronization signal by the clock 27 (step S41).
- step S41 a process corresponding to step S1 in the first embodiment is executed, and the clock 26 and the clock 34 are synchronized. That is, although not shown in FIG. 12, a normal procedure related to wireless communication is executed.
- the image processing unit 24a and the communication unit 23 are in a state of monitoring the ON state of the first vertical synchronization signal output from the clock 27 (step S42).
- the encoder 25 is in a state of monitoring whether or not a predetermined amount of frame data 50 has been input from the image processing unit 24a (step S51). Further, the communication unit 23 enters a state of monitoring whether or not a predetermined amount of frame data 50 has been input from the encoder 25 (step S53).
- the communication unit 23 When the first vertical synchronization signal is turned on, the communication unit 23 creates frame timing data as communication data at the timing when the first vertical synchronization signal is turned on, and sends the communication data of the frame timing data to the extension unit 3. It transmits to (step S43). In step S43, the communication unit 23 sets the priority of the frame timing data higher than the priority of the moving image data 5, and transmits the communication data of the frame timing data separately from the communication data of the moving image data 5.
- the image processing unit 24a creates frame data 50 (step S44). That is, creation of the frame data 50 is started in step S44, and output of the created frame data 50 to the encoder 25 is started.
- the clock 34 of the expansion unit 3 and the first vertical synchronization signal of the game main body 2 are synchronized with each other via the clock 26 of the communication unit 23.
- the timing at which the first vertical synchronization signal is turned on is notified each time by transmitting the frame timing data as communication data to the extension unit 3, and the second vertical synchronization signal will be described later. Synchronize with.
- 14 and 15 are flowcharts showing the operations of the extension unit 3 and the television receiver 4 in the second embodiment.
- step S61 when the power of the expansion unit 3 is turned on, the oscillator of the clock 37 starts self-oscillation so that the clock 37 starts generating the second vertical synchronization signal (step S61) and the communication unit of the expansion unit 3 It is in a state of monitoring whether or not 33 has detected an incoming communication data (step S62).
- step S62 a process corresponding to step S21 in the first embodiment is executed, and the clock 26 and the clock 34 are in a synchronized state.
- the communication unit 33 determines Yes in step S62 and receives the communication data (step S63). More specifically, reception of communication data is started in step S63.
- steps S71 to S76 are executed. These processes can be executed in the same manner as steps S31 to S36 described in the first embodiment. Since it can, explanation is omitted.
- step S63 it is determined by the CPU 30 whether or not the communication data received in step S63 is frame timing data (step S64), and even if the communication data is not frame timing data, the processing of steps S71 to S76 is executed.
- step S63 If the communication data received in step S63 is frame timing data (Yes in step S64), the timing signal is turned ON at that timing, and the decoder 35a is notified of the timing of receiving the frame timing data.
- step S64 When it is determined Yes in step S64 and the timing signal is turned on, the timer 355 outputs a value (a value indicating “delay”) to the comparator 356. That is, the timer 355 measures the “delay” of the timing signal with respect to the second vertical synchronization signal (step S65).
- the comparator 356 compares the threshold value shown in the setting data 310 with the measured “delay”.
- step S66 If “delay” is not less than or equal to the upper limit value of the threshold value (No in step S66), the upper limit value determination signal output from the comparator 356 is turned on. Therefore, the control circuit of the clock 37 controls the oscillator in the direction of lowering the frequency by lowering the control voltage (step S67). As a result, the frequency of the second vertical synchronization signal is lowered, and the delay of the second vertical synchronization signal with respect to the timing signal is increased. Therefore, the “delay” of the timing signal with respect to the second vertical synchronization signal is reduced.
- step S68 If “delay” is not equal to or greater than the lower limit value of the threshold value (No in step S68), the lower limit value determination signal output from the comparator 356 is turned on. Therefore, the control circuit of the clock 37 controls the oscillator in the direction of increasing the frequency by increasing the control voltage (step S69). As a result, the frequency of the second vertical synchronization signal is increased, and the delay of the second vertical synchronization signal with respect to the timing signal is reduced. Therefore, the “delay” of the timing signal with respect to the second vertical synchronization signal is increased.
- the moving image reproduction system 1 includes moving image data 5 representing moving images between the communication unit 23 that transmits communication data and the communication unit 33 that receives communication data.
- a moving image expressing a moving image by generating a first vertical synchronization signal and creating frame data according to the generated first vertical synchronization signal.
- An image processing unit 24a for creating image data 5 is provided, and the communication unit 23 transmits frame timing data indicating timing for starting creation of each frame data 50 by the image processing unit 24a and moving image data 5 as communication data.
- the communication unit 23 transmits the frame timing data by setting the priority of the communication data higher than the priority of the communication data of the moving image data 5, so that the delay time of the frame timing data can be shortened. Therefore, the accuracy of the second vertical synchronizing signal that should satisfy the predetermined condition is further improved.
- the frame timing data and the moving image data are transmitted as separate communication data.
- the moving image data received as communication data on the receiving side can also be used as frame timing data, and the second vertical synchronization signal can be generated according to the receiving timing of the moving image data.
- the third embodiment can be realized by a configuration similar to that of the moving image reproduction system 1 in the second embodiment, the same reference numerals as those in the moving image reproduction system 1 in the second embodiment are used to appropriately explain the third embodiment. Is omitted.
- the image processing unit 24a of the moving image reproduction system 1 in the third embodiment does not output the first vertical synchronization signal to the communication unit 23.
- a header for storing data that is not data representing an image is added to the head portion of the frame data 50.
- the header is simply data indicating the head of the frame data 50, data indicating information such as the compression method and image quality, and various data depending on the application.
- the header is created according to a rule determined in advance between the transmission side and the reception side, and can be distinguished from data representing an image on the reception side. That is, even if the game main body 2 and the expansion unit 3 do not have a special configuration, it is possible to provide a header in the frame data 50 and identify the header in the received frame data 50.
- the image processing unit 24a in the third embodiment creates header data using a conventional technique and starts outputting the frame data 50 to the encoder 25 when the creation of the frame data 50 is started.
- the encoder 25 ignores the header data in the frame data 50, encodes only the data portion representing the image in the frame data 50, and encodes the frame data together with the header data. 50 is output to the communication unit 23.
- the communication unit 23 in the third embodiment transmits the encoded frame data 50 input from the encoder 25 to the extension unit 3 as communication data. That is, in the third embodiment, the communication data of the frame timing data is not transmitted separately from the communication data of the moving image data 5.
- the CPU 30 of the extension unit 3 analyzes the communication data received by the communication unit 33 and detects the header data, the CPU 30 turns on the timing signal at that timing. That is, in the moving image reproduction system 1 according to the third embodiment, the timing signal is turned on according to the timing at which the header that is the head portion of the frame data 50 is received.
- the header data included in the frame data 50 (the header data also constitutes part of the moving image data 5) is regarded as the frame timing data.
- the synchronization between the first vertical synchronization signal and the second vertical synchronization signal is ensured.
- FIG. 16 is a flowchart showing the operation of the game main body 2 in the third embodiment.
- the game main body 2 in the third embodiment generates a first vertical synchronization signal by the image processing unit 24a, similarly to step S41 of the game main body 2 in the second embodiment (step S81).
- the image processing unit 24a and the communication unit 23 are in a state of monitoring the ON state of the first vertical synchronization signal (step S82). Further, the encoder 25 is in a state of monitoring whether or not a predetermined amount of frame data 50 has been input from the image processing unit 24a (step S84). Further, the communication unit 23 enters a state of monitoring whether or not a predetermined amount of frame data 50 has been input from the encoder 25 (step S86).
- the image processing unit 24a When the ON state of the first vertical synchronization signal is detected (Yes in step S82), the image processing unit 24a creates the frame data 50 at this timing. At this time, the image processing unit 24 a creates header data using a conventional technique and outputs the header data to the encoder 25.
- the communication data of the frame timing data is not created separately from the communication data of the moving image data 5 by the communication unit 23, and the communication data of the moving image data 5 (frame data 50) is generated. As a result, communication data of frame timing data is created. Therefore, in the moving image reproduction method according to the third embodiment, as shown in FIG. 16, the processing corresponding to step S43 (FIG. 12) in the second embodiment is not performed.
- or S88 can be performed similarly to step S51 thru
- FIGS. 17 and 18 are flowcharts showing the operations of the extension unit 3 and the television receiver 4 in the third embodiment.
- step S91 when the power of the expansion unit 3 is turned on, the oscillator of the clock 37 starts self-oscillation, whereby the clock 37 starts generating the second vertical synchronization signal (step S91), and the communication unit of the expansion unit 3 It is in a state of monitoring whether or not 33 has detected an incoming communication data (step S92).
- the communication unit 33 determines Yes in step S92 and receives the communication data (step S93). More specifically, reception of communication data is started in step S93.
- steps S101 to S106 are executed, but these processes can be executed in the same manner as steps S71 to S76 in the second embodiment. Since it can, explanation is omitted.
- the CPU 30 determines whether or not the header is included in the communication data received in step S93 (step S94). If the header is not included in the communication data, the moving image reproduction system 1 Steps S101 to S106 are executed.
- step S94 When the header is included in the communication data received in step S93 (Yes in step S94), the timing signal is turned on at that timing, and the decoder 35a is notified of the timing of receiving the header.
- steps S95 to S99 after the timing signal is generated by the CPU 30 can be executed in the same manner as steps S65 to S69 in the second embodiment, the description thereof is omitted.
- the moving image data 5 received as communication data by the communication unit 33 is also used as frame timing data, and the decoder 35a receives the moving image data 5.
- the decoder 35a receives the moving image data 5.
- the moving image data 5 that is also used as frame timing data is the data (header data) of the head portion of the moving image data 5, the portion with a small delay time error is used as the frame timing data. Will improve.
- the portion of the moving image data 5 that is also used as frame timing data is not limited to the data of the head portion.
- the last data of the moving image data 5 may be used as the frame timing data.
- the moving image reproduction system 1 in the above embodiment has been described as including the television receiver 4 and reproducing the moving image data 5 in the television receiver 4.
- a configuration example has been described in which a television already installed in a general home can be used as the television receiver 4 in the moving image reproduction system 1.
- the moving image reproduction system 1 does not necessarily need to reproduce images on a home television.
- the moving image data 5 can be reproduced by a configuration including a dedicated display device.
- FIG. 19 is a diagram showing a moving image reproduction system 1a according to the fourth embodiment.
- the moving image reproduction system 1a is different from the moving image reproduction system 1 in the above embodiment in that the expansion unit 3a is provided instead of the expansion unit 3.
- the same reference numerals are given to components having the same functions as those of the moving image reproduction system 1 according to the second embodiment, and description thereof will be omitted as appropriate. .
- FIG. 20 is a block diagram showing a configuration of the extension unit 3a in the fourth embodiment.
- the extension unit 3a is different from the extension unit 3 in the second embodiment in that it includes a decoder 35b instead of the decoder 35a and a liquid crystal display 39.
- the liquid crystal display 39 has a function of displaying an image (particularly moving image data 5) on a screen, and is a dedicated reproducing device in the moving image reproducing system 1a (extended unit 3a). That is, the moving image reproduction system 1a in the fourth embodiment is configured as a system including a dedicated liquid crystal display 39 instead of a television set (television receiver 4) installed in a general home.
- the decoder 35b is different from the decoder 35a in the second embodiment in that a clock 38 is provided instead of the clock 37.
- the supplied video signal (moving image data 5) needs to comply with the standard.
- the clock frequency of the clock 26 and the clocks 34 and 37 is controlled using the VCXO in order to control the number of clocks in the vertical synchronization signal with high accuracy.
- the moving image reproduction system 1a includes the liquid crystal display 39 dedicated to the moving image reproduction system 1a as described above.
- the dedicated liquid crystal display 39 can be configured to display the moving image data 5 even if the number of clocks in the vertical synchronization signal (second vertical synchronization signal) changes for each frame (that is, a television set).
- the number of clocks per frame may not be constant as in the case of the receiver 4).
- the moving image reproduction system 1a (clock 38) in the fourth embodiment can increase the number of clocks in the second vertical synchronization signal to lower the frequency of the second vertical synchronization signal, and can also reduce the second vertical synchronization signal.
- the frequency of the second vertical synchronization signal can be increased by reducing the number of clocks in the synchronization signal.
- the control circuit of the clock 38 controls the oscillator in the direction of decreasing the frequency by lowering the control voltage like the control circuit of the clock 37. Instead, the number of clocks per frame in the second vertical signal is increased. As a result, the frequency of the second vertical synchronization signal is lowered, so that the delay of the second vertical synchronization signal with respect to the timing signal can be increased. Therefore, the “delay” of the timing signal with respect to the second vertical synchronization signal is reduced. The clock 38 continues such control until the “delay” becomes equal to or less than the upper limit value of the threshold.
- the control circuit of the clock 38 controls the oscillator in the direction of increasing the frequency by increasing the control voltage like the control circuit of the clock 37. Instead, the number of clocks per frame in the second vertical signal is reduced. As a result, the frequency of the second vertical synchronization signal is increased, so that the delay of the second vertical synchronization signal with respect to the timing signal can be reduced. Therefore, the “delay” of the timing signal with respect to the second vertical synchronization signal is increased. The clock 38 continues such control until the “delay” becomes equal to or greater than the lower limit value of the threshold value.
- the first technique is to increase or decrease the number of horizontal synchronization signals in the second vertical synchronization signal.
- the second vertical signal in one cycle is composed of a plurality of horizontal synchronization signals. Therefore, for example, when the second vertical synchronization signal in one cycle is composed of n (n is a natural number of 2 or more) horizontal synchronization signals, the first synchronization signal in one cycle is composed of (n ⁇ 1) horizontal synchronization signals.
- the number of horizontal synchronization signals is reduced so that two vertical synchronization signals are formed.
- the number of clocks included in one period of the second vertical synchronization signal decreases, and the frequency of the second vertical synchronization signal increases. According to this method, the number of clocks in the horizontal synchronization signal can be kept constant.
- the second method is a method of increasing / decreasing the number of clocks included in one horizontal synchronization signal without changing the number of horizontal synchronization signals included in one cycle of the second vertical synchronization signal.
- one horizontal synchronization signal is composed of m clocks (m is a natural number of 2 or more)
- 1 of n horizontal synchronization signals included in the second vertical synchronization signal of one cycle 1 of n horizontal synchronization signals included in the second vertical synchronization signal of one cycle.
- One, two or more, or all of the horizontal synchronization signals are reduced in number of clocks so as to be composed of (m ⁇ 1) clocks.
- the number of clocks included in one period of the second vertical synchronization signal decreases, and the frequency of the second vertical synchronization signal increases. According to this method, highly accurate control is possible.
- the third method is a modification of the second method, in which the number of clocks of the horizontal synchronization signal in the vertical blanking period is increased or decreased. Since the vertical blanking period is the period after drawing is finished in image display, the influence of the disturbance of the horizontal synchronization signal during drawing can be suppressed by changing the number of clocks only for the horizontal synchronization signal during this period. Can do.
- any one of these three methods may be selected and adopted, or some may be used simultaneously.
- the number of horizontal synchronization signals included in one cycle of the second vertical synchronization signal may be increased or decreased and simultaneously the number of clocks in the horizontal synchronization signal may be increased or decreased.
- the number of horizontal synchronization signals may be reduced when the frequency of the second vertical synchronization signal is increased, while the number of clocks included in the horizontal synchronization signal may be increased when the frequency of the second vertical synchronization signal is decreased.
- the second vertical synchronization signal having a large deviation from the first vertical synchronization signal (timing signal) is output from the comparator 356. Is corrected by the clock 38 in a direction to suppress the deviation.
- the moving image reproduction system 1a according to the fourth embodiment is configured with inexpensive hardware instead of a clock (a clock capable of controlling the frequency of the oscillator) provided with the VCXO which is relatively expensive hardware.
- a clock a clock capable of controlling the frequency of the oscillator
- Another type of clock for example, a clock having an oscillator with a fixed frequency
- the second vertical synchronizing signal can be easily controlled by directly controlling the number of clocks.
- the liquid crystal display 39 is configured as a device built in the expansion unit 3a, but may be configured to be connected to the outside.
- the frame timing data is transmitted, and the creation-side vertical synchronization signal and the reproduction-side vertical synchronization signal are synchronized in accordance with the arrival timing of the frame timing data.
- the method of synchronizing the first vertical synchronization signal and the second vertical synchronization signal is not limited to the example shown in the above embodiment.
- FIG. 21 is a block diagram showing a configuration of the game main body 2 in the fifth embodiment.
- FIG. 22 is a block diagram illustrating a configuration of the extension unit 3 according to the fifth embodiment.
- the communication unit 23 of the game main body 2 in the fifth embodiment has a timer 230 (transmission for measuring time). Side timer).
- the communication unit 33 of the extension unit 3 in the fifth embodiment includes a timer 330 (reception side timer).
- the communication unit 23 and the communication unit 33 synchronize the timer 230 and the timer 330 built in each other. Then, the game main body 2 includes the value of the timer 230 in the beacon periodically transmitted to the expansion unit 3 and transmits the beacon toward the expansion unit 3. The expansion unit 3 matches the value of the timer 330 of the communication unit 33 with the value of the timer 230 included in the beacon received from the game main body 2.
- timer 230 and the timer 330 are synchronized unless otherwise specified.
- the communication unit 23 in the fifth embodiment includes the value of the timer 230 at the timing when the first vertical synchronization signal input from the image processing unit 24a is turned on in the frame timing data and uses this as communication data as an extension unit. 3 to send.
- the frame timing data is transmitted separately from the communication data of the moving image data 5 and at a higher priority than the communication data of the moving image data 5.
- the fifth embodiment may be configured to transmit the frame timing data including the value of the timer 230 together with the moving image data 5.
- FIG. 23 is a diagram illustrating a configuration of the decoder 35c according to the fifth embodiment.
- the decoder 35c in the fifth embodiment is different from the decoder 35a in the second embodiment in that an adder 358 and a comparator 359 are provided instead of the timer 355 and the comparator 356.
- the decoder 35c outputs an output signal (second vertical synchronization signal) from the clock 37 as a read request signal.
- the value of the timer 330 is read from the communication unit 33.
- the read value of the timer 330 is input to the decoder 35c (comparator 359) as "timer value (reception side timer value)" shown in FIG.
- the extension unit 3 in the fifth embodiment reads the value of the timer 330 at the timing of the second vertical synchronization signal of the own device and inputs the read value to the comparator 359.
- the value of the timer 230 included in the frame timing data is input to the decoder 35c as the “reception value (transmission side timer value)” shown in FIG. Is done. More specifically, this “reception value” is input to the adder 358 of the decoder 35 c.
- the adder 358 adds the input “reception value” and the predicted value (predicted value of delay time required for processing) stored in the setting data 310, and a value obtained by adding (added value) Is output to the comparator 359.
- the received value is the value of the timer 230 when the creation of the frame data 50 is started.
- the added value obtained by the adder 358 adding the predicted value to the received value is the value of the timer 230 when it is predicted that the processing for the frame data 50 is completed and display is possible. Since the timer 230 and the timer 330 are synchronized as described above, the value of the timer 230 is equivalent to the value of the timer 330.
- the comparator 359 compares the timer value input from the timer 330 with the added value input from the adder 358.
- the timer value input from the timer 330 to the comparator 359 is the value of the timer 330 when the second vertical synchronizing signal is turned ON, and the added value input from the adder 358 is the second vertical synchronizing signal ON. This is the value of the timer 330 when
- the comparator 359 also has a function of evaluating the difference between the timer value and the added value based on the threshold value (setting data 310). When the value of the timer is larger than the added value and larger than the threshold value (upper limit value), the comparator 359 transmits an upper limit determination signal to the clock 37 as an ON state. When the timer value is smaller than the added value and smaller than the threshold value (lower limit value), the comparator 359 transmits the lower limit value determination signal to the clock 37 in the ON state.
- the upper limit determination signal is turned on.
- the delay of the second vertical synchronization signal is larger than the allowable range (when the delay is larger than the predicted value)
- the lower limit determination signal is turned on.
- the clock 37 in the fifth embodiment controls the oscillator in the direction of increasing the frequency by increasing the control voltage.
- the frequency of the second vertical synchronization signal is increased, so that the delay of the second vertical synchronization signal can be reduced.
- Such control is continued until the “delay” becomes equal to or less than the upper limit value of the threshold.
- the clock 37 in the fifth embodiment controls the oscillator in the direction of decreasing the frequency by decreasing the control voltage.
- the frequency of the second vertical synchronization signal is lowered, so that the delay of the second vertical synchronization signal can be increased.
- Such control is continued until the “delay” becomes equal to or greater than the lower limit value of the threshold.
- a moving image reproduction method realized by the moving image reproduction system 1 in the fifth embodiment as described above will be described.
- the operation of the game main body 2 in the fifth embodiment is the same as that in the second embodiment except that the value of the timer 230 is stored in the frame timing data when the frame timing data is created (see FIG. 12 and FIG. 13), the description is omitted.
- steps S110 to S113 shown in FIG. 24 can be executed in the same manner as steps S61 to S64 (FIG. 14) already described in the second embodiment, and thus description thereof is omitted.
- steps S121 to S126 shown in FIG. 25 can be executed in the same manner as steps S71 to S76 (FIG. 15) already described in the second embodiment, description thereof will be omitted.
- the received communication data is frame timing data (Yes in step S114)
- the value of the timer 230 included in the frame timing data is input to the decoder 35c (adder 358) as a received value.
- the adder 358 calculates the added value based on the received value and the predicted value (step S114).
- the added value calculated by the adder 358 is output toward the comparator 359.
- step S115 When the second vertical synchronizing signal is turned on (Yes in step S115), the value of the timer 330 is read out and input to the decoder 35c (comparator 359). Thereby, the comparator 359 determines whether or not the input value of the timer 330 is equal to or greater than the added value (step S116).
- the comparator 359 is a value obtained by subtracting the addition value from the value of the timer 330 (a value indicating the deviation of the second vertical synchronization signal). It is determined whether or not the value is equal to or less than the value (step S117).
- step S117 when the value obtained by subtracting the added value from the value of the timer 330 is not less than or equal to the upper limit value of the threshold value, the comparator 359 sets the upper limit value determination signal to the ON state and transmits it to the clock 37. Thereby, the clock 37 controls the oscillator so as to increase the frequency of the second vertical synchronizing signal (step S118). In addition, when it determines with No in step S117, the expansion unit 3 skips step S118 and a 2nd vertical synchronizing signal is maintained.
- step S116 when it is determined No in step S116 (when the value of the timer 330 is smaller than the added value), the comparator 359 subtracts the value of the timer 330 from the added value (indicating a deviation of the second vertical synchronization signal). It is determined whether or not (value) is greater than or equal to the lower limit value of the threshold (step S119).
- step S119 when the value obtained by subtracting the value of the timer 330 from the added value is not equal to or greater than the lower limit value of the threshold value, the comparator 359 sets the lower limit value determination signal to the ON state and transmits the signal to the clock 37. Thereby, the clock 37 controls the oscillator so as to lower the frequency of the second vertical synchronizing signal (step S120). In addition, when it determines with No in step S119, the expansion unit 3 skips step S120 and a 2nd vertical synchronizing signal is maintained.
- the game main body 2 transmission side
- the expansion unit 3 reception side
- the timers 230 and 330 are provided with the timers 230 and 330, respectively, and these are synchronized.
- the same effect as in the second embodiment can also be obtained by configuring so that the timing at which the creation of the frame data 50 is started is notified by the value of the timer 230.
- the moving image playback system 1 in the fifth embodiment is not affected by the delay time caused by transmitting frame timing data (the value of the timer 230), and the second vertical The synchronization signal can be adjusted.
- step S123 when the second vertical synchronization signal is turned on in the state where it is already determined as Yes in step S123, the processing of steps S116 to S120 is performed. The process and the process of step S125 are executed in parallel.
- the liquid crystal display 39 according to the fourth embodiment may be provided, and the clock 37 according to the fifth embodiment may be configured as the clock 38 according to the fourth embodiment. .
- the communication unit 23 and the communication unit 33 have been described as adopting a configuration that realizes the WiFi standard.
- the present invention is not limited to this, and other standards (such as infrared communication) are employed. May be.
- a moving image (game screen) created by a game program in accordance with a user operation or the like has been described as an example.
- a real image captured by a video camera may be used as a moving image.
- the moving image reproduction system 1 may be configured as a system that transmits a moving image captured by a video camera by wireless communication and receives / reproduces the image at a remote location.
- each process shown in the above embodiment is merely an example, and is not limited to such contents and order. That is, as long as the same effect can be obtained, it may be changed as appropriate.
- the timing for starting the generation of the second vertical synchronizing signal by the clock 37 is indefinite with respect to the first vertical synchronization signal.
- the timing for starting the generation of the second vertical synchronization signal is determined in accordance with the timing at which the timing signal in the second embodiment first turns ON (the timing at which the first frame timing data is received). It may be configured. The same applies to the third to fifth embodiments described as being the same as the second embodiment.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- Computer Hardware Design (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
2 ゲーム本体
23 通信部(送信手段)
230 タイマー(送信側タイマー)
24,24a 画像処理部
25 エンコーダ
26,34 クロック(通信クロック)
27,37,38 クロック
3,3a 拡張ユニット
310 設定データ
33 通信部(受信手段)
330 タイマー(受信側タイマー)
35,35a,35b,35c デコーダ
355 タイマー
356,359 比較器
39 液晶ディスプレイ
4 テレビ受像器
5 動画像データ
50 フレームデータ
図1は、本発明に係る動画像再生システム1の構成を示す図である。動画像再生システム1は、ゲーム本体2、拡張ユニット3、テレビ受像器4およびケーブル9から構成されており、ゲーム本体2と拡張ユニット3との間で動画像を無線によって送受信しつつ、テレビ受像器4において当該動画像を再生するシステムとして構成されている。
第1の実施の形態では、動画像データの作成側と再生側とが備え、かつ、同期がとられている2つの通信クロック(クロック26,34)を用いて、動画像データの作成のための垂直同期信号(第1垂直同期信号)と、動画像データの再生のための垂直同期信号(第2垂直同期信号)との同期をとる例について説明した。しかし、第1垂直同期信号と第2垂直同期信号とを同期させる手法は、第1の実施の形態に示した例に限定されるものではない。
第2の実施の形態では、フレームタイミングデータと動画像データ(フレームデータ)とを別々の通信データとして送信するように構成していた。しかし、受信側において通信データとして受信される動画像データをフレームタイミングデータとして兼用し、当該動画像データの受信タイミングに応じて第2垂直同期信号を生成するように構成することも可能である。
上記実施の形態における動画像再生システム1はテレビ受像器4を備えており、当該テレビ受像器4において動画像データ5を再生するとして説明した。言い換えれば、すでに一般家庭に設置されているテレビを、動画像再生システム1におけるテレビ受像器4として兼用することができる構成例について説明した。
上記第2ないし第4の実施の形態では、フレームタイミングデータを伝送し、当該フレームタイミングデータが到着したタイミングに応じて、作成側の垂直同期信号と再生側の垂直同期信号との同期をとる例について説明した。しかし、第1垂直同期信号と第2垂直同期信号とを同期させる手法は、上記の実施の形態に示した例に限定されるものではない。
以上、本発明の実施の形態について説明してきたが、本発明は上記実施の形態に限定されるものではなく様々な変形が可能である。
Claims (12)
- 通信データを送信する送信手段が備える通信クロックと前記通信データを受信する受信手段が備える通信クロックとが同期した状態で、前記送信手段と前記受信手段との間で、動画像を表現した動画像データを送受信しつつ、前記動画像を再生する動画像再生システムであって、
前記送信手段の通信クロックに応じて第1垂直同期信号を生成する第1信号生成手段と、
前記第1信号生成手段によって生成された第1垂直同期信号に従ってフレームデータを作成することにより動画像を表現した動画像データを作成する画像作成手段と、
を備え、
前記送信手段は、前記画像作成手段による前記動画像データの作成を開始するタイミングを示す開始タイミングデータと前記画像作成手段によって作成された前記動画像データとを通信データとして送信し、
前記受信手段によって通信データとして受信された前記開始タイミングデータと前記受信手段の通信クロックとに応じて第2垂直同期信号を生成する第2信号生成手段と、
前記受信手段によって通信データとして受信された前記動画像データに基づいて、前記動画像データに含まれるフレームデータを前記第2信号生成手段によって生成された第2垂直同期信号に従って表示することにより、前記動画像データによって表現される動画像を再生する画像再生手段と、
をさらに備えることを特徴とする動画像再生システム。 - 請求項1に記載の動画像再生システムであって、
前記送信手段は、前記開始タイミングデータの通信データと前記動画像データの通信データとを別々の通信データとして送信することを特徴とする動画像再生システム。 - 請求項2に記載の動画像再生システムであって、
前記送信手段は、前記開始タイミングデータの通信データの優先順位を、前記動画像データの通信データの優先順位よりも高く設定しつつ送信することを特徴とする動画像再生システム。 - 通信データを送信する送信手段と前記通信データを受信する受信手段との間で、動画像を表現した動画像データを送受信しつつ、前記動画像を再生する動画像再生システムであって、
第1垂直同期信号を生成する第1信号生成手段と、
前記第1信号生成手段によって生成された第1垂直同期信号に従ってフレームデータを作成することにより動画像を表現した動画像データを作成する画像作成手段と、
を備え、
前記送信手段は、前記画像作成手段による各フレームデータの作成を開始するタイミングを示すフレームタイミングデータと前記動画像データとを通信データとして送信し、
前記受信手段によって通信データとして受信された前記フレームタイミングデータに応じて第2垂直同期信号を生成する第2信号生成手段と、
前記受信手段によって通信データとして受信された前記動画像データに含まれるフレームデータを前記第2信号生成手段によって生成された第2垂直同期信号に従って表示することにより、前記動画像データによって表現される動画像を再生する画像再生手段と、
をさらに備えることを特徴とする動画像再生システム。 - 請求項4に記載の動画像再生システムであって、
前記送信手段は、前記フレームタイミングデータの通信データと前記動画像データの通信データとを別々の通信データとして送信することを特徴とする動画像再生システム。 - 請求項5に記載の動画像再生システムであって、
前記送信手段は、前記フレームタイミングデータの通信データの優先順位を、前記動画像データの通信データの優先順位よりも高く設定しつつ送信することを特徴とする動画像再生システム。 - 請求項4に記載の動画像再生システムであって、
前記受信手段によって通信データとして受信された動画像データを前記フレームタイミングデータとして兼用し、
前記第2信号生成手段は、前記動画像データの受信タイミングに応じて第2垂直同期信号を生成することを特徴とする動画像再生システム。 - 請求項7に記載の動画像再生システムであって、
前記フレームタイミングデータとして兼用される動画像データは、前記動画像データの先頭部分のデータであることを特徴とする動画像再生システム。 - 請求項4に記載の動画像再生システムであって、
前記画像再生手段は、前記第2垂直同期信号におけるフレームごとのクロック数が変更されても前記動画像データに含まれるフレームデータを表示することが可能であり、
前記第2信号生成手段は、前記第2垂直同期信号におけるフレームごとのクロック数を増減することにより、前記第2垂直同期信号を制御しつつ生成することを特徴とする動画像再生システム。 - 請求項4に記載の動画像再生システムであって、
送信側タイマーと受信側タイマーとをさらに備え、
前記フレームタイミングデータは前記送信側タイマーの値を含み、
前記第2信号生成手段は、前記フレームタイミングデータに含まれる前記送信側タイマーの値と、前記受信側タイマーの値とに応じて、第2垂直同期信号を生成することを特徴とする動画像再生システム。 - 動画像を再生する動画像再生方法であって、
(a) 送信手段の通信クロックと受信手段の通信クロックとを同期させる工程と、
(b) 前記(a)工程を実行した後に、前記送信手段の通信クロックに応じて第1垂直同期信号を生成する工程と、
(c) 前記第1垂直同期信号に従ってフレームデータを作成することにより動画像を表現した動画像データを作成する工程と、
(d) 動画像データの作成を開始するタイミングを示す開始タイミングデータと前記動画像データとを通信データとして前記送信手段により前記受信手段に向けて送信する工程と、
(e) 前記送信手段によって送信された通信データを前記受信手段により受信する工程と、
(f) 前記受信手段の通信クロックと前記受信手段によって通信データとして受信された前記開始タイミングデータとに応じて第2垂直同期信号を生成する工程と、
(g) 前記受信手段によって通信データとして受信された動画像データに含まれるフレームデータを、前記第2垂直同期信号に従って表示することにより、前記動画像データによって表現される動画像を再生する工程と、
を有することを特徴とする動画像再生方法。 - 動画像を再生する動画像再生方法であって、
(a) 第1垂直同期信号を生成する工程と、
(b) 前記第1垂直同期信号に従ってフレームデータを作成することにより動画像を表現した動画像データを作成する工程と、
(c) 動画像データを構成する各フレームデータの作成を開始するタイミングを示すフレームタイミングデータと前記動画像データとを通信データとして送信する工程と、
(d) 送信された通信データを受信する工程と、
(e) 通信データとして受信された前記フレームタイミングデータに応じて第2垂直同期信号を生成する工程と、
(f) 通信データとして受信された動画像データに含まれるフレームデータを、前記第2垂直同期信号に従って表示することにより、前記動画像データによって表現される動画像を再生する工程と、
を有することを特徴とする動画像再生方法。
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201080022503.9A CN102439974B (zh) | 2009-05-22 | 2010-05-17 | 活动图像再生系统及活动图像再生方法 |
JP2011514397A JP5581317B2 (ja) | 2009-05-22 | 2010-05-17 | 動画像再生システムおよび動画像再生方法 |
US13/318,229 US8582033B2 (en) | 2009-05-22 | 2010-05-17 | Movie reproduction system and movie reproduction method for reducing delay time of reproduced movie |
EP10777715.3A EP2434757B1 (en) | 2009-05-22 | 2010-05-17 | Video playback system and video playback method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2009-123884 | 2009-05-22 | ||
JP2009123884 | 2009-05-22 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2010134482A1 true WO2010134482A1 (ja) | 2010-11-25 |
Family
ID=43126163
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2010/058266 WO2010134482A1 (ja) | 2009-05-22 | 2010-05-17 | 動画像再生システムおよび動画像再生方法 |
Country Status (5)
Country | Link |
---|---|
US (1) | US8582033B2 (ja) |
EP (1) | EP2434757B1 (ja) |
JP (1) | JP5581317B2 (ja) |
CN (1) | CN102439974B (ja) |
WO (1) | WO2010134482A1 (ja) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5623551B2 (ja) * | 2010-12-10 | 2014-11-12 | 三菱電機株式会社 | マルチ画面表示システム |
JP2015195977A (ja) * | 2014-04-01 | 2015-11-09 | 株式会社ソニー・コンピュータエンタテインメント | ゲーム提供サーバ |
US9566514B2 (en) | 2014-04-01 | 2017-02-14 | Sony Corporation | Game providing system |
US10579571B2 (en) | 2014-04-01 | 2020-03-03 | Sony Interactive Entertainment Inc. | Processing system and multiprocessing system |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104205860B (zh) * | 2012-04-04 | 2017-09-26 | 三菱电机株式会社 | 数字数据发布装置和方法、数字数据再现装置和方法以及同步再现系统 |
US9706508B2 (en) * | 2013-04-05 | 2017-07-11 | Honeywell International Inc. | Integrated avionics systems and methods |
CN106412379B (zh) * | 2016-09-20 | 2019-02-15 | 青岛海信电器股份有限公司 | 实现频率同步的控制方法、装置及液晶电视 |
KR20210158110A (ko) * | 2020-06-23 | 2021-12-30 | 삼성전자주식회사 | 디스플레이의 리프레쉬 레이트를 동적으로 조정하는 전자 장치 |
CN113364767B (zh) * | 2021-06-03 | 2022-07-12 | 北京字节跳动网络技术有限公司 | 一种流媒体数据显示方法、装置、电子设备及存储介质 |
CN114020097B (zh) * | 2022-01-10 | 2022-06-17 | 北京鲸鲮信息系统技术有限公司 | 信号同步方法、装置、电子设备及存储介质 |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08205146A (ja) * | 1995-01-25 | 1996-08-09 | Hitachi Denshi Ltd | 符号化伝送方式におけるタイムスタンプ値演算方法 |
JPH10248066A (ja) * | 1997-03-05 | 1998-09-14 | Oki Electric Ind Co Ltd | 画像データ復号装置および画像データ復号方法 |
JP2000042247A (ja) * | 1998-07-30 | 2000-02-15 | Namco Ltd | ゲームシステム、ゲームデータ配信装置、ゲーム装置、リアルタイム画像表示システムおよび情報記録媒体 |
JP2003037585A (ja) * | 2001-07-25 | 2003-02-07 | Sony Corp | ネットワークシステム、出力機器、およびネットワークシステムの同期方法 |
JP2005057590A (ja) * | 2003-08-06 | 2005-03-03 | Matsushita Electric Ind Co Ltd | デコード表示装置、撮像装置及びそれらを備えた画像伝送システム |
JP2007221411A (ja) | 2006-02-16 | 2007-08-30 | Mie Univ | 映像符号化、復号化装置および映像符号化、復号化方法、並びにそれらのプログラム |
Family Cites Families (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH03220872A (ja) * | 1990-01-26 | 1991-09-30 | Hitachi Ltd | 同期発生回路 |
US5111292A (en) * | 1991-02-27 | 1992-05-05 | General Electric Company | Priority selection apparatus as for a video signal processor |
US5612981A (en) * | 1994-02-15 | 1997-03-18 | Philips Electronics North America Corporation | Apparatus and methods for improving timing recovery of a system clock |
US5559999A (en) * | 1994-09-09 | 1996-09-24 | Lsi Logic Corporation | MPEG decoding system including tag list for associating presentation time stamps with encoded data units |
CN1190081C (zh) * | 1997-03-17 | 2005-02-16 | 松下电器产业株式会社 | 发送和接收动态图像数据的方法及其设备 |
JP3024599B2 (ja) * | 1997-07-22 | 2000-03-21 | 日本電気株式会社 | Aal5ジッタ低減方法及び装置 |
DE19813551C2 (de) * | 1998-03-27 | 2000-03-23 | Grundig Ag | Verfahren zur Übertragung von zeitkritischen Datenpaketen in digitalen drahtlosen Übertragungssystemen |
JP3169009B2 (ja) * | 1999-02-17 | 2001-05-21 | 日本電気株式会社 | Mpegデコーダ、mpegシステムデコーダ及びmpegビデオデコーダ |
KR100330029B1 (ko) * | 1999-08-31 | 2002-03-27 | 구자홍 | 표준신호 처리장치 |
KR100442286B1 (ko) * | 2002-02-25 | 2004-07-30 | 엘지전자 주식회사 | 디지털 방송 수신기의 색재현 오차 보상 장치 및 방법 |
JP4080366B2 (ja) * | 2003-04-01 | 2008-04-23 | シャープ株式会社 | ネットワーク端末、ネットワークシステム、ネットワーク端末の制御方法 |
EP1693999A4 (en) * | 2003-12-11 | 2011-09-14 | Panasonic Corp | PACK STATION DEVICE |
US7784076B2 (en) * | 2004-10-30 | 2010-08-24 | Sharp Laboratories Of America, Inc. | Sender-side bandwidth estimation for video transmission with receiver packet buffer |
CN1925593A (zh) * | 2005-08-30 | 2007-03-07 | 乐金电子(沈阳)有限公司 | 交互式数字视频系统接口的允许数据信号处理装置 |
JP4680793B2 (ja) | 2006-02-16 | 2011-05-11 | アルプス電気株式会社 | 車載用電子機器 |
CN101039442A (zh) * | 2006-03-13 | 2007-09-19 | 硕颉科技股份有限公司 | 影像处理方法及装置 |
US7511762B2 (en) * | 2006-09-06 | 2009-03-31 | Amimon Ltd. | Generation of a frame synchronized clock for a wireless video receiver |
-
2010
- 2010-05-17 JP JP2011514397A patent/JP5581317B2/ja not_active Expired - Fee Related
- 2010-05-17 CN CN201080022503.9A patent/CN102439974B/zh not_active Expired - Fee Related
- 2010-05-17 EP EP10777715.3A patent/EP2434757B1/en not_active Not-in-force
- 2010-05-17 US US13/318,229 patent/US8582033B2/en not_active Expired - Fee Related
- 2010-05-17 WO PCT/JP2010/058266 patent/WO2010134482A1/ja active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08205146A (ja) * | 1995-01-25 | 1996-08-09 | Hitachi Denshi Ltd | 符号化伝送方式におけるタイムスタンプ値演算方法 |
JPH10248066A (ja) * | 1997-03-05 | 1998-09-14 | Oki Electric Ind Co Ltd | 画像データ復号装置および画像データ復号方法 |
JP2000042247A (ja) * | 1998-07-30 | 2000-02-15 | Namco Ltd | ゲームシステム、ゲームデータ配信装置、ゲーム装置、リアルタイム画像表示システムおよび情報記録媒体 |
JP2003037585A (ja) * | 2001-07-25 | 2003-02-07 | Sony Corp | ネットワークシステム、出力機器、およびネットワークシステムの同期方法 |
JP2005057590A (ja) * | 2003-08-06 | 2005-03-03 | Matsushita Electric Ind Co Ltd | デコード表示装置、撮像装置及びそれらを備えた画像伝送システム |
JP2007221411A (ja) | 2006-02-16 | 2007-08-30 | Mie Univ | 映像符号化、復号化装置および映像符号化、復号化方法、並びにそれらのプログラム |
Non-Patent Citations (1)
Title |
---|
See also references of EP2434757A4 |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5623551B2 (ja) * | 2010-12-10 | 2014-11-12 | 三菱電機株式会社 | マルチ画面表示システム |
JP2015195977A (ja) * | 2014-04-01 | 2015-11-09 | 株式会社ソニー・コンピュータエンタテインメント | ゲーム提供サーバ |
US9427665B2 (en) | 2014-04-01 | 2016-08-30 | Sony Corporation | Game providing server |
US9566514B2 (en) | 2014-04-01 | 2017-02-14 | Sony Corporation | Game providing system |
US10579571B2 (en) | 2014-04-01 | 2020-03-03 | Sony Interactive Entertainment Inc. | Processing system and multiprocessing system |
Also Published As
Publication number | Publication date |
---|---|
CN102439974A (zh) | 2012-05-02 |
CN102439974B (zh) | 2015-01-28 |
EP2434757A4 (en) | 2014-07-02 |
EP2434757A1 (en) | 2012-03-28 |
EP2434757B1 (en) | 2016-11-23 |
JPWO2010134482A1 (ja) | 2012-11-12 |
US8582033B2 (en) | 2013-11-12 |
JP5581317B2 (ja) | 2014-08-27 |
US20120050614A1 (en) | 2012-03-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5581317B2 (ja) | 動画像再生システムおよび動画像再生方法 | |
JP3698376B2 (ja) | 同期再生装置 | |
US9489980B2 (en) | Video/audio synchronization apparatus and video/audio synchronization method | |
JP4347322B2 (ja) | 受信装置および方法、並びにプログラム | |
US7865021B2 (en) | Compressed stream decoding apparatus and method | |
JP6275326B2 (ja) | 映像情報再生システム及び映像情報再生装置 | |
JP5178375B2 (ja) | デジタル放送再生装置およびデジタル放送再生方法 | |
KR20130018207A (ko) | 수신 장치 및 그 수신 방법 | |
US8077222B2 (en) | Image processing apparatus to transmit moving image data | |
KR20070026249A (ko) | 정보 재생 장치, 및 정보 재생 방법 및 컴퓨터 프로그램 | |
JP4511952B2 (ja) | メディア再生装置 | |
US8229270B2 (en) | Method and apparatus for compensating audio/video synchronization | |
JP2007281716A (ja) | 無線動画伝送システム、無線動画伝送方法、無線動画送信装置、無線動画送信方法、そのコンピュータプログラム、無線動画受信装置、無線動画受信方法、並びにそのコンピュータプログラム | |
JP2007312122A (ja) | ネットワーク受信機 | |
JP2005318488A (ja) | データ同期再生装置及び端末装置 | |
JP4096915B2 (ja) | デジタル情報再生装置及び方法 | |
JP4359024B2 (ja) | 同期制御方法と装置およびそれを用いた同期再生装置およびテレビジョン受信装置 | |
JP2008244820A (ja) | 映像表示システム及び映像出力装置 | |
JP5471328B2 (ja) | 動画像再生装置及び動画像再生方法並びにプログラム | |
JP4342424B2 (ja) | 映像信号処理装置 | |
JP2007201797A (ja) | 伝送システム及び映像出力方法 | |
JP2009188897A (ja) | 通信システム | |
JP2015204509A (ja) | 無線通信システム、無線通信装置、及び無線通信方法 | |
US20100026911A1 (en) | Transmission device, transmission system, transmission method, and computer program product | |
JP2011128409A (ja) | 液晶表示システム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
WWE | Wipo information: entry into national phase |
Ref document number: 201080022503.9 Country of ref document: CN |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 10777715 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011514397 Country of ref document: JP |
|
REEP | Request for entry into the european phase |
Ref document number: 2010777715 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2010777715 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13318229 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |