TWI597984B - Control method with synchronized video, control system with synchronized video and electronic apparatus thereof - Google Patents

Description

Video and audio synchronization control method, video and audio synchronization control system and related electronic device

The present invention relates to a control method, a control system, and related electronic devices, and more particularly to a video and audio synchronization control method, a video and audio synchronization control system, and related electronic devices.

As technology advances, it is quite common to use pre-recorded films for teaching, operational demonstrations, or as a set with a particular device. For example, when learning an instrument, the content of the instructional film is usually explained by the teacher with relevant techniques and knowledge, and the actual performance of the instrument is demonstrated by different musical compositions. While watching the teaching videos, students can practice their own exercises to achieve the effect of teaching. It is worth noting that teaching films are not only used in musical instrument learning, but also in mechanical operation or in the use of various electronic products.

However, while watching a movie, while performing musical instrument performance, mechanical operation, or use of electronic products, problems such as difficulty in comparison or mismatching often occur, causing frustration in the learning of the instrument or the erroneous use of mechanical or electronic products. On the other hand, if the action of the movie and the specific device is not synchronized, it will cause uncoordinated audiovisual effects. Therefore, how to provide a better video synchronization control method and video and audio synchronization control system to promote the linkage between the operating device and the film is still one of the goals of those skilled in the art.

The invention provides a video and audio synchronization control method, a video and audio synchronization control system and related electronic devices, which can analyze whether there is a control instruction while playing an image file, and control the operation by outputting a control command to the operation device to synchronize with the image file. Equipment to enhance the linkage between operating equipment and movies.

An embodiment of the present invention provides a video and audio synchronization control method, including the following steps. Obtain an image file corresponding to one operating device, and play the aforementioned image file. Corresponding to the current image screen of the played image file, it is determined whether there is a control command. If there is a control command corresponding to the current image frame, the control command is obtained, and the control command is output to the operating device to control the operating device.

Another embodiment of the present invention provides an AV synchronization control system. The video and audio synchronization control system includes a video library, an operating device, and a main device. The main device includes a transmission interface, a display unit, and a processing unit. The transmission interface is coupled to the operating device and the video library, and the main device uses the video library to obtain the image file of the corresponding operating device. The display unit plays the image file. The processing unit is coupled to the transmission interface and the display unit, and determines whether there is a control instruction corresponding to the current image frame of the played image file. If there is a control command corresponding to the current image frame, the processing unit acquires the control command and outputs a control command to the operating device through the transmission interface to control the operating device.

Yet another embodiment of the present invention provides an electronic device suitable for use as a master device of an AV synchronization control system. The electronic device includes a transmission interface, a display unit, and a processing unit. The transmission interface is coupled to the operating device and the audio and video library, and the electronic device utilizes the video library to obtain an image file of the corresponding operating device. The display unit plays the image file. The processing unit is coupled to the transmission interface and the display unit. The processing unit determines whether there is a control command corresponding to the current image frame of the played image file. If there is a control command corresponding to the current image frame, the processing unit acquires the control command and outputs a control command to the operating device through the transmission interface to control the operating device.

Based on the above, the video and audio synchronization control method, the video and audio synchronization control system, and the related electronic device provided by the embodiments of the present invention further analyze whether there is a control instruction corresponding to the image file while playing the teaching image file of the operating device. In more detail, if the control command does exist, the control command is synchronously transmitted to the operating device corresponding to the playback status of the video file. The operating device is actuated in accordance with the received control commands. In this way, through the cooperation of the operating device and the image file, the linkage between the operating device and the movie can be improved.

The above described features and advantages of the invention will be apparent from the following description.

The video and audio synchronization control method, the video and audio synchronization control system, and the related electronic device according to the embodiments of the present invention further determine whether there is a control instruction corresponding to the plurality of image frames when the video file is played, and the control command is, for example, Embedded in the image screen or additionally stored in a control command file. When the video file is played, when the current image screen displayed has a corresponding control command, the control command is output to the operating device, and the operating device operates according to the received control command.

FIG. 1 is a schematic diagram of a video and audio synchronization control system according to an embodiment of the invention. Referring to FIG. 1, the AV synchronization control system 10 includes a video library DB, an operation device OI, and a host device 100. The video library DB stores a plurality of image files, and the image files are image files corresponding to different types of operating devices OI. Specifically, the video library DB includes a network video platform or a server for storing video and audio materials. The image file of the AV library DB can be downloaded directly or provided to other devices in a streaming form. The image file can be an image file that provides different types of images such as a flat image, a stereo image, or a holographic projection. The operating device OI is for example a musical instrument, a mechanical product or an electronic product. In more detail, the operation device OI is, for example, a keyboard, an electronic drum, an electric piano, an electric guitar, or other kinds of electronic musical instruments. On the other hand, the operating device is, for example, a conventional musical instrument in a non-electronic form. In another embodiment, the operating device OI is, for example, a robot for entertainment. In other embodiments, the operating device OI is also, for example, a digital camera, a digital home appliance, an entertainment electronic product, or other kinds of electronic products, but the invention is not limited thereto.

In an embodiment of the invention, the operating device OI further includes a plurality of operating portions and a plurality of indicating devices respectively provided corresponding to the operating portions. FIG. 2 is a schematic diagram of an operation device according to an embodiment of the invention. Referring to FIG. 2, when the operating device OI is, for example, a keyboard, the plurality of keys of the keyboard are the operating portion OP, and the indicating device IA is, for example, a plurality of indicator lights provided corresponding to the keys. In other embodiments of the invention, the operating portion OP of the operating device OI and the pointing device IA may also be integrated. In the example of the aforementioned keyboard, the key can be integrated with the indicator light so that the key body has a function of emitting an indicator light. It is to be noted that the operation unit OP and the pointing device IA are different members depending on the type of the operating device OI. For example, if the operating device OI is an electronic drum, the operating portion OP is, for example, each tapping surface of the electronic drum, and the pointing device IA is an indicator light corresponding to the tapping surface. In summary, when the operating device OI is an electronic musical instrument or a non-electronic type of conventional musical instrument, the pointing device IA is, for example, an indicator light corresponding to the operating portion OP of each type of musical instrument, and the indicator light is illuminated by a light emitting diode (Light Emitting) Diode, LED) or other type of lighting unit. On the other hand, the pointing device IA also includes, for example, more than one display screen, such as a liquid crystal display (LCD) or other type of display screen, built into the operating device OI or externally connected to the operating device OI.

However, it is worth noting that the pointing device IA of the operating device OI is not limited to the foregoing. In another example, if the operating device OI is a digital camera, the operating portion OP is, for example, a button of a digital camera and a touch panel, and the pointing device IA is an indicator light and a backlight corresponding to the button and the touch panel. .

In still another embodiment of the present invention, the operating device OI may not include the aforementioned pointing device IA and the operating portion OP. FIG. 3 is a schematic diagram of an operation device according to an embodiment of the invention. Referring to FIG. 3, the operating device OI is, for example, a robot. The aforementioned robot is suitable for the entertainment public, but the invention is not limited thereto. In the present embodiment, the operation device OI has a built-in portion OI-100, an operation portion OI-200, and an acousto-optic portion OI-300. The built-in portion OI-100 is coupled to the operating portion OI-200 and the acousto-optic portion OI-300. The built-in unit OI-100 is, for example, an element including a transmission interface, a processing unit, and the like. The operation unit OI-200 is, for example, the limbs of the robot, and the acousto-optic unit OI-300 is, for example, a lighting fixture and a horn on the robot. Specifically, the operation unit OI-200 and the acousto-optic unit OI-300 are activated, flashed, or played back based on the control of the built-in unit OI-100.

Referring to FIG. 1, the main device 100 includes a transmission interface 110, a display unit 120, and a processing unit 130. In this embodiment, the main device 100 is independent of the audiovisual database DB and the operating device OI, and is, for example, an electronic device such as a tablet computer, a smart phone, or a computer. However, in another embodiment of the present invention, the main device 100 may also be integrated with the video library DB and the operating device OI, and is mainly operated by the operating device OI. In another embodiment of the present invention, the main device 100 may also be integrated only with the operating device OI, and the video library DB is independent of the main device 100 and the operating device OI.

The transmission interface 110 is respectively coupled to the operating device OI and the video library DB in a wired or wireless manner. In detail, the transmission interface 110 is, for example, supporting various wireless communication standards such as Bluetooth, WiFi, Worldwide Interoperability for Microwave Access (WiMax), Near Field Communication (NFC), and Long Term Evolution (LTE). Wireless transmission interface. In other embodiments, the transmission interface 110 further includes a wired transmission interface that is connected through an Asymmetric Digital Subscriber Line (ADSL), a Cable Modem, or the like.

The display unit 120 is, for example, a display unit of a liquid crystal display (LCD), a light emitting diode (LED) display or the like for displaying an image file. The processing unit 130 is coupled to the transmission interface 110 and the display unit 120, and is, for example, a central processing unit (CPU), or other programmable general purpose or special purpose microprocessor (Microprocessor), digital signal. A Digital Signal Processor (DSP), a programmable controller or the like or a combination of the above.

FIG. 4 is a flowchart of a method for controlling video and audio synchronization according to an embodiment of the invention. The video and audio synchronization control method shown in FIG. 4 is applicable to the video and audio synchronization control system shown in FIG. 1, but the present invention is not limited thereto. Referring to FIG. 1 and FIG. 4, in the video and audio synchronization control method, the main device 100 first acquires an image file corresponding to the operation device OI by the assistance of components such as the transmission interface 110 and the processing unit 130 (step S310). In more detail, the image file is, for example, a learning teaching image of the operating device OI, using a teaching image or other corresponding image, and the image file is stored, for example, in the video library DB, or is the original teaching in the video library DB. The image is obtained by further processing, but the invention is not limited thereto. Next, the video file is played by the display unit 120 of the host device 100 (step S320). It should be noted that if the operating device OI has the pointing device IA indicating the type of the screen, the aforementioned image file may also be played by the pointing device IA of the display screen type. In general, an image file consists of multiple continuous image frames. Therefore, in the process of playing the image file, the processing unit 130 determines whether there is a control command corresponding to a current image frame of the played image file (step S330).

More specifically, in the process of playing the video file, for the video screen currently playing on the display unit 120, or for the video screen to be played on the display unit 120, the processing unit 130 determines whether there is a corresponding control command. If there is no control command corresponding to the current image frame in the foregoing case, the video synchronization control method returns to the foregoing step S320 and continues to play the video file by the display unit 120. However, if there is a control command corresponding to the current video frame in the foregoing case, the processing unit 130 further acquires the control command (step S340).

As described above, the main device 100 acquires and utilizes control commands to control the operating device. In an embodiment of the present invention, when the operating device OI is an operating device including a plurality of operating portions OP and a plurality of pointing devices IA corresponding to the operating portion OP, the operating device OI cooperates with the display unit 120 according to the received control commands. The current image displayed is conveyed by the pointing device IA. Specifically, in the foregoing embodiment, the operating device OI is, for example, an electronic musical instrument such as a keyboard, an electronic drum, an electric piano, or an electric guitar, or a non-electronic traditional musical instrument such as a piano or a guitar, or a digital camera or a digital home appliance. Electronic products that can be operated.

Referring to Fig. 2, the electronic organ is taken as an operating device OI as an example, and it is assumed that there are 88 keys as the operating portion OP, and each of the keys is provided with an indicator light for displaying a plurality of colors as the pointing device IA. At this time, the control command is composed of, for example, an 8-bit main command and 88 2-bit operation data, and each of the operation data corresponds to one key (operation unit OP). The main instructions are used to indicate the hardware settings of the operating device OI. Take the keyboard as an example, such as the overall volume of the keyboard, the power switch, the color of the indicator light, the accompaniment type, and so on. On the other hand, the operation unit data is used to indicate the pressing force of the key and the opening and closing of the indicator light. Based on the foregoing, in this example, the control instructions require a total of 23 bytes of storage space.

In another embodiment of the present invention, when the operating device OI is the robot shown in FIG. 3, the control command received by the built-in portion OI-100 of the operating device OI is matched with the current image displayed by the display unit 120, and is provided by the built-in portion. The OI-100 controls the operation unit OI-200 and the acousto-optic unit OI-300, so that the operating device OI operates, flashes, or emits a sound effect. The control commands are composed of segments of different bit lengths, and each segment corresponds to a different action portion OI-200 and an acousto-optic portion OI-300, respectively. The built-in unit OI-100 controls the operation unit OI-200 and the acousto-optic unit OI-300 in accordance with each instruction segment.

FIG. 5 is a flow chart of obtaining a control command according to an embodiment of the invention. FIG. 6 is a schematic diagram of a control instruction embedded in an image frame according to an embodiment of the invention. Referring to FIG. 1, FIG. 4, FIG. 5 and FIG. 6, in the embodiment, the control command CI is mainly embedded in the image frame. Therefore, when the display unit 120 plays the video file (step S320), the processing unit 130 first determines whether the current image frame is embedded with the control command (step S332), and if the current image frame is indeed embedded with the control command, the processing unit 130 is configured by the current image. The control command is retrieved (step S342).

In general, image files typically have 30 or 60 image frames per second. When the image frame is defined in the red-green-blue (RGB) color system, one pixel of each image frame usually occupies 3 bytes of space to store the corresponding image data segment, but the present invention is not limited thereto. In other embodiments, the image frame may also be defined in a hue-saturation-lightness (HSV) color system, a hue-saturation-luminance (HSL) color system, a brightness-chroma-density (YUV) color system, or In other color systems, the storage space occupied by one pixel of an image frame to store image data segments varies with the defined color system. Therefore, taking the red-green-blue color system as an example, as shown in FIG. 6, for the video picture CVF currently playing or to be played, the control command CI can be embedded in the image picture by replacing part of the pixel P. Among the CFV. For example, if the control command CI is the size of 23 bytes, at least the image data segment of the 8 pixels P needs to be sacrificed, and the plurality of instruction segments CIP of the control command are respectively written to the pixel P. In other words, the data segment corresponding to the aforementioned pixel P is changed to a plurality of instruction segments CIP corresponding to the control command. In order to avoid interference with the current image frame CFV, the pixels P used to embed the instruction segment CIP may be located at the four corners of the current image frame CFV. The processing unit 130 obtains the complete control command CI by recombining the plurality of instruction segments CIP stored by the aforementioned pixels P.

However, control commands are not necessarily embedded in the image frame. In another embodiment of the present invention, all control commands of the image file are collected, for example, in a control instruction file, but are not limited thereto. In more detail, the control instruction file includes the aforementioned control instructions and the transmission time point corresponding to each of the control instructions.

FIG. 7 is a flowchart of obtaining a control command according to another embodiment of the present invention. Referring to FIGS. 1, 4, and 7, the host device 100 first acquires a video file and a control command file corresponding to the operating device OI by using the transmission interface 110 (step S312). Next, the display unit 120 plays the image file (step S320). When the video file is played, the processing unit 130 determines the current image frame by using a plurality of transmission time points recorded in the control command file according to the playback time point of the current video image being played on the playback time axis of the video file. Whether there is a corresponding control command (step S334). In other words, the processing unit 130 compares the transmission time points of the plurality of control commands by the playback time point of the current image frame on the playback time axis of the video file. If there is a matching transmission time point, it means that there is a control command corresponding to the current image picture. At this time, the processing unit 130 acquires the aforementioned control command from the control command file (step S340). Then, during the playing period of the current image frame, the processing unit 130 transmits a corresponding control command to the operating device OI. It should be noted that in other embodiments of the present invention, all control commands of the image file may also be stored in a table, a specific memory block, or a specific storage device. Each control command corresponds, for example, to a transmission time point. The processing unit 130 compares the transmission time points of the plurality of control commands by the playing time point of the current image frame on the playing time axis of the image file, so as to be from the instruction table (Table), the specific memory block or the specific A corresponding control command is obtained among the storage devices.

Referring back to FIG. 4, after acquiring the control command (step S340), the processing unit 130 further outputs a control command to the operating device OI to control the operating device (step S350). After the operation device OI receives the control command, it operates according to the control command and cooperates with the current image screen.

In an embodiment of the invention, after receiving the control command, the operating device OI transmits the navigation message by the plurality of pointing devices IA according to the control command and the current image frame. FIG. 8 is a schematic diagram of a navigation message according to an embodiment of the invention. The electronic organ shown in FIG. 2 is used as the operating device OI. In FIG. 8, when the current video frame played by the display unit 120 is one of pressing a plurality of keys, the operating device OI synchronously makes the keys at the same position according to the control command. The indicator light (instruction unit IA) of the (operation unit OP) blinks. By prompting the keys to be pressed by the blinking indicator light, the AV synchronization control system 10 can guide the learning process of the keyboard with the progress of the current image frame, but the invention is not limited thereto. In another embodiment of the present invention, when the current video frame played by the display unit 120 is one of pressing a plurality of keys, the operating device OI, for example, synchronously plays the corresponding sound of the keys according to the control command, thereby prompting The key that should be pressed. In still another embodiment of the present invention, when the current image frame played by the display unit 120 is one of pressing a plurality of keys, the operating device OI, for example, synchronously flashes the indicator light according to the control command and plays the corresponding key. sound. Obviously, in the foregoing embodiment, the navigation message is, for example, the blinking of the indicator light and the sound of the key. After outputting the control command to the operating device OI, the display unit 120 continues the playback of the video file (step S320), and the processing unit 130 repeatedly checks whether the subsequently played video image has a corresponding control command to determine whether to extract the control command. And transfer until the video file is broadcast.

It should be noted that, in another embodiment of the present invention, when the operating device OI is a robot, after receiving the control command, the electronic robot may be activated according to the received control command, and generated with the synchronized video file. Entertainment effect. Specifically, the built-in unit OI-100 of the operation device OI receives the control command, and accordingly controls the operation unit OI-200 and the acousto-optic unit OI-300 to operate, flash, or emit an effect.

In the foregoing several embodiments, the image file of the operating device OI has, for example, a corresponding plurality of control commands. In the present invention, a relatively special user such as a teacher, an instructor or a designer can also reversely generate a control command by operating the aforementioned operating device OI. Specifically, the main device 100 can receive the original teaching image without the control instruction and the related control instruction file from the video library DB or other sources, and then generate the control instruction or the control instruction file by itself. FIG. 9 is a flow chart of obtaining an image file according to another embodiment of the invention. Referring to FIG. 9, the host device 100 receives the original image of the corresponding operation device OI from the video library DB, for example, using the transmission interface 100 (step S301). The processing unit 130 generates a plurality of control commands corresponding to the original image (step S303), and respectively embeds the control commands into the plurality of image frames of the corresponding original image to generate the image file (step S305). In this way, the obtained image file is embedded with control commands.

In the following, an exemplary embodiment will be described how the AV synchronization control system 10 generates a control command corresponding to a video file based on the feedback of the special user in the operating device OI. In an embodiment of the invention, after the display unit 120 plays the original image, the host device 100 receives the operation message returned by the operating device OI through the transmission interface 110. Taking the keyboard (operating device OI) shown in FIG. 2 as an example, if the teacher, the instructor, or the designer views the original image and presses the key (operating portion OP) following the image content, the key combination pressed for each current image frame is used. It will be transmitted back to the host device 100 as an operation message. In other words, the operation message is the operation situation of the aforementioned person on the operation unit OP, and may be directly received by the processing unit 130 of the host device 100 in the form of an electronic signal. After the original image is played, the processing unit 130 generates a plurality of control commands corresponding to the original image by using the received operation message, wherein the control commands respectively correspond to the plurality of image frames. In addition, the main device 100 further embeds the original image and the corresponding control command to generate an image file, and then stores the image file into the video library DB. In this way, a more special user such as a teacher, an instructor or a designer can generate an image file with a control command by himself.

In an embodiment of the invention, the AV synchronization control system 10 and the main device 100 can also be used for instant teaching. In this embodiment, the AV synchronization control system 10 further includes, for example, a photographing device (not shown), and a plurality of users such as a teacher and at least one student can use a set of the main device 100 and the operation device OI, respectively. When the teacher operates the operation device OI, the master device 100 of the teacher terminal converts the operation of the teacher on the operation portion OP into an image through the photographing device and the transmission interface 110. On the other hand, the operation of the teacher to the operation unit OP is also converted into an operation message, and then the processing unit 130 of the teacher side receives and corresponds to the aforementioned image to generate a control instruction. For example, when the operating device OI is a piano, the teacher's operation of the keys can be converted into an electronic message, which is then received and recognized by the processing unit 130. In an embodiment of the invention, the processing unit 130 further combines control commands into the recorded images to generate an image file, and transmits the image file combined with the control command to the host device 100 of the student terminal through the transmission interface 110. It should be noted that, in another embodiment, the processing unit 130 of the teacher may also be an image of the analysis camera to obtain an operation situation of the teacher to the operation unit OP, and accordingly generate a control instruction.

After receiving the image file of the control command, the main device 100 of the student terminal extracts the relevant control command, and then outputs the control command to the operation device OI used by the student, and cooperates with the image file to convey the guide message. In this way, students can follow the teacher's actions to learn in real time. In another embodiment of the present invention, the main device 100 of the student terminal may further receive the original operation image without the embedded control instruction by the main device 100 of the tutor, and then analyze by the processing unit 130 of the main device 100 of the student terminal, thereby generating A control instruction corresponding to the original operation image. Thereafter, the main device 100 of the student terminal guides the student to learn the operating device OI according to the operation image and the self-generated control command.

In summary, the video and audio synchronization control method, the video and audio synchronization control system, and the related electronic device provided by the embodiments of the present invention further analyze whether there is a control instruction corresponding to the image file while playing the corresponding image file of the operation device. . The control commands are, for example, embedded in the image screen or included in the control command file. If the control command does exist, the control command is synchronously transmitted to the operating device corresponding to the playback status of the image file. The operating device is actuated according to the received control command, for example, to convey a guide message or to entertain the public by acting, flashing, and emitting sound effects. In this way, through the cooperation of the operating device and the image file, the linkage between the operating device and the movie can be improved.

Although the present invention has been disclosed in the above embodiments, it is not intended to limit the present invention, and any one of ordinary skill in the art can make some changes and refinements without departing from the spirit and scope of the present invention. The scope of the invention is defined by the scope of the appended claims.

10: AV synchronization control system 100: Main device 110: Transmission interface 120: Display unit 130: Processing unit DB: Video library OI: Operation device OI-100: Built-in unit OI-200: Operation unit OI-300: Sound and light unit OP: operation unit IA: pointing device P: pixel CVF: current video picture CI: control command CIP: command segment S310, S312, S320, S330, S332, S334, S340, S342, S350: step S301 of the video and audio synchronization control method, S303, S305: Steps of obtaining an image file

FIG. 1 is a schematic diagram of a video and audio synchronization control system according to an embodiment of the invention. FIG. 2 is a schematic diagram of an operation device according to an embodiment of the invention. FIG. 3 is a schematic diagram of an operation device according to an embodiment of the invention. FIG. 4 is a flowchart of a method for controlling video and audio synchronization according to an embodiment of the invention. FIG. 5 is a flow chart of obtaining a control command according to an embodiment of the invention. FIG. 6 is a schematic diagram of a control instruction embedded in an image frame according to an embodiment of the invention. FIG. 7 is a flowchart of obtaining a control command according to another embodiment of the present invention. FIG. 8 is a schematic diagram of a navigation message according to an embodiment of the invention. FIG. 9 is a flow chart of obtaining an image file according to another embodiment of the invention.

S310, S320, S330, S340, S350: steps of the video and audio synchronization control method

Claims (17)

An image and audio synchronization control method includes: acquiring an image file corresponding to an operation device, wherein the file image is a teaching image of the operation device; playing the image file; corresponding to a current image frame of the played image file, Determining whether there is a control command, wherein the control command is generated by performing an input operation on the operating device; if the control command is present corresponding to the current image frame, obtaining the control command; and outputting the control command to the The device is operated to control the operating device. The video synchronization control method of claim 1, wherein the step of determining whether the control command exists comprises: determining whether the current image frame is embedded in the control command, and if the current image frame is embedded in the control command, And the step of obtaining the control instruction further includes: capturing the control instruction from the current image frame. The video synchronization control method according to claim 2, wherein the data segments corresponding to the partial pixels of the current image frame are respectively a plurality of instruction segments of the control instruction. The method for controlling video and audio synchronization according to claim 1, wherein the step of obtaining the image file further comprises: Obtaining a control instruction file, where the control instruction file includes a plurality of the control instructions and a corresponding plurality of transmission time points, and the step of determining whether the control instruction exists, further comprising: according to the current image frame in the image file A playback time point located on a playback time axis determines whether the corresponding control command exists by the transmission time points in the control instruction file. The video synchronization control method of claim 1, wherein the step of acquiring the image file corresponding to the operation device further comprises: receiving an original image corresponding to the operation device; generating a plurality of corresponding images corresponding to the original image And the control command; and respectively embedding the plurality of the control commands in the plurality of image images of the corresponding original image to generate the image file. The video synchronization control method according to claim 1, wherein the operation device transmits a navigation message according to the received control instruction in cooperation with the current image frame. The video synchronization control method according to claim 6, wherein the operating device is a musical instrument, and the musical instrument comprises a keyboard. The video synchronization control method according to claim 1, wherein the operating device is a robot. An audio-visual synchronization control system, comprising: a video and audio library; an operating device; a main device includes: a transmission interface coupled to the operating device and the video library, and the main device uses the video library to obtain an image file corresponding to the operating device; and a display unit that plays the image file; And a processing unit coupled to the transmission interface and the display unit, corresponding to a current image frame of the played image file, determining whether a control command exists, and if the control command exists corresponding to the current image frame, The processing unit obtains the control command, and outputs the control command to the operating device through the transmission interface to control the operating device, wherein the file image is a teaching image of the operating device, wherein the control command is by using the operating device An input operation is performed to generate. The video synchronization control system of claim 9, wherein the processing unit determines whether the current image frame is embedded with the control command, and if the current image frame is embedded with the control command, the processing unit is configured by the current image frame. Take this control command. The video synchronization control system of claim 10, wherein the data segments corresponding to the partial pixels of the current image frame are respectively a plurality of instruction segments of the control instruction. The video synchronization control system according to claim 9, wherein the transmission interface obtains a control instruction file when acquiring the image file, and The control instruction file includes a plurality of the control instructions and a corresponding plurality of transmission time points, and the processing unit is configured by the control instruction file according to a current playback time point of the current image frame located on a play time axis of the image file. The transmission time points in the medium are determined whether there is a corresponding control instruction. The video synchronization control system of claim 9, wherein the transmission interface receives an original image corresponding to the operating device by the video library, and the processing unit generates a plurality of the control commands corresponding to the original image. And respectively, the plurality of the control instructions are embedded in the plurality of image frames of the corresponding original image to generate the image file. The video synchronization control system according to claim 9, wherein the operation device comprises a plurality of operation portions and a plurality of indication devices corresponding to the operation portions, and the operation device cooperates with the display according to the received control command The current image frame displayed by the unit is used by the pointing devices to convey a navigation message. The video synchronization control system of claim 14, wherein the operating device is an instrument, and the musical instrument comprises a keyboard, wherein when the operating device is the keyboard, the operating portions comprise a plurality of the keyboard The keys, and the indicating devices include a plurality of indicator lights corresponding to the plurality of keys. The video-synchronous control system according to claim 9, wherein the operating device is a robot. An electronic device adapted to function as a master device of an AV synchronization control system, the electronic device comprising: a transmission interface, coupled to an operating device and a video library, and the electronic device uses the video library to obtain an image file corresponding to the operating device; a display unit that plays the image file; and a processing unit coupled Corresponding to the transmission interface and the display unit, determining whether there is a control command corresponding to a current image frame of the played image file, and if the control command exists corresponding to the current image frame, the processing unit obtains the control command And outputting the control command to the operating device to control the operating device through the transmission interface, wherein the file image is a teaching image of the operating device, wherein the control command is generated by performing an input operation on the operating device .