TW202315414A - Infrared remote controlled video and audio device and infrared remote control method of playing video and audio - Google Patents

Abstract

An infrared remote control method of playing video and audio includes playing display frames of a video by a display interface and outputting an audio signal by an audio output interface, receiving a first instruction signal by an infrared sensor, pausing the display interface and the audio output interface according to the first instruction signal to make the display interface display a pause frame, receiving a second instruction signal by the infrared sensor, determining a target character pattern in a target block in the pause frame according to the second instruction signal, extracting a determined audio track corresponding to the target character pattern from the audio signal according to the correspondence between pre-processed character feature groups and pre-processed audio tracks, and controlling the display interface to continue playing and the audio output interface to output the determined audio track.

Description

Infrared remote control audio-visual device and infrared remote control audio-visual playing method

The present invention relates to a video and audio playback control method, in particular to an infrared remote control audio and video playback method.

Traditional TV must be connected to digital TV antenna, HDMI video input or the fourth channel to watch the program, and watch according to the established broadcast time. With the rise of smart home appliances in recent years, all home appliances require functions such as being able to connect to the Internet and connecting to applications (APPs), including TVs. Smart TV provides the function of watching videos on the Internet through YouTube, Netflix, Apple TV+, myVideo and other platforms just like a smartphone. However, when a TV is currently playing a video, the sound is usually mixed and broadcast, so users often encounter the problem of being unable to distinguish which character the sound belongs to in the display screen.

In view of the above, the present invention provides an infrared remote control audio-visual device and an infrared remote-control audio-visual playing method, which can provide the voice of a specified character.

According to an embodiment of the present invention, an infrared remote control audio-visual device includes an infrared sensor, a display interface, an audio output interface, a memory, and a processor, wherein the processor is connected to the infrared sensor, the display interface, the audio output interface, and the memory . The infrared sensor is used for receiving the first indication signal and the second indication signal. The display interface is used to play multiple display screens of the video. The audio output interface is used to output the audio of the video. The memory stores multiple pre-processing character feature sets, multiple pre-processing audio tracks, and correspondence between the multiple pre-processing character feature sets and the multiple pre-processing audio tracks. The processor is used to: according to the first instruction signal, pause the playback of the display interface and the output of the audio output interface, so that the display interface displays a pause image; according to the second instruction signal, determine the target character pattern located in the target block of the pause image, wherein The second indication signal indicates the target block, and the target character pattern conforms to one of the plurality of pre-processing character feature groups; according to the corresponding relationship between the plurality of pre-processing character feature groups and the plurality of pre-processing audio tracks , extracting the determination audio track corresponding to the target character pattern from the audio; and controlling the display interface to continue playing, and controlling the audio output interface to output the determination audio track.

According to an embodiment of the present invention, an infrared remote control video playback method includes: playing multiple display screens of a video through a display interface, and outputting the audio of the video through an audio output interface; receiving a first indication signal through an infrared sensor; The processor, according to the first instruction signal, pauses the playback of the display interface and the output of the audio output interface, so that the display interface displays a pause image; receives the second instruction signal through the infrared sensor; and uses the processor according to the second instruction signal, judging the target character pattern located in the target block of the pause screen, wherein the second indication signal indicates the target block, and the target character pattern conforms to one of a plurality of pre-processed character feature groups; by the processor according to the Correspondence between multiple pre-processed character feature groups and multiple pre-processed audio tracks, extracting a determination audio track corresponding to the target character pattern from the audio; and controlling the display interface to continue playing, and controlling the audio output interface to output the determination audio track.

With the above structure, the infrared remote control audio-visual device and the infrared remote control audio-visual playback method disclosed in this case determine the corresponding sound of the character specified by the infrared indication signal based on the correspondence between multiple pre-processed character feature groups and multiple pre-processed audio tracks. track, it can provide the function of playing the sound of the specified character independently.

The above description of the disclosure and the following description of the implementation are used to demonstrate and explain the spirit and principle of the present invention, and provide a further explanation of the patent application scope of the present invention.

The detailed feature groups and advantages of the present invention are described in detail below in the embodiments, the content of which is sufficient to enable anyone familiar with the relevant art to understand the technical content of the present invention and implement it accordingly, and according to the content disclosed in this specification, the patent scope of the application and the drawings Any person skilled in the relevant art can easily understand the related objects and advantages of the present invention. The following examples are to further describe the concept of the present invention in detail, but not to limit the scope of the present invention in any way.

Please refer to FIG. 1 . FIG. 1 is a functional block diagram of an infrared remote control audio-visual device according to an embodiment of the present invention. As shown in FIG. 1 , the infrared remote control audio-visual device 10 includes an infrared sensor 11, a display interface 13, an audio output interface 15, a memory 17 and a processor 19, wherein the processor 19 is connected to the infrared sensor by wired or wireless means. 11. A display interface 13 , an audio output interface 15 and a memory 17 . In particular, the infrared remote control audio-visual device 10 can be realized by a smart TV, but not limited thereto.

The infrared sensor 11 is used for receiving an infrared indication signal, such as an infrared indication signal sent by a TV remote control. Furthermore, the infrared indication signal may carry different codes or other marks that can be identified by the processor 19 depending on the key that is triggered (for example, pressed) on the TV remote control. The display interface 13 is, for example, a screen, and the audio output interface 15 is, for example, a speaker. The display interface 13 and the audio output interface 15 are used for playing video. Furthermore, the display interface 13 is used to play multiple display images of the video, and the audio output interface 15 is used to output the audio of the video.

Memory 17 is, for example, flash (flash) memory, hard disk (HDD), solid state disk (SSD), dynamic random access memory (DRAM), static random access memory (SRAM) or other non-volatile Memory. The memory 17 can be a local storage medium or a remote storage medium, such as a cloud database. The memory 17 stores a plurality of pre-processing character feature groups, a plurality of pre-processing audio tracks, and the corresponding relationship between the plurality of pre-processing character feature groups and the plurality of pre-processing audio tracks, wherein the corresponding relationship is, for example, searched for stored in the form of a table.

The processor 19 is, for example, a central processing unit, a microcontroller, a programmable logic controller or other processors. The processor 19 is used for processing the video played by the display interface 13 and the audio output interface 15 according to the infrared indication signal received by the infrared sensor 11, so as to play the sound corresponding to the specified character. Further implementation steps will be described later.

Please refer to FIGS. 1 and 2 together, wherein FIG. 2 is a flow chart of an infrared remote control video playback method according to an embodiment of the present invention. As shown in FIG. 2 , the method for playing audio and video by infrared remote control may include steps S201 - S207 . The infrared remote control audio-visual playing method shown in FIG. 2 can be executed by the infrared remote control audio-visual device 10 shown in FIG. 1 , but is not limited thereto. For the convenience of understanding, the operation of the infrared remote control audio-visual device 10 is exemplified below to illustrate the infrared remote control audio-visual playing method.

In step S201 , the infrared remote control audio-visual device 10 plays multiple display frames of the video through the display interface 13 , and outputs the audio of the video through the audio output interface 15 . In steps S202 and S203, the infrared remote control audio-visual device 10 receives the first indication signal through the infrared sensor 11, and the processor 19 pauses the playback of the display interface 13 and the output of the audio output interface 15 according to the first indication signal. , to make the display interface 13 display a pause image, that is, to pause the playing of the movie. Further, the first indication signal can be derived from an infrared remote controller, and the infrared remote controller has a plurality of keys. When a specific key or combination of keys is triggered, the infrared remote controller outputs the first indication signal, and the first indication signal is accompanied by There are codes (hereafter referred to as pause codes) that represent the specific key or combination of keys in question. For example, the specific key may be the key of number zero or the key of pausing playback, which is not limited in the present invention. The processor 19 pre-stores the corresponding relationship between the pause code and the pause movie playback operation. When the processor 19 receives the first indication signal, it can control the display interface 13 and the audio output interface 15 to pause playing the video according to the pause code included in the first indication signal.

In step S204 , the infrared remote control audio-visual device 10 receives the second indication signal through the infrared sensor 11 . It should be noted here that step S204 may be executed between step S202 and step S203. For example, the user can send two indication signals successively through the infrared remote controller. The processor 19 may determine that the receiver of the first indication signal is the first indication signal and the receiver of the second indication signal is the second indication signal according to the time sequence in which the infrared sensor 11 receives the two indication signals.

Next, the infrared remote control audio-visual device 10 executes steps S205 - S207 through the processor 19 . In step S205, the processor 19 judges the target character pattern located in the target block of the paused screen according to the second indication signal, wherein the second indication signal indicates the target block, and the target character pattern conforms to a plurality of pre-processed character feature groups one of them. Further, the processor 19 may divide the paused screen into multiple divided blocks, and assign a designated code to each divided block, and the designated code of each block corresponds to a different key or combination of keys on the infrared remote controller. The second indication signal generated by the infrared remote controller carries a corresponding designated code according to the key or combination of keys triggered by it. When the processor 19 receives the second indication signal, it can determine that the divided block corresponding to the specified code is the target block. Specifically, the key or key combination corresponding to the specified code is different from the key or key combination corresponding to the aforementioned pause code.

The processor 19 judges that there is a matching target character pattern in the target block according to a plurality of pre-processed character feature groups stored in the memory 17 . Furthermore, each pre-processing character feature group contains multiple features, such as facial features, facial features, etc., when the processor 19 judges that the target block contains the same preset number of features in the same pre-processing character feature group , it is judged that there is a target character pattern in the target block that conforms to the pre-processed character feature group. Specifically, when the processor 19 judges that there is no pattern matching the pre-processed character feature set in the target block, it does not act, or outputs a request signal through the display interface 13 or the audio output interface 15 to request another second instruction signal , and execute step S205 again after receiving a new second indication signal.

In step S206 of FIG. 2 , the processor 19 extracts the determined audio track corresponding to the target character pattern from the audio according to the correspondence between the plurality of pre-processed character feature groups and the plurality of pre-processed audio tracks. Further, the plurality of pre-processing character feature groups respectively include facial features and facial features of different characters in the movie, the plurality of pre-processing audio tracks respectively include the voices of different characters in the movie, and the plurality of pre-processing The correspondence between the processing character feature set and the multiple pre-processing tracks indicates the association between the pre-processing character feature set belonging to the same character and the multiple pre-processing tracks. The pre-processed character feature group, the pre-processed audio track and the correspondence between the two can be processed by the processor 19 or an external processor (such as a cloud server) with artificial intelligence (AI) technology before playing the video and stored in the memory 17, or processed by the processor 19 with AI technology during video playback before receiving the first instruction signal and stored in the memory 17, further AI processing methods will be described later. In one implementation, the pre-processed audio track is obtained by processing the audio of a part of the video, and the processor 19 can determine the A preprocessed audio track corresponding to the pattern of the target character, and extracting a determination audio track with the same voiceprint from the audio according to the voiceprint of the preprocessed audio track. In another embodiment, the pre-processed audio track is obtained by processing the audio of the complete movie, and the processor 19 may, according to the correspondence between the plurality of pre-processed character feature groups and the plurality of pre-processed audio tracks, A pre-processed track corresponding to the pattern of the target character is judged and this pre-processed track is used as the judged track.

In step S207, the processor 19 controls the display interface 13 to continue playing, and controls the audio output interface 15 to output the determined audio track. In an implementation, the processor 19 can control the audio output interface 15 to only output the determined audio track and not output other audio tracks in the audio. In another implementation, the processor 19 can control the audio output interface 15 to output the determined audio track at a higher volume than other audio tracks.

To give a practical example to illustrate steps S205-S207, please refer to FIG. 3 and FIG. 4. FIG. A schematic diagram of the pause screen of the infrared remote control audio-visual device shown in the embodiment. As shown in FIG. 3 , the pause screen F3 of the TV screen as the display interface can be divided into nine divided blocks F31, and these nine divided blocks F31 can be assigned designated codes 1 to 9, corresponding to the TV remote control respectively. Number buttons 1~9 on the screen. When the number key 1 is triggered to generate the second indication signal to the TV, the processor of the TV will judge the target block to be the divided block F31 with the specified code 1, and so on.

Assume that the pause screen F4 shown in FIG. 4 has the specified code configuration as shown in FIG. 3 . When the second indication signal indicates the specified code 4, the processor judges that there is a matching target character pattern 41 in the target block according to the pre-processing character feature group in the memory, and then according to the correspondence between the pre-processing character feature group and the pre-processing audio track relationship, extract the determination track corresponding to the target character pattern 41 from the audio, and control the display interface to continue playing and control the audio output interface to output the determination track. When the second indication signal indicates the designated code 5, similar to the above, the processor judges the target character pattern 42, extracts the corresponding target character pattern 42 from the audio, and controls the display interface to continue playing and controls the audio output interface to output the judgment track . In particular, the dotted line dividing the pause frame F4 shown in FIG. 4 can be selectively presented on the actually displayed frame. For example, when the processor controls the display interface to pause the playback, it can simultaneously control the display interface to display the dotted line dividing the pause screen F4, so as to facilitate the user to select the target block.

FIG. 4 exemplarily illustrates an embodiment in which a single target character pattern 41 or 42 exists in the target block. In an embodiment where there are multiple target character patterns in the target block, the processor can extract multiple target character patterns respectively corresponding to the multiple target character patterns from the audio according to the correspondence between the pre-processed character feature set and the pre-processed audio track. Determine the audio track, control the display interface to continue playing and control the audio output interface to output the plurality of determined audio tracks.

For another embodiment in which there are multiple target character patterns in the target block, please refer to FIG. 1 , FIG. 2 and FIG. 5 , wherein FIG. 5 is a flow chart of an infrared remote control video playback method according to this embodiment. The infrared remote control video playback method shown in FIG. 5 includes steps S201-S204, S206, and S207 described in the embodiment of FIG. 2, the difference is that step S205 includes steps S501-S505. Steps S501-S505 can also be performed by the infrared remote control audio-visual device 10 shown in FIG. 1 , but is not limited thereto. For the convenience of understanding, steps S501 - S505 will be described below by using the operation of the infrared remote control audio-visual device 10 as an example.

In step S501, the processor 19 judges whether there is one pre-selected pattern in the target block (corresponding to the second indication signal) of the paused screen. When the judgment result is yes, as shown in step S502, the processor 19 takes the preselected pattern as the target character pattern, and then executes step S206. When the judgment result is negative (that is, the number of preselected patterns is multiple), as shown in step S503 , the processor 19 requests a third indication signal through the display interface 13 or/and the audio output interface 15 . For example, the processor 19 may control the display interface 13 to enlarge the target block to fill the screen, and/or display a text message requesting the third indication signal. For another example, the processor 19 may control the audio output interface 15 to output a voice message requesting the third indication signal.

In step S504 and step S505, the processor 19 obtains a third indication signal through the infrared sensor 11, and according to the third indication signal, determines which of the plurality of pre-selected patterns is located in the target sub-block of the target block The pattern is a target character pattern, wherein the third indication signal indicates the target sub-block. Further, the processor 19 may divide the target block into a plurality of divided sub-blocks, and assign each divided block a specified code, and the specified code of each divided sub-block corresponds to a different button on the infrared remote controller or key combination. The third indication signal generated by the infrared remote controller carries a corresponding designated code according to the key or combination of keys triggered by it. When the processor 19 receives the third indication signal, it can determine that the divided sub-block corresponding to the specified code is the target sub-block. The processor 19 takes the preselected pattern located in the target sub-block as the target character pattern, and proceeds to step S206. Specifically, when the processor 19 judges that there is no preselected pattern in the target sub-block, it does not act, or outputs a request signal through the display interface 13 or the audio output interface 15 to request another third instruction signal, and upon receiving Step S505 is executed again after a new third indication signal.

To give a practical example to illustrate steps S501 - S505 , please refer to FIGS. 6A and 6B . FIGS. 6A and 6B are schematic diagrams of pause screens of an infrared remote control audio-visual device according to another embodiment of the present invention. Assume that the pause screen F6 shown in FIG. 6A has the specified code configuration as shown in FIG. 3 . When the second indication signal indicates the designation code 6, the processor determines that there is only one preselected pattern 61 in the target block, and takes the preselected pattern 61 as the target character pattern. When the second indication signal indicates the designation code 4, the processor judges that there are multiple preselected patterns 62 and 63 in the target block, and then controls the display interface to enlarge the target block to fill the screen , as shown in Figure 6B. Assume that the target block F61 shown in FIG. 6B has the specified code configuration as shown in FIG. 3 . When the third indication signal specifies the code 6, the processor determines that the preselected pattern 63 is the target character pattern. When the third indication signal indicates the designation code 5, the processor determines that the preselected pattern 62 is the target character pattern.

In particular, the dotted line dividing the pause frame F6/target block F61 shown in FIG. 6A/6B can be selectively presented on the actually displayed frame. For example, when the processor controls the display interface to pause playback, it can simultaneously control the display interface to present the dotted line that divides the pause screen F6, so as to facilitate the user to select the target block, and/or can simultaneously control the display interface to enlarge the target block F61 The control display interface presents dotted lines dividing the target block F61 to facilitate the user to select the target sub-block.

As mentioned above, the pre-processed character feature group, pre-processed audio track and the corresponding relationship between them stored in the memory of the infrared remote control audio-visual device can be controlled by the internal processor of the device or an external processor (such as a cloud server). Processed before playing the video, or processed by the processor during video playback before receiving the first instruction signal. Please refer to FIG. 7 for the processing flow of the above data. FIG. 7 is a preprocessing flow chart of an infrared remote control video playback method according to an embodiment of the present invention. As shown in FIG. 7 , the preprocessing flow of the infrared remote control video and audio playback method involves AI technology and may include steps S701 - S704 .

In step S701 , the processor executes multi-object tracking on multiple display frames of the video to obtain multiple feature blocks corresponding to each of the multiple characters in the multiple display frames. The plurality of display frames mentioned here may be all display frames of the video, or the display frames of the video that have been played before the processor receives the first instruction signal. Further, the multi-target tracking performed by the processor may include: adjusting the size of the display screen; inputting the adjusted display screen into a pre-trained object detection model (such as Yolov3 or other detection models that can detect people), to generate multiple detection frames; input the multiple detection frames into the tracker for processing, so as to obtain the tracking results of multiple characters, that is, the feature blocks of each character in each display screen. Among them, the tracker can perform multi-target tracking algorithms on the input data, such as SORT (Simple Online and Real-time Tracking).

In step S702, the processor obtains a plurality of appearance feature groups according to the corresponding feature blocks of the characters as the plurality of pre-processed character feature groups. Furthermore, for each character, the processor can obtain appearance features such as facial features and facial features from the tracking results, and combine them into an appearance feature group as a pre-processed character feature group.

In step S703, the processor separates the audio into multiple pre-processed tracks with different voiceprints. Furthermore, the processor can separate the audio into multiple pre-processed tracks with different voiceprints by using a pre-trained sound source separation model. The sound source separation model may be a model trained with an AI intelligent neural network human voice recognition algorithm, wherein the AI intelligent neural network human voice recognition algorithm is, for example, SORT. It should be noted here that the preprocessing of the video image and the video audio by the processor can be performed separately or simultaneously. In addition to being performed after step S702 as shown in FIG. 7 , step S703 may be performed before step S701 , or may be performed between steps S701 and S702 , or may be performed simultaneously with step S701 or S702 .

In step S704, the processor establishes the multiple pre-processing character feature groups and the multiple pre-processing character feature groups and the multiple pre-processing character feature groups according to the multiple display screens, the multiple pre-processing character feature Handle the correspondence between audio tracks. Further, this step may include taking each pre-processed audio track as a target audio track, and executing: performing on the feature blocks in the plurality of target images corresponding to the period when the target audio track has a signal in the plurality of display images Facial motion detection; and according to the facial motion detection result, judging that the target audio track corresponds to one of the plurality of pre-processed character feature groups. In short, the processor can determine the character whose mouth is opening and closing in the display screen when the target audio track has a signal, and establishes the correspondence between the target audio track and the pre-processed character feature set of the character. In particular, the processor will pre-judge the period when the target audio track has a signal, and then execute the judgment of the character whose mouth is opening and closing in the display screen, so as to avoid the period when the target audio track has a signal and the opening and closing of the mouth in the screen. The voice of the moving character does not correspond to the movement, and there is a problem that the movement of the character is delayed.

With the above structure, the infrared remote control audio-visual device and the infrared remote control audio-visual playback method disclosed in this case determine the corresponding sound of the character specified by the infrared indication signal based on the correspondence between multiple pre-processed character feature groups and multiple pre-processed audio tracks. track, it can provide the function of playing the sound of the specified character independently.

Although the present invention is disclosed by the aforementioned embodiments, they are not intended to limit the present invention. Without departing from the spirit and scope of the present invention, all changes and modifications are within the scope of patent protection of the present invention. For the scope of protection defined by the present invention, please refer to the appended scope of patent application.

10: Infrared remote control audio and video device 11: Infrared sensor 13: Display interface 15: Audio output interface 17: Memory 19: Processor 1～9: specify the code F3, F4, F6: Pause screen F31: split block F61: target block 41, 42: target character pattern 61, 62, 63: Preselected patterns

FIG. 1 is a functional block diagram of an infrared remote control audio-visual device according to an embodiment of the present invention. FIG. 2 is a flow chart of an infrared remote control audio-visual playing method according to an embodiment of the present invention. FIG. 3 is a diagram of the usage situation of the infrared remote control audio-visual device according to an embodiment of the present invention. FIG. 4 is a schematic diagram of a pause screen of an infrared remote control audio-visual device according to an embodiment of the present invention. FIG. 5 is a flow chart of an infrared remote control video and audio playback method according to another embodiment of the present invention. 6A and 6B are schematic diagrams of a pause screen of an infrared remote control audio-visual device according to another embodiment of the present invention. FIG. 7 is a preprocessing flowchart of an infrared remote control video and audio playback method according to an embodiment of the present invention.

Claims (10)

An infrared remote control audio-visual device, comprising: An infrared sensor for receiving a first indication signal and a second indication signal; a display interface for playing multiple display images of a video; an audio output interface for outputting the audio of the video; A memory for storing a plurality of pre-processing character feature groups, a plurality of pre-processing audio tracks, and correspondence between the pre-processing character feature groups and the pre-processing audio tracks; and A processor, connected to the infrared sensor, the display interface, the audio output interface and the memory, and used for: Pausing the playback of the display interface and the output of the audio output interface according to the first instruction signal, so that the display interface displays a pause image; According to the second indication signal, determine a target character pattern located in a target block of the pause screen, wherein the second indication signal indicates the target block, and the target character pattern conforms to the pre-processing character feature groups one of Extracting a determined audio track corresponding to the target character pattern from the audio according to the correspondence between the pre-processed character feature sets and the pre-processed audio tracks; and Control the display interface to continue playing, and control the audio output interface to output the determined audio track. The infrared remote control audio-visual device as described in claim 1, wherein the processor is further used for: performing multi-target tracking on the display images to obtain a plurality of feature blocks corresponding to the respective characters in the display images; Obtaining a plurality of appearance feature groups as the pre-processed character feature groups according to the feature blocks corresponding to the characters; separating the audio into multiple pre-processed tracks with different voiceprints; and According to the display images, the pre-processing character feature groups and the pre-processing audio tracks, the corresponding relationship between the pre-processing character feature groups and the pre-processing audio tracks is established. The infrared remote control audio-visual device as described in claim 2, wherein the processor executes to establish the pre-processing character feature groups and the pre-processing character feature groups and the pre-processing audio tracks according to the display screens, the pre-processing character feature groups and the This correspondence for some preprocessed tracks includes: To use each of these preprocessed tracks as a target track, execute: performing facial motion detection on the feature blocks in the plurality of target frames corresponding to the period in which the target audio track has a signal in the display frames; and According to the facial motion detection result, it is determined that the target audio track corresponds to one of the pre-processed character feature groups. The infrared remote control audio-visual device as described in claim 1, wherein the processor is configured to, when judging that there are a plurality of pre-selected patterns in the target block of the paused screen that match more of the pre-processed character feature groups, through the The display interface or the audio output interface requests a third indication signal, obtains the third indication signal through the infrared sensor, and judges a target object located in the target block among the preselected patterns according to the third indication signal The preselected pattern in the block is the target character pattern, wherein the third indication signal indicates the target sub-block. The infrared remote control audio-visual device as described in claim 1, wherein the processor is further used to divide the paused screen into a plurality of divided blocks, and assign a designated code to each of the divided blocks, wherein the target block is the one of the divided blocks, and the second indication signal indicates the designated code corresponding to the target block. An infrared remote control audio and video playback method, comprising: Play multiple display images of a video through a display interface, and output the audio of the video through an audio output interface; receiving a first indication signal through an infrared sensor; A processor, according to the first instruction signal, pauses the playback of the display interface and the output of the audio output interface, so that the display interface displays a pause image; receiving a second indication signal through the infrared sensor; judging by the processor a target character pattern located in a target block of the paused screen according to the second indication signal, wherein the second indication signal indicates the target block, and the target character pattern conforms to a plurality of predetermined Dealing with one of the group of character traits; Extracting, by the processor, a determination track corresponding to the target character pattern from the audio according to the correspondence between the pre-processing character feature groups and a plurality of pre-processing tracks; and Control the display interface to continue playing, and control the audio output interface to output the determined audio track. The infrared remote control audio and video playback method as described in request item 6 further includes: performing multi-target tracking on the display images to obtain a plurality of feature blocks corresponding to the respective characters in the display images; Obtaining a plurality of appearance feature groups as the pre-processed character feature groups according to the feature blocks corresponding to the characters; separating the audio into multiple pre-processed tracks with different voiceprints; and According to the display images, the pre-processing character feature groups and the pre-processing audio tracks, the corresponding relationship between the pre-processing character feature groups and the pre-processing audio tracks is established. The infrared remote control audio-visual playback method as described in claim 7, wherein the pre-processing character feature groups and the pre-processing audio tracks are established according to the display screens, the pre-processing character feature groups and the pre-processing audio tracks This correspondence for contains: To use each of these preprocessed tracks as a target track, execute: performing facial motion detection on the feature blocks in the plurality of target frames corresponding to the period in which the target audio track has a signal in the display frames; and According to the facial motion detection result, it is determined that the target audio track corresponds to one of the pre-processed character feature groups. The infrared remote control audio-visual playback method as described in claim 6, wherein according to the second indication signal, it is determined that the target character pattern located in the target block of the pause screen includes: requesting a third indication signal through the display interface or the audio output interface when it is judged that there are multiple pre-selected patterns matching more than one of the pre-processed character feature sets in the target block of the pause screen; obtain the third indication signal through the infrared sensor; and According to the third indication signal, it is determined that the pre-selected pattern located in a target sub-block of the target block among the pre-selected patterns is the target character pattern, wherein the third indication signal indicates the target sub-block. The infrared remote control audio and video playback method as described in request item 6 further includes: dividing the paused picture into a plurality of divided blocks, and assigning a specified code to each of the divided blocks; Wherein the target block is one of the divided blocks, and the second indication signal indicates the designated code corresponding to the target block.

Images