TWI501136B - Control signal feedback system and interactive method thereof - Google Patents

Description

Control signal feedback system and its interaction method

The invention relates to a control signal feedback system and an interaction method thereof; in particular to a control signal feedback system applied to a display terminal device and an interaction method thereof.

With the rapid development of smart TVs and other display terminal devices, there are more and more ways to manipulate these terminal devices, such as remote control, keyboard, mouse, etc., or touch, voice, Gestures, eyeballs, and even brain waves are remotely controlled. At present, in the case of the same terminal device but with multiple control modes in parallel, the user cannot tell which kind of behavior is being manipulated, the control signal and the state are not timely fed back to the user, causing troubles in user manipulation. Reduced the experience.

In view of this, the object of the present invention is to provide a control signal feedback system and an interactive method thereof, in order to make the operation simpler and to instantly feedback the control signal to improve the use experience.

To achieve the above object, the present invention provides a control signal feedback system, including a signal transmitting end, a signal receiving end, a signal analyzing module, an event broadcasting module, a system processor, a storage unit, a feedback processing module, and an image synthesizing module. . The signal transmitting end sends a control signal for controlling the terminal device, the signal receiving end is disposed on the terminal device and receives the control signal sent by the signal transmitting end, the signal analyzing module is electrically connected to the signal receiving end, and the event broadcast module is electrically connected. The signal analysis module, the system processor is electrically connected to the event broadcast module, the storage unit stores a feedback interface, a plurality of icons and a control state, and the feedback processing module is electrically connected to the system processor, the storage unit and the signal analysis module. The image synthesis module is electrically connected to the system processor and the feedback processing module.

The signal receiving end transmits the received control signal to the signal analysis module, and the signal analysis module converts the control signal into a corresponding event and transmits it to the event broadcast module, and the signal analysis module also parses the control signal into a control mode and Passed to the feedback processing module, the event broadcast module sends an event broadcast to the system processor according to the corresponding event, the system processor receives the event broadcast and responds to the corresponding event, generates the terminal device image, generates the manipulation state, and feeds the control state back to the feedback The processing module, the feedback processing module queries the corresponding icon from the storage unit according to the control mode, and the feedback processing module further queries the corresponding control state from the storage unit according to the control state, and the feedback processing module is based on the queried icon and The control state indicates that the feedback interface is generated, and the image synthesis module synthesizes the feedback interface generated by the feedback processing module and the terminal device image generated by the system processor on the screen of the terminal device.

In order to achieve the above object, the present invention also provides an interaction method according to the above control signal feedback system, the interaction method comprising the following steps: S1: determining whether there is a manipulation signal input; S2: parsing the input manipulation signal, generating a feedback interface and a terminal Device image; S3: composite feedback interface and terminal device image; S4: displayed on the screen of the terminal device.

The control signal feedback system and the interaction method thereof provided by the invention realize that the screen of the terminal device can instantly feedback the current user's manipulation mode, and provide a schematic description of the user's manipulation state in real time, and the user can explain the state through the manipulation state. To the current control state or result, the smart signal of the control signal and the user is realized, the user experience is improved, and the terminal device is more humanized.

In order to make the objects, features, and advantages of the present invention more readily understood by those of ordinary skill in the art, the following description of the preferred embodiments and the accompanying drawings.

10. . . Control signal feedback system

151. . . Terminal device image

11. . . Signal sender

16. . . Storage unit

12. . . Signal receiving end

17. . . Feedback processing module

13. . . Signal analysis module

18. . . Image synthesis module

14. . . Event broadcast module

19. . . Screen

15. . . System processor

20. . . Feedback interface

twenty one. . . Turntable element

213. . . Remote control icon

211. . . Gesture manipulation icon

214. . . Keyboard control icon

212. . . Voice control icon

twenty two. . . Schematic element

S12. . . Whether to receive the control signal

S13. . . Pass control signal to signal analysis module

S21. . . Signal analysis module analyzes the control signal

S211. . . Converting the control signal to a corresponding event, passing it to the event broadcast module and sending an event broadcast to the system processor

S212. . . The control signal is parsed into a control mode and then passed to the feedback processing module.

S22. . . The system processor receives the event broadcast and responds to the corresponding event

S221. . . Generate terminal device image

S222. . . After being parsed into a control state, it is passed to the feedback processing module.

S23. . . Generate feedback interface

S3. . . Composite feedback interface and terminal device image

S4. . . Displayed on the screen with dynamic effects

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a system block diagram of a control signal feedback system in accordance with a preferred embodiment of the present invention.
Figure 2 is a schematic illustration of a turntable element in accordance with a preferred embodiment of the present invention.
Figure 3 is a schematic illustration of the schematic elements of a preferred embodiment of the invention.
Figure 4 is a perspective perspective view of a turntable element of a preferred embodiment of the present invention.
Figure 5 is a schematic perspective view of a schematic element of the preferred embodiment of the present invention entering the screen.
Figure 6 is a schematic perspective view of a schematic element exiting the screen in accordance with a preferred embodiment of the present invention.
Figure 7 is a schematic diagram showing the feedback interface of the feedback interface and the terminal device of the preferred embodiment of the present invention displayed on the screen.
Figure 8 is a perspective perspective view of a turntable element of a preferred embodiment of the present invention.
Figure 9 is a flow diagram of an interactive method of a control signal feedback system in accordance with a preferred embodiment of the present invention.

Please refer to FIG. 1. FIG. 1 is a system block diagram of a control signal feedback system 10 according to a preferred embodiment of the present invention. In the present embodiment, the control signal feedback system 10 includes a display terminal device and a corresponding remote control device (such as a liquid crystal television and a remote controller thereof), but is not limited thereto. The control signal feedback system 10 includes a signal transmitting end 11, a signal receiving end 12, a signal analyzing module 13, an event broadcast module 14, a system processor 15, a storage unit 16, a feedback processing module 17, and an image synthesizing module 18. The signal transmitting end 11 is disposed on the remote control device, and can transmit a manipulation signal for controlling the display terminal device. The signal transmitting end 11 may be any one or a combination of two or more of a remote controller, a keyboard, a mouse, a touch sensor, a voice input device, a gesture sensor, an eyeball detector, and a brain wave detector. The signal receiving end 12 is disposed on the terminal device for receiving the control signal sent by the signal transmitting end 11. The control signal received by the signal receiving end 12 includes any one or more of a remote control button value, a keyboard button value, a mouse event, a touch sensing value, a voice signal, a gesture motion signal, an eye movement signal, or a brain wave signal. The combination. The control signal received by the signal receiving end 12 corresponds to the control signal sent by the signal transmitting end 11, and the signal receiving end 12 can receive or scan the control signal sent by the signal transmitting end 11 by wire or wirelessly.

The signal analysis module 13, the event broadcast module 14, the system processor 15, the storage unit 16, the feedback processing module 17, and the image synthesizing module 18 are also disposed on the terminal device. The signal analysis module 13 is electrically connected to the signal receiving end 12, and the event broadcast module 14 is electrically connected to the signal analysis module 13. The system processor 15 is electrically connected to the event broadcast module 14. The storage unit 16 stores the feedback interface 20 and the plurality of The icon and the control state are schematically illustrated. The feedback processing module 17 is electrically connected to the system processor 15, the storage unit 16 and the signal analysis module 13, and the image synthesis module 18 is electrically connected to the system processor 15 and the feedback processing module 17.

The signal receiving end 12 transmits the received control signal to the signal analysis module 13 . The signal analysis module 13 converts the control signal into a corresponding event and transmits it to the event broadcast module 14. The signal analysis module 13 also parses the control signal into a control mode and transmits it to the feedback processing module 17, and the event broadcast module 14 responds according to the corresponding The event transmits an event broadcast to the system processor 15, and the system processor 15 receives the event broadcast and generates a terminal device image 151 and generates a manipulation state in response to the corresponding event, and feeds the manipulation status back to the feedback processing module 17. The feedback processing module 17 queries the corresponding icon from the storage unit 16 according to the above-mentioned control mode, and the feedback processing module 17 also queries the corresponding control state from the storage unit 16 according to the above-mentioned manipulation state, and the feedback processing module 17 according to the query. The icon and the control state indicate that the feedback interface 20 is generated. The image synthesis module 18 synthesizes the feedback interface 20 generated by the feedback processing module 17 and the terminal device image 151 generated by the system processor 15 on the screen 19 of the terminal device. .

The feedback interface 20 stored in the storage unit 16 includes a turntable element 21 and a schematic element 22. Please refer to FIG. 2 and FIG. 3, FIG. 2 is a turntable element 21 of the present invention, and FIG. 3 is a schematic view of the present invention. Element 22. The feedback processing module 17 queries the corresponding icon from the storage unit 16 as the content displayed in the turntable element 21 according to the manipulation manner. As shown in FIG. 2, the icon in the turntable element 21 includes a gesture manipulation icon 211 and a voice manipulation icon 212. The remote control manipulation icon 213 and the keyboard manipulation icon 214, and the turntable element 21 presents a corresponding icon with the dynamic effect of the turntable rotation. The feedback processing module 17 further queries the corresponding manipulation state from the storage unit 16 according to the manipulation state as the content displayed in the schematic element 22. As shown in FIG. 3, the manipulation state in the schematic element 22 schematically illustrates the corresponding manipulation. The state is a gesture control, so the manipulation state indicates a gesture manipulation action including "moving" and "determining", and the schematic element 22 is schematically illustrated by the dynamic effect of the movement from the outside of the screen 19 into the screen 19, and The corresponding control state is illustrated by the dynamic effect of moving out of the screen 19 by the movement inside the screen 19.

Please refer to FIG. 4, FIG. 5 and FIG. 6. FIG. 4 is a layered operation state of the turntable element 21 of the present invention, and FIG. 5 and FIG. 6 respectively show the entry and exit of the schematic element 22 of the present invention. The layered actuation state of the screen 19. The feedback processing module 17 queries the corresponding icon from the storage unit 16 according to the user's control mode, as the control mode icon of the turntable element 21 in the current feedback interface 20, and presents the control mode icon with the dynamic effect of the turntable rotation. The perspective view is as shown in FIG. 4, and the dotted outer frame in the figure can be regarded as a virtual space or a virtual plane, and the screen 19 on the terminal device is the inner frame portion of the solid line in the figure. The turntable element 21 is rotated at the corner of the screen 19, causing an icon corresponding to the mode of operation of the user to be turned into the screen 19 (e.g., the gesture manipulation icon 211 in Fig. 4). In addition, the feedback processing module 17 will query the corresponding manipulation state from the storage unit 16 according to the manipulation state, as the content of the schematic element 22 in the feedback interface 20, as shown in FIGS. 5 and 6, the schematic element 22 It is a long rectangle, but it is not limited to this. The schematic element 22 is schematically illustrated by the dynamic effect of moving the screen 19 into the screen 19, and the corresponding control state is illustrated by the dynamic effect of moving out of the screen 19 by the screen 19 to close the corresponding control state.

Please refer to FIG. 7 at the same time. FIG. 7 shows a state in which the feedback interface 20 and the terminal device image 151 are combined and displayed on the screen 19. According to the above process, the image synthesizing module 18 finally generates the feedback processing module 17. The feedback interface 20 (the turntable element 21 and the schematic element 22) is combined with the terminal device image 151 generated by the system processor 15 for display on the screen 19 of the terminal device. At this time, the user manipulates the terminal device by using the gesture, so the turntable element 21 turns the gesture manipulation icon 211 into the screen 19, and the schematic element 22 is moved outside the screen 19 into the screen 19, and the manipulation state on the schematic element 22 is schematically illustrated. The gestures of "moving" and "determining" can be manipulated by the user and instantly know the manipulation feedback result.

On a smart TV with multiple remote control devices controlling parallel, the smart TV can also be controlled by the remote controller. At this time, the remote control icon 213 in the turntable is transferred to the screen 19 of the terminal device. In addition to this, the terminal device can be controlled by voice. Please refer to FIG. 8 at the same time, and FIG. 8 shows another use state of the turntable element 21. When the user speaks the command, the signal receiving end 12 receives the voice audio signal and transmits it to the signal analyzing module 13. The signal analyzing module 13 converts the received voice audio signal into a corresponding event and transmits it to the event broadcast module 14 . On the other hand, the received voice audio signal is parsed into a control mode and transmitted to the feedback processing module 17; the event broadcast module 14 broadcasts the received voice audio signal to the system processor 15; the system processor 15 receives the broadcast. Then, in response to the event, the terminal device image 151 is generated, and the manipulation state of the response event is fed back to the feedback processing module 17. The feedback processing module 17 queries the corresponding voice manipulation icon 212 from the storage unit 16 as the manipulation mode icon of the turntable element 21 in the current feedback interface 20, and the turntable accordingly goes to the voice manipulation icon 212. In this embodiment, the control mode icon is presented by the dynamic effect of the turntable rotation, and the dynamic effect of the turntable rotation is used to present the information of the same level and multiple contents. The schematic element 22 also presents a schematic description of the manipulation state corresponding to the voice manipulation (not shown), and finally generates a feedback interface 20 according to the voice-controlled turntable element 21 and the schematic element 22. For the processing of the remote control button value, the keyboard key value, the mouse event, the touch sensing value, the gesture motion signal, the eye movement signal or the brain wave signal, refer to the above embodiment, and details are not described herein again.

Referring to FIG. 9, FIG. 9 is a flow chart showing an interactive method of the control signal feedback system 10. Figure 9 is an interactive method further detailed in accordance with the control signal feedback system 10 of Figures 1 through 8, the interactive method comprising the steps of:

S1, it is judged whether there is a manipulation signal input. S1 further includes: S11, the signal transmitting end 11 sends a control signal for controlling the terminal device; S12, the signal receiving end 12 determines whether the control signal is received, and if the control signal is received, step S13 is performed, and if the control signal is not received, Then, in step S12; S13, the signal receiving end 12 transmits the received control signal to the signal analysis module 13.

S2, parsing the input manipulation signal, and generating the feedback interface 20 and the terminal device image 151. S2 further includes: S21, the signal analysis module 13 parses the manipulation signal. The S21 further includes: S211, the control signal is converted into a corresponding event and then transmitted to the event broadcast module 14, the event broadcast module 14 sends an event broadcast to the system processor 15; S212, the control signal is parsed into a control mode and then transmitted to the feedback process. Module 17. Then, S22 is executed, and after receiving the event broadcast, the system processor 15 organizes the system processing event in response to the corresponding event. S22 further includes: S221, generating a terminal device image 151; S222, parsing into a manipulation state according to a system processing event, and transmitting the manipulation state to the feedback processing module 17. Then, in S23, the feedback processing module 17 queries the corresponding icon from the storage unit 16 according to the manipulation mode, and uses it as the manipulation mode icon in the turntable element 21, and the feedback processing module 17 also queries the storage unit 16 according to the manipulation state. The corresponding control state is schematically illustrated and illustrated as a control state in the schematic element 22, and finally the feedback interface 20 is generated.

S3. The image composition module 18 further synthesizes the feedback interface 20 generated by the feedback processing module 17 in step S23 with the terminal device image 151 generated by the system processor 15 in step S22.

S4, displaying the feedback interface 20 and the terminal device image 151 synthesized by the S3 on the screen 19 of the terminal device, and presenting the corresponding icon in the feedback interface 20 by the dynamic effect of the rotation of the turntable to move outside the screen 19 into the screen 19 The dynamic effect within the presentation presents a corresponding illustration of the corresponding control state in the feedback interface 20 to illustrate the manipulation state by the dynamic effect of moving out of the screen 19 within the screen 19. Specifically, the corresponding icon is queried from the storage unit 16 as the control mode icon of the turntable element 21 in the current feedback interface 20, and the control mode icon is presented by the dynamic effect of the turntable rotation. Then, the storage unit 16 is queried for the corresponding control state. As the content of the element 22 in the feedback interface 20, the dynamic element presentation schematic element 22 and its manipulation state are illustrated by moving from the outside of the screen 19 into the screen 19. The schematic element 22 and its manipulation state are schematically illustrated by moving the effect from the inside of the screen 19 to the outside of the screen 19.

In summary, the control signal feedback system and the interaction method thereof provided by the invention realize that the screen of the terminal device can instantly feedback the current user's manipulation mode, and immediately provide the user with a schematic description of the manipulation state, and the user can By knowing the current control state or result through the manipulation state, the control signal and the user's smart interaction are realized, the user experience is improved, and the terminal device is more humanized. In addition, the dynamic effect of the turntable in the turntable element can be used to present information of the same level and multiple contents, so that the interaction between the terminal device and the user is more simple and flexible. The schematic element presents the manipulation state with dynamic effects to illustrate the way to enter or exit the screen, which enhances the user's visual sense and ensures the integrity of the content displayed on the screen.

While the present invention has been described above in terms of the preferred embodiments thereof, it is not intended to limit the invention, and the present invention may be modified and modified without departing from the spirit and scope of the invention. The scope of protection is subject to the definition of the scope of the patent application.

10. . . Control signal feedback system

11. . . Signal sender

12. . . Signal receiving end

13. . . Signal analysis module

14. . . Event broadcast module

15. . . System processor

151. . . Terminal device image

16. . . Storage unit

17. . . Look back processing module

18. . . Image synthesis module

19. . . Screen

20. . . Feedback interface

Claims (10)

A control signal feedback system includes:
a signal transmitting end, transmitting a control signal for controlling a terminal device;
a signal receiving end, disposed on the terminal device, and receiving the control signal sent by the signal sending end;
a signal analysis module electrically connected to the signal receiving end;
An event broadcast module electrically connected to the signal analysis module;
a system processor electrically connected to the event broadcast module;
a storage unit, storing a feedback interface, a plurality of icons and a schematic description of the control state;
a feedback processing module electrically connected to the system processor, the storage unit and the signal analysis module;
An image synthesis module electrically connected to the system processor and the feedback processing module;
The signal receiving end transmits the received control signal to the signal analysis module; the signal analysis module converts the control signal into a corresponding event and transmits the signal to the event broadcast module, and the signal analysis module further Parsing the control signal into a control mode and transmitting to the feedback processing module; the event broadcast module sends an event broadcast to the system processor according to the corresponding event; the system processor receives the event broadcast and responds to the corresponding event Generating a terminal device image, generating a control state, and feeding back the control state to the feedback processing module; the feedback processing module queries the corresponding icon from the storage unit according to the control mode, and the feedback processing module The feedback processing module is further configured to query the corresponding control state according to the control state, and the feedback processing module generates the feedback interface according to the queried icon and the control state. The image synthesis module uses the feedback processing module. The generated feedback interface and the terminal device image generated by the system processor are combined and displayed on the terminal device. On the screen. The control signal feedback system according to claim 1, wherein the signal transmitting end is a remote controller, a keyboard, a mouse, a touch sensor, a voice input device, a gesture sensor, an eyeball detector, and an electroencephalogram detection. Any one or a combination of two or more. The control signal feedback system according to claim 1, wherein the control signal received by the signal receiving end includes a remote controller button value, a keyboard button value, a mouse event, a touch sensing value, a voice signal, and a gesture. Any one or a combination of two or more of an action signal, an eye movement signal, or an electroencephalogram signal. The control signal feedback system of claim 1, wherein the feedback interface comprises a turntable element and a schematic element, and the feedback processing module queries the corresponding icon from the storage unit for display according to the control manner. The content of the turntable element, and the turntable element presents a corresponding icon with the dynamic effect of the turntable rotation; the feedback processing module further queries the corresponding read state from the storage unit according to the control state as a display on the schematic The content of the element, and the schematic element is schematically illustrated by the dynamic effect of moving out of the screen into the screen, and is illustrated by the dynamic state effect of closing the screen by moving out of the screen. The control signal feedback system according to any one of claims 1 to 4, wherein the signal receiving end receives or scans the control signal sent by the signal transmitting end by wire or wirelessly. An interactive method for controlling a signal feedback system according to claim 1 of the patent application scope, the interaction method comprising the following steps:
S1: determining whether there is a control signal input;
S2: parsing the input control signal, generating a feedback interface and a terminal device image;
S3: synthesizing the feedback interface and the terminal device image;
S4: Displayed on the screen of the terminal device. The method for interacting with the control signal feedback system of claim 6, wherein the step S1 further comprises:
S11: The signal sending end sends a control signal for controlling the terminal device;
S12: the signal receiving end determines whether the control signal is received, if the control signal is received, step S13 is performed, if the control signal is not received, then step S12 is performed;
S13: The signal receiving end transmits the received control signal to the signal analysis module. The method for interacting with the control signal feedback system of claim 6, wherein the step S2 further comprises:
S21: the signal analysis module parses the control signal, converts the control signal into a corresponding event and transmits it to the event broadcast module, parses the control signal into a control mode, and then transmits the signal to the feedback processing module, and the event broadcast module to the system processor Send an event broadcast;
S22: After receiving the event broadcast, the system processor responds to the corresponding event, organizes the system to process the event, generates the terminal device image, and parses the control state into the control state according to the system processing event, and transmits the control state to the feedback processing module;
S23: The feedback processing module queries the corresponding icon from the storage unit according to the control mode, and queries the corresponding control state from the storage unit according to the manipulation state, and generates a feedback interface according to the queried icon and the manipulation state. The method for interacting with the control signal feedback system of claim 6, wherein the step S3 further comprises: the feedback interface generated by the image synthesis module synthesis feedback processing module and the terminal device image generated by the system processor. The interactive method of the control signal feedback system of claim 6 or 8, wherein the step S4 further comprises:
Displaying a corresponding icon in the feedback interface by the dynamic effect of the turntable rotation;
A schematic description of the corresponding manipulation state in the feedback interface is presented by the dynamic effect moving from outside the screen into the screen, and the manipulation state is closed by the dynamic effect of moving out of the screen by the movement inside the screen.