CN111596883A - Data visualization system supporting voice recognition and somatosensory operation remote control - Google Patents
Data visualization system supporting voice recognition and somatosensory operation remote control Download PDFInfo
- Publication number
- CN111596883A CN111596883A CN202010404967.1A CN202010404967A CN111596883A CN 111596883 A CN111596883 A CN 111596883A CN 202010404967 A CN202010404967 A CN 202010404967A CN 111596883 A CN111596883 A CN 111596883A
- Authority
- CN
- China
- Prior art keywords
- module
- data visualization
- visualization system
- instruction
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/06—Creation of reference templates; Training of speech recognition systems, e.g. adaptation to the characteristics of the speaker's voice
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/08—Speech classification or search
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
- G10L15/00—Speech recognition
- G10L15/26—Speech to text systems
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Abstract
The invention provides a data visualization system supporting voice recognition and somatosensory operation remote control, which comprises a data visualization system remote controller unit, a message bus, a central control bus and a data visualization unit, wherein the data visualization system remote controller unit is used for analyzing voice and somatosensory and converting the voice and somatosensory into instructions; the message bus is used for transmitting the instruction converted by the remote control unit of the data visualization system; the central control bus is used for receiving, analyzing and converting the instruction of the data visualization system remote control unit and is responsible for transmitting the converted instruction to the data visualization unit. The invention has the beneficial effects that: the data visualization system supporting voice recognition and somatosensory operation remote control can control the data visualization unit by performing complex operation on the mobile phone without holding the mobile phone, and can control the data visualization unit only by voice and somatosensory.
Description
Technical Field
The invention relates to the field of data visualization, in particular to a data visualization system supporting voice recognition and somatosensory operation remote control.
Background
With the development of big data technology, a data visualization system becomes the best way for people to acquire the visual feeling of data in the future. The data visualization system is generally displayed on a large screen, and an interpreter of the data visualization system (hereinafter, collectively referred to as an interpreter) interprets the content displayed on the large screen. The existing data visualization system can achieve the effect of effectively displaying data in the data visualization system to audiences by mouse and keyboard technology (the traditional interaction mode requires the instructor to be matched with a controller for many times for training, and the display process requires the communication of the two parties, thereby wasting a large amount of manpower and material resources and influencing the display result)、The mobile phone remote controller (the mobile phone remote controller can not realize the mouse positioning as a mouse at will, and needs a lot of time to train to improve part of efficiency, and the mobile phone remote controller wastes the time of an interpreter and slows down the rhythm. In general, only the display of a data visualization system is realized in the market at present, and the effective combination of human and machine cannot be realized through the traditional means. But also has high realization cost and low efficiency.
At present, when a data visualization system is displayed on a large screen, no particularly good method is provided for realizing the control and interaction of an instructor on the system. Although the traditional mouse, keyboard mode and mobile phone remote controller mode can realize the control of an interpreter on the data visualization system, the traditional modes either need personnel cooperation (mouse and keyboard mode) or are difficult to accurately position, have complex steps (mobile phone remote controller mode: the data visualization system display computer and the mobile phone need to be simultaneously provided with corresponding App and software), and cannot be handy. The method has high cost and low efficiency in the project implementation process, and cannot meet the requirement that an interpreter carries out efficient and simple control on the data visualization system.
Disclosure of Invention
The invention provides a data visualization system supporting voice recognition and somatosensory operation remote control, which comprises a data visualization system remote controller unit, a message bus, a central control bus and a data visualization unit, wherein the data visualization system remote controller unit is used for analyzing voice and somatosensory and converting the voice and somatosensory into instructions; the message bus is used for transmitting the instruction converted by the remote control unit of the data visualization system;
the central control bus is used for receiving, analyzing and converting the instruction of the data visualization system remote control unit and is responsible for transmitting the converted instruction to the data visualization unit;
the data visualization unit is used for receiving and executing the instruction transmitted through the central control bus;
in the data visualization system, firstly, a remote controller unit of the data visualization system is started; analyzing the received voice and body feeling by the data visualization system remote controller unit, and commanding an analysis result, namely generating a remote controller command; sending a remote controller instruction to the central control bus through the message bus; the central control bus is responsible for analyzing the received remote controller instruction, converting the remote controller instruction into a data visualization unit instruction and then sending the converted data visualization unit instruction to the data visualization unit; and the data visualization unit is responsible for receiving the data visualization unit instruction converted by the central control bus and executing corresponding operation.
As a further improvement of the present invention, the data visualization system remote controller unit includes a voice recognition module, a voice search module, an AR recognition module, and an instruction processing module, wherein:
the voice recognition module: the voice command of the interphonest and resolvers is preprocessed, voice characteristic values are extracted, the best matched template is searched in the template library according to the characteristic values, and a recognition result is output;
the voice search module: the voice search module is responsible for receiving a voice search instruction and converting the voice search instruction into a search for the data visualization unit function module through the instruction processing module;
the AR identification module: when the digital visualization system remote controller enters the AR identification module, a mouse of the visualization display system moves along with the gesture of the interpreter, and the AR identification module identifies the action gesture of the interpreter in real time;
the instruction processing module: and converting the processing and analyzing result of the appellation function module into an instruction, and sending the instruction to the central control bus through the message bus.
As a further improvement of the present invention, the data visualization system remote controller unit further comprises an image recognition module, an AI processing module, wherein:
the image recognition module: the image recognition module is a supplement of the AR recognition module, and can promote the AR recognition module to perform more efficient recognition processing;
the AI processing module: every AI processing is the training of a model base, and the model base comprises a voice recognition module, an AR recognition module and an image recognition module which are all required to be assisted by AI processing, and the AI processing module is used for better recognizing the voice and the body feeling of an explanation person.
As a further improvement of the present invention, the data visualization unit includes a display module, an instruction execution module, a project management module, a topic management module, a module library management module, a chart control module, a configuration module, a role authority module, and a visualization design module, wherein: the display module is: the system display is completed according to the configuration of the data visualization unit, and dynamic data and man-machine interaction can be loaded;
the instruction execution module: receiving the instruction transmitted by the central control bus and executing the related instruction;
the project management module: the system is responsible for the management of all projects of the data visualization system, and can add, delete, modify and be responsible for operation of the projects;
the special topic management module is as follows: the system comprises a thematic page directory, a thematic panel, a data visualization system project management module and a data visualization system project management module, wherein the thematic page directory is used for managing all thematic page directories of a single data visualization system project, the thematic page directories are arranged according to a newly-added time positive sequence, and the thematic panel can carry out' adding, copying and deleting;
the module management module: the module directory is used for managing all module directories quoted by a single special topic page, the module directories are arranged in reverse order according to newly added time by default, namely the newly added module directory is in the highest level, manual level adjustment is supported on a module panel, and the module panel can carry out editing, copying, deleting and hiding operations on the module quoted by the current special topic;
the module library management module: all modules containing the current data visualization unit support editing of attributes of the selected module, such as module name, width and height, transparency, module style, click style, description and starting of an IE kernel, and perform 'adding, modifying, deleting, layout and sequencing' operation on controls contained in the selected module;
the chart control module: the functional area is used for selecting a newly added control when the data visualization system designer carries out module editing;
the configuration module: the system comprises a configuration module, a data visualization system designer and a control module, wherein the configuration module is used for configuring functional areas for all information related to projects for the data visualization system designer, and comprises five states of 'creating a project, selecting a special subject, selecting a module, editing the module and selecting a control';
the role authority module: the role authority management module comprises role management and user management, wherein the role management is based on user role identity management data visualization system project thematic page access authority and first screen display thematic; the user management is that the user individual is taken as a unit, and the user belongs to the role identity and the data visualization system project thematic page access authority and the first screen display thematic endowed by the role identity are checked;
the visual design module: the method is used for previewing the layout of the special page of the data visualization system and the editing effect of the modules, supporting the selection of the modules and the dragging of the layout of the modules in the visualization interface, and setting the gray to lock other modules in the special topic during the editing of the modules.
As a further improvement of the present invention, when the ratio of the length to the width of the screen is smaller than the difference between the configuration of the large screen, the presentation module supports the global page scaling to adapt to the display requirements of different devices and resolutions.
As a further improvement of the invention, the data visualization system provides a plurality of sets of project templates by default, a user can directly complete the configuration of the own large-screen project on the basis of the templates, and partial modules and controls in the project templates can also be used for the configuration of new projects.
As a further improvement of the invention, the chart control panel of the chart control module provides six types of controls of chart, index, map, text, material and interaction, and the controls can be selected to display service data according to actual requirements or used to realize the configuration of page action events.
As a further improvement of the invention, the data visualization system comprises a terminal, the terminal comprises a mobile phone, and the data visualization system remote controller is an APP installed on the mobile phone.
As a further improvement of the invention, the data visualization system also comprises a unified authentication module and an AI helper module.
The invention has the beneficial effects that: 1. the data visualization system supporting voice recognition and somatosensory operation remote control can control the data visualization unit by performing complex operation on the mobile phone without holding the mobile phone, and can control the data visualization unit only by voice and somatosensory; 2. the interpreter can input and search characters for the data visualization unit through voice, and a simple mobile phone remote controller can be realized only by matching a keyboard; 3. and a single person can explain and control the data visualization system without the cooperation of other persons.
Drawings
FIG. 1 is a data visualization system workflow diagram of the present invention;
FIG. 2 is a block diagram of the data visualization system of the present invention.
Detailed Description
The invention discloses a data visualization system supporting voice recognition and somatosensory operation remote control, which comprises two parts: the method comprises two parts of introduction of an implementation idea, a business process, system composition and module functions.
First, realizing thought and business process
1. Data visualization system directionalization
The problem of instruction conversion is firstly solved in order to solve the control and interaction problem of the instructor on the data visualization system. Before the instruction is converted, what is more critical is how to make the instruction be able to be identified and corresponding operation be made by the data visualization unit. We instruct the control and interaction of the data visualization unit so that the data visualization unit can recognize these instructions and can perform autonomous operations based on the instructions.
2. Voice and somatosensory commanding
The instruction of the voice and the body feeling of the interpreter is an important ring for releasing the complex operation of the interpreter. Only when the instructor explains the data visualization system, the instructor can realize the cooperation of other personnel without complex operation of the mobile phone, and the data visualization system can be controlled. By means of a data visualization system remote controller App installed on a mobile phone of an interpreter, by means of a mobile phone camera, a voice recording function, a voice recognition technology, an AR and image recognition technology and an AI technology, voice and body feeling of the interpreter are analyzed, and an analysis result is instructed.
3. Command communication and translation
And the voice and somatosensory instructions are transmitted to a central control bus (an instruction analysis system), the central control bus is responsible for analyzing and converting the voice and somatosensory instructions into data visualization unit instructions, and the converted data visualization unit instructions are transmitted to a data visualization unit. The received instruction, voice and body feeling control flow chart executed by the data visualization unit is shown in fig. 1.
Secondly, system composition and function description of each module are shown in fig. 2:
the invention discloses a data visualization system supporting voice recognition and somatosensory operation remote control, which comprises a data visualization system remote controller unit, a message bus, a central control bus and a data visualization unit, wherein the data visualization system remote controller unit is used for analyzing voice and somatosensory and converting the voice and somatosensory into instructions; the message bus is used for transmitting the instruction converted by the remote control unit of the data visualization system;
the central control bus is used for receiving, analyzing and converting the instruction of the data visualization system remote control unit and is responsible for transmitting the converted instruction to the data visualization unit;
the data visualization unit is used for receiving and executing the instruction transmitted through the central control bus;
as shown in fig. 1, in the data visualization system, the data visualization system remote control unit is first activated; analyzing the received voice and body feeling by the data visualization system remote controller unit, and commanding an analysis result, namely generating a remote controller command; sending a remote controller instruction to the central control bus through the message bus; the central control bus is responsible for analyzing the received remote controller instruction, converting the remote controller instruction into a data visualization unit instruction and then sending the converted data visualization unit instruction to the data visualization unit; and the data visualization unit is responsible for receiving the data visualization unit instruction converted by the central control bus and executing corresponding operation.
The data visualization system remote controller unit comprises a voice recognition module, a voice search module, an AR recognition module and an instruction processing module, wherein:
the voice recognition module: the voice recognition system is responsible for preprocessing the voice command, extracting a voice characteristic value, searching the best matched template in the template library according to the characteristic value and outputting a recognition result;
the voice search module: the voice search module is responsible for receiving a voice search instruction and converting the voice search instruction into a search for the data visualization unit function module through the instruction processing module;
the AR identification module: when the digital visualization system remote controller enters the AR identification module, a mouse of the visualization display system moves along with the gesture of the interpreter, and the AR identification module identifies the action gesture of the interpreter in real time;
the instruction processing module: and converting the processing and analyzing result of the appellation function module into an instruction, and sending the instruction to the central control bus through the message bus.
The data visualization system remote control unit further comprises an image recognition module and an AI processing module, wherein:
the image recognition module: the image recognition module is a supplement of the AR recognition module, and can promote the AR recognition module to perform more efficient recognition processing;
the AI processing module: every AI processing is the training of a model base, and the model base comprises a voice recognition module, an AR recognition module and an image recognition module which are all required to be assisted by AI processing, and the AI processing module is used for better recognizing the voice and the body feeling of an explanation person.
The data visualization unit comprises a display module, an instruction execution module, a project management module, a thematic management module, a module library management module, a chart control module, a configuration module, a role authority module and a visualization design module, wherein:
the display module is: the system display is completed according to the configuration of the data visualization unit, and dynamic data and man-machine interaction can be loaded; the display module supports the starting of global page scaling to adapt to the display requirements of different devices and resolutions when the difference between the length-width ratio of the screen and the configuration of the large screen is small.
The instruction execution module: receiving the instruction transmitted by the central control bus and executing the related instruction;
the project management module: the system is responsible for the management of all projects of the data visualization system (only an administrator has the authority), and can add, delete, modify and take charge of the operation of the projects; the data visualization system provides a plurality of sets of project templates (namely a plurality of large-screen project cases) by default, a user can directly complete the configuration of the own large-screen project on the basis of the templates, and partial modules and controls in the project templates can also be used for the configuration of new projects.
The special topic management module is as follows: the system comprises a thematic page directory management module, a thematic panel display module and a data visualization system project management module, wherein the thematic page directory management module is used for managing all thematic page directories of a single data visualization system project, the thematic page directories are arranged in a positive sequence according to increasing time (the thematic panel is only arranged to take effect in a sequencing mode and is irrelevant to a data visualization system front-end display module), and the thematic panel can carry out 'adding, copying and deleting' operation;
the module management module: the module directory is used for managing all module directories quoted by a single special topic page, the module directories are arranged in reverse order according to newly added time by default, namely the newly added module directory is arranged at the highest level, manual adjustment of the level of the special topic directory is supported on a module panel (a display module is required to be arranged according to the module directory when the special topic page is displayed at the front end of a data visualization system), and the module panel can carry out editing, copying, deleting and hiding operations on the module quoted by the current special topic;
the module library management module: all modules containing the current data visualization unit support editing of the attributes of the selected module, such as module name, width, height, transparency, module style, click style, description and starting of IE kernel, and carry out operations of 'adding, modifying, deleting, layout and sequencing' on the control contained in the selected module (the editing operation of the module library management module acts on the module itself, namely all thematic pages which refer to the module after editing show the modified content of the module);
the chart control module: the functional area is used for selecting a newly added control when the data visualization system designer carries out module editing; the chart control panel of the chart control module provides six types of 40 controls of 'charts, indexes, maps, characters, materials and interactions', and the controls can be selected to display business data according to actual requirements or used to realize page action event configuration.
The configuration module: the system comprises a configuration module, a data visualization system designer and a display module, wherein the configuration module is used for configuring functional areas for all information related to projects for the data visualization system designer, and comprises five states of 'newly building a project, selecting a special subject, selecting a module, editing the module (not selecting a control), and selecting the control';
the role authority module: the role authority management module comprises role management and user management, wherein the role management is based on user role identity management data visualization system project thematic page access authority and first screen display thematic; the user management is that the user individual is taken as a unit, and the user belongs to the role identity and the data visualization system project thematic page access authority and the first screen display thematic endowed by the role identity are checked;
the visual design module: the method is used for previewing the layout of the special page and the editing effect of the module (control) of the data visualization system, supporting the selection of the module and the dragging of the layout of the module under a visualization interface, and graying and locking other modules under the special topic (namely, the modules cannot be selected) when the module (control) is edited.
The data visualization system remote controller unit comprises a voice recognition module, a voice search module, an AR recognition module and an instruction processing module, wherein:
the voice recognition module: the voice recognition function of the mobile phone is relied on, and the voice recognition function is responsible for preprocessing voice instructions of interphonest and resolvers, extracting voice characteristic values, searching for the best matched template in a template library according to the characteristic values and outputting a recognition result;
the voice search module: the voice search module is responsible for receiving a voice search instruction and converting the voice search instruction into a search for the data visualization unit function module through the instruction processing module; when the instructor outputs a search instruction, the remote controller of the visualization system can convert the search instruction of the instructor into a search for the data visualization unit function module through the instruction processing module;
the AR identification module: the interpreter needs to activate the AR recognition module through the speech recognition module. When the digital visualization system remote controller enters the AR identification module, a mouse of the visualization display system moves along with the gesture of the interpreter, and the AR identification module can identify the action gesture of the interpreter in real time (for example, when the interpreter needs to click, the interpreter can take a hand);
the instruction processing module: and converting the processing and analyzing result of the appellation function module into an instruction, and sending the instruction to the central control bus through the message bus.
The data visualization system remote control unit further comprises an image recognition module and an AI processing module, wherein:
the image recognition module: the image recognition module is a supplement of the AR recognition module, and can promote the AR recognition module to perform more efficient recognition processing;
the AI processing module: every AI processing is the training of a model base, and the model base comprises a voice recognition module, an AR recognition module and an image recognition module which are all required to be assisted by AI processing, and the AI processing module is used for better recognizing the voice and the body feeling of an explanation person.
The data visualization system comprises a terminal, wherein the terminal comprises a mobile phone, and the data visualization system remote controller is an APP installed on the mobile phone.
The data visualization system also comprises a unified authentication module and an AI helper module.
The invention has the beneficial effects that: 1. the data visualization system supporting voice recognition and somatosensory operation remote control can control the data visualization unit by performing complex operation on the mobile phone without holding the mobile phone, and can control the data visualization unit only by voice and somatosensory; 2. the interpreter can input and search characters for the data visualization unit through voice, and a simple mobile phone remote controller can be realized only by matching a keyboard; 3. and a single person can explain and control the data visualization system without the cooperation of other persons.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.
Claims (9)
1. The utility model provides a support speech recognition and body to feel data visualization system of operation remote control which characterized in that: the system comprises a data visualization system remote controller unit, a message bus, a central control bus and a data visualization unit, wherein the data visualization system remote controller unit is used for analyzing voice and body feeling and converting the voice and body feeling into instructions; the message bus is used for transmitting the instruction converted by the remote control unit of the data visualization system;
the central control bus is used for receiving, analyzing and converting the instruction of the data visualization system remote control unit and is responsible for transmitting the converted instruction to the data visualization unit;
the data visualization unit is used for receiving and executing the instruction transmitted through the central control bus;
in the data visualization system, first the data visualization system remote control unit is started; analyzing the received voice and body feeling by the data visualization system remote controller unit, and commanding an analysis result, namely generating a remote controller command; sending a remote controller instruction to the central control bus through the message bus; the central control bus is responsible for analyzing the received remote controller instruction, converting the remote controller instruction into a data visualization unit instruction and then sending the converted data visualization unit instruction to the data visualization unit; and the data visualization unit is responsible for receiving the data visualization unit instruction converted by the central control bus and executing corresponding operation.
2. The data visualization system according to claim 1, wherein the data visualization system remote control unit comprises a voice recognition module, a voice search module, an AR recognition module, an instruction processing module, wherein:
the voice recognition module: the voice command of the interphonest and resolvers is preprocessed, voice characteristic values are extracted, the best matched template is searched in the template library according to the characteristic values, and a recognition result is output; the voice search module: the voice search module is responsible for receiving a voice search instruction and converting the voice search instruction into a search for the data visualization unit function module through the instruction processing module;
the AR identification module: when the digital visualization system remote controller enters the AR identification module, a mouse of the visualization display system moves along with the gesture of the interpreter, and the AR identification module identifies the action gesture of the interpreter in real time;
the instruction processing module: and converting the processing and analyzing result of the appellation function module into an instruction, and sending the instruction to the central control bus through the message bus.
3. The data visualization system according to claim 1, wherein the data visualization system remote control unit further comprises an image recognition module, an AI processing module, wherein:
the image recognition module: the image recognition module is a supplement of the AR recognition module, and can promote the AR recognition module to perform more efficient recognition processing;
the AI processing module: every AI processing is the training of a model base, and the model base comprises a voice recognition module, an AR recognition module and an image recognition module which are all required to be assisted by AI processing, and the AI processing module is used for better recognizing the voice and the body feeling of an explanation person.
4. The data visualization system according to claim 1, wherein the data visualization unit comprises a presentation module, an instruction execution module, a project management module, a topic management module, a module management module, a chart control module, a configuration module, a role authority module, and a visualization design module, wherein:
the display module is: the system display is completed according to the configuration of the data visualization unit, and dynamic data and man-machine interaction can be loaded;
the instruction execution module: receiving the instruction transmitted by the central control bus and executing the related instruction;
the project management module: the system is responsible for the management of all projects of the data visualization system, and can add, delete, modify and be responsible for operation of the projects;
the special topic management module is as follows: the system comprises a thematic page directory, a thematic panel, a data visualization system project management module and a data visualization system project management module, wherein the thematic page directory is used for managing all thematic page directories of a single data visualization system project, the thematic page directories are arranged according to a newly-added time positive sequence, and the thematic panel can carry out' adding, copying and deleting;
the module management module: the module directory is used for managing all module directories quoted by a single special topic page, the module directories are arranged in reverse order according to newly added time by default, namely the newly added module directory is in the highest level, manual level adjustment is supported on a module panel, and the module panel can carry out editing, copying, deleting and hiding operations on the module quoted by the current special topic;
the module library management module: all modules containing the current data visualization unit support editing of attributes of the selected module, such as module name, width and height, transparency, module style, click style, description and starting of an IE kernel, and perform 'adding, modifying, deleting, layout and sequencing' operation on controls contained in the selected module;
the chart control module: the functional area is used for selecting a newly added control when the data visualization system designer carries out module editing;
the configuration module: the system comprises a configuration module, a data visualization system designer and a control module, wherein the configuration module is used for configuring functional areas for all information related to projects for the data visualization system designer, and comprises five states of 'creating a project, selecting a special subject, selecting a module, editing the module and selecting a control';
the role authority module: the role authority management module comprises role management and user management, wherein the role management is based on user role identity management data visualization system project thematic page access authority and first screen display thematic; the user management is that the user individual is taken as a unit, and the user belongs to the role identity and the data visualization system project thematic page access authority and the first screen display thematic endowed by the role identity are checked;
the visual design module: the method is used for previewing the layout of the special page of the data visualization system and the editing effect of the modules, supporting the selection of the modules and the dragging of the layout of the modules in the visualization interface, and setting the gray to lock other modules in the special topic during the editing of the modules.
5. The data visualization system of claim 4, wherein the presentation module supports global page zoom to accommodate display requirements of different devices, resolutions when the ratio of screen length to width differs less from the large screen configuration.
6. The data visualization system of claim 4, wherein the data visualization system provides multiple project templates by default, and the user can directly complete the configuration of the project with a large screen on the basis of the templates, and can use part of the modules and controls in the project templates for the configuration of new projects.
7. The data visualization system according to claim 4, wherein the chart control panel of the chart control module provides six types of controls including "chart, index, map, text, material and interaction", and the controls can be selected to display the business data according to actual needs, or the controls can be used to realize the configuration of page action events.
8. The data visualization system as claimed in claim 1, wherein the data visualization system comprises a terminal, the terminal comprises a mobile phone, and the data visualization system remote controller is an APP installed on the mobile phone.
9. The data visualization system of claim 1, further comprising a unified authentication module, an AI helper module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010404967.1A CN111596883B (en) | 2020-05-14 | 2020-05-14 | Data visualization system supporting voice recognition and somatosensory operation remote control |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010404967.1A CN111596883B (en) | 2020-05-14 | 2020-05-14 | Data visualization system supporting voice recognition and somatosensory operation remote control |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111596883A true CN111596883A (en) | 2020-08-28 |
| CN111596883B CN111596883B (en) | 2023-06-06 |
Family
ID=72190733
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010404967.1A Active CN111596883B (en) | 2020-05-14 | 2020-05-14 | Data visualization system supporting voice recognition and somatosensory operation remote control |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111596883B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113658592A (en) * | 2021-07-29 | 2021-11-16 | 脑谷人工智能研究院(南京)有限公司 | Data visualization system capable of supporting voice recognition function |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101753871A (en) * | 2008-11-28 | 2010-06-23 | 康佳集团股份有限公司 | Voice remote control TV system |
| CN104185050A (en) * | 2014-07-30 | 2014-12-03 | 哈尔滨工业大学深圳研究生院 | OTT television based intelligent remote control system and control method thereof |
| CN104636146A (en) * | 2015-03-05 | 2015-05-20 | 北京掌中经纬技术有限公司 | Online visual customizing method and system |
| CN108737869A (en) * | 2018-05-08 | 2018-11-02 | 康佳集团股份有限公司 | Smart television starting processing method based on human body sensing and intelligent television system |
| CN109146190A (en) * | 2018-08-31 | 2019-01-04 | 饶智彬 | Intelligent sound based on interior way system and expansion visualizes real-time situation sensory perceptual system |
| US20190287552A1 (en) * | 2018-03-14 | 2019-09-19 | Baidu Online Network Technology (Beijing) Co., Ltd. | Method, apparatus, system and storage medium for implementing a far-field speech function |
-
2020
- 2020-05-14 CN CN202010404967.1A patent/CN111596883B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101753871A (en) * | 2008-11-28 | 2010-06-23 | 康佳集团股份有限公司 | Voice remote control TV system |
| CN104185050A (en) * | 2014-07-30 | 2014-12-03 | 哈尔滨工业大学深圳研究生院 | OTT television based intelligent remote control system and control method thereof |
| CN104636146A (en) * | 2015-03-05 | 2015-05-20 | 北京掌中经纬技术有限公司 | Online visual customizing method and system |
| US20190287552A1 (en) * | 2018-03-14 | 2019-09-19 | Baidu Online Network Technology (Beijing) Co., Ltd. | Method, apparatus, system and storage medium for implementing a far-field speech function |
| CN108737869A (en) * | 2018-05-08 | 2018-11-02 | 康佳集团股份有限公司 | Smart television starting processing method based on human body sensing and intelligent television system |
| CN109146190A (en) * | 2018-08-31 | 2019-01-04 | 饶智彬 | Intelligent sound based on interior way system and expansion visualizes real-time situation sensory perceptual system |
Non-Patent Citations (1)
| Title |
|---|
| 徐彤;: "运用数据分析和可视化技术的数据大屏交互体验系统研究" * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113658592A (en) * | 2021-07-29 | 2021-11-16 | 脑谷人工智能研究院(南京)有限公司 | Data visualization system capable of supporting voice recognition function |
| CN113658592B (en) * | 2021-07-29 | 2024-04-02 | 浙江亿秒数字科技有限公司 | Data visualization system capable of supporting voice recognition function |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111596883B (en) | 2023-06-06 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107608652B (en) | Method and device for controlling graphical interface through voice | |
| CN106527892B (en) | Screen capturing method and system of electronic equipment | |
| US7496230B2 (en) | System and method for automatic natural language translation of embedded text regions in images during information transfer | |
| US5982928A (en) | Character recognizing apparatus and method of controlling the same | |
| CN101308610B (en) | Calligraphy exercising method and apparatus based on mobile terminal | |
| US20080282160A1 (en) | Designated screen capturing and automatic image exporting | |
| KR20170014353A (en) | Apparatus and method for screen navigation based on voice | |
| US11003680B2 (en) | Method for providing e-book service and computer program therefor | |
| CN102930263A (en) | Information processing method and device | |
| EP4105791A2 (en) | Method and apparatus for training, based on cross-modal information, document reading comprehension model | |
| CN105528418A (en) | Design document generation method and apparatus | |
| CN110490182A (en) | A kind of point reads production method, system, storage medium and the electronic equipment of data | |
| US5898819A (en) | System for black and white printing of colored pages | |
| KR20140028810A (en) | User interface appratus in a user terminal and method therefor | |
| CN108230236B (en) | Digital image automatic imposition method and digitally published picture imposition method | |
| CN102289745A (en) | Method for realizing visual operation interface of ERP (Enterprise Resource Planning) system of power system | |
| CN111596883B (en) | Data visualization system supporting voice recognition and somatosensory operation remote control | |
| CN111488147A (en) | Intelligent layout method and device | |
| CN101571799A (en) | Editing system of application program interface and method thereof | |
| CN117057318A (en) | Domain model generation method, device, equipment and storage medium | |
| CN106775337A (en) | The method for sorting and mobile terminal of multipad icon | |
| WO2023045053A1 (en) | File comparison method and apparatus based on rpa and ai, device, and storage medium | |
| Zaguia et al. | Using multimodal fusion in accessing web services | |
| CN113223520A (en) | Voice interaction method, system and platform for semantic understanding of software operation live-action | |
| CN112287131A (en) | Information interaction method and information interaction device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |