Disclosure of Invention
In order to solve the defects and shortcomings of the prior art, the invention mainly aims to provide a large-screen linkage system for a reception robot in an electric power trading hall.
The technical scheme of the invention is as follows: a large-screen system for linking a reception robot in an electric power trading hall,
the method comprises the following steps:
the robot body collects an external sound control instruction and the position information of the explanation point, plays audio information corresponding to the video, judges a video control action according to the sound control instruction and the position information of the explanation point, sends the position information of the explanation point and the video control action to the master control background, is electrically connected with the master control background and is electrically connected with the control computer;
the main control background is used for receiving data information sent by the robot body, storing a control computer address and a video address corresponding to each explanation point position, inquiring the control computer address and the video address corresponding to the explanation point position according to the explanation point position, sending a video control action and the video address to a corresponding control computer according to the control computer address, and electrically connecting the control computer with the video control action and the video address;
the control computer is used for receiving the data information sent by the master control background, playing the video on the video address according to the video address, controlling the video playing according to the video control action and sending the audio data of the video to the robot body;
and the large screen is used for displaying the video played by the control computer and is electrically connected with the control computer in a one-to-one mode.
The robot body includes:
the microphone is used for acquiring voice metadata, sending the data to the voice recognition module and electrically connecting with the robot controller;
the loudspeaker is used for playing audio information corresponding to the video and is electrically connected with the control computer;
the voice recognition module is used for receiving the voice metadata collected by the microphone, recognizing corresponding characters according to the voice metadata, sending the characters to the robot controller and electrically connecting the characters with the robot controller;
the navigation module is used for acquiring the position of the robot body, judging whether the position is at an explanation point, sending explanation point position information to the robot controller if the robot body is at the explanation point, and not sending the explanation point position information to the robot controller if the robot body is not at the explanation point;
and the robot controller receives the data processed by the voice recognition module and the navigation module, sends a video control action and an explanation point address to the master control background by using a robot explanation control algorithm according to the data processed by the voice recognition module and the navigation module, and is electrically connected with the master control background.
The robot body further includes:
and the awakening word judgment module judges whether the awakening words exist according to the data input by the voice recognition module, sends information whether the awakening words exist to the robot controller and is electrically connected with the robot controller. Whether the robot is interrupted by visitors in the explanation process is judged through the awakening words, and the explanation process of the robot can be prevented from being interrupted by conversation errors among the visitors.
The robot interpretation control algorithm includes the following steps,
s1, judging the position of the explanation point, if the robot body is on the explanation point, the robot controller sends the position information of the current explanation point to the master control background and starts playing the video control action;
s2, when the robot body broadcasts the lecture, if the robot controller detects that the awakening word judgment module judges that the awakening word exists, the robot controller simultaneously sends the current explanation point position information and the control action of pausing the video playing to the master control background, and enters a free question-answering state;
s3, when the robot body is in a free question answering state, if the microphone does not receive sound for 5 seconds continuously, sending the position information of the current explanation point to the master control background and resuming playing of video control action;
and S4, when the robot body leaves the current position to explain the point in the lecture report state or the free question and answer state, sending the position information of the current explanation point to the master control background and stopping playing the video control action.
The control computer comprises:
and the video driver receives the video address information and the video control action information sent by the master control background, and controls the playing, pausing, waking up and stopping of the video in the control computer according to the video address information and the video control action information sent by the master control background.
And converting all multimedia for demonstration into videos in a recording mode, wherein the multimedia comprises videos, sound recordings, web pages and PPT.
The mapping relation format of the total control background configuration site and the video to be played at the site is
{ < location 1, video 1>, < location 2, video 2> … < location n, video n > }.
The instruction format of the robot body for sending the video control instruction to the master control background is
{ location, action },
the place is a place name, and the actions include four actions of start, pause, resume and stop.
After receiving the instruction { place, action }, the master control background performs the following operations:
a) inquiring a video driver information registry, and reversely checking the IP and video addresses of large-screen computers managing the site according to the site;
b) sending the instruction { video, place, action } to a video driver on a large-screen computer corresponding to the IP; c) after receiving the instruction { video, place, action }, the video driver firstly checks whether the place is a place maintained by the video driver through the configuration information, checks whether the video name is legal, and checks whether the action is legal, if the check is not passed, the video driver directly discards the instruction, and if the check is passed, the video driver calls a video playing component to perform operation specified by the action on the video file in the directory specified by the video name.
The invention has the beneficial effects that:
compared with the prior art, the robot body collects the sound control instruction and the position information of the explanation point, judges the video control action according to the sound control instruction and the position information of the explanation point, then sends the video control action to the master control background, the master control background inquires the address and the video address of the control computer through the position information of the explanation point, then sends the video control action and the video address to the inquired control computer address, and the control computer executes corresponding actions on the video corresponding to the video address after receiving the video control action and the video address, so that the automation of large-screen explanation is realized, and the requirement of manually cooperating operation multimedia demonstration in the process of receiving the robot guide explanation is thoroughly solved. And the robot completes the synchronous demonstration of multimedia, which is more stable and more standardized than manual operation.
Detailed Description
The invention will be further described with reference to the following drawings and specific embodiments:
referring to fig. 1, a large screen linkage system of a reception robot in an electric trading hall comprises:
the robot body collects an external sound control instruction and the position information of the explanation point, plays audio information corresponding to the video, judges a video control action according to the sound control instruction and the position information of the explanation point, sends the position information of the explanation point and the video control action to the master control background, is electrically connected with the master control background and is electrically connected with the control computer; the robot body is a Beijing hunter starry sky leopard small secret, wherein the acquisition place uses a Beijing hunter starry sky leopard small secret SDK interface function getPlaceList/isRobotInlocalities.
The main control background is used for receiving data information sent by the robot body, storing a control computer address and a video address corresponding to each explanation point position, inquiring the control computer address and the video address corresponding to the explanation point position according to the explanation point position, sending a video control action and the video address to a corresponding control computer according to the control computer address, and electrically connecting the control computer with the video control action and the video address;
the control computer is used for receiving the data information sent by the master control background, playing the video on the video address according to the video address, controlling the video playing according to the video control action and sending the audio data of the video to the robot body;
and the large screen is used for displaying the video played by the control computer and is in one-to-one wire data connection with the control computer.
The robot body includes:
the microphone is used for acquiring voice metadata, sending the data to the voice recognition module and connecting the data with the robot controller through a wire;
the loudspeaker is used for playing audio information corresponding to the video and is connected with the control computer through a wireless signal;
speech recognition module, receivingThe voice metadata collected by the microphone identifies corresponding characters according to the voice metadata, and the characters are sent to the robot controller and electrically connected with the robot controller; the speech recognition module uses a Baidu speech recognition interfacehttp://ai.baidu.com/tech/speech/asr。
The navigation module is used for acquiring the position of the robot body, judging whether the position is at an explanation point, sending explanation point position information to the robot controller if the robot body is at the explanation point, and not sending the explanation point position information to the robot controller if the robot body is not at the explanation point;
and the robot controller receives the data processed by the voice recognition module and the navigation module, sends a video control action and an explanation point address to the master control background by using a robot explanation control algorithm according to the data processed by the voice recognition module and the navigation module, and is electrically connected with the master control background. The voice recognition module and the navigation module are used for generating control algorithm input data, so that the error rate is low, and the accuracy and the stability are extremely high.
The robot body further includes:
and the awakening word judgment module judges whether the awakening words exist according to the data input by the voice recognition module, sends information whether the awakening words exist to the robot controller and is electrically connected with the robot controller.
The robot interpretation control algorithm includes the following steps,
s1, judging the position of the explanation point, if the robot body is on the explanation point, the robot controller sends the position information of the current explanation point to the master control background and starts playing the video control action;
s2, when the robot body broadcasts the lecture, if the robot controller detects that the awakening word judgment module judges that the awakening word exists, the robot controller simultaneously sends the current explanation point position information and the control action of pausing the video playing to the master control background, and enters a free question-answering state;
s3, when the robot body is in a free question answering state, if the microphone does not receive sound for 5 seconds continuously, sending the position information of the current explanation point to the master control background and resuming playing of video control action;
and S4, when the robot body leaves the current position to explain the point in the lecture report state or the free question and answer state, sending the position information of the current explanation point to the master control background and stopping playing the video control action.
The control computer comprises:
and the video driver receives the video address information and the video control action information sent by the master control background, and controls the playing, pausing, waking up and stopping of the video in the control computer according to the video address information and the video control action information sent by the master control background. The video driving program is installed in the large-screen computer and controls the playing, pausing, waking up and stopping of the video in the large-screen computer according to the video address and the video control action sent by the master control background; the video driver can control the video by simulating a computer keyboard, for example, a space key in video playing software can pause the video playing, and a space key in the video driver can be simulated to pause the video.
And converting all multimedia for demonstration into videos in a recording mode, wherein the multimedia comprises videos, sound recordings, web pages and PPT.
The multimedia in various formats can be played by video in a unified way, and the standard is unified, so that the control of a computer is facilitated. The recording mode can adopt screen recording software for recording.
The mapping relation format between the total control background configuration site and the video to be played at the site is { < site 1, video 1>, < site 2, video 2> … < site n, video n > }.
The videos and the places are in one-to-one correspondence, so that the corresponding videos can be known by the computer when the places are obtained through computer query.
The command format of the video control command sent by the robot body to the master control background is { location, action }, the location is a location name, and the action comprises four actions of start, pause, resume and stop.
The instruction signals are in a uniform format, so that the general control background decoding execution is facilitated.
After receiving the instruction { place, action }, the master control background performs the following operations:
a) inquiring a video driver information registry, and reversely checking the IP and video addresses of large-screen computers managing the site according to the site;
b) sending the instruction { video, place, action } to a video driver on a large-screen computer corresponding to the IP;
c) after receiving the instruction { video, place, action }, the video driver firstly checks whether the place is a place maintained by the video driver through the configuration information, checks whether the video name is legal, and checks whether the action is legal, if the check is not passed, the video driver directly discards the instruction, and if the check is passed, the video driver calls a video playing component to perform operation specified by the action on the video file in the directory specified by the video name.
The video address and the IP of the large-screen computer are inquired through the site, and the video address and the corresponding action are sent to the large-screen computer video driving program corresponding to the IP, so that a video playing instruction can be executed, and the video driving program can also play a role in increasing the anti-noise capability of the system and avoiding the influence of irrelevant commands on the operation of the system.
Each large screen can correspond to a plurality of different explanation places, each explanation place corresponds to a different video, and the method is executed according to the following steps when in use:
1. all multimedia presentations are converted into uniform video resources in a recording mode: the method comprises the steps of webpage demonstration, PPT playing and the like, wherein videos and lecture records are synchronized in time;
2. storing the video to be driven by the large-screen computer in a fixed path on the large-screen computer: in the "D: \ video" directory. Where each lecture location cannot exceed 1 video. The video names of different places cannot be the same, and the video names are video 1 … video n;
3. and starting a video driving program on a large-screen computer. When the program is started, starting parameters need to be given, and the format of the starting parameters is as follows:
{ site 1, site 2 …, site n };
4. each large-screen computer can simultaneously control videos corresponding to the n explanation points in application, a video driver program is registered to a master control background after being started, and the registration information format is as follows:
{ IP, < location 1, < location 2 …, location n > },
wherein the IP is the IP address of the large-screen computer where the video driving program is located. The master control background stores all the registration information for future reference;
5. the administrator configures a mapping relation between a place and a video to be played at the place in a master control background, and the format is as follows:
{ < location 1, video 1>, < location 2, video 2> … < location n, video n > };
6. the robot body sends a video control instruction to the master control background, and the instruction format is defined as follows:
{ location, action },
the place is a place name, and the action comprises the following steps of (start, pause, resume and stop);
assuming that the robot body is located at a place 2, which corresponds to a played video with the name of video 2, the instruction sending rule is defined as follows:
a) when the robot body just arrives at the place 2 through the mobile module, the robot body starts to broadcast the lecture, and simultaneously sends information { the place 2, start } to the master control background;
b) when the robot body finishes broadcasting the lecture, an instruction is sent to a master control background: { site 2, stop };
c) robot body is when broadcasting the lecture, if awaken up, then pause to broadcast, gets into the free state of asking for answering, simultaneously to total control backstage send instruction: < site 2, pause >;
d) the robot is in the free question answering state, if do not receive the radio for 5 seconds in succession, then return the lecture notes and report the state, send the instruction to the robot backstage simultaneously: < site 2, resume >;
e) the robot body is forced to end the explanation at the current place or forced to end the whole explanation flow in the lecture note broadcasting state/free question-answering state, then simultaneously sends an instruction to the master control background: < site 2, stop >.
7. The master control background receives the instruction: { site, action } is followed by the following:
1) inquiring a video driver information registry, and reversely checking the IP and video addresses of large-screen computers managing the site according to the site;
2) sending the instruction { video, place, action } to a video driver on a large-screen computer corresponding to the IP;
3) after receiving the instruction, { video, location and action }, the video driver firstly checks whether the location is the location maintained by the video driver, checks whether the video name is legal and checks whether the action is legal through the configuration information. If the check does not pass, the instruction is directly discarded. If the verification is passed, calling the video playing component to perform the operation specified by the action on the video file under the D: \ video directory specified by the video name.
The foregoing is a more detailed description of the invention in connection with specific preferred embodiments and it is not intended that the invention be limited to these specific details. For those skilled in the art to which the invention pertains, several simple deductions or substitutions can be made without departing from the spirit of the invention, and all shall be considered as belonging to the protection scope of the invention.