CN110497421B - Intelligent manufacturing consultation system and method based on Internet of things - Google Patents
Intelligent manufacturing consultation system and method based on Internet of things Download PDFInfo
- Publication number
- CN110497421B CN110497421B CN201910701686.XA CN201910701686A CN110497421B CN 110497421 B CN110497421 B CN 110497421B CN 201910701686 A CN201910701686 A CN 201910701686A CN 110497421 B CN110497421 B CN 110497421B
- Authority
- CN
- China
- Prior art keywords
- consultation
- robot
- controller
- help
- worker
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
- B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
- B25J11/00—Manipulators not otherwise provided for
- B25J11/0005—Manipulators having means for high-level communication with users, e.g. speech generator, face recognition means
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- Human Computer Interaction (AREA)
- Robotics (AREA)
- Mechanical Engineering (AREA)
- Management, Administration, Business Operations System, And Electronic Commerce (AREA)
- Manipulator (AREA)
- General Factory Administration (AREA)
Abstract
The invention relates to an intelligent manufacturing consultation system and method based on the Internet of things, wherein the system comprises an expert terminal and a consultation robot arranged in a factory area, the consultation robot is communicated with the expert terminal, the consultation robot comprises a positioning module for acquiring position information, a camera for acquiring images, a microphone array for acquiring sound, a voice playing module for playing the sound, an infrared distance measuring module, a controller, a wireless communication module, a memory for storing operation videos of all manufacturing devices, a display screen for playing the operation videos and a walking mechanism for controlling the consultation robot to move, a help seeking button is arranged at each manufacturing device, and a help seeking signal is sent to the consultation robot when the help seeking button is pressed. By adopting the system and the method, the consultation robot is used as a worker to establish contact with the expert terminal, so that the worker can conveniently consult professional technical problems at any time and any place, and the intelligent manufacturing consultation efficiency is improved.
Description
Technical Field
The invention relates to the technical field of intelligent manufacturing, in particular to an intelligent manufacturing consultation system and method based on the Internet of things.
Background
Intelligence is a growing direction in manufacturing automation. Artificial intelligence techniques are almost widely used in various links of the manufacturing process. The expert system technology can be used for engineering design, process design, production scheduling, fault diagnosis and the like. Advanced computer intelligent methods such as a neural network and a fuzzy control technology can also be applied to product formulation, production scheduling and the like, so that the intellectualization of the manufacturing process is realized.
Due to the high expertise and high technical content of smart manufacturing, the quality requirements on the staff are also increasing. However, the worker may still encounter some problems during the manufacturing process. In the prior art, a method for facilitating the staff to consult professional technical problems at any time and any place does not exist, and some inconvenience is caused to the working process of the staff.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides an intelligent manufacturing consultation system and method based on the Internet of things.
In order to achieve the above object, the present invention has the following configurations:
the invention provides an intelligent manufacturing consultation system based on the Internet of things, which comprises an expert terminal and a consultation robot arranged in a factory area, wherein the consultation robot is communicated with the expert terminal, the consultation robot comprises a positioning module for acquiring position information, a camera for acquiring images, a microphone array for acquiring sound, a voice playing module for playing the sound, an infrared distance measuring module, a controller, a wireless communication module communicated with the expert terminal, a memory for storing operation videos of various manufacturing devices, a display screen for playing the operation videos and a walking mechanism for controlling the movement of the consultation robot, a help seeking button is arranged at each manufacturing device, and when the help seeking button is pressed, a help seeking signal is sent to the consultation robot; wherein:
when the consultation robot does not receive any help-seeking signal of a help-seeking button, the consultation robot moves in a factory according to a set route through the walking mechanism and adopts the camera to collect a front image;
when the consultation robot receives a help signal of a help button, the controller of the consultation robot judges the number of the help button sending the help signal, and judges the position of a worker pressing the help button according to the recorded position of the help button;
the controller of the consultation robot inquires the number of the manufacturing equipment corresponding to the help-seeking button according to the mapping relation between the number of the help-seeking button and the number of the manufacturing equipment;
the consultation robot moves to the position of the worker through the walking mechanism, and the consultation robot stops moving when the infrared distance measuring module measures that the worker is located within a preset distance range;
the consultation robot reminds workers to speak instructions through the voice playing module and detects the instructions of the workers through the controller;
if the instruction of the staff is a playing instruction, the controller of the consultation robot inquires the operation video of the manufacturing equipment stored in the memory according to the serial number of the manufacturing equipment and controls the display screen and the voice playing module to play the operation video;
if the instruction of the worker is a consultation instruction, the consultation robot reminds the worker to start to speak the problem, starts a recording mode and records the problem voice of the worker;
the consultation robot inquires an expert terminal corresponding to the serial number of the manufacturing equipment, sends the question voice to the expert terminal for consultation and acquires answer voice fed back by the expert terminal;
and the consultation robot adopts the voice playing module to play the answer voice.
Optionally, when the advisory robot detects an instruction of a worker through the controller, the advisory robot further includes the following steps:
if the instruction of the staff is a production cycle starting instruction, the controller of the consulting robot records the work starting state and the work starting time of the manufacturing equipment currently in the production cycle;
and if the instruction of the worker is a production cycle end instruction, the controller of the consulting robot records the work end state and the work end time of the manufacturing equipment in the production cycle, counts the number of times of playing the operation video, the total time of watching the operation video and the number of times of consulting the problem in the production cycle, and scores the proficiency of the worker according to the statistical data.
Optionally, after receiving the production cycle end instruction, the controller of the advisory robot calculates a similarity value of the advisory problems every two times when the counted number of the advisory problems is more than one time, and averages all the calculated similarity values to obtain a similarity value of the advisory problems;
and the controller of the consultation robot scores the proficiency of the staff according to the counted times of playing the operation videos, the total duration of watching the operation videos, the times of consulting the problems and the similarity value of the consulting problems.
Optionally, the controller of the consulting robot sums the counted number of times n1 of playing the operation video, the total duration n2 of watching the operation video, the number n3 of the consulting questions and the similarity value n4 of the consulting questions respectively by weighting values to obtain the proficiency score.
Optionally, the controller of the consulting robot recognizes the voice of each consulting problem to obtain a consulting problem text, and when the controller of the consulting robot calculates the similarity value of each consulting problem twice, the repeated word number x in the consulting problem text twice and the average word number y of the consulting problem text twice are calculated, and x/y is used as the similarity of the consulting problems twice.
Optionally, a plurality of process step nodes are arranged in the operation video, when the controller of the consulting robot plays the operation video, if a voice instruction of a worker is received, the controller of the consulting robot judges whether the voice instruction includes a process step keyword, if so, the controller of the consulting robot inquires the corresponding process step node, inquires the video playing time corresponding to the process step node, and jumps the currently played operation video to the video playing time corresponding to the process step node.
Optionally, after the controller of the consulting robot receives the help seeking signal of the help seeking button, the current interrupt position is recorded, and after the controller moves to the position of the worker who sends the help seeking button, if the controller receives the voice command of the worker, and the voice command includes the keyword for completing the consultation, the consulting robot returns to the interrupt position and continues to walk according to a preset route.
Optionally, after the controller of the consulting robot queries the expert terminal corresponding to the serial number of the manufacturing device, the number of currently-serviced workers of each expert terminal is calculated, the expert terminals are ranked according to the number of currently-serviced workers of the expert terminals, the expert terminal with the smallest number of currently-serviced workers is selected, the expert terminal is used as the expert terminal for sending the consulting problem, and the number of currently-serviced workers of the expert terminal is increased by one.
The embodiment of the invention also provides an intelligent manufacturing consultation method based on the Internet of things, which is adopted by the intelligent manufacturing consultation system based on the Internet of things, and comprises the following steps:
the consultation robot receives a help signal of a help button;
the controller of the consultation robot judges the number of the help-seeking button sending the help-seeking signal, and judges the position of a worker pressing the help-seeking button according to the recorded position of the help-seeking button;
the controller of the consultation robot inquires the number of the manufacturing equipment corresponding to the help-seeking button according to the mapping relation between the number of the help-seeking button and the number of the manufacturing equipment;
the consultation robot moves to the position of the worker through the walking mechanism, and the consultation robot stops moving when the infrared distance measuring module measures that the worker is located within a preset distance range;
the consultation robot reminds workers to speak instructions through the voice playing module and detects the instructions of the workers through the controller;
if the instruction of the staff is a playing instruction, the controller of the consultation robot inquires the operation video of the manufacturing equipment stored in the memory according to the serial number of the manufacturing equipment and controls the display screen and the voice playing module to play the operation video;
if the instruction of the worker is a consultation instruction, the consultation robot reminds the worker to start to speak the problem, starts a recording mode and records the problem voice of the worker;
the consultation robot inquires an expert terminal corresponding to the serial number of the manufacturing equipment, sends the question voice to the expert terminal for consultation and acquires answer voice fed back by the expert terminal;
and the consultation robot adopts the voice playing module to play the answer voice.
In conclusion, compared with the prior art, the consulting robot is used as a worker to establish contact with the expert terminal, so that the worker can conveniently consult professional technical problems at any time and any place, and the intelligent manufacturing consultation efficiency is improved; the staff can choose to check the operation video, choose to ask a question with voice when the operation video can not answer the doubts of the staff, and the consulting robot forwards the voice to the expert terminal to ask the expert at the expert terminal to answer; after the production period is finished, proficiency grading can be carried out on the staff according to the video watching situation and the consultation problem situation of the staff, and an objective working capacity evaluation result is obtained.
Drawings
Fig. 1 is a schematic structural diagram of an intelligent manufacturing consultation system based on the internet of things according to an embodiment of the present invention;
FIG. 2 is a block diagram of an embodiment of a consultation robot;
FIG. 3 is a schematic structural diagram of an advisory robot in accordance with an embodiment of the present invention;
fig. 4 is a flowchart of an intelligent manufacturing consultation method based on the internet of things according to an embodiment of the present invention.
Reference numerals:
m100 expert terminal
M200 consultation robot
M201 positioning module M202 camera
M203 microphone array M204 voice playing module
M205 infrared ranging module M206 controller
M207 Wireless communication Module M208 memory
M210 running gear of M209 display screen
M300 help-seeking button
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The same reference numerals in the drawings denote the same or similar structures, and thus their repetitive description will be omitted.
The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to provide a thorough understanding of embodiments of the invention. One skilled in the relevant art will recognize, however, that the invention may be practiced without one or more of the specific details, or with other methods, components, materials, and so forth. In some instances, well-known structures, materials, or operations are not shown or described in detail to avoid obscuring the invention.
As shown in fig. 1, in order to solve the technical problems in the prior art, the invention provides an intelligent manufacturing consultation system based on the internet of things, which includes an expert terminal M100 and a consultation robot M200 disposed in a factory, wherein the consultation robot M200 communicates with the expert terminal M100. The expert terminal M100 may be a mobile phone terminal, a tablet terminal, a notebook terminal, or the like used by the expert, may receive the consultation question of the worker from the consulting robot M200, and may transmit the answer of the expert to the consulting robot M200 in the form of voice. A plurality of the consulting robots M200 may be installed in one factory floor, and may provide services to a plurality of workers at the same time. The expert terminals M100 may also be provided with a plurality of manufacturing devices, each expert corresponding to the expert terminal M100 has its own responsibility, the expert may be a highly skilled worker using the manufacturing device, or may be a manufacturer of the manufacturing device, that is, each expert terminal M100 corresponds to one or more manufacturing devices. The plurality of expert terminals M100 may serve the advisory robot M200 in one factory, or may serve the advisory robots M200 in a plurality of factories.
As shown in fig. 2 and 3, the advisory robot M200 includes a positioning module M201 for acquiring position information, a camera M202 for acquiring images, a microphone array M203 for acquiring sounds, a voice playing module M204 for playing sounds, an infrared ranging module M205, a controller M206, a wireless communication module M207 for communicating with the expert terminal M100, a memory M208 for storing operation videos of each manufacturing device, a display screen M209 for playing the operation videos, and a traveling mechanism M210 for controlling the movement of the advisory robot M200, wherein a help-seeking button M300 is provided at each manufacturing device, and when the help-seeking button M300 is pressed, a help-seeking signal is transmitted to the advisory robot M200. The help button M300 serves as a medium for a worker to call the counseling robot M200. The consulting robot M200 provides the consulting service for the staff in time according to the following steps:
when the consulting robot M200 does not receive any help signal of the help button M300, the consulting robot M200 moves in the factory according to a predetermined route through the traveling mechanism M210; the predetermined route may be a preset patrol robot of the consultation robot M200, and when the consultation robot M200 does not receive the help signal of the help button M300, the consultation robot M200 may collect images in front through the camera M202, may set to a video mode, may set to collect a photo at intervals, may set to stay at each manufacturing device for a preset time, and then records a video corresponding to the manufacturing device, and so on;
when the advisory robot M200 receives a help signal of a help button M300, the controller M206 of the advisory robot M200 determines the number of the help button M300 which sent the help signal, and determines the position of the worker who pressed the help button M300 according to the recorded position of the help button M300;
the controller M206 of the advisory robot M200 queries the number of the manufacturing equipment corresponding to the help button M300 according to the mapping relationship between the number of the help button M300 and the number of the manufacturing equipment;
the consulting robot M200 moves to the position of the worker through the walking mechanism M210, and when the infrared distance measuring module M205 measures that the worker is located within a preset distance range, the consulting robot M200 stops moving;
the consulting robot M200 reminds the staff to speak out the instruction through the voice playing module M204 and detects the instruction of the staff through the controller M206;
if the instruction of the worker is a play instruction, which indicates that the worker only needs to view the operation video of the manufacturing equipment at present, the controller M206 of the advisory robot M200 queries the operation video of the manufacturing equipment stored in the memory M208 according to the serial number of the manufacturing equipment, and controls the display screen M209 and the voice play module M204 to play the operation video;
if the instruction of the worker is a consultation instruction, which indicates that the worker needs to ask for help from an expert, the consultation robot M200 reminds the worker to start speaking a problem, starts a recording mode, and records the problem voice of the worker;
the consulting robot M200 inquires the expert terminal M100 corresponding to the serial number of the manufacturing equipment, sends the question voice to the expert terminal M100 for consulting, and obtains the answer voice fed back by the expert terminal M100; the consulting robot M200 transfers information between the expert terminal M100 and the staff through a voice mode, so that the information can be more accurately transmitted;
the consulting robot M200 plays the answer voice by using the voice playing module M204.
In this embodiment, when the advisory robot M200 detects the instruction of the worker through the controller M206, the method further includes the following steps:
if the worker's command is a production cycle start command, the controller M206 of the advisory robot M200 records a work start state and a work start time of the manufacturing equipment currently in the production cycle;
if the instruction of the worker is a production cycle end instruction, the controller M206 of the consulting robot M200 records the work end state and the work end time of the manufacturing equipment in the production cycle, counts the number of times of playing the operation video, the total time of watching the operation video and the number of times of consulting the problem by the worker in the production cycle, and scores the proficiency of the worker according to the statistical data. Therefore, objective scores of proficiency and working ability of workers can be obtained according to the situation of watching the operation videos and the situation of the consultation problems.
Further, after receiving the production cycle end instruction, the controller M206 of the advisory robot M200 calculates similarity values of the advisory problems every two times when the counted number of the advisory problems is greater than one time, and averages all the calculated similarity values to obtain the advisory problem similarity values, and if the advisory problem similarity values are high, which indicates that a worker has asked a very similar problem for many times, the worker may be unfamiliar with the problem or have poor learning ability of the worker, which may affect the score of the worker;
and the controller M206 of the consulting robot M200 scores the proficiency of the staff according to the counted times of playing the operation videos, the total time of watching the operation videos, the times of consulting the problems and the similarity value of the consulting problems.
In this embodiment, the controller M206 of the consulting robot M200 sums the counted number of times n1 of playing the operation video, the total duration n2 of watching the operation video, the number n3 of the consulting questions, and the similarity value n4 of the consulting questions with weights, respectively, to obtain the proficiency score. The weight of the number of times of playing the operation video, the weight of the total duration of watching the operation video, the weight of the number of times of consulting the question and the weight of the similarity value of the consulting question can be selected and set according to the requirement.
When the controller M206 of the advisory robot M200 calculates the advisory question similarity, the following methods may be adopted: the controller M206 of the consulting robot M200 recognizes the voice of each consultation problem to obtain a consultation problem text, and when the controller M206 of the consulting robot M200 calculates the similarity value of each consultation problem, the repeated word number x in the consultation problem text and the average word number y of the consultation problem text are calculated, and x/y is used as the similarity of the consultation problems. However, the present invention is not limited thereto, and if the word vectors of the text of the question to be consulted each time can be obtained according to the preset mapping relationship between the word vectors and the keywords after the speech recognition of the question to be consulted each time, the euclidean distance between the word vectors of the text of the question to be consulted twice can be calculated, and can be used as the similarity of the question to be consulted twice.
In this embodiment, a plurality of process step nodes are provided in the operation video, when the controller M206 of the advisory robot M200 plays the operation video, if a voice instruction of a worker is received, the controller M206 of the advisory robot M200 determines whether the voice instruction includes a process step keyword, if so, the controller M206 of the advisory robot M200 queries the corresponding process step node and queries the video playing time corresponding to the process step node, and jumps the currently played operation video to the video playing time corresponding to the process step node, so that the time for the worker to watch the played video can be effectively saved, and the worker can directly see the operation course of the process step that is the most concerned.
Further, after receiving the help signal of the help button M300, the controller M206 of the advisory robot M200 records the current interrupt position, and after moving to the position of the worker who sends the help button M300, if the voice command of the worker is received and the voice command includes a keyword for completing the consultation, the advisory robot M200 returns to the interrupt position and continues to walk according to a preset route, so that the patrol task can be continuously completed.
In this embodiment, after the controller M206 of the consulting robot M200 queries the expert terminals M100 corresponding to the serial numbers of the manufacturing devices, the number of currently-serviced workers of each expert terminal M100 is calculated, the expert terminals M100 are sorted according to the number of currently-serviced workers of the expert terminals M100, the expert terminal M100 with the smallest number of currently-serviced workers is selected, the expert terminal M100 is used as the expert terminal M100 for sending a consulting question, and the number of currently-serviced workers of the expert terminal M100 is increased by one. Therefore, in the method of the embodiment, the number of the staff serviced by each expert terminal M100 can be well balanced, and the problem that some experts corresponding to the expert terminals M100 are too busy to answer the staff in time is avoided.
As shown in fig. 4, an embodiment of the present invention further provides an intelligent manufacturing and consulting method based on the internet of things, where the intelligent manufacturing and consulting system based on the internet of things is used, the method includes the following steps:
the consultation robot receives a help signal of a help button;
the controller of the consultation robot judges the number of the help-seeking button sending the help-seeking signal, and judges the position of a worker pressing the help-seeking button according to the recorded position of the help-seeking button;
the controller of the consultation robot inquires the number of the manufacturing equipment corresponding to the help-seeking button according to the mapping relation between the number of the help-seeking button and the number of the manufacturing equipment;
the consultation robot moves to the position of the worker through the walking mechanism, and the consultation robot stops moving when the infrared distance measuring module measures that the worker is located within a preset distance range;
the consultation robot reminds workers to speak instructions through the voice playing module and detects the instructions of the workers through the controller;
if the instruction of the staff is a playing instruction, the controller of the consultation robot inquires the operation video of the manufacturing equipment stored in the memory according to the serial number of the manufacturing equipment and controls the display screen and the voice playing module to play the operation video;
if the instruction of the worker is a consultation instruction, the consultation robot reminds the worker to start to speak the problem, starts a recording mode and records the problem voice of the worker;
the consultation robot inquires an expert terminal corresponding to the serial number of the manufacturing equipment, sends the question voice to the expert terminal for consultation and acquires answer voice fed back by the expert terminal;
and the consultation robot adopts the voice playing module to play the answer voice.
In the intelligent manufacturing and consulting method based on the internet of things, the specific implementation of each step can be realized by adopting the function implementation method of each device in the intelligent manufacturing and consulting system based on the internet of things, and details are not repeated herein.
In conclusion, compared with the prior art, the consulting robot is used as a worker to establish contact with the expert terminal, so that the worker can conveniently consult professional technical problems at any time and any place, and the intelligent manufacturing consultation efficiency is improved; the staff can choose to check the operation video, choose to ask a question with voice when the operation video can not answer the doubts of the staff, and the consulting robot forwards the voice to the expert terminal to ask the expert at the expert terminal to answer; after the production period is finished, proficiency grading can be carried out on the staff according to the video watching situation and the consultation problem situation of the staff, and an objective working capacity evaluation result is obtained.
In this specification, the invention has been described with reference to specific embodiments thereof. It will, however, be evident that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention. The specification and drawings are, accordingly, to be regarded in an illustrative rather than a restrictive sense.
Claims (9)
1. An intelligent manufacturing consultation system based on the Internet of things is characterized by comprising an expert terminal and a consultation robot arranged in a factory area, wherein the consultation robot is communicated with the expert terminal, the consultation robot comprises a positioning module for acquiring position information, a camera for acquiring images, a microphone array for acquiring sound, a voice playing module for playing the sound, an infrared distance measuring module, a controller, a wireless communication module for communicating with the expert terminal, a memory for storing operation videos of all manufacturing equipment, a display screen for playing the operation videos and a walking mechanism for controlling the movement of the consultation robot, a help seeking button is arranged at each manufacturing equipment, and when the help seeking button is pressed, a help seeking signal is sent to the consultation robot; wherein:
when the consultation robot does not receive any help-seeking signal of a help-seeking button, the consultation robot moves in a factory according to a set route through the walking mechanism and adopts the camera to collect a front image;
when the consultation robot receives a help signal of a help button, the controller of the consultation robot judges the number of the help button sending the help signal, and judges the position of a worker pressing the help button according to the recorded position of the help button;
the controller of the consultation robot inquires the number of the manufacturing equipment corresponding to the help-seeking button according to the mapping relation between the number of the help-seeking button and the number of the manufacturing equipment;
the consultation robot moves to the position of the worker through the walking mechanism, and the consultation robot stops moving when the infrared distance measuring module measures that the worker is located within a preset distance range;
the consultation robot reminds workers to speak instructions through the voice playing module and detects the instructions of the workers through the controller;
if the instruction of the staff is a playing instruction, the controller of the consultation robot inquires the operation video of the manufacturing equipment stored in the memory according to the serial number of the manufacturing equipment and controls the display screen and the voice playing module to play the operation video;
if the instruction of the worker is a consultation instruction, the consultation robot reminds the worker to start to speak the problem, starts a recording mode and records the problem voice of the worker;
the controller of the consultation robot inquires an expert terminal corresponding to the serial number of the manufacturing equipment, sends the question voice to the expert terminal for consultation and acquires an answer voice fed back by the expert terminal;
and the consultation robot adopts the voice playing module to play the answer voice.
2. The intelligent manufacturing and consulting system based on the internet of things of claim 1, wherein when the consulting robot detects an instruction of a worker through the controller, the system further comprises the following steps:
if the instruction of the staff is a production cycle starting instruction, the controller of the consulting robot records the work starting state and the work starting time of the manufacturing equipment currently in the production cycle;
and if the instruction of the worker is a production cycle end instruction, the controller of the consulting robot records the work end state and the work end time of the manufacturing equipment in the production cycle, counts the number of times of playing the operation video, the total time of watching the operation video and the number of times of consulting the problem in the production cycle, and scores the proficiency of the worker according to the statistical data.
3. The intelligent manufacturing consultation system based on the internet of things of claim 2, wherein after receiving a production cycle end instruction, the controller of the consultation robot calculates the similarity value of each consultation problem when the counted number of times of the consultation problems is more than one time, and averages all the calculated similarity values to obtain the similarity value of the consultation problems;
and the controller of the consultation robot scores the proficiency of the staff according to the counted times of playing the operation videos, the total duration of watching the operation videos, the times of consulting the problems and the similarity value of the consulting problems.
4. The intelligent manufacturing and consulting system based on the internet of things of claim 3, wherein the controller of the consulting robot sums the counted number of times n1 of playing the operation videos, the total duration n2 of watching the operation videos, the number n3 of the consulting questions and the similarity value n4 of the consulting questions by weight to obtain the proficiency score.
5. The intelligent manufacturing consultation system based on the internet of things as claimed in claim 3, wherein the controller of the consultation robot recognizes the voice of each consultation problem to obtain a consultation problem text, and when the controller of the consultation robot calculates the similarity value of each consultation problem, the controller calculates the number of repeated words x in the consultation problem text and the average number of words y of the consultation problem text, and takes x/y as the similarity of the consultation problems.
6. The intelligent manufacturing consultation system based on the internet of things as claimed in claim 1, wherein a plurality of process step nodes are provided in the operation video, and when the controller of the consultation robot plays the operation video, if a voice instruction of a worker is received, the controller of the consultation robot judges whether the voice instruction includes a process step keyword, if so, the controller of the consultation robot inquires the corresponding process step node and inquires the video playing time corresponding to the process step node, and jumps the currently played operation video to the video playing time corresponding to the process step node.
7. The intelligent manufacturing and consulting system based on the internet of things of claim 1, wherein the controller of the consulting robot records a current interrupt position after receiving a help seeking signal of the help seeking button, and after moving to a position of a worker who sends the help seeking button, if a voice command of the worker is received and the voice command includes a keyword for which consultation is completed, the consulting robot returns to the interrupt position and continues to walk according to a preset route.
8. The intelligent manufacturing consultation system based on the internet of things of claim 1, wherein after the controller of the consultation robot queries the expert terminals corresponding to the serial numbers of the manufacturing equipment, the number of the workers currently served by each expert terminal is calculated, the expert terminals are ranked according to the number of the workers currently served by the expert terminals, the expert terminal with the least number of the workers currently served is selected, the expert terminal is used as the expert terminal for sending the consultation problem, and the number of the workers currently served by the expert terminal is increased by one.
9. An intelligent manufacturing consultation method based on the internet of things, which is characterized in that the intelligent manufacturing consultation system based on the internet of things of any one of claims 1 to 8 is adopted, and the method comprises the following steps:
the consultation robot receives a help signal of a help button;
the controller of the consultation robot judges the number of the help-seeking button sending the help-seeking signal, and judges the position of a worker pressing the help-seeking button according to the recorded position of the help-seeking button;
the controller of the consultation robot inquires the number of the manufacturing equipment corresponding to the help-seeking button according to the mapping relation between the number of the help-seeking button and the number of the manufacturing equipment;
the consultation robot moves to the position of the worker through the walking mechanism, and the consultation robot stops moving when the infrared distance measuring module measures that the worker is located within a preset distance range;
the consultation robot reminds workers to speak instructions through the voice playing module and detects the instructions of the workers through the controller;
if the instruction of the staff is a playing instruction, the controller of the consultation robot inquires the operation video of the manufacturing equipment stored in the memory according to the serial number of the manufacturing equipment and controls the display screen and the voice playing module to play the operation video;
if the instruction of the worker is a consultation instruction, the consultation robot reminds the worker to start to speak the problem, starts a recording mode and records the problem voice of the worker;
the consultation robot inquires an expert terminal corresponding to the serial number of the manufacturing equipment, sends the question voice to the expert terminal for consultation and acquires answer voice fed back by the expert terminal;
and the consultation robot adopts the voice playing module to play the answer voice.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910701686.XA CN110497421B (en) | 2019-07-31 | 2019-07-31 | Intelligent manufacturing consultation system and method based on Internet of things |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910701686.XA CN110497421B (en) | 2019-07-31 | 2019-07-31 | Intelligent manufacturing consultation system and method based on Internet of things |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110497421A CN110497421A (en) | 2019-11-26 |
| CN110497421B true CN110497421B (en) | 2020-11-24 |
Family
ID=68587980
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910701686.XA Active CN110497421B (en) | 2019-07-31 | 2019-07-31 | Intelligent manufacturing consultation system and method based on Internet of things |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110497421B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107450564A (en) * | 2017-09-22 | 2017-12-08 | 芜湖星途机器人科技有限公司 | Bootstrap robot |
| CN108888246A (en) * | 2018-05-08 | 2018-11-27 | 广西师范大学 | A kind of intelligent nursing system of being hospitalized |
| CN109118860A (en) * | 2018-09-19 | 2019-01-01 | 江苏金惠甫山软件科技有限公司 | Expert English language training by qualified teachers system and method based on artificial intelligence |
| CN109318237A (en) * | 2017-08-01 | 2019-02-12 | 安康市汉滨区易智网络科技有限公司 | Scenic spot guide robot service system |
| CN109549765A (en) * | 2018-11-23 | 2019-04-02 | 罗中兴 | Endowment management system and method applied to robot |
| CN208819349U (en) * | 2018-08-06 | 2019-05-03 | 深圳来邦科技有限公司 | A kind of doctor supports the house formula endowment monitor system of combination |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11351673B2 (en) * | 2017-03-06 | 2022-06-07 | Miso Robotics, Inc. | Robotic sled-enhanced food preparation system and related methods |
-
2019
- 2019-07-31 CN CN201910701686.XA patent/CN110497421B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109318237A (en) * | 2017-08-01 | 2019-02-12 | 安康市汉滨区易智网络科技有限公司 | Scenic spot guide robot service system |
| CN107450564A (en) * | 2017-09-22 | 2017-12-08 | 芜湖星途机器人科技有限公司 | Bootstrap robot |
| CN108888246A (en) * | 2018-05-08 | 2018-11-27 | 广西师范大学 | A kind of intelligent nursing system of being hospitalized |
| CN208819349U (en) * | 2018-08-06 | 2019-05-03 | 深圳来邦科技有限公司 | A kind of doctor supports the house formula endowment monitor system of combination |
| CN109118860A (en) * | 2018-09-19 | 2019-01-01 | 江苏金惠甫山软件科技有限公司 | Expert English language training by qualified teachers system and method based on artificial intelligence |
| CN109549765A (en) * | 2018-11-23 | 2019-04-02 | 罗中兴 | Endowment management system and method applied to robot |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110497421A (en) | 2019-11-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110809306B (en) | Terminal access selection method based on deep reinforcement learning | |
| US10783476B2 (en) | System for customized interactions-related assistance | |
| US20190213490A1 (en) | Federated intelligent assistance | |
| CN101198128B (en) | Multi-module equipment and its service stream switching method | |
| US20240086795A1 (en) | System and method of driver matching and dispatch | |
| JP2022519901A (en) | Voice assistant in electric toothbrush | |
| CN203279119U (en) | Wireless earphone based on motion sensor | |
| CN105074528A (en) | Imaging device, and focus control method | |
| US9020460B2 (en) | Smart alarm providing terminal and alarm providing method thereof | |
| CN110497421B (en) | Intelligent manufacturing consultation system and method based on Internet of things | |
| CN111098307A (en) | Intelligent patrol robot | |
| JP2018202595A (en) | Service providing system and database | |
| CN116021250B (en) | Intelligent assembly system | |
| CN110866392B (en) | System for policy control and policy control method thereof | |
| CN112699731A (en) | Air conditioner music intelligent playing method and device based on human behavior recognition and air conditioner | |
| CN117176864A (en) | Outbound communication data management method, system, medium and equipment based on AI | |
| KR102185369B1 (en) | System and mehtod for generating information for conversation with user | |
| JP2023113694A (en) | Learning device, communication system, learning method, and learning program | |
| CN113869523A (en) | Machine learning method, system, base station and medium based on B-M2M | |
| CN116668622A (en) | Multi-party communication voice control method and system | |
| CN113163063A (en) | Intelligent outbound call system and method | |
| CN205507455U (en) | Interactive's robot | |
| JP2018101941A (en) | Controller, control system, control method, and program | |
| CN212628195U (en) | Television control system based on voice and mobile phone APP multi-module | |
| CN113543242B (en) | Method, device and computer readable storage medium for realizing pilot frequency switching |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20200304 Address after: Wujiang District of Suzhou City, Jiangsu province 215200 Lili town FENHU Road No. 558 Applicant after: Suzhou Lingxi Internet of Things Technology Co., Ltd. Address before: Wujiang District of Suzhou City, Jiangsu province 215200 Lili town FENHU Road No. 558 Applicant before: Suzhou Lingrui Intelligent Technology Co.,Ltd. |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |