CN112597894A - Equipment disassembly and assembly processing method, device, equipment and storage medium - Google Patents
Equipment disassembly and assembly processing method, device, equipment and storage medium Download PDFInfo
- Publication number
- CN112597894A CN112597894A CN202011541895.1A CN202011541895A CN112597894A CN 112597894 A CN112597894 A CN 112597894A CN 202011541895 A CN202011541895 A CN 202011541895A CN 112597894 A CN112597894 A CN 112597894A
- Authority
- CN
- China
- Prior art keywords
- disassembled
- assembled
- target
- component
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 20
- 238000000034 method Methods 0.000 claims abstract description 51
- 238000012545 processing Methods 0.000 claims description 18
- 238000005516 engineering process Methods 0.000 claims description 6
- 230000003190 augmentative effect Effects 0.000 claims description 5
- 238000004590 computer program Methods 0.000 claims description 4
- 238000010586 diagram Methods 0.000 description 8
- 230000000694 effects Effects 0.000 description 7
- 238000001514 detection method Methods 0.000 description 4
- 238000004364 calculation method Methods 0.000 description 3
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 2
- 238000004891 communication Methods 0.000 description 2
- 238000009434 installation Methods 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 235000019800 disodium phosphate Nutrition 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/10—Terrestrial scenes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10016—Video; Image sequence
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Multimedia (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Processing Or Creating Images (AREA)
Abstract
The application provides a device dismounting processing method, a device and a storage medium, and relates to the field of device dismounting. The method comprises the following steps: acquiring a first image to be detected with equipment to be disassembled and assembled; detecting the first image to be detected, and determining information of at least one part to be disassembled and assembled in the equipment to be disassembled and assembled, wherein the information of each part to be disassembled and assembled comprises: the name of each component to be disassembled and assembled; according to the name of a target part to be disassembled and assembled, disassembling and assembling indication information corresponding to the target part to be disassembled and assembled is determined; and displaying dismounting indication information corresponding to the target dismounting component at a target position corresponding to the target dismounting component on the first image to be detected. Compared with the prior art, the problems of poor teaching result and low teaching efficiency are avoided.
Description
Technical Field
The present application relates to the field of device detachment and installation technologies, and in particular, to a device detachment and installation processing method, apparatus, device, and storage medium.
Background
Dismouting teaching can all be used in many fields, for example in industrial field, when the apprentice is to the components and parts dismouting on some machines, need impart knowledge to students to the apprentice through the dismouting teaching.
In the prior art, disassembly and assembly teaching is mostly introduced to the whole disassembly and assembly process through ppt, a structure diagram or video made by a disassembly and assembly teacher; or a large number of teachers for dismounting and mounting are needed for teaching, and dismounting and mounting teaching tutoring is carried out personally.
However, the teaching effect of the teaching mode mostly depends on the experience of assembling and disassembling teachers, the requirement on teachers is high, manpower is wasted, the teaching result is not good, and the teaching efficiency is not high.
Disclosure of Invention
An object of the present application is to provide a method, an apparatus, a device and a storage medium for handling disassembly and assembly of an apparatus, so as to solve the problems of poor teaching result and low teaching efficiency in the prior art.
In order to achieve the above purpose, the technical solutions adopted in the embodiments of the present application are as follows:
in a first aspect, an embodiment of the present application provides an apparatus disassembling and assembling processing method, where the method includes:
acquiring a first image to be detected with equipment to be disassembled and assembled;
detecting the first image to be detected, and determining information of at least one part to be disassembled and assembled in the equipment to be disassembled and assembled, wherein the information of each part to be disassembled and assembled comprises: the name of each component to be disassembled and assembled;
according to the name of a target part to be disassembled and assembled, disassembling and assembling indication information corresponding to the target part to be disassembled and assembled is determined;
and displaying dismounting indication information corresponding to the target dismounting component at a target position corresponding to the target dismounting component on the first image to be detected.
Optionally, the information of each component to be disassembled and assembled further includes: each part to be disassembled and assembled is arranged at a first position in the first image to be detected;
the method further comprises the following steps:
acquiring a second image to be detected with the equipment to be disassembled and assembled;
detecting the second image to be detected, and determining a second position of the target part to be disassembled in the second image to be detected;
and determining whether the target component to be disassembled and assembled is disassembled and assembled according to the first position and the second position.
Optionally, the information of each component to be disassembled and assembled further includes: the initial state of each part to be disassembled and assembled; the determining whether the target component to be disassembled and assembled is disassembled and assembled according to the first position, the second position and the initial state of the target component to be disassembled and assembled comprises the following steps:
if the first position is different from the second position, determining whether the target component to be disassembled and assembled is disassembled and assembled according to the initial state of the target component to be disassembled and assembled;
and if the first position is the same as the second position, determining that the target part to be disassembled and assembled is not disassembled and assembled.
Optionally, the initial state of the target component to be disassembled and assembled is an undetached state, and the first position is the target position;
if the first position and the second position are different, determining whether the target component to be disassembled and assembled is disassembled and assembled according to the initial state of the target component to be disassembled and assembled comprises the following steps:
and if the first position is different from the second position, determining that the state of the target component to be disassembled and assembled changes, and updating the state of the target component to be disassembled and assembled into the disassembled and assembled state.
Optionally, the initial state of the target component to be disassembled and assembled is an uninstalled state, and if the first position and the second position are different, determining whether the target component to be disassembled and assembled has been disassembled and assembled according to the initial state of the target component to be disassembled and assembled includes:
and if the first position is different from the second position, and the second position is the target position, determining that the state of the target component to be disassembled and assembled changes, and updating the state of the target component to be disassembled and assembled into the installed state.
Optionally, before determining, according to the name of the target component to be disassembled and assembled, the disassembling and assembling instruction information corresponding to the target component to be disassembled and assembled, the method further includes:
and determining the target component to be disassembled and assembled according to the preset disassembling and assembling flow corresponding to the equipment to be disassembled and assembled.
Optionally, the disassembly and assembly instruction information includes: the disassembly and assembly guiding animation is used for displaying disassembly and assembly indicating information corresponding to a target disassembly and assembly part at a target position corresponding to the target disassembly and assembly part on the first image to be detected, and comprises the following steps:
and displaying the disassembly and assembly guide animation in an overlapping manner at the target position on the first image to be detected through an augmented reality technology.
Optionally, the method further comprises:
according to the name of the target part to be disassembled and assembled, determining a disassembly and assembly prompt voice corresponding to the target part to be disassembled and assembled, wherein the disassembly and assembly prompt voice is a disassembly and assembly use prompt voice of a target tool corresponding to the target part to be disassembled and assembled;
and playing the disassembly and assembly prompt voice.
Optionally, the first image to be detected and the second image to be detected are both continuous frame images of a preset number.
In a second aspect, another embodiment of the present application provides an apparatus for disassembling and assembling a device, where the apparatus includes: the device comprises an acquisition module, a determination module and a display module, wherein:
the acquisition module is used for acquiring a first image to be detected with equipment to be disassembled and assembled;
the determining module is configured to detect the first image to be detected, and determine information of at least one component to be disassembled and assembled in the device to be disassembled and assembled, where the information of each component to be disassembled and assembled includes: the name of each component to be disassembled and assembled; according to the name of a target part to be disassembled and assembled, disassembling and assembling indication information corresponding to the target part to be disassembled and assembled is determined;
the display module is used for displaying dismounting indication information corresponding to the target dismounting component at a target position corresponding to the target dismounting component on the first image to be detected.
Optionally, the information of each component to be disassembled and assembled further includes: each part to be disassembled and assembled is arranged at a first position in the first image to be detected;
the acquisition module is specifically used for acquiring a second image to be detected of the equipment to be disassembled and assembled;
the determining module is specifically configured to detect the second image to be detected, and determine a second position of the target component to be disassembled and assembled in the second image to be detected; and determining whether the target component to be disassembled and assembled is disassembled and assembled according to the first position and the second position.
Optionally, the information of each component to be disassembled and assembled further includes: the initial state of each part to be disassembled and assembled; the determining module is specifically configured to determine whether the target component to be disassembled and assembled has been disassembled and assembled according to an initial state of the target component to be disassembled and assembled if the first position and the second position are different; and if the first position is the same as the second position, determining that the target part to be disassembled and assembled is not disassembled and assembled.
Optionally, the initial state of the target component to be disassembled and assembled is an undetached state, and the first position is the target position; the determining module is specifically configured to determine that the state of the target component to be disassembled and assembled changes if the first position is different from the second position, and update the state of the target component to be disassembled and assembled to the disassembled and assembled state.
Optionally, the determining module is specifically configured to determine that the state of the target component to be disassembled and assembled changes and update the state of the target component to be disassembled and assembled to the installed state if the first position and the second position are different and the second position is the target position.
Optionally, the determining module is specifically configured to determine the target component to be disassembled and assembled according to a preset disassembling and assembling process corresponding to the device to be disassembled and assembled.
Optionally, the display module is specifically configured to display the disassembly and assembly guidance animation in an overlaid manner at the target position on the first image to be detected by using an augmented reality technology.
Optionally, the apparatus further comprises: a play module, wherein:
the determining module is specifically configured to determine, according to the name of the target component to be disassembled and assembled, a disassembling and assembling prompting voice corresponding to the target component to be disassembled and assembled, where the disassembling and assembling prompting voice is a disassembling and assembling use prompting voice of a target tool corresponding to the target component to be disassembled and assembled;
the playing module is specifically used for playing the disassembly and assembly prompt voice.
In a third aspect, another embodiment of the present application provides an apparatus disassembly and assembly processing apparatus, including: a processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, when the device is mounted and dismounted, the processor and the storage medium communicate through the bus, and the processor executes the machine-readable instructions to execute the steps of the method according to any one of the first aspect.
In a fourth aspect, another embodiment of the present application provides a storage medium having a computer program stored thereon, where the computer program is executed by a processor to perform the steps of the method according to any one of the above first aspects.
The beneficial effect of this application is: by adopting the equipment disassembly and assembly processing method provided by the application, the first image to be detected with the device to be disassembled and assembled can be detected, the name of the target part to be disassembled and assembled in the part to be disassembled and assembled is determined, the disassembly and assembly indicating information corresponding to the target part to be disassembled and assembled is determined, and then the disassembly and assembly indicating information corresponding to the target part to be disassembled and assembled is displayed at the target position corresponding to the target part to be disassembled and assembled on the first image to be detected.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings that are required to be used in the embodiments will be briefly described below, it should be understood that the following drawings only illustrate some embodiments of the present application and therefore should not be considered as limiting the scope, and for those skilled in the art, other related drawings can be obtained from the drawings without inventive effort.
Fig. 1 is a schematic flow chart of an apparatus disassembly and assembly processing method according to an embodiment of the present application;
fig. 2 is a schematic flow chart of an apparatus disassembly and assembly processing method according to another embodiment of the present application;
fig. 3 is a schematic flow chart illustrating an apparatus disassembling and assembling processing method according to another embodiment of the present application;
fig. 4 is a schematic structural diagram of an apparatus disassembly and assembly processing device according to an embodiment of the present application;
fig. 5 is a schematic structural diagram of an apparatus disassembly and assembly processing device according to another embodiment of the present application;
fig. 6 is a schematic structural diagram of an apparatus dismounting processing apparatus according to an embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some embodiments of the present application, but not all embodiments.
The components of the embodiments of the present application, generally described and illustrated in the figures herein, can be arranged and designed in a wide variety of different configurations. Thus, the following detailed description of the embodiments of the present application, presented in the accompanying drawings, is not intended to limit the scope of the claimed application, but is merely representative of selected embodiments of the application. All other embodiments, which can be derived by a person skilled in the art from the embodiments of the present application without making any creative effort, shall fall within the protection scope of the present application.
Additionally, the flowcharts used in this application illustrate operations implemented according to some embodiments of the present application. It should be understood that the operations of the flow diagrams may be performed out of order, and steps without logical context may be performed in reverse order or simultaneously. One skilled in the art, under the guidance of this application, may add one or more other operations to, or remove one or more operations from, the flowchart.
In the following embodiments, the method for handling disassembly and assembly of equipment is described by taking an application scenario as an example of a teaching for disassembling a switch machine, and it should be understood that an actual application process is not limited to the application scenario, and the method can be applied to any scenario requiring teaching or guidance for handling disassembly and assembly of equipment, and the method is not limited herein; the execution main body of the method provided by the application can be terminal equipment, and the terminal equipment is equipment provided with a dismounting processing application program.
The following explains a device dismounting processing method provided in the embodiments of the present application with reference to a plurality of specific application examples. Fig. 1 is a schematic flow chart of an apparatus disassembling and assembling processing method according to an embodiment of the present application, and as shown in fig. 1, the method includes:
s101: acquiring a first image to be detected with equipment to be disassembled and assembled.
In an embodiment of the present application, the first image to be detected is obtained through a camera, for example, the camera may be integrated on the terminal device, for example, may be a camera on a smart phone, or may also be a camera externally connected to the terminal device, for example, the camera externally connected to the smart phone through a data line or a bluetooth, or the camera externally connected to the desktop computer through a data line, and the like, and a specific form of the camera may be flexibly adjusted according to a user requirement, which is not limited to that given in the above embodiment.
Wherein, in the embodiment of this application, the position of camera is fixed, and in the dismouting course of handling, the position and the shooting angle of camera all keep unchangeable to guarantee the uniformity of image acquisition in the dismouting in-process, prevent because camera position or shooting angle change after, lead to not having in the image of collection and wait to dismantle the problem such as equipment, or only have some to wait to dismantle the equipment.
Optionally, in an embodiment of the present application, before S101, after image data acquired by a camera is acquired, it is necessary to compare the acquired image with a template of a device to be disassembled and assembled, and according to a preset image recognition algorithm, for example, YOLOV4, determine whether the acquired image includes the device to be disassembled and assembled, and determine whether each component to be disassembled and assembled in the device to be disassembled and assembled is complete, if the acquired image includes the device to be disassembled and assembled, and each component to be disassembled and assembled in the device to be disassembled and assembled is complete, determine that the acquired image is a first image to be detected, otherwise, return voice prompt information and/or text prompt information to an operating user, prompt that the currently acquired image does not include the device to be disassembled and assembled and the position or shooting angle of the camera needs to be determined again, so that the acquired image includes the complete device to be disassembled and assembled.
Optionally, the image data acquired by the camera may be, for example, a plurality of pieces of image information or continuous video information, and a specific manner of acquiring the image data by the camera may be flexibly adjusted according to a user's need, which is not limited herein.
S102: and detecting the first image to be detected, and determining the information of at least one part to be disassembled and assembled in the equipment to be disassembled and assembled.
Wherein, the information of each part to be disassembled comprises: the name of each component to be disassembled; if the device to be disassembled and assembled includes a plurality of identical components to be disassembled and assembled, the information of the components to be disassembled and assembled may include, in addition to the name of each component to be disassembled and assembled, the position information of each component to be disassembled and assembled, where the position information may be, for example, coordinate information, or number information in the first image to be detected, so as to distinguish the components to be disassembled and assembled with the same name in the same device to be disassembled and assembled.
S103: and determining disassembly and assembly indication information corresponding to the target part to be disassembled and assembled according to the name of the target part to be disassembled and assembled.
For example, in an embodiment of the present application, the detachment indication information may be, for example, still image identification indication information, animation indication information, or the like, and information and indication form included in the specific indication information may be flexibly adjusted according to user needs, which is not limited to those given in the foregoing embodiments.
The animation indication information may be, for example, a disassembly and assembly guidance animation, that is, the disassembly and assembly guidance animation is displayed in an overlaid manner at a target position on the first image to be detected by using an augmented reality technology.
This kind of mode through the dismouting of animation instruction information guide operation user superposes dismouting guide animation to the image that awaits measuring for the dismouting is directed more directly perceived and is understood easily, reaches the effect that virtuality and reality combines, has further improved the teaching of dismouting and has instructed the effect.
S104: and displaying dismounting indication information corresponding to the target dismounting component at a target position corresponding to the target dismounting component on the first image to be detected.
For example, in some possible embodiments, for example, the terminal device is a terminal device with a speaker, the disassembly and assembly instruction information may further include a voice prompt message, that is, while the disassembly and assembly instruction information corresponding to the target disassembly and assembly component is displayed, the voice prompt message may also be played through the speaker, so as to further improve the teaching effect.
Optionally, the target component to be disassembled and assembled may be, for example, a target component to be disassembled and assembled determined according to a preset disassembling and assembling process corresponding to the device to be disassembled and assembled. Predetermine the dismouting flow for example can be for in advance according to treating that dismouting equipment is configured, need not treat that the dismouting equipment corresponds predetermine the dismouting flow different, predetermine the dismouting flow and include: the disassembly and assembly sequence of each part to be disassembled and assembled in the equipment to be disassembled and assembled and the corresponding disassembly and assembly indication information.
By adopting the equipment disassembly and assembly processing method provided by the application, the first image to be detected with the device to be disassembled and assembled can be detected, the name of the target part to be disassembled and assembled in the part to be disassembled and assembled is determined, the disassembly and assembly indicating information corresponding to the target part to be disassembled and assembled is determined, and then the disassembly and assembly indicating information corresponding to the target part to be disassembled and assembled is displayed at the target position corresponding to the target part to be disassembled and assembled on the first image to be detected.
Optionally, on the basis of the foregoing embodiment, an apparatus disassembling and assembling processing method may also be provided in the embodiments of the present application, and an implementation process of the foregoing method is described as follows with reference to the accompanying drawings. Fig. 2 is a schematic flow chart of an apparatus detachment processing method according to another embodiment of the present application, where information of each component to be detached further includes: each part to be disassembled and assembled is arranged at a first position in the first image to be detected; as shown in fig. 2, the method further comprises:
s105: and acquiring a second image to be detected with equipment to be disassembled and assembled.
Illustratively, the second image to be detected is acquired within a preset time interval after the first image to be detected is acquired, or is acquired at a preset acquisition frame rate, in one embodiment of the present application, the preset acquisition frame rate may be, for example, a rate of 20 frames/second, wherein the larger the preset acquisition frame rate is, the larger the acquisition density of the image is, the better the real-time performance of the detection is, but the larger the amount of calculation, the smaller the preset acquisition frame rate setting, the smaller the density representing image acquisition, the smaller the amount of calculation, however, the real-time performance of the detection is poor, so in order to balance the real-time performance of the calculation and the detection, the preset acquisition frame rate in the present application is generally set to be about 11-18 frames/second, and the specific preset acquisition frame rate or the preset time interval may be flexibly adjusted according to the user requirement, which is not limited to the embodiments described above.
S106: and detecting the second image to be detected, and determining a second position of the target part to be disassembled and assembled in the second image to be detected.
S107: and determining whether the target part to be disassembled and assembled is disassembled and assembled according to the first position and the second position.
Illustratively, the information of each component to be disassembled further includes: the initial state of each component to be disassembled; in one embodiment of the present application, the manner of determining whether the assembly/disassembly is performed may be, for example: if the first position is different from the second position, determining whether the target part to be disassembled and assembled is disassembled and assembled according to the initial state of the target part to be disassembled and assembled; and if the first position is the same as the second position, determining that the target part to be disassembled and assembled is not disassembled and assembled.
The initial state of the target part to be disassembled is an undetached state, and the first position is a target position; if the first position is different from the second position, determining that the state of the target part to be disassembled and assembled changes, and updating the state of the target part to be disassembled and assembled into the disassembled and assembled state; and if the first position and the second position are different and the second position is the target position, determining that the state of the target component to be disassembled and assembled changes, and updating the state of the target component to be disassembled and assembled into the installed state.
Optionally, in some possible embodiments, whether the component to be disassembled and assembled is disassembled and assembled may be determined by an ectopic fault-tolerant method, and since in the detection process of the component to be disassembled and assembled, an operator needs to operate the device to be disassembled and assembled, a certain shielding may inevitably be caused, and after the component to be disassembled and assembled is shielded, a problem that the component to be disassembled and assembled cannot be normally identified may be caused, so that the present application determines whether the state of the component to be disassembled and assembled is changed by determining a change between the current position and the initial position of the component to be disassembled and assembled, and if the position of the component to be disassembled and assembled is changed, determines whether the current position of the component to be disassembled and assembled is the same as the position stored during system initialization (i.e., whether the original position frame and the existing position frame have an intersection), and if the positions. Similarly, if the current component a to be disassembled has been disassembled, and it is detected that it appears in the original position, the component a to be disassembled has been installed.
Optionally, on the basis of the foregoing embodiment, an apparatus disassembling and assembling processing method may also be provided in the embodiments of the present application, and an implementation process of the foregoing method is described as follows with reference to the accompanying drawings. Fig. 3 is a schematic flow chart of an apparatus disassembling and assembling processing method according to another embodiment of the present application, and as shown in fig. 3, the method may further include:
s108: and determining a disassembly and assembly prompt voice corresponding to the target component to be disassembled and assembled according to the name of the target component to be disassembled and assembled.
The disassembly/assembly prompt voice is a disassembly/assembly use prompt voice of a target tool corresponding to a target component to be disassembled/assembled, and may be, for example, "please use sleeve No. 5 to perform the current disassembly step".
S109: and playing a disassembly and assembly prompt voice.
The first image to be detected and the second image to be detected are continuous frame images with preset quantity.
Optionally, in order to avoid the recognition error caused by the error of the recognition algorithm itself or other situations, in an embodiment of the present application, N-frame fault tolerance is set, where N is a continuous preset number and is a positive integer greater than 0, that is, when determining whether the component to be disassembled and assembled exists, it is determined that the component to be disassembled and assembled exists only if the component to be disassembled and assembled is recognized by the continuous N-frame images, otherwise, the component to be disassembled and assembled does not exist.
For example, in the embodiment of the present application, if it is determined that the target component to be disassembled and assembled is completely disassembled, the next component to be disassembled and assembled is obtained according to the preset disassembling and assembling process, and the above steps are repeated until the whole preset disassembling and assembling process is completed, so that the disassembling and assembling teaching is completed.
Optionally, in an embodiment of the present application, for example, after the assembly and disassembly teaching is completed, one or more test questions of the assembly and disassembly teaching may be generated intelligently by presetting a question library, for example, a fault point of the completed assembly and disassembly teaching is generated intelligently, whether an operating user is proficient in solving the fault is checked randomly, an intelligent score may be performed according to an operation result of the operating user during the checking, and an error prompt may be given by displaying or voice prompting, so that the authenticity of the teaching training is improved, and since the identification of the checking is performed automatically, the fairness of the checking is achieved, and the effectiveness of the teaching training is ensured.
By adopting the equipment dismounting processing method provided by the application, the first image to be detected with the device to be dismounted can be detected, the name of the target replacement dismounting part in the part to be dismounted is determined, the dismounting indication information corresponding to the target replacement dismounting part is determined, then the dismounting indication information corresponding to the target dismounting part is displayed at the target position corresponding to the target part to be dismounted on the first image to be detected, for example, a dismounting guide animation is superposed on the first image to be detected and dismounting prompt voice is played, the equipment dismounting processing method can directly determine the target part to be dismounted and the corresponding dismounting indication information according to the first image to be detected and display the dismounting indication information at the target position corresponding to the target part to be dismounted, thereby realizing the automatic teaching of dismounting processing, and by virtue of dismounting indication information combined with virtual reality, the operation experience is more visual for the operation user, the teaching effect is more fine, the labor cost is saved, and the teaching efficiency is improved.
The following explains the device detachment processing apparatus provided in the present application with reference to the drawings, where the device detachment processing apparatus can execute any one of the device detachment processing methods shown in fig. 1 to 3, and specific implementation and beneficial effects of the method refer to the above description, which is not described again below.
Fig. 4 is a schematic structural diagram of an apparatus dismounting processing apparatus according to an embodiment of the present application, and as shown in fig. 4, the apparatus includes: an obtaining module 201, a determining module 202 and a displaying module 203, wherein:
the acquiring module 201 is configured to acquire a first image to be detected with a device to be disassembled and assembled.
The determining module 202 is configured to detect a first image to be detected, and determine information of at least one component to be disassembled and assembled in the device to be disassembled and assembled, where the information of each component to be disassembled and assembled includes: the name of each component to be disassembled; and determining disassembly and assembly indication information corresponding to the target part to be disassembled and assembled according to the name of the target part to be disassembled and assembled.
The display module 203 is configured to display, at a target position corresponding to a target component to be disassembled and assembled on the first image to be detected, disassembling and assembling indication information corresponding to the target component to be disassembled and assembled.
Optionally, the information of each component to be disassembled and assembled further includes: each part to be disassembled and assembled is arranged at a first position in the first image to be detected; the obtaining module 201 is specifically configured to obtain a second image to be detected with a device to be disassembled and assembled.
The determining module 202 is specifically configured to detect the second image to be detected, and determine a second position of the target component to be disassembled and assembled in the second image to be detected; and determining whether the target part to be disassembled and assembled is disassembled and assembled according to the first position and the second position.
Optionally, the information of each component to be disassembled and assembled further includes: the initial state of each component to be disassembled; the determining module 202 is specifically configured to determine whether the target component to be disassembled and assembled has been disassembled and assembled according to an initial state of the target component to be disassembled and assembled if the first position and the second position are different; and if the first position is the same as the second position, determining that the target part to be disassembled and assembled is not disassembled and assembled.
Optionally, the initial state of the target component to be disassembled is an undetached state, and the first position is a target position; the determining module 202 is specifically configured to determine that the state of the target component to be disassembled and assembled changes if the first position and the second position are different, and update the state of the target component to be disassembled and assembled to the disassembled and assembled state.
Optionally, the determining module 202 is specifically configured to determine that the state of the target component to be disassembled and assembled changes and update the state of the target component to be disassembled and assembled to the installed state if the first position and the second position are different and the second position is the target position.
Optionally, the determining module 202 is specifically configured to determine the target component to be disassembled and assembled according to a preset disassembling and assembling process corresponding to the device to be disassembled and assembled.
Optionally, the display module 203 is specifically configured to display, in an overlaid manner, the disassembly and assembly guidance animation at the target position on the first image to be detected by using an augmented reality technology.
Fig. 5 is a schematic structural diagram of an apparatus dismounting processing apparatus according to an embodiment of the present application, and as shown in fig. 5, the apparatus further includes: a play module 204, wherein:
the determining module 202 is specifically configured to determine, according to the name of the target component to be disassembled and assembled, a disassembly and assembly prompting voice corresponding to the target component to be disassembled and assembled, where the disassembly and assembly prompting voice is a disassembly and assembly use prompting voice of a target tool corresponding to the target component to be disassembled and assembled.
The playing module 204 is specifically configured to play a disassembly and assembly prompt voice.
The above-mentioned apparatus is used for executing the method provided by the foregoing embodiment, and the implementation principle and technical effect are similar, which are not described herein again.
These above modules may be one or more integrated circuits configured to implement the above methods, such as: one or more Application Specific Integrated Circuits (ASICs), or one or more microprocessors (DSPs), or one or more Field Programmable Gate Arrays (FPGAs), among others. For another example, when one of the above modules is implemented in the form of a Processing element scheduler code, the Processing element may be a general-purpose processor, such as a Central Processing Unit (CPU) or other processor capable of calling program code. For another example, these modules may be integrated together and implemented in the form of a system-on-a-chip (SOC).
Fig. 6 is a schematic structural diagram of a device detachment processing device according to an embodiment of the present application, where the device detachment processing device may be integrated in a terminal device or a chip of the terminal device.
This equipment dismouting treatment facility includes: a processor 501, a storage medium 502, and a bus 503.
The processor 501 is used for storing a program, and the processor 501 calls the program stored in the storage medium 502 to execute the method embodiment corresponding to fig. 1-3. The specific implementation and technical effects are similar, and are not described herein again.
Optionally, the present application also provides a program product, such as a storage medium, on which a computer program is stored, including a program, which, when executed by a processor, performs embodiments corresponding to the above-described method.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
The integrated unit implemented in the form of a software functional unit may be stored in a computer readable storage medium. The software functional unit is stored in a storage medium and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to perform some steps of the methods according to the embodiments of the present application. And the aforementioned storage medium includes: a U disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Claims (12)
1. An apparatus disassembly and assembly processing method, the method comprising:
acquiring a first image to be detected with equipment to be disassembled and assembled;
detecting the first image to be detected, and determining information of at least one part to be disassembled and assembled in the equipment to be disassembled and assembled, wherein the information of each part to be disassembled and assembled comprises: the name of each component to be disassembled and assembled;
according to the name of a target part to be disassembled and assembled, disassembling and assembling indication information corresponding to the target part to be disassembled and assembled is determined;
and displaying dismounting indication information corresponding to the target dismounting component at a target position corresponding to the target dismounting component on the first image to be detected.
2. The method of claim 1, wherein the information for each component to be disassembled further comprises: each part to be disassembled and assembled is arranged at a first position in the first image to be detected;
the method further comprises the following steps:
acquiring a second image to be detected with the equipment to be disassembled and assembled;
detecting the second image to be detected, and determining a second position of the target part to be disassembled in the second image to be detected;
and determining whether the target component to be disassembled and assembled is disassembled and assembled according to the first position and the second position.
3. The method of claim 2, wherein the information for each component to be disassembled further comprises: the initial state of each part to be disassembled and assembled; the determining whether the target component to be disassembled and assembled is disassembled and assembled according to the first position, the second position and the initial state of the target component to be disassembled and assembled comprises the following steps:
if the first position is different from the second position, determining whether the target component to be disassembled and assembled is disassembled and assembled according to the initial state of the target component to be disassembled and assembled;
and if the first position is the same as the second position, determining that the target part to be disassembled and assembled is not disassembled and assembled.
4. The method according to claim 3, wherein the initial state of the target member to be attached and detached is an undetached state, and the first position is the target position;
if the first position and the second position are different, determining whether the target component to be disassembled and assembled is disassembled and assembled according to the initial state of the target component to be disassembled and assembled comprises the following steps:
and if the first position is different from the second position, determining that the state of the target component to be disassembled and assembled changes, and updating the state of the target component to be disassembled and assembled into the disassembled and assembled state.
5. The method according to claim 3, wherein the initial state of the target component to be disassembled is an uninstalled state, and the determining whether the target component to be disassembled has been disassembled according to the initial state of the target component to be disassembled if the first position and the second position are different comprises:
and if the first position is different from the second position, and the second position is the target position, determining that the state of the target component to be disassembled and assembled changes, and updating the state of the target component to be disassembled and assembled into the installed state.
6. The method according to claim 1, wherein before determining the disassembly and assembly indication information corresponding to the target component to be disassembled and assembled according to the name of the target component to be disassembled and assembled, the method further comprises:
and determining the target component to be disassembled and assembled according to the preset disassembling and assembling flow corresponding to the equipment to be disassembled and assembled.
7. The method of claim 1, wherein the disassembly indication information comprises: the disassembly and assembly guiding animation is used for displaying disassembly and assembly indicating information corresponding to a target disassembly and assembly part at a target position corresponding to the target disassembly and assembly part on the first image to be detected, and comprises the following steps:
and displaying the disassembly and assembly guide animation in an overlapping manner at the target position on the first image to be detected through an augmented reality technology.
8. The method of any one of claims 1-7, wherein the method further comprises:
according to the name of the target part to be disassembled and assembled, determining a disassembly and assembly prompt voice corresponding to the target part to be disassembled and assembled, wherein the disassembly and assembly prompt voice is a disassembly and assembly use prompt voice of a target tool corresponding to the target part to be disassembled and assembled;
and playing the disassembly and assembly prompt voice.
9. The method according to claim 2, wherein said first image to be detected and said second image to be detected are each a consecutive predetermined number of frame images.
10. An apparatus mounting and dismounting processing apparatus, characterized in that the apparatus comprises: the device comprises an acquisition module, a determination module and a display module, wherein:
the acquisition module is used for acquiring a first image to be detected with equipment to be disassembled and assembled;
the determining module is configured to detect the first image to be detected, and determine information of at least one component to be disassembled and assembled in the device to be disassembled and assembled, where the information of each component to be disassembled and assembled includes: the name of each component to be disassembled and assembled; according to the name of a target part to be disassembled and assembled, disassembling and assembling indication information corresponding to the target part to be disassembled and assembled is determined;
the display module is used for displaying dismounting indication information corresponding to the target dismounting component at a target position corresponding to the target dismounting component on the first image to be detected.
11. An apparatus disassembly and assembly processing apparatus, the apparatus comprising: a processor, a storage medium and a bus, the storage medium storing machine-readable instructions executable by the processor, the processor and the storage medium communicating via the bus when the device detachment process is executed, the processor executing the machine-readable instructions to perform the method of any of claims 1-9.
12. A storage medium, characterized in that the storage medium has stored thereon a computer program which, when being executed by a processor, performs the method of any of the preceding claims 1-9.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011541895.1A CN112597894A (en) | 2020-12-21 | 2020-12-21 | Equipment disassembly and assembly processing method, device, equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011541895.1A CN112597894A (en) | 2020-12-21 | 2020-12-21 | Equipment disassembly and assembly processing method, device, equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112597894A true CN112597894A (en) | 2021-04-02 |
Family
ID=75200988
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011541895.1A Pending CN112597894A (en) | 2020-12-21 | 2020-12-21 | Equipment disassembly and assembly processing method, device, equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112597894A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106919983A (en) * | 2017-02-20 | 2017-07-04 | 北京小米移动软件有限公司 | Workpiece information processing method, apparatus and system |
| CN106931882A (en) * | 2017-03-21 | 2017-07-07 | 常州雷利电机科技有限公司 | For the bumper and absorbing shock part detection means and its detection method of impeller rotary part |
| CN108344387A (en) * | 2017-12-29 | 2018-07-31 | 深圳市越疆科技有限公司 | Pressure type assembles automatic test approach and automatic checkout system |
| CN108595197A (en) * | 2018-04-16 | 2018-09-28 | 上海与德科技有限公司 | A kind of robot components update method, device, robot and storage medium |
| CN111081108A (en) * | 2019-12-26 | 2020-04-28 | 中国航空工业集团公司西安飞机设计研究所 | Disassembly and assembly training method and device based on augmented reality technology |
-
2020
- 2020-12-21 CN CN202011541895.1A patent/CN112597894A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106919983A (en) * | 2017-02-20 | 2017-07-04 | 北京小米移动软件有限公司 | Workpiece information processing method, apparatus and system |
| CN106931882A (en) * | 2017-03-21 | 2017-07-07 | 常州雷利电机科技有限公司 | For the bumper and absorbing shock part detection means and its detection method of impeller rotary part |
| CN108344387A (en) * | 2017-12-29 | 2018-07-31 | 深圳市越疆科技有限公司 | Pressure type assembles automatic test approach and automatic checkout system |
| CN108595197A (en) * | 2018-04-16 | 2018-09-28 | 上海与德科技有限公司 | A kind of robot components update method, device, robot and storage medium |
| CN111081108A (en) * | 2019-12-26 | 2020-04-28 | 中国航空工业集团公司西安飞机设计研究所 | Disassembly and assembly training method and device based on augmented reality technology |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110120087B (en) | Label marking method and device for three-dimensional virtual sand table and terminal equipment | |
| CN110580226A (en) | object code coverage rate testing method, system and medium for operating system level program | |
| CN109814894A (en) | A kind of application update method, device, equipment and storage medium | |
| CN107918555A (en) | The method and apparatus for handling data based on physical host | |
| CN112288883A (en) | Method and device for prompting operation guide information, electronic equipment and storage medium | |
| CN112597894A (en) | Equipment disassembly and assembly processing method, device, equipment and storage medium | |
| CN110688173B (en) | Positioning method and device of components in cross-platform interface framework and electronic equipment | |
| CN109344335B (en) | Content recommendation method and electronic equipment | |
| CN112148544B (en) | Terminal device testing method, smart watch and system | |
| CN106126314B (en) | Expand the analogy method and device of instruction | |
| CN112306838A (en) | Page layout compatibility testing method, device and equipment and readable storage medium | |
| CN109782925B (en) | Processing method and device and electronic equipment | |
| CN115391168A (en) | Sandbox testing method, sandbox testing device, sandbox testing equipment and storage medium | |
| CN112749777A (en) | Scene interaction simulation method, device, equipment and storage medium | |
| CN113095450A (en) | Two-dimensional code data acquisition method and system, electronic device and storage medium | |
| CN112765041A (en) | Game automatic testing method and device and electronic equipment | |
| CN111679863A (en) | Test question display method, device, equipment and medium based on head-mounted display equipment | |
| CN110554969B (en) | Target code coverage rate testing method, system and medium based on preset breakpoints | |
| CN112100077B (en) | Transaction testing method and device | |
| CN112363696B (en) | Augmented reality rapid development system and method, electronic device and readable storage medium | |
| CN112988475B (en) | Disaster tolerance test method, device, test server and medium | |
| CN210119873U (en) | Supervision device based on VR equipment | |
| CN118259626A (en) | Assembly line distribution method, device, equipment and storage medium | |
| CN106339256B (en) | For distributing the method and device of simulator automatically | |
| CN116627791A (en) | Test script generation method, computer-readable storage medium, and electronic device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210402 |