CN111273762A - Connector pin sending method and device based on AR equipment, AR equipment and storage medium - Google Patents
Connector pin sending method and device based on AR equipment, AR equipment and storage medium Download PDFInfo
- Publication number
- CN111273762A CN111273762A CN201910798507.9A CN201910798507A CN111273762A CN 111273762 A CN111273762 A CN 111273762A CN 201910798507 A CN201910798507 A CN 201910798507A CN 111273762 A CN111273762 A CN 111273762A
- Authority
- CN
- China
- Prior art keywords
- connector
- information
- terminating
- wire
- hole position
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 83
- 238000003860 storage Methods 0.000 title claims abstract description 37
- 238000009877 rendering Methods 0.000 claims abstract description 27
- 230000008569 process Effects 0.000 claims description 28
- 238000002788 crimping Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 8
- 238000009826 distribution Methods 0.000 claims description 6
- 230000003321 amplification Effects 0.000 claims description 3
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 3
- 238000012384 transportation and delivery Methods 0.000 description 9
- 238000013461 design Methods 0.000 description 8
- 238000005516 engineering process Methods 0.000 description 8
- 230000003190 augmentative effect Effects 0.000 description 6
- 238000001228 spectrum Methods 0.000 description 6
- 230000009471 action Effects 0.000 description 4
- 238000004458 analytical method Methods 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 238000011990 functional testing Methods 0.000 description 4
- 230000006870 function Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000007796 conventional method Methods 0.000 description 2
- 238000013523 data management Methods 0.000 description 2
- 238000013135 deep learning Methods 0.000 description 2
- 238000012840 feeding operation Methods 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 239000013307 optical fiber Substances 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 230000000644 propagated effect Effects 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000012790 confirmation Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000007726 management method Methods 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000003825 pressing Methods 0.000 description 1
- 230000001737 promoting effect Effects 0.000 description 1
- 230000008707 rearrangement Effects 0.000 description 1
- 230000011218 segmentation Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000001953 sensory effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q50/00—Information and communication technology [ICT] specially adapted for implementation of business processes of specific business sectors, e.g. utilities or tourism
- G06Q50/04—Manufacturing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
- G06F2203/01—Indexing scheme relating to G06F3/01
- G06F2203/012—Walk-in-place systems for allowing a user to walk in a virtual environment while constraining him to a given position in the physical environment
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/30—Computing systems specially adapted for manufacturing
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- General Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Manufacturing & Machinery (AREA)
- Human Computer Interaction (AREA)
- Economics (AREA)
- General Health & Medical Sciences (AREA)
- Human Resources & Organizations (AREA)
- Marketing (AREA)
- Primary Health Care (AREA)
- Strategic Management (AREA)
- Tourism & Hospitality (AREA)
- General Business, Economics & Management (AREA)
- Processing Or Creating Images (AREA)
Abstract
The embodiment of the invention discloses a connector pin sending method and device based on AR equipment, the AR equipment and a storage medium. The method comprises the following steps: identifying the identification of the terminating wire with an input unit of the AR device; calling the guiding information corresponding to the terminating wire from a storage unit of the AR equipment according to the identification; displaying the guide information on a display unit of the AR device to guide the AR device user to operate; acquiring a first image of a connector corresponding to a terminating wire, determining a hole position of the connector corresponding to the terminating wire according to the first image, and rendering and displaying a tracked object on a display unit of the hole position. According to the technical scheme of the embodiment of the invention, the guiding information is displayed to guide the AR equipment user to operate, so that the errors of terminating and pin sending operations are reduced, and the error risk caused by manually searching the pin sending information is reduced.
Description
Technical Field
The embodiment of the invention relates to an augmented reality technology, in particular to a connector pin sending method and device based on AR equipment, the AR equipment and a storage medium.
Background
The cable assembly is one of main work of aviation system assembly, and the remarkable characteristics are that the number of cables is large, and the connection relation is complex. When the cable is assembled, the contact is firstly pressed on the wire end, and after the pressing is finished, the wire end is finally assembled to the connector before or after the wire end is laid on a cable machine.
The main workflow of the conventional operation method of cable termination and connector pin feeding is shown in fig. 1. Description of main procedures of the conventional method: in the aviation cable wire termination and connector pin sending work, the traditional method is mainly divided into 8 steps. Step 1, determining a connector needing to be assembled and a wire harness corresponding to the connector, and then selecting a wire object to be terminated from the wire harness; step 2, searching corresponding contact part numbers and crimping codes from design data according to the wire numbers of the wires and the corresponding connector equipment number information; step 3, searching information such as a crimping tool, a wire stripping length and the like in the process specification according to the searched crimping code; step 4, completing the crimping of the contact on the wire by using a crimping tool according to the information checked in the step 2 and the step 3; step 5, according to the wire number and the connector number, searching the corresponding hole number of the wire on the connector in the design information; step 6, searching the pin sending tool information of the wire in the process specification according to the termination code; step 7, finding and confirming hole sites on the connector real object; and 8, using a pin feeding tool to complete the pin feeding operation of the wire on the connector.
In the above operation method, information such as contact information, stripping length, termination tool and the like when the cable is terminated needs to be manually searched in the corresponding process specification file. After the wire is terminated, when the pin taking and sending operation of the wire and the connector is executed, connector hole position information corresponding to the wire needs to be manually searched in design data, tool information is searched in a process specification file, and then the pin sending operation is carried out after the actual position of the hole is determined on a connector object. Because the number of wires is very large, the crimping requirement and the pin feeding requirement of each wire contact are different, searching corresponding design and process information is very time-consuming, and errors are prone to occur.
Based on the above defects, currently, in the field of aerospace manufacturing, existing enterprises begin to explore the use of AR (augmented reality) technology to assist cable and connector assembly, but the rapid identification of wire numbers based on computer vision and the utilization of image tracking technology and augmented reality technology have not been realized yet, and meanwhile, due to the individualization of enterprise requirements and the difference of data structures, the structured management and control of a termination relation database cannot be systematically solved, and a systematic operation guide flow for aviation cable wire crimping and connector delivery and sale has not been realized yet.
Disclosure of Invention
The embodiment of the invention provides a connector pin sending method and device based on AR equipment, the AR equipment and a storage medium, so that the error risk caused by manual searching of terminating and pin sending information is reduced.
In a first aspect, an embodiment of the present invention provides a connector pin sending method based on an AR device, including:
identifying the identification of the terminating wire with an input unit of the AR device;
calling the guiding information corresponding to the terminating wire from a storage unit of the AR equipment according to the identification;
displaying the guide information on a display unit of the AR device to guide the AR device user to operate;
acquiring a first image of a connector corresponding to a terminating wire, determining a hole position of the connector corresponding to the terminating wire according to the first image, and rendering and displaying a tracked object on a display unit of the hole position.
Optionally, after the rendering and displaying of the hole position on the display unit for tracking the real object, the method further includes:
the AR device user carries out marketing operation based on the rendering display;
and controlling the video equipment to carry out video backup on the pin sending operation process.
Optionally, the input unit is a microphone, and the identifying of the terminating wire by using the input unit of the AR device includes:
voice input is received and the identity of the terminating wire is identified based on the voice content.
Optionally, the input unit is a camera, and the identifying of the terminating wire by using the input unit of the AR device includes:
and acquiring a second image of the terminating wire through the camera, and identifying the identifier of the terminating wire according to the second image.
Optionally, the guidance information includes one or more of crimping information, pin sending information, and process information.
Optionally, the rendering and displaying the hole position on the display unit for tracking the real object further includes:
and performing amplification rendering display of the hole sites on the display unit for tracking the real objects so as to more clearly display the hole sites.
Optionally, the method further includes:
if the terminating lead is inserted into the correct hole position, generating and outputting correct indication information;
and if the terminating lead is not inserted into the correct hole position within the preset time, or if the terminating lead is inserted into the wrong hole position, generating and outputting indicating error information.
In a second aspect, an embodiment of the present invention further provides an AR device-based connector pin sending apparatus, including:
an identification unit for identifying the identification of the terminating wire using the input unit of the AR device;
the calling unit is used for calling the guide information corresponding to the terminating wire from the storage unit of the AR equipment according to the identification;
the display unit is used for displaying the guide information on the display unit of the AR device so as to guide the AR device user to operate;
and the rendering unit is used for acquiring a first image of the connector corresponding to the terminating wire, determining a hole position of the connector corresponding to the terminating wire according to the first image, and rendering and displaying the hole position on a display unit for tracking a real object.
In a third aspect, an embodiment of the present invention further provides an AR device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, where the processor executes the computer program to implement the connector distribution method according to any one of the above embodiments.
In a fourth aspect, an embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the connector pin sending method as described in any one of the above embodiments.
According to the technical scheme of the embodiment of the invention, the guiding information is displayed to guide the AR equipment user to operate, so that the marketing operation errors are reduced, and the error risk caused by manually searching marketing information is reduced.
Drawings
FIG. 1 is a schematic view of a conventional method of operation of a conventional cable termination and connector pin feed;
fig. 2 is a schematic flowchart of a connector pin sending method based on an AR device according to a first embodiment of the present invention;
fig. 3 is a schematic flowchart of a connector pin sending method based on an AR device according to a second embodiment of the present invention;
fig. 4 is a schematic flowchart of a connector pin sending method based on an AR device in a third embodiment of the present invention;
fig. 5 is a schematic structural diagram of a connector pin feeding apparatus based on an AR device in a fourth embodiment of the present invention;
fig. 6 is a schematic structural diagram of an AR device in the fifth embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the invention and are not limiting of the invention. It should be further noted that, for the convenience of description, only some of the structures related to the present invention are shown in the drawings, not all of the structures.
Before discussing exemplary embodiments in more detail, it should be noted that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although a flowchart may describe the steps as a sequential process, many of the steps can be performed in parallel, concurrently or simultaneously. In addition, the order of the steps may be rearranged. The process may be terminated when its operations are completed, but may have additional steps not included in the figure. The processes may correspond to methods, functions, procedures, subroutines, and the like.
Furthermore, the terms "first," "second," and the like may be used herein to describe various orientations, actions, steps, elements, or the like, but the orientations, actions, steps, or elements are not limited by these terms. These terms are only used to distinguish one direction, action, step or element from another direction, action, step or element. For example, a first speed difference may be referred to as a second speed difference, and similarly, a second speed difference may be referred to as a first speed difference, without departing from the scope of the present application. The first speed difference and the second speed difference are both speed differences, but they are not the same speed difference. The terms "first", "second", etc. are not to be construed as indicating or implying a relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of the present invention, "a plurality" means at least two, e.g., two, three, etc., unless specifically limited otherwise.
Example one
Fig. 2 is a schematic flowchart of a connector pin sending method based on an AR device according to an embodiment of the present invention, which is applicable to a connector pin sending situation. The method of the embodiment of the invention can be executed by a connector pin sending method device based on the AR equipment, and the device can be realized by software and/or hardware and can be generally integrated in the AR equipment. Referring to fig. 2, the connector pin sending method based on the AR device in the embodiment of the present invention specifically includes the following steps:
step S210, identifying the identification of the terminating wire using the input unit of the AR device.
Specifically, the AR device is a relatively new technical content capable of promoting integration of real world information and virtual world information content, and implements analog simulation processing on entity information that is difficult to experience in a spatial range of the real world originally on the basis of scientific technologies such as computers, and the virtual information content is effectively applied in the real world by superposition, and can be perceived by human senses in the process, so that the device capable of realizing sensory experience beyond reality can be AR glasses, AR helmets, wearable devices, tablets or mobile phones, and the like. The input unit generally refers to any component capable of inputting information, including but not limited to image information, sound information, press information, touch information, etc., and may be a camera, a microphone, a key, a touch pad, a touch screen, etc. The identification of the terminating wire is a specific designation that can be distinguished from other wires, such as wire number, etc.
As an alternative embodiment, the input unit is a microphone, and step S210 may be replaced by:
voice input is received and the identity of the terminating wire is identified based on the voice content. In particular, the operator may speak the identification of the terminating wire, such as the wire number, via the microphone and identify the identification of the terminating wire via voice recognition.
As an alternative embodiment, the input unit is a camera, and step S210 may be replaced by:
and acquiring a second image of the terminating wire through the camera, and identifying the identifier of the terminating wire according to the second image. Specifically, the second image refers to various images related to the wire, including but not limited to an identification image of the wire, and the type of the second image is not limited by the invention. In the embodiment of the invention, a deep learning-based wire identification recognition system is established, and intelligent recognition of wire numbers is realized through collected wire identification picture information, a deep learning-based computer vision model, and algorithms such as scene text positioning, character extraction, character segmentation and character recognition.
And step S220, calling the guiding information corresponding to the terminating wire from the storage unit of the AR equipment according to the identification.
Specifically, the storage unit of the AR device may be a memory located inside the AR device, or may be a memory located in a remote server, and the AR device establishes a wired or wireless communication connection with the remote server. And a structured database is established in a storage unit, design information such as the corresponding relation between the terminating wire and the connector and process information such as crimping parameters, assembly parameters of a crimping tool and a connector tail accessory are established in a logical relation, and automation of data management and calling is realized. In the embodiment of the invention, after the identification of the terminating wire is identified, the AR device automatically calls the corresponding guide information of the terminating wire according to the identification.
Wherein the guide information comprises one or more of crimping information, pin sending information and process information. The types of instructional information displayed may also include one or more of the following types of information: (1) a wire number; (2) a wire gauge; (3) a connector device number; (4) a contact number; (5) a termination code; (6) stripping the length of the lead; (7) a termination tool; (8) a pin sending tool; (9) removing the tool; (10) the number of the holes; (11) the location of the hole in the connector real object; (12) tail accessory clock direction; (13) tail attachment fixation values.
In addition, the technical scheme of the embodiment of the invention further comprises a connector type spectrum acquisition and marking module which is used for establishing a type spectrum coordinate library of the connector needing pin feeding and assembling, and semi-automatically generating the corresponding relation between the hole positions and the vector coordinates thereof according to the type spectrum hole position arrangement rule through image acquisition.
And step S230, displaying the guide information on a display unit of the AR device to guide the AR device user to operate.
Specifically, the display unit is a display screen or other device, and is configured to display guidance information corresponding to the terminating wire to a user of the AR device, so as to guide the user of the AR device to perform a terminating operation. Specifically, the display may be in a text form or a picture form. And the man-machine interaction client is deployed at the hardware terminal of the AR equipment, the identified wire number is taken as input according to the designed termination method and the operation process flow, the wire number identification result is manually confirmed, the corresponding wire termination and assembly information of the database is called according to the wire number, and the design and process information is pushed to the AR equipment (glasses, tablet or mobile phone).
Step S240, acquiring a first image of a connector corresponding to the terminating wire, determining a hole position of the connector corresponding to the terminating wire according to the first image, and rendering and displaying a tracked object on a display unit of the hole position.
Specifically, the first image refers to various images related to the connector, including but not limited to a type spectrogram of the connector, and the type of the first image is not limited in the present invention. The method comprises the steps of obtaining a first image of a connector corresponding to a terminating wire through a camera, determining a hole site of the connector corresponding to the terminating wire on the first image according to a recognized identifier of the terminating wire, and utilizing augmented reality and image tracking technologies to track and identify the hole site corresponding to the wire on a connector real object in real time so as to guide an AR (augmented reality) device user to quickly and accurately determine the hole site of the connector corresponding to the wire. A connector hole site tracking identification system based on an image tracking technology is characterized in that an auxiliary tracking tool is designed to serve as a world coordinate system, an established connector type spectrum vector coordinate library is called, and the hole site corresponding to a lead is tracked and identified on a connector real object in real time by utilizing augmented reality and image tracking technologies, so that an AR equipment user is guided to quickly and accurately determine the connector hole site corresponding to the lead.
Further, the rendering and displaying the hole position on the display unit for tracking the real object further includes: and performing amplification rendering display of the hole sites on the display unit for tracking the real objects so as to more clearly display the hole sites. And the display is enlarged so as to be clearer and facilitate the AR equipment user to find the hole site.
As an alternative embodiment, before step S210, the method may further include:
and step S207, establishing a connector database.
Specifically, a camera, three-dimensional structured light or other equipment capable of acquiring pictures is used for shooting pictures of the connector, connector type spectrogram vector coordinate information is calibrated, a connector type spectrum acquisition marking tool is used for automatically or semi-automatically generating the jack hole number and the vector coordinate of the connector, and a connector type spectrum vector coordinate library is established.
And step S208, associating the work card of the AR device user with the connector database.
Specifically, the design information of the termination relation of the wiring harness and the process parameter information are imported into a cable connector assembly information data management system in the form of a structured document and are associated with a work card.
And S209, the AR equipment user opens the AR equipment and selects the work card to be operated and the connector to be pin-fed.
According to the technical scheme of the embodiment of the invention, the guiding information is displayed to guide the AR equipment user to operate, so that the marketing operation errors are reduced, and the error risk caused by manually searching marketing information is reduced.
Furthermore, when the hole sites on the connector object are displayed, the hole sites can be displayed more clearly by enlarging the connector object window.
Example two
Fig. 3 is a schematic flowchart of a connector pin sending method based on an AR device according to a second embodiment of the present invention, which is applicable to a connector pin sending situation according to the second embodiment of the present invention. The method of the embodiment of the invention can be executed by a connector pin sending method device based on the AR equipment, and the device can be realized by software and/or hardware and can be generally integrated in the AR equipment. Referring to fig. 3, the connector pin sending method based on the AR device in the embodiment of the present invention specifically includes the following steps:
step S310, identifying the identity of the terminating wire using the input unit of the AR device.
And step S320, retrieving the guiding information corresponding to the terminating wire from the storage unit of the AR device according to the identification.
And step S330, displaying the guide information on a display unit of the AR device to guide the AR device user to operate.
Step S340, acquiring a first image of a connector corresponding to the terminating wire, determining a hole position of the connector corresponding to the terminating wire according to the first image, and rendering and displaying a tracked object on a display unit of the hole position.
And S350, the AR equipment user carries out the selling sending operation based on the rendering display.
Specifically, after the user sees the rendered display, the user can conveniently find the hole site of the connector corresponding to the wire to be terminated, and the pin feeding operation is performed on the hole site.
As an optional example, the termination operation of this embodiment further requires a connector to be subjected to pin feeding, a corresponding wire harness, a contact piece to be crimped, and pin feeding design and process information of the wire harness and the connector, and termination is performed in different manners according to actual conditions.
As an alternative, each connector is pinned by a plurality of strands, each strand having a plurality of wires. In the process of carrying out the pin sending operation, after finishing the termination and pin sending work of one wire, the user carries out the confirmation system to record the completion state of the pin sending of the wire and switch to the wire list under the same wire harness, and at the moment, the termination and pin sending operation of another wire under the same wire harness can be carried out. After finishing the termination operation of all the wires in the wire harness, the system can prompt that the termination and pin sending work of the wire harness is finished, a user can switch to a wire harness list corresponding to the same connector after confirming, and then the termination work of other wire harnesses can be carried out.
And S360, controlling the video equipment to carry out video backup on the marketing operation process.
Specifically, the video information backed up by video may be stored in the AR device, or may be transmitted to the remote server for storage in a wired or wireless manner.
According to the technical scheme of the embodiment of the invention, the guiding information is displayed to guide the AR equipment user to operate, so that the operation errors of end receiving and pin sending are reduced, and the error risk caused by manually searching the information of end receiving and pin sending is reduced.
Furthermore, traceability of the terminal pin sending operation process is realized through backup of the terminal pin sending operation video, and when a fault occurs in a later functional test stage, the auxiliary fault location analysis can be carried out by referring to the video.
EXAMPLE III
Fig. 4 is a schematic flowchart of a connector pin sending method based on an AR device according to a third embodiment of the present invention, which is applicable to a connector pin sending situation according to the third embodiment of the present invention. The method of the embodiment of the invention can be executed by a connector pin sending method device based on the AR equipment, and the device can be realized by software and/or hardware and can be generally integrated in the AR equipment. Referring to fig. 4, the connector pin sending method based on the AR device in the embodiment of the present invention specifically includes the following steps:
step S410, identifying the identity of the terminating wire using the input unit of the AR device.
And step S420, retrieving guidance information corresponding to the terminating wire from a storage unit of the AR device according to the identification.
And step S430, displaying the guide information on a display unit of the AR device to guide the AR device user to operate.
Step S440, acquiring a first image of a connector corresponding to the terminating wire, determining a hole position of the connector corresponding to the terminating wire according to the first image, and rendering and displaying a tracked object on a display unit of the hole position.
Step S450, if the terminating lead is inserted into the correct hole position, generating and outputting correct indication information; and if the terminating lead is not inserted into the correct hole position within the preset time, or if the terminating lead is inserted into the wrong hole position, generating and outputting indicating error information.
According to the technical scheme of the embodiment of the invention, the guiding information is displayed to guide the AR equipment user to operate, so that the operation errors of end receiving and pin sending are reduced, and the error risk caused by manually searching the information of end receiving and pin sending is reduced.
Furthermore, by setting the indication information, correct information is output when the sales delivery is correct, and error information is output when the sales delivery is wrong, so that the error risk of AR equipment users is reduced.
Example four
The AR device-based connector pin sending apparatus provided in the embodiment of the present invention may execute the AR device-based connector pin sending method provided in any embodiment of the present invention, has the corresponding functional modules and beneficial effects of the execution method, may be implemented by software and/or hardware (integrated circuit), and may be generally integrated in an AR device. Fig. 5 is a schematic structural diagram of a connector pin feeding apparatus 500 based on an AR device in a fourth embodiment of the present invention. Referring to fig. 5, the AR device-based connector pin sending apparatus 500 according to the embodiment of the present invention may specifically include:
an identification unit 510 for identifying an identification of the terminating wire with an input unit of the AR device;
a retrieving unit 520, configured to retrieve, according to the identifier, guidance information corresponding to the terminating wire from a storage unit of the AR device;
a display unit 530 for displaying the guide information on a display unit of the AR device to guide a user of the AR device to perform an operation;
and the rendering unit 540 is configured to acquire a first image of a connector corresponding to the terminating wire, determine a hole location of the connector corresponding to the terminating wire according to the first image, and render and display a tracked object on the display unit of the hole location.
Optionally, the AR device-based connector pin sending apparatus 500 further includes:
and the video recording unit is used for carrying out video recording backup on the pin sending operation process.
Optionally, the recognition unit 510 is further configured to receive a voice input, and recognize the identification of the terminating wire according to the voice content.
Optionally, the identifying unit 510 is further configured to acquire a second image of the terminating wire through the camera, and identify the identifier of the terminating wire according to the second image.
Optionally, the guidance information includes one or more of crimping information, pin sending information, and process information.
Optionally, the rendering unit 540 is further configured to perform an enlarged rendering display of the hole location on the display unit by using a tracked real object, so as to show the hole location more clearly.
Optionally, the AR device-based connector pin sending apparatus 500 further includes:
the indicating unit is used for generating and outputting indicating correct information if the terminating lead is inserted into the correct hole position;
and if the terminating lead is not inserted into the correct hole position within the preset time, or if the terminating lead is inserted into the wrong hole position, generating and outputting indicating error information.
According to the technical scheme of the embodiment of the invention, the guiding information is displayed to guide the AR equipment user to operate, so that the operation errors of end receiving and pin sending are reduced, and the error risk caused by manually searching the information of end receiving and pin sending is reduced.
Furthermore, traceability of the pin sending operation process is realized by backing up the pin sending operation video, and when a fault occurs in the later functional test stage, the video can be referred to for auxiliary fault positioning analysis.
Furthermore, when the hole sites on the connector object are displayed, the hole sites can be displayed more clearly by enlarging the connector object window.
Furthermore, by setting the indication information, correct information is output when the sales delivery is correct, and error information is output when the sales delivery is wrong, so that the error risk of AR equipment users is reduced.
EXAMPLE five
Fig. 6 is a schematic structural diagram of an AR apparatus according to a third embodiment of the present invention, as shown in fig. 6, the AR apparatus includes a processor 610, a memory 620, an input device 630, and an output device 640; the number of processors 610 in the AR device may be one or more, and one processor 610 is taken as an example in fig. 6; the processor 610, the memory 620, the input device 630 and the output device 640 in the AR apparatus may be connected by a bus or other means, and fig. 6 illustrates an example of connection by a bus.
The memory 620, which is a computer-readable storage medium, may be used to store software programs, computer-executable programs, and modules, such as program instructions/modules corresponding to the AR device-based connector distribution method in the embodiments of the present invention (e.g., the identification unit 610, the retrieval unit 620, the display unit 630, and the rendering unit 640 in the AR device-based connector distribution apparatus). The processor 610 executes various functional applications and data processing of the AR device by executing software programs, instructions and modules stored in the memory 620, that is, implements the above-described connector distribution method based on the AR device.
Namely:
identifying the identification of the terminating wire with an input unit of the AR device;
calling the guiding information corresponding to the terminating wire from a storage unit of the AR equipment according to the identification;
displaying the guide information on a display unit of the AR device to guide the AR device user to operate;
acquiring a first image of a connector corresponding to a terminating wire, determining a hole position of the connector corresponding to the terminating wire according to the first image, and rendering and displaying a tracked object on a display unit of the hole position.
Of course, the processor of the AR device provided in the embodiment of the present invention is not limited to execute the method operations described above, and may also execute related operations in the AR device-based connector pin sending method provided in any embodiment of the present invention.
The memory 620 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created according to the use of the terminal, and the like. Further, the memory 620 may include high speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid state storage device. In some examples, the memory 620 may further include memory located remotely from the processor 610, which may be connected to the AR device over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The input means 630 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the AR device. The output device 640 may include a display device such as a display screen.
According to the technical scheme of the embodiment of the invention, the guiding information is displayed to guide the AR equipment user to operate, so that the operation errors of end receiving and pin sending are reduced, and the error risk caused by manually searching the information of end receiving and pin sending is reduced.
Furthermore, traceability of the pin sending operation process is realized by backing up the pin sending operation video, and when a fault occurs in the later functional test stage, the video can be referred to for auxiliary fault positioning analysis.
Furthermore, when the hole sites on the connector object are displayed, the hole sites can be displayed more clearly by enlarging the connector object window.
Furthermore, by setting the indication information, correct information is output when the sales delivery is correct, and error information is output when the sales delivery is wrong, so that the error risk of AR equipment users is reduced.
EXAMPLE six
An embodiment of the present invention further provides a storage medium containing computer-executable instructions, which when executed by a computer processor, are configured to perform a method for sending pins to a connector based on an AR device, where the method includes:
identifying the identification of the terminating wire with an input unit of the AR device;
calling the guiding information corresponding to the terminating wire from a storage unit of the AR equipment according to the identification;
displaying the guide information on a display unit of the AR device to guide the AR device user to operate;
acquiring a first image of a connector corresponding to a terminating wire, determining a hole position of the connector corresponding to the terminating wire according to the first image, and rendering and displaying a tracked object on a display unit of the hole position.
Of course, the storage medium containing computer-executable instructions provided by the embodiments of the present invention is not limited to the method operations described above, and may also perform related operations in the AR device-based connector distribution method provided by any embodiments of the present invention.
The computer-readable storage media of embodiments of the invention may take any combination of one or more computer-readable media. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a storage medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or terminal. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
According to the technical scheme of the embodiment of the invention, the guiding information is displayed to guide the AR equipment user to operate, so that the marketing operation errors are reduced, and the error risk caused by manually searching marketing information is reduced.
Furthermore, traceability of the pin sending operation process is realized by backing up the pin sending operation video, and when a fault occurs in the later functional test stage, the video can be referred to for auxiliary fault positioning analysis.
Furthermore, when the hole sites on the connector object are displayed, the hole sites can be displayed more clearly by enlarging the connector object window.
Furthermore, by setting the indication information, correct information is output when the sales delivery is correct, and error information is output when the sales delivery is wrong, so that the error risk of AR equipment users is reduced.
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A connector pin sending method based on an AR device is characterized by comprising the following steps:
identifying the identification of the terminating wire with an input unit of the AR device;
calling the guiding information corresponding to the terminating wire from a storage unit of the AR equipment according to the identification;
displaying the guide information on a display unit of the AR device to guide the AR device user to operate;
acquiring a first image of a connector corresponding to a terminating wire, determining a hole position of the connector corresponding to the terminating wire according to the first image, and rendering and displaying a tracked object on a display unit of the hole position.
2. The connector pin sending method according to claim 1, further comprising, after rendering and displaying the hole position on a display unit, the hole position being a real object, the following steps:
the AR device user carries out marketing operation based on the rendering display;
and controlling the video equipment to carry out video backup on the pin sending operation process.
3. The connector pin feeding method of claim 1, wherein the input unit is a microphone, and the identifying the identification of the terminating wire using the input unit of the AR device comprises:
voice input is received and the identity of the terminating wire is identified based on the voice content.
4. The connector pin feeding method according to claim 1, wherein the input unit is a camera, and the identifying the identification of the terminating wire by using the input unit of the AR device comprises:
and acquiring a second image of the terminating wire through the camera, and identifying the identifier of the terminating wire according to the second image.
5. The connector pin feeding method according to claim 1, wherein the guide information includes one or more of crimping information, pin feeding information, and process information.
6. The connector pin sending method according to claim 1, wherein the displaying the hole position on a display unit for rendering and displaying a tracked object further comprises:
and performing amplification rendering display of the hole sites on the display unit for tracking the real objects so as to more clearly display the hole sites.
7. The connector pin feeding method according to claim 1, further comprising:
if the terminating lead is inserted into the correct hole position, generating and outputting correct indication information;
and if the terminating lead is not inserted into the correct hole position within the preset time, or if the terminating lead is inserted into the wrong hole position, generating and outputting indicating error information.
8. A connector pin feeding device based on an AR device is characterized by comprising:
an identification unit for identifying the identification of the terminating wire using the input unit of the AR device;
the calling unit is used for calling the guide information corresponding to the terminating wire from the storage unit of the AR equipment according to the identification;
the display unit is used for displaying the guide information on the display unit of the AR device so as to guide the AR device user to operate;
and the rendering unit is used for acquiring a first image of the connector corresponding to the terminating wire, determining a hole position of the connector corresponding to the terminating wire according to the first image, and rendering and displaying the hole position on a display unit for tracking a real object.
9. An AR device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, wherein the processor implements the connector distribution method of any of claims 1-7 when executing the computer program.
10. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out a connector pin feeding method according to any one of claims 1 to 7.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910798507.9A CN111273762A (en) | 2019-08-27 | 2019-08-27 | Connector pin sending method and device based on AR equipment, AR equipment and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910798507.9A CN111273762A (en) | 2019-08-27 | 2019-08-27 | Connector pin sending method and device based on AR equipment, AR equipment and storage medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111273762A true CN111273762A (en) | 2020-06-12 |
Family
ID=71002878
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910798507.9A Pending CN111273762A (en) | 2019-08-27 | 2019-08-27 | Connector pin sending method and device based on AR equipment, AR equipment and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111273762A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112084346A (en) * | 2020-09-11 | 2020-12-15 | 上海飞机制造有限公司 | Hole site information acquisition device and method for aerial cable connector |
| CN115576434A (en) * | 2022-12-09 | 2023-01-06 | 深圳先进技术研究院 | AR-based device operation guidance method, system and related device |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106569769A (en) * | 2016-11-09 | 2017-04-19 | 唐雪松 | AR technology-based machine operation instruction information display method and apparatus |
| CN108700912A (en) * | 2017-06-30 | 2018-10-23 | 广东虚拟现实科技有限公司 | The method and system of equipment is operated by augmented reality |
| CN109993023A (en) * | 2017-12-29 | 2019-07-09 | 佛山市顺德区美的电热电器制造有限公司 | A kind of household electrical appliances networking indicating means, AR equipment and computer storage medium |
| CN110020649A (en) * | 2019-03-22 | 2019-07-16 | 联想(北京)有限公司 | A kind of information processing method, device, equipment and storage medium |
-
2019
- 2019-08-27 CN CN201910798507.9A patent/CN111273762A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106569769A (en) * | 2016-11-09 | 2017-04-19 | 唐雪松 | AR technology-based machine operation instruction information display method and apparatus |
| CN108700912A (en) * | 2017-06-30 | 2018-10-23 | 广东虚拟现实科技有限公司 | The method and system of equipment is operated by augmented reality |
| CN109993023A (en) * | 2017-12-29 | 2019-07-09 | 佛山市顺德区美的电热电器制造有限公司 | A kind of household electrical appliances networking indicating means, AR equipment and computer storage medium |
| CN110020649A (en) * | 2019-03-22 | 2019-07-16 | 联想(北京)有限公司 | A kind of information processing method, device, equipment and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112084346A (en) * | 2020-09-11 | 2020-12-15 | 上海飞机制造有限公司 | Hole site information acquisition device and method for aerial cable connector |
| CN115576434A (en) * | 2022-12-09 | 2023-01-06 | 深圳先进技术研究院 | AR-based device operation guidance method, system and related device |
| CN115576434B (en) * | 2022-12-09 | 2023-04-25 | 深圳先进技术研究院 | AR-based equipment operation guiding method, AR-based equipment operation guiding system and related equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN107223246B (en) | Image labeling method and device and electronic equipment | |
| CN108830235B (en) | Method and apparatus for generating information | |
| KR102657309B1 (en) | Method for mounting an electrical switching system and assembly support device for simplifying assembly of such switching system | |
| JP6453312B2 (en) | Cable harness production support | |
| CN108763086A (en) | Script method for recording, terminal and computer readable storage medium based on remote real machine | |
| WO2013054975A1 (en) | Method and system for automating a scene-based test | |
| CN110716853A (en) | Test script recording method, application program testing method and related device | |
| JP2012152016A (en) | Cable connection work support apparatus | |
| CN111273762A (en) | Connector pin sending method and device based on AR equipment, AR equipment and storage medium | |
| CN114003451B (en) | Interface testing method, device, system and medium | |
| CN112584250A (en) | Video preview method and device, terminal equipment and storage medium | |
| CN112799656B (en) | Script file configuration method, device, equipment and storage medium for automation operation | |
| CN114638939A (en) | Model generation method, model generation device, electronic device, and readable storage medium | |
| CN112102836A (en) | Voice control screen display method and device, electronic equipment and medium | |
| CN110457219B (en) | Method and device for selecting time when test script is recorded | |
| CN112433935A (en) | Test method, test device, electronic equipment and storage medium | |
| JP5613621B2 (en) | Wiring work support apparatus and method | |
| CN107391354B (en) | Method and system for automatically monitoring terminal performance and storage device | |
| WO2018183179A1 (en) | Method and apparatus for in-situ querying support for industrial environments | |
| CN112632161A (en) | Interactive wire harness manufacturing execution system and method | |
| CN115552913A (en) | Information processing method, information processing apparatus, program, and information processing system | |
| CN112308745A (en) | Method and apparatus for generating information | |
| JP2020135608A (en) | Information processing apparatus and method | |
| JP7318918B2 (en) | Work activity support system | |
| CN109684405B (en) | Data synchronization method, device, equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |