TWI700924B - Machine identification and positioning system using augmented reality and method thereof - Google Patents

Abstract

The invention discloses a machine identification and positioning system using augmented reality and a method thereof. A beacon set on a machine transmits a beacon signal having a universal unique identifier (UUID), and a wireless signal receiver of an augmented reality (AR) device worn or held by a person receives the beacon signal. A machine relative position output module produces a machine relative position based on the beacon signal, and a beacon signal positioning calculation module calculates a current location or positioning location of the person based on the beacon signal and the machine relative position. A machine positioning and machine data presentation module presents the current location or positioning location of the person and data of the machine on the augmented reality device. Thereby, the present invention can quickly identify the machine and position the person's location.

Description

Machine recognition and positioning system and method using augmented reality

The present invention relates to a machine identification and positioning technology, in particular to a machine identification and positioning system and method using augmented reality.

In the past, when a person wears AR (Augmented Reality) glasses for machine maintenance, it is often impossible to identify the machine and the location of the person who locates it. As a result, the person spends too much time looking for the machine, which increases the cost of manpower and time.

Secondly, the current common indoor positioning technologies include Bluetooth (Bluetooth) positioning, wireless local area network (Wi-Fi) positioning, ultra-wideband (UWB) positioning and other positioning methods, and various positioning methods are based on technical principles and constructions. There are differences in the way of placement and venue restrictions.

Therefore, in an existing technology, a hybrid indoor positioning architecture is proposed, which according to the different positioning requirements of each area in the field, installs multiple types of positioning devices in the field at the same time, and receives and tracks the target through different positioning devices Positioning is performed by the corresponding positioning tag signal on the above, and then the management system integrates the positioning information of each positioning device for subsequent use. However, this prior art requires the use of multiple types of positioning equipment and positioning tags for positioning, thereby increasing equipment or The complexity of the component.

Therefore, how to provide a novel or innovative machine identification and positioning technology has become one of the major research topics for those skilled in the art.

The present invention provides a novel or innovative machine identification and positioning system and method using augmented reality, which can quickly identify the machine and locate personnel positions.

The machine identification and positioning system using augmented reality of the present invention includes: at least one beacon, which is set on at least one machine to transmit a beacon signal or beacon signal data with a universal unique identification code (UUID); An augmented reality (AR) device, which is worn or hand-held by personnel, and has a wireless signal receiver to receive beacon signals or beacon signal data with universal unique identifiers sent by beacons on the station; A machine relative position output module calculates or produces the machine's relative position of the machine based on the beacon signal or beacon signal data with a universal unique identifier from the wireless signal receiver of the augmented reality device; A beacon signal positioning calculation module, which calculates the current position or location of the personnel based on the beacon signal or beacon signal data with a universal unique identification code and the relative position of the machine from the relative position output module of the machine ; And a machine positioning and machine data presentation module, which will be able to identify the current location or positioning position of the personnel of the calculation module by the signal and present the data of the machine on the augmented reality device.

The machine identification and positioning method using augmented reality of the present invention includes: sending a beacon signal or beacon signal data with a universally unique identifier (UUID) from at least one beacon set on at least one machine; A beacon signal or beacon with a universal unique identifier sent by a person wearing or holding an augmented reality (AR) device, a wireless signal receiver, a beacon on the receiver station Signal data; a machine relative position output module calculates or produces the machine relative to the machine based on the beacon signal or beacon signal data with universal unique identifier from the wireless signal receiver of the augmented reality device Location; a beacon signal positioning calculation module calculates the current location or location of the personnel based on the beacon signal or beacon signal data with a universal unique identification code and the relative position of the machine from the relative position output module of the machine Location; and a machine positioning and machine data presentation module will confidently sign the signal to locate the current location or location of the personnel of the computing module and the machine data will be displayed on the augmented reality device.

In order to make the above-mentioned features and advantages of the present invention more comprehensible, embodiments are specifically described below in conjunction with the accompanying drawings. In the following description, the additional features and advantages of the present invention will be partially described, and these features and advantages will be partially known from the description, or can be learned by practicing the present invention. The features and advantages of the present invention are realized and achieved by means of the elements and combinations specifically pointed out in the scope of the patent application. It should be understood that the foregoing general description and the following detailed description are both exemplary and explanatory, and are not intended to limit the scope of the present invention.

1‧‧‧Using augmented reality machine recognition and positioning system

10‧‧‧Beacon

20‧‧‧AR (Amplified Reality) Equipment

21‧‧‧Wireless signal receiver

30‧‧‧Machine relative position output module

40‧‧‧Beacon signal positioning calculation module

41‧‧‧Machine distance calculation unit

42‧‧‧Machine data filter unit

43‧‧‧Positioning calculation and analysis unit

44‧‧‧Position score positioning unit

50‧‧‧Positioning and machine data presentation module

51‧‧‧Machine data query unit

52‧‧‧Select the display unit of the viewing machine

53‧‧‧Machine data presentation unit

60‧‧‧Server

A‧‧‧Beacon signal

A1‧‧‧Beacon signal data

B‧‧‧The relative position of the machine

C‧‧‧location or positioning location

M‧‧‧machine

M1‧‧‧Positioning data

M2‧‧‧Distance data

P1, P2‧‧‧Position

P1', P2'‧‧‧location position

Steps S11 to S19, S21 to S25‧‧‧

Sa‧‧‧ process

Figure 1 is a schematic diagram of the beacon sending parameter setting rules of the present invention; Figure 2 is a schematic diagram of the architecture of the machine identification and positioning system using augmented reality of the present invention; Figure 3 is the second figure of the present invention The operation flow chart of the relative position output module of the machine; Figure 4 is a block diagram of the beacon signal positioning calculation module in Figure 2 of the present invention; Figure 5 is the positioning and machine data in Figure 2 of the present invention The block diagram of the presentation module; Fig. 6A, Fig. 6B and Fig. 7 are schematic diagrams of an embodiment of the machine identification and positioning system and its method using augmented reality of the present invention. Fig. 6A is the position of the machine and the position of the personnel Figure 6B is a schematic diagram of the position of the machine and the positioning position of the personnel; Figure 7 is a schematic diagram of the beacon signal data and calculated data; Figure 8A, Figure 8B and Figure 9 are diagrams of the present invention A schematic diagram of another embodiment of a machine identification and positioning system and its method using augmented reality, where Figure 8A is a schematic diagram of the position of the machine and personnel, and Figure 8B is a diagram of the position of the machine and personnel The schematic diagram of the positioning position, Figure 9 is a schematic diagram of the beacon signal data and calculated data; and Figure 10 is a schematic flow diagram of the machine identification and positioning method using augmented reality of the present invention.

The following describes the implementation of the present invention with specific specific embodiments. Those familiar with this technology can understand the other advantages and effects of the present invention from the contents disclosed in this specification, and can also implement other different specific equivalent embodiments. Or apply.

Figure 1 is a schematic diagram of the Beacon sending parameter setting rule of the present invention. As shown in the figure, UUID (Universally Unique Identifier) is the identification code of the area/floor. For example, UUID1 is the identification code of area 1/floor 1 and UUID2 is the identification code of area 2/floor 2. The same area/ The UUID of the beacons of the machines on the floor can be set to the same UUID. Major and Minor are respectively the row and column of the machine arrangement position. The arrangement order of the row (Major) is from front to back, and the arrangement number of the row (Major) is arranged from front to back, the front is 1 followed by 2, 3 ,... The arrangement order of the column (Minor) is from left to right, and the arrangement number of the column (Minor) is from left to right Arrangement on the right, the leftmost is 1 followed by 2,3,... The position number of the machine is represented by "Major, Minor". Take the left side (area 1/floor 1) of Figure 1 as an example, the machine in the upper left corner is "1,1", and the middle one is The machine is "2,2", the machine at the bottom right corner is "3,3", and so on.

At the same time, in the embodiment in Figure 1, the present invention only schematically illustrates that the area 1/floor 1 on the left and the area 2/floor 2 on the right include nine machines (ie, machine 1, 1 to machine 3). ,3). However, in practical applications, the area 1/floor 1 on the left and the area 2/floor 2 on the right can include less than nine machines (such as one to eight machines), or more than nine machines (such as ten Or more than dozens of machines).

Figure 2 is a schematic diagram of the architecture of the machine identification and positioning system 1 using augmented reality of the present invention. As shown in the figure, the machine identification and positioning system 1 using augmented reality can meet the requirements of indoor machine identification and positioning, and can wear or hold a wireless signal receiver 21 through wireless signals (such as Bluetooth signals). The position of the personnel of the AR (Augmented Reality) device 20 is automatically located near the machine M and the machine M is recognized, and the position or location of the personnel can also be displayed on the AR device 20.

The machine identification and positioning system 1 using augmented reality may include at least one beacon 10, an AR (augmented reality) device 20 with a wireless signal receiver 21, a machine relative position output module 30, A beacon signal positioning calculation module 40, a positioning and machine data presentation module 50, and a server 60. A beacon 10 can be installed on a machine M, and the machine relative position output module 30, the beacon signal positioning calculation module 40, and the positioning and machine data presentation module 50 can be constructed in AR (Amplified Reality). In the environment) equipment 20, or constructed in an electronic device (such as a computer, a host, a server, etc.). The beacon 10 can be a hardware Bluetooth low energy (BLE) beacon, and the AR device 20 can be AR glasses, a smart phone or tablet with AR function, etc. The wireless signal receiver 21 may be a Bluetooth receiver or the like. However, the present invention is not limited to this.

In the machine identification and positioning system 1 using augmented reality of the present invention, at least one (such as one or several) beacons 10 provided on at least one (such as one or several) machines M can send a UUID (universal) Unique identification code) beacon signal A or beacon signal data. At the same time, an AR (augmented reality) device 20 with a wireless signal receiver 21 is worn or held by a person to use the wireless signal receiver 21 of the AR device 20 to receive at least one (such as one or several) nearby machines M The beacon signal A or the beacon signal data with UUID sent by the beacon 10 to convert the UUID (Universal Unique Identifier) and RSSI (Received Signal Strength Indication) of the beacon signal A or the beacon signal data; ), row (Major), column (Minor), received signal strength (Tx Power), etc. are sent to the relative position output module 30 of the machine. Then, the relative machine position output module 30 calculates or generates the relative machine position of machine M based on the UUID beacon signal A or beacon signal data from the wireless signal receiver 21 of the AR device 20 B, to transmit the beacon signal A or the beacon signal data and the relative position B of the machine to the beacon signal positioning calculation module 40. Then, the beacon signal positioning calculation module 40 calculates the personnel (that is, the AR equipment 20) based on the UUID beacon signal A or beacon signal data from the machine relative position output module 30 and the machine relative position B. Or the wireless signal receiver 21) the current location or location C, and then the current location or location C of the personnel is sent to the location and machine data presentation module 50. Then, the positioning and machine data presentation module 50 will confidently mark the current position of the personnel of the signal positioning calculation module 40 or the location C and the detailed data of the machine M to display or present on the AR (augmented reality) equipment 20 on.

It is said that in the machine identification and positioning system 1 using augmented reality of the present invention, at least one (such as one or more) beacons 10 provided on at least one (such as one or more) machines M can be used (Such as The hardware Bluetooth low energy beacon) sends the beacon signal A or beacon signal data about the machine M to the wireless signal receiver 21 of the AR (augmented reality) device 20, and transmits it according to the current area/floor The beacon signal A or the universal unique identifier (UUID) of the beacon signal data queries the information of all the machines M to establish the data of the relative positions of the machines. Then, calculate the distance between the person (ie AR device 20 or wireless signal receiver 21) and the machine M to filter or filter out suitable data, analyze or calculate the position relationship of the machine, the weighted score of the position relationship, and calculate the front Position score, rear position score, left position score and right position score, and then locate the current position of machine M based on the score. Then, according to the position of the current machine M, the selection screen of the nearest several machines M (such as 3 machines) is displayed. When the staff clicks to view the detailed information of the machine M, the information of the machine M is displayed. Detailed information, at the same time, accurately and quickly locate which machine M the person is in the room, and identify the machine M to display the required machine information. For example, the detailed data (detailed data) or machine information of the machine M may be the type, name, brand, manufacturer, model, identification code, pattern, size, function, etc. of the machine M.

For example, in the machine identification and positioning system 1 using augmented reality of the present invention, a beacon sent by a beacon 10 (such as a hardware Bluetooth low energy beacon) on the machine M Signal A or beacon signal data is used to establish the relative position of the machine. For example, beacon signal A or beacon signal data includes universally unique identifier (UUID), received signal strength index (RSSI), row (Major), column ( Minor), transmit power (Tx Power), etc. Then, according to the received beacon signal A or beacon signal data, calculate the distance between the person (that is, the AR device 20 or the wireless signal receiver 21) and the machine M to automatically filter or filter out the appropriate beacon signal A or The beacon signal data is used to calculate the machine position relationship and the weighted score of the position relationship, and the position of the indoor machine M is determined based on the front position score, the rear position score, the left position score and the right position score. then, The selection screen of the nearest several machines M (such as 3 machines) is presented, allowing the personnel to freely choose the detailed information of the machine M that they want to view.

Figure 3 is a flowchart of the operation of the relative position output module 30 of the machine in Figure 2 of the present invention. In step S11 in Figure 3, the wireless signal receiver 21 (such as a Bluetooth receiver) of the AR (augmented reality) device 20 shown in Figure 2 receives at least one (such as one or several) nearby machines M Multiple beacon signals A or beacon signal data sent by the beacon 10. Next, in step S12 in Fig. 3, the relative position output module 30 of the machine shown in Fig. 2 filters out the beacon signal A or beacon signal data with the largest RSSI (received signal strength index) Value (ie the strongest signal strength) beacon signal A or beacon signal data. Then, the relative machine position output module 30 performs the area/floor positioning and machine relative position output process Sa based on the beacon signal or beacon signal data with the maximum RSSI (received signal strength index).

In short, in the area/floor positioning and machine relative position output process Sa in Figure 3, the machine relative position output module 30 shown in Figure 2 first confirms the area position of the machine M to The server 60 queries the row (Major) and column (Minor) data of all machines M in the same area/floor, and then the machine relative position output module 30 creates it based on the row (Major) and column (Minor) data For information about the relative position of the machine, please refer to the description of the beacon sending parameter setting rule in Figure 1 above for this establishment rule.

Specifically, the area/floor positioning and machine relative position output process Sa in Figure 3 may include the following steps S13 to S19.

In step S13 in Figure 3, the relative position output module 30 of the machine shown in Figure 2 determines the beacon signal A or beacon with the maximum RSSI (received signal strength index) value in step S12 in Figure 3 Whether the UUID (Universal Unique Identifier) of the signal data is currently queried UUID? If it is (UUID is the UUID currently queried), the process ends. If not (the UUID is not the currently queried UUID), the relative machine position generating module 30 obtains the new UUID and proceeds to step S14.

In step S14 in Figure 3, the relative machine position generation module 30 determines whether the new UUID is a temporary UUID? If yes (the new UUID is a temporary UUID), proceed to step S15, where the relative position output module 30 of the machine adds the value of the temporary UUID to the preset value (for example, the preset value is 1), and then proceed to step S17 . If not (the new UUID is not a temporary UUID), proceed to step S16, so that the machine relative position generation module 30 overwrites the original temporary UUID with the new UUID, and ends the process at the same time.

In step S17 in Figure 3, the relative position output module 30 of the machine determines whether the temporary UUID is greater than the threshold (for example, the threshold is 15)? If it is (the temporary UUID is greater than the threshold), proceed to step S18 to step S19, and the relative position output module 30 of the machine queries the machine data of the same UUID according to the temporary UUID, and based on the data of the inquired machine Column (Major) and column (Minor) establish the relative position of the machine. If not (the temporary UUID is not greater than the threshold), the process ends.

Figure 4 is a block diagram of the beacon signal positioning calculation module 40 in Figure 2 of the present invention, and the beacon signal positioning calculation module 40 may have a machine distance calculation unit 41, a machine data filtering unit 42, a The positioning calculation and analysis unit 43 and a position score positioning unit 44.

As shown in Figure 4 and contained in the algorithms [1]-[8] below, in the beacon signal positioning calculation module 40 and its operation method, the beacon signal positioning calculation module 40 first calculates the machine distance The calculation unit 41 calculates the distance d of all the machines M in Figures 1 to 2 according to the beacon signal or the beacon signal data A1 and [1] RSSI (Received Signal Strength Index) distance algorithm. Then, the machine data filtering unit 42 of the beacon signal positioning calculation module 40 deletes machine data with a distance d exceeding the distance threshold (such as 15m), and filters or filters out the nearest machines M (Such as the first 5 machines) machine information. Then, the positioning calculation and analysis unit 43 of the beacon signal positioning calculation module 40 is based on the [2] column position relationship algorithm, the column position (Major ₁ ) of the first machine (the closest machine) and the nth machine ( For example, the row position (Major _n ) of the second, 3, 4, and 5 machines calculates the row position relationship between the nth machine and the first machine (Major _1n ), and calculates the position relation algorithm based on the column [3]. The column position (Minor ₁ ) of the first machine (the closest machine) and the column position of the nth machine (Minor _n ) are calculated to calculate the position relationship between the nth machine and the first machine (Minor _1n ), and Calculate the position relationship based on the [4] position relationship weighted score algorithm, the column position relationship between the nth machine and the first machine (Major _1n ), and the column position relationship between the nth machine and the first machine (Minor _1n ) The weighted score W _{n is} calculated or counted according to [5] front position score algorithm, [6] rear position score algorithm, [7] left position score algorithm, and [8] right position score algorithm. The current _front position score P _front , the back position score P _back , the left position score P _left and the right position score P _right . Then, the position score positioning unit 44 of the beacon signal positioning calculation module 40 finds the position with the highest score from the front position score P _front , the rear position score P _back , the left position score P _left and the right position score P _right When the axis, and position one group according to the score ratio (for example, define the front and rear as a group, the left and the right as a group, a total of two groups), if the front position score P _front has the highest score, then the left position score P _left and the right The position score P _right locates the position of the personnel at the nearest machine 1 according to the proportion; if the highest scores of the two groups are the same, the front or back axis will be selected first (for example, the machine is selected in Figure 6B 3,3 is the axis before), and when P _front = P _back = P _left = P _right =1, the positioning point is positioned at the center of the machine M.

[1] RSSI distance algorithm: d=10 ^{((Tx Power-RSSI)÷20)} . d represents the distance between the person (that is, AR equipment or wireless signal receiver) and the machine (in meters), Tx power represents the received signal strength (dBm) at a predetermined distance (such as 1 meter), and RSSI represents the beacon signal Or the received signal strength index (dBm) in the beacon signal data A1.

[2] Column position relationship algorithm: Major _1n = sgn(Major _n -Major ₁ ). Major _1n represents the positional relationship between the nth machine and the first machine (Major), Major _n represents the position of the nth machine, Major ₁ represents the position of the first machine, sgn represents the sign function (sign function) , N represents a positive integer greater than or equal to 2 (eg n=2, 3, 4, 5). For example, Major _1n =1 means that the nth machine is behind the first machine, Major _1n =0 means that the nth machine is in the same row as the first machine, and Major _1n = -1 means that the nth machine is in front of the first machine. .

[3] Column position relationship algorithm: Minor _1n =sgn(Minor _n -Minor ₁ ). Minor _1n represents the positional relationship of the column (Minor) between the nth machine and the first machine, Minor _n represents the column position of the nth machine, Minor ₁ represents the column position of the first machine, sgn represents the symbolic function, and n represents greater than A positive integer equal to 2 (eg n=2, 3, 4, 5). For example, Minor _1n =1 means that the nth machine is on the right of the first machine, Minor _1n =0 means that the nth machine is in the same column as the first machine, and Minor _1n =-1 means that the nth machine is on the first machine. On the left.

[4] Location relation weighted score algorithm: W _n =(2-|Major _1n |．|Minor _1n |)×(6-n). W _n represents the weighted score of the position relation of the nth machine, Major _1n represents the position relation of the nth machine and the first machine (Major), Minor _1n represents the column of the nth machine and the first machine (Minor) Position relationship, n represents a positive integer greater than or equal to 2 (such as n=2, 3, 4, 5).

P_front表示前方位置分數，k表示過濾後之機台數量，其餘符號如同上述演算法[1]至[4]之說明。 [5] Forward position score algorithm:

P _front represents the score of the front position, k represents the number of machines after filtering, and the rest of the symbols are as described in the above algorithm [1] to [4].

P_back表示後方位置分數，k表示過濾後之機台數量，其餘符號如同上述演算法[1]至[4]之說明。 [6] The rear position score algorithm:

P _back represents the score of the rear position, k represents the number of machines after filtering, and the rest of the symbols are the same as the description of the above algorithm [1] to [4].

P_left表示左方位置分數，k表示過濾後之機台數量，其餘符號如同上述演算法[1]至[4]之說明。 [7] Left position score algorithm:

P _left represents the score of the left position, k represents the number of machines after filtering, and the rest of the symbols are the same as the description of the above algorithm [1] to [4].

P_right表示右方位置分數，k表示過濾後之機台數量，其餘符號如同上述演算法[1]至[4]之說明。 [8] The right position score algorithm:

P _right represents the position score on the right, k represents the number of machines after filtering, and the rest of the symbols are the same as the description of the above algorithm [1] to [4].

Figure 5 is a block diagram of the positioning and machine data presentation module 50 in Figure 2 of the present invention, and the positioning and machine data presentation module 50 may have a machine data query unit 51 and a viewing machine selection display Unit 52 and a machine data presentation unit 53.

In the positioning and machine data presentation module 50 and its operating method shown in Figure 5, the machine data query unit 51 of the positioning and machine data presentation module 50 first receives the beacon signal positioning shown in Figure 4 Calculate the distance data M2 between the positioning data M1 of the machine M in the module 40 and the machine M, and query the server 60 for detailed data of the nearest several machines M (such as 3 machines). Then, by the viewing machine selection of the positioning and machine data presentation module 50, the presenting unit 52 presents several machines M (such as 3 machines) according to the data of the nearest several machines M (such as 3 machines) ) Of the selection screen. Then, the machine data presentation unit 53 of the positioning and machine data presentation module 50 presents a detailed data screen according to the machine M selected for viewing.

Fig. 6A, Fig. 6B and Fig. 7 are schematic diagrams of an embodiment of the machine identification and positioning system and its method using augmented reality of the present invention. Fig. 6A is the position of the machine and the position of the personnel The schematic diagram of P1 (actual position), Figure 6B is the schematic diagram of the position of the machine and the positioning position of the personnel P1', and Figure 7 is the schematic diagram of the beacon signal data (beacon signal) and the calculated data.

For example, suppose that a person wearing or holding an AR (augmented reality) device 20 with a wireless signal receiver 21 walks to the position P1 in Fig. 6A. The network points in the picture are the position of the person P1 (actual position), and the machine The number (such as 1,1,...,3,3) is the set rule data of beacon sending parameters. Therefore, a plurality of beacon signals A or beacon signal data can be obtained from the plurality of beacons 10 on the plurality of machines M by the machine relative position output module 30 shown in FIGS. 2 to 3, and through 3 As shown in the figure, the area/floor positioning and machine relative position output process Sa Confirm the UUID (Universal Unique Identifier) of the current area/floor, and then query the row (Major) and column of all machine data under the UUID ( For the data of Minor, the data of the relative position of the machine is established based on the data of the row (Major) and the column (Minor).

Then, the distance d of all the machines M is calculated by the machine distance calculation unit 41 of the beacon signal positioning calculation module 40 shown in Fig. 4, and the machine data filtering unit of the beacon signal positioning calculation module 40 42 Filter or filter out the machine data of the nearest machine M. Then, the positioning calculation and analysis unit 43 of the beacon signal positioning calculation module 40 calculates Major _1n (the positional relationship between the nth machine and the first machine), Minor _1n (the nth machine and the first machine Column position relationship), W _n (weighted score of position relationship of the nth machine), P _front (front position score), P _back (rear position score), P _left (left position score), P _right (right position Score), such as RSSI (received signal strength index), Tx power (received signal strength), Major (row), Minor (column) and the calculated d (distance) of the beacon signal or beacon signal data shown in Figure 7 ), Major _1n (the column position relationship between the nth machine and the first machine), Minor _1n (the column position relation between the nth machine and the first machine), P _front (the front position score), P _back (the rear Position score), P _left (left position score), P _right (right position score) and other data.

Then, the position score positioning unit 44 of the beacon signal positioning calculation module 40 calculates P _front (front position score), P _back (rear position score), P _left (left position score), P _right (right). Square position score) locate the position of the machine M, for example, the black dot shown in Figure 6B is the position P1' of the personnel. Finally, the machine data query unit 51 of the positioning and machine data presentation module 50 shown in Fig. 5 queries the server 60 for the details of several (eg n, n=2, 3, 4...) machines M Data, and the viewing machine selection and presentation unit 52 of the positioning and machine data presentation module 50 displays several (such as n) machine selection screens of the machines M, and then the positioning and machine data presentation module 50 The machine data presentation unit 53 presents a detailed data screen according to the machine M selected for viewing.

Figure 8A, Figure 8B and Figure 9 are the machine of the present invention using augmented reality A schematic diagram of another embodiment of the station identification and positioning system and its method, where Figure 8A is a schematic diagram of the position of the machine and the position of the personnel P2 (actual position), and Figure 8B is the position of the machine and the positioning of the personnel The schematic diagram of P2', Figure 9 is the schematic diagram of the beacon signal data (beacon signal) and the calculated data.

For example, suppose a person wearing or holding an AR (Augmented Reality) device 20 with a wireless signal receiver 21 walks to the position P2 in Fig. 8A, and the network point in the picture is the position P2 (the actual position) of the person. The number (such as 1,1) is the set rule data of the beacon sending parameter. Therefore, at least one beacon signal A or beacon signal data can be obtained from a beacon 10 on a machine M by the machine relative position output module 30 shown in Figs. Show area/floor positioning and machine relative position output process Sa Confirm the UUID (Universal Unique Identifier) of the current area/floor, and then query the column (Major) and column (Minor) of all machine data under the UUID Based on the data in the row (Major) and column (Minor), establish the data of the relative position of the machine.

Then, the distance d of the machine M is calculated by the machine distance calculation unit 41 of the beacon signal positioning calculation module 40 shown in FIG. 4, and the machine data filtering unit 42 of the beacon signal positioning calculation module 40 Filter or filter out the machine data of the nearest machine M. Then, the positioning calculation and analysis unit 43 of the beacon signal positioning calculation module 40 calculates Major _1n (the positional relationship between the nth machine and the first machine), Minor _1n (the nth machine and the first machine Column position relationship), W _n (weighted score of position relationship of the nth machine), P _front (front position score), P _back (rear position score), P _left (left position score), P _right (right position Score), such as RSSI (received signal strength index), Tx power (received signal strength), Major (row), Minor (column) and the calculated d (distance) of the beacon signal or beacon signal data shown in Figure 9 ), Major _1n (the column position relationship between the nth machine and the first machine), Minor _1n (the column position relation between the nth machine and the first machine), P _front (the front position score), P _back (the rear Position score), P _left (left position score), P _right (right position score) and other data.

Then, the position score positioning unit 44 of the beacon signal positioning calculation module 40 calculates P _front (front position score), P _back (rear position score), P _left (left position score), P _right (right). Square position score) locate the position of the machine M. For example, the black dot shown in Figure 8B is the position P2' of the personnel. Finally, the machine data query unit 51 of the positioning and machine data presentation module 50 shown in Fig. 5 queries the server 60 for detailed data of a machine M (that is, n=1), and the machine data The viewing machine selection presentation unit 52 of the presentation module 50 displays a machine selection screen of the machine M (ie n=1), and the machine data presentation unit 53 of the positioning and machine data presentation module 50 selects and watches The machine M shows the detailed information screen.

Figure 10 is a schematic flow diagram of the machine identification and positioning method using augmented reality of the present invention, and please refer to Figure 2. At the same time, the main technical content of the machine identification and positioning method using augmented reality of the present invention is as follows, and the rest of the technical content is the same as the description in Figure 1 to Figure 9 above, and will not be repeated here.

In step S21 of FIG. 10, at least one beacon 10 provided on at least one machine M transmits a beacon signal A or beacon signal data with a universally unique identifier (UUID).

In step S22 in Fig. 10, a wireless signal receiver 21 of an augmented reality (AR) device 20 worn or held by a person receives the beacon 10 sent by the station M with a universal unique identification code Beacon signal A or beacon signal data.

In step S23 in Fig. 10, the relative position output module 30 of a machine is based on the universal unique identification code of the wireless signal receiver 21 from the augmented reality (AR) device 20 Calculate or produce the relative position of the beacon signal A or beacon signal data of the machine M.

In step S24 in Figure 10, a beacon signal positioning calculation module 40 is based on the beacon signal A or beacon signal data with a universally unique identification code and the relative position of the machine from the relative position output module 30. The location calculates the person's current location or location.

In step S25 in Fig. 10, a machine positioning and machine data presentation module 50 is confident that the current location or positioning position of the personnel of the signal positioning calculation module 40 and the data of the machine M are presented in the augmentation Reality (AR) device 20.

In summary, the machine identification and positioning system and method using augmented reality of the present invention can at least have the following features, advantages or technical effects.

1. The present invention can send beacon signals or beacon signal data through beacons (such as Bluetooth low energy beacons) to calculate (analyze) the distance or position of the machine to learn the current position of the personnel, and then increase Real-world (AR) equipment locates the current location information, allowing personnel to quickly find the location of the machine that needs maintenance for maintenance operations, thereby reducing machine downtime and improving machine utilization.

2. The present invention can use beacons (such as Bluetooth low energy beacons) to send beacon signals or beacon signal data for distance and positioning analysis, and each machine only needs to install its own beacon to send identification Sexual beacon signal or beacon signal data does not require multiple types of positioning equipment, thereby simplifying the complexity of the system or equipment.

3. The possible applications of the present invention are related industries of machines (such as machine tools, injection molding machines, mainframes, computers, etc.), and the possible applications of products are, for example, iEN (Intelligent Energy Network) products.

The above-mentioned embodiments only exemplify the principles, features and effects of the present invention. It is not intended to limit the scope of implementation of the present invention. Anyone who is familiar with the art can modify and change the above-mentioned embodiments without departing from the spirit and scope of the present invention. Any equivalent changes and modifications made using the content disclosed in the present invention should still be covered by the scope of the patent application. Therefore, the protection scope of the present invention should be as listed in the scope of patent application.

1‧‧‧Using augmented reality machine recognition and positioning system

10‧‧‧Beacon

20‧‧‧AR (Amplified Reality) Equipment

21‧‧‧Wireless signal receiver

30‧‧‧Machine relative position output module

40‧‧‧Beacon signal positioning calculation module

50‧‧‧Positioning and machine data presentation module

60‧‧‧Server

A‧‧‧Beacon signal

B‧‧‧The relative position of the machine

C‧‧‧location or positioning location

M‧‧‧machine

Claims (18)

A machine identification and positioning system using augmented reality, comprising: at least one beacon, which is set on at least one machine to transmit a beacon signal or beacon signal data with a universally unique identification code (UUID); Augmented reality (AR) equipment, which is worn or held by personnel, and has a wireless signal receiver to receive the beacon signal or beacon signal with the universal unique identifier sent by the beacon on the machine Data; a machine's relative position output module is based on the beacon signal or beacon signal data with the universal unique identifier from the wireless signal receiver of the augmented reality device to calculate or generate the machine's The relative position of the machine; a beacon signal positioning calculation module is calculated based on the beacon signal or beacon signal data with the universal unique identifier and the relative position of the machine from the relative position output module of the machine The person’s current location or location; and a machine positioning and machine data presentation module, which combines the person’s current location or location and the machine’s data from the beacon signal positioning calculation module Presented on the augmented reality device; where the beacon signal positioning calculation module has a machine data filtering unit, so that the machine data filtering unit deletes machine data with a distance exceeding the distance threshold. And filter or filter out the machine data of the nearest machines. The system described in item 1 of the scope of patent application, wherein the beacon is a Bluetooth low energy beacon, and the augmented reality device is augmented reality glasses, a smartphone or tablet with augmented reality functions , And the wireless signal receiver is a Bluetooth receiver. Such as the system described in item 1 of the scope of patent application, wherein the wireless signal receiver of the augmented reality device is the universally unique identifier (UUID) of the beacon signal or the beacon signal data, and the received signal strength index ( RSSI), row (Major), column (Minor) and received signal strength are sent to the relative position output module of the machine for the relative position output module of the machine to calculate or output the relative position of the machine position. For example, the system described in item 1 of the scope of patent application, wherein the relative position output module of the machine filters out the signal with the maximum value of the received signal strength index (RSSI) from multiple beacon signals or beacon signal data. The beacon signal or beacon signal data is used to query a server for the row and column data of all machines in the same area or floor, and then establish the relative position data of the machine based on the row and column data. For example, the system described in item 1 of the scope of patent application, wherein the beacon signal positioning calculation module has a machine distance calculation unit, so that the machine distance calculation unit is based on the beacon signal or beacon signal data and The Received Signal Strength Index (RSSI) distance algorithm calculates the distance of all machines. For example, the system described in item 1 of the scope of patent application, wherein the beacon signal positioning calculation module has a positioning calculation and analysis unit, so that the positioning calculation and analysis unit calculates and analyzes the row position relationship algorithm and the first machine row Calculate the row position relationship between the nth machine and the first machine based on the column position relationship algorithm, the column position of the first machine and the nth machine The column position calculates the column position relationship between the nth machine and the first machine, and n represents a positive integer greater than or equal to 2. A machine recognition and positioning system using augmented reality, including: At least one beacon is set on at least one machine to send a beacon signal or beacon signal data with a universally unique identification number (UUID); an augmented reality (AR) device is for personnel to wear or hold, It also has a wireless signal receiver to receive the beacon signal or beacon signal data with the universal unique identification code sent by the beacon on the machine; a relative position output module of the machine is based on the The beacon signal or beacon signal data with the universal unique identification code of the wireless signal receiver of the augmented reality device calculates or produces the relative position of the machine; a beacon signal positioning calculation module is based on The beacon signal or beacon signal data with the universally unique identification code and the relative position of the machine from the relative position output module of the machine calculate the person’s current position or location; and a machine positioning and The machine data presentation module presents the person’s current location or location and the machine’s data from the beacon signal positioning calculation module on the augmented reality device; among them, the beacon signal The positioning calculation module has a positioning calculation and analysis unit, and the positioning calculation and analysis unit uses the weighted score algorithm according to the position relationship, the position relationship between the nth machine and the first machine, and the nth machine and the first machine The position relationship of the station column calculates the weighted score of the position relationship, and n represents a positive integer greater than or equal to 2. A machine identification and positioning system using augmented reality, including: at least one beacon, which is set on at least one machine to send a beacon signal or beacon signal data with a universal unique identification code (UUID); An augmented reality (AR) device, which is worn or held by personnel, and has a wireless signal receiver to receive the beacon signal or beacon with the universal unique identifier sent by the beacon on the machine Signal data; a machine's relative position output module is based on the beacon signal or beacon signal data with the universal unique identifier from the wireless signal receiver of the augmented reality device to calculate or produce the machine The relative position of the machine; a beacon signal positioning calculation module is calculated based on the beacon signal or beacon signal data with the universal unique identifier and the relative position of the machine from the relative position output module of the machine The person’s current location or location; and a machine positioning and machine data presentation module, which combines the person’s current location or location from the beacon signal positioning calculation module and the machine’s The data is presented on the augmented reality device; wherein, the beacon signal positioning calculation module has a positioning calculation and analysis unit, so that the positioning calculation and analysis unit is based on the front position score algorithm, the rear position score algorithm, and the left The square position score algorithm and the right position score algorithm respectively calculate the front position score, the back position score, the left position score and the right position score of the person’s current location. For example, the system described in item 8 of the scope of patent application, wherein the position score positioning unit further finds the position with the highest score among the front position score, rear position score, left position score, and right position score as the axis, and According to the ratio, locate the position of the person at the nearest machine 1. A method for machine identification and positioning using augmented reality, including: sending a beacon signal or beacon signal data with a universally unique identification code (UUID) from at least one beacon set on at least one machine; A wireless signal receiver of an augmented reality (AR) device worn or held by a person receives the beacon signal or beacon signal data with the universal unique identifier sent by the beacon on the machine; A machine relative position output module calculates or generates the machine relative position of the machine based on the beacon signal or beacon signal data with the universal unique identifier from the wireless signal receiver of the augmented reality device ; A beacon signal positioning calculation module calculates the person’s current location based on the beacon signal or beacon signal data with the universal unique identifier and the relative position of the machine from the relative position output module of the machine Position or positioning location; and a machine positioning and machine data presentation module presents the person’s current location or positioning location and the machine’s data from the beacon signal positioning calculation module in the augmented reality Equipment; among them, the machine data filtering unit of the beacon signal positioning calculation module deletes machine data with a distance exceeding the distance threshold, and filters or filters out the machine data of the nearest previous machines . The method described in item 10 of the scope of patent application, wherein the beacon is a Bluetooth low energy beacon, and the augmented reality device is augmented reality glasses, a smartphone or tablet with augmented reality function , And the wireless signal receiver is a Bluetooth receiver. For example, the method described in item 10 of the scope of patent application further includes the universally unique identifier (UUID) of the beacon signal or beacon signal data and the received signal strength index by the wireless signal receiver of the augmented reality device (RSSI), row (Major), column (Minor) and received signal strength are sent to the relative position output module of the machine for the relative position output module of the machine to calculate or output the machine of the machine relative position. For example, the method described in item 10 of the scope of the patent application further includes the relative position output module of the machine to filter out the signal with the maximum received signal strength index (RSSI) from multiple beacon signals or beacon signal data. The beacon signal or beacon signal data is used to query a server for the row and column data of all machines in the same area or floor, and then establish the relative position data of the machine based on the row and column data. For example, the method described in item 10 of the scope of patent application further includes a distance calculation unit of the beacon signal positioning calculation module based on the beacon signal or beacon signal data and the received signal strength index (RSSI) distance calculation Method to calculate the distance of all machines. For example, the method described in item 10 of the scope of patent application further includes a positioning calculation and analysis unit of the beacon signal positioning calculation module based on the row position relationship algorithm, the row position of the first machine and the row of the nth machine Calculate the column position relationship between the nth machine and the first machine, and calculate the nth machine based on the column position relationship algorithm, the column position of the first machine and the column position of the nth machine The column position relationship between the station and the first station, and n represents a positive integer greater than or equal to 2. A method for machine identification and positioning using augmented reality includes: sending a beacon signal or beacon signal data with a universally unique identifier (UUID) from at least one beacon set on at least one machine; Wearing or holding a wireless signal receiver of an augmented reality (AR) device to receive the beacon signal or beacon signal data with the universal unique identifier sent by the beacon on the machine; A machine relative position output module calculates or produces the machine relative to the machine based on the beacon signal or beacon signal data with the universal unique identifier from the wireless signal receiver of the augmented reality device Location; a beacon signal positioning calculation module calculates the person’s current location based on the beacon signal or beacon signal data with the universally unique identifier and the relative position of the machine from the relative position output module of the machine The position or positioning position of the machine; and a machine positioning and machine data presentation module presents the person’s current position or positioning position and the machine’s data from the beacon signal positioning calculation module in the augmentation Real-world equipment; wherein, a positioning calculation and analysis unit of the beacon signal positioning calculation module is based on the position relationship weighted score algorithm, the position relationship between the nth machine and the first machine, the nth machine and the first machine The position relationship of the column of 1 machine calculates the position relationship weighted score, and n represents a positive integer greater than or equal to 2. A method for machine identification and positioning using augmented reality includes: sending a beacon signal or beacon signal data with a universally unique identifier (UUID) from at least one beacon set on at least one machine; A wireless signal receiver of an augmented reality (AR) device that is worn or hand-held receives the beacon signal or beacon signal data with the universal unique identifier sent by the beacon on the machine; by a machine The relative station position output module calculates or generates the relative station position of the station based on the beacon signal or beacon signal data with the universal unique identifier from the wireless signal receiver of the augmented reality device; A beacon signal positioning calculation module calculates the current location of the person based on the beacon signal or beacon signal data with the universal unique identifier and the relative position of the machine from the relative position output module of the machine Or positioning location; and a machine positioning and machine data presentation module presents the person’s current location or positioning location and the machine’s data from the beacon signal positioning calculation module in the augmented reality On the device; among them, the positioning calculation and analysis unit of the beacon signal positioning calculation module separately calculates the person according to the front position score algorithm, the rear position score algorithm, the left position score algorithm and the right position score algorithm Current position scores in front, back, left, and right. For example, the method described in item 17 of the scope of patent application further includes the position score positioning unit finding the position with the highest score among the front position score, rear position score, left position score, and right position score as the axis, and According to the ratio, locate the position of the person at the nearest machine 1.

Images