CN117528399A - Method for installing intelligent device and electronic device - Google Patents

Method for installing intelligent device and electronic device Download PDF

Info

Publication number
CN117528399A
CN117528399A CN202210904139.3A CN202210904139A CN117528399A CN 117528399 A CN117528399 A CN 117528399A CN 202210904139 A CN202210904139 A CN 202210904139A CN 117528399 A CN117528399 A CN 117528399A
Authority
CN
China
Prior art keywords
equipment
coordinate system
electronic device
determining
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210904139.3A
Other languages
Chinese (zh)
Inventor
潘锦玲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Huawei Technologies Co Ltd
Original Assignee
Huawei Technologies Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Huawei Technologies Co Ltd filed Critical Huawei Technologies Co Ltd
Priority to CN202210904139.3A priority Critical patent/CN117528399A/en
Priority to PCT/CN2023/108889 priority patent/WO2024022288A1/en
Publication of CN117528399A publication Critical patent/CN117528399A/en
Pending legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/023Services making use of location information using mutual or relative location information between multiple location based services [LBS] targets or of distance thresholds
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/02Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using radio waves
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01SRADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S5/00Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations
    • G01S5/16Position-fixing by co-ordinating two or more direction or position line determinations; Position-fixing by co-ordinating two or more distance determinations using electromagnetic waves other than radio waves
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72439User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/029Location-based management or tracking services
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/50Service provisioning or reconfiguring

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Electromagnetism (AREA)
  • Multimedia (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

The embodiment of the application provides a method for installing intelligent equipment and electronic equipment. The method comprises the following steps: determining a target coordinate system; determining the relative coordinates of equipment to be installed, wherein the relative coordinates of the equipment to be installed are coordinates in a target coordinate system; and displaying first installation information according to the relative coordinates of the equipment to be installed, wherein the first installation information is used for prompting a user to install the equipment to be installed. According to the method and the electronic device, the user can intuitively acquire the related information of the device to be installed from the user interface, intuitive installation guidance is provided for the user, and the user can conveniently install the corresponding intelligent device. Furthermore, the method and the electronic device display the second installation information by determining the network equipment which is located in the target coordinate system, the second installation information is used for prompting the user to test the network equipment, and the user can test the network equipment through the control in the second installation information, so that the working state of the network equipment can be conveniently determined.

Description

Method for installing intelligent device and electronic device
Technical Field
The embodiment of the application relates to the field of electronic equipment, in particular to a method for installing intelligent equipment and the electronic equipment.
Background
With the development of science and technology, users can choose to install intelligent devices at home to provide more convenient and faster services. The installation of the intelligent equipment and the debugging of the intelligent equipment after the installation are complicated and error-prone works. At present, a great deal of labor cost is required for installation and debugging of intelligent equipment.
Therefore, how to install the intelligent device conveniently and intuitively and efficiently complete the debugging work of the intelligent device is a problem to be solved at present.
Disclosure of Invention
The embodiment of the application provides a method for installing intelligent equipment and electronic equipment, and the method enables information for prompting installation and testing to be directly displayed on a user interface, so that the intelligent equipment is more convenient to install and test.
In a first aspect, a method for installing a smart device is provided, including: determining a target coordinate system; determining the relative coordinates of equipment to be installed, wherein the relative coordinates of the equipment to be installed are the coordinates in the target coordinate system; and displaying first installation information according to the relative coordinates of the equipment to be installed, wherein the first installation information is used for prompting a user to install the equipment to be installed.
It should be understood that the target coordinate system is the coordinate system in which the target space is located. The target space is a space where the smart device needs to be installed. The target coordinate system is aligned with the design coordinate system. The relative coordinates of the individual devices to be installed are marked in the design coordinate system. The relative coordinates of the device to be installed are coordinates in the target coordinate system.
In an embodiment of the application, a method for installing an intelligent device is provided. The user may determine the relative position of the device to be installed within the coordinate system via the electronic device and display the relevant information of the installation at the user interface. The user can intuitively acquire the installation information of the equipment to be installed, and the user can install the corresponding intelligent equipment conveniently.
With reference to the first aspect, in certain implementations of the first aspect, the determining the relative coordinates of the device to be installed includes: and determining the relative coordinates of the equipment to be installed when any coordinate in the target coordinate system corresponds to the calibration coordinate in the design coordinate system and when the distance between the position point corresponding to any coordinate in the target coordinate system and the design installation point on the reference plane of the target coordinate system is smaller than or equal to a preset threshold value.
The electronic device calculates the relative coordinates of the different position points within the current field of view, or the electronic device calculates the relative coordinates of the current position. When the calibration coordinates and the relative coordinates exist in the design coordinate system, and the distance between the position point corresponding to the relative coordinates and the design installation point on the reference plane is smaller than or equal to a preset threshold value, the position is required to be provided with equipment to be installed. The relative coordinates of the intelligent equipment to be installed are calibrated in the design coordinate system.
It should be appreciated that the specific value of the preset threshold may be determined based on the actual size of the target space. The larger the target space, the larger the preset threshold. For example, the accuracy of current enhanced display technology (augmented reality, AR) positioning technology may be on the order of 10cm, and the preset threshold may be set to 10cm as desired.
In the embodiment of the application, whether the design coordinate system has corresponding relative coordinates or not and whether the distance between the position point corresponding to the relative coordinates and the design installation point on the reference plane is within a certain error range or not are judged. It can be more accurately determined whether or not the corresponding device needs to be installed at the relative coordinates. In addition, any coordinate in the target coordinate system can be compared with the calibration coordinate in the design coordinate system in real time, and the efficiency of installing the intelligent equipment is improved.
With reference to the first aspect, in certain implementations of the first aspect, the determining the target coordinate system includes: calibrating a coordinate origin in response to a first operation of a user; and determining a target coordinate system according to the coordinate origin.
The user opens the camera of the electronic device, and when the camera scans the ground door spindle, the user clicks the calibration control to calibrate the ground door spindle to be the origin of coordinates and the coordinate system with the ground door spindle to be the origin of coordinates to be the target coordinate system.
In the embodiment of the application, the target coordinate system may be determined by an AR positioning technology. Because of the high accuracy of AR location technology, the technology can be run as a common application for electronic devices (e.g., smartphones). Therefore, the target coordinate system can be more accurately and conveniently determined by adopting the AR positioning technology.
With reference to the first aspect, in certain implementations of the first aspect, the determining the target coordinate system includes: acquiring position information of at least three base stations; and determining a target coordinate system according to the position information of the at least three base stations.
The electronic device determines the relative coordinates of the electronic device according to the position information of at least three base stations, and determines the coordinate system in which the electronic device is located as the target coordinate system according to the relative coordinates of the current position of the electronic device. At least three base stations, including but not limited to Ultra Wide Band (UWB) base stations, any base station capable of determining its own relative coordinates may fall within the scope of the present application, which is not limited thereto.
In the embodiment of the application, when the target space is larger, the deviation of positioning by adopting the AR technology is larger. Therefore, the base station positioning method can be adopted, and is more suitable for scenes with larger positioning space, and the positioning deviation is reduced as much as possible.
With reference to the first aspect, in certain implementations of the first aspect, the first installation information includes at least one of: the point position coordinates of the equipment to be installed, the relative coordinates of the equipment to be installed and the installation coordinates of the equipment to be installed.
With reference to the first aspect, in certain implementations of the first aspect, the first installation information further includes at least one of: the equipment identification of the equipment to be installed and the equipment image of the equipment to be installed.
In the embodiment of the application, when the electronic device determines that the device to be installed needs to be installed at the current position, information for prompting installation of the device to be installed can be displayed on a user interface. The user can determine the equipment to be installed, the specific installation position of the equipment to be installed or the network accessed by the equipment to be installed according to the related information visually displayed on the user interface, so that unnecessary workload of the user is reduced, and the accuracy of installing the intelligent equipment is improved.
With reference to the first aspect, in certain implementations of the first aspect, the method further includes: determining the distributed network equipment in the target coordinate system; and in response to the determination of the distributed network device, displaying the second installation information, wherein the second installation information is used for prompting a user to test the distributed network device.
With reference to the first aspect, in certain implementations of the first aspect, the second installation information includes a test control and test information, where the test information is used to prompt a user to perform a second operation on the test control to obtain an expected result.
It should be appreciated that the network-ready device and the device to be installed may be different stages of the same intelligent device, and the network-ready device may be considered as a device that has not yet been installed successfully (the device after the test is completed may be considered as a device that has been installed successfully). After the equipment to be installed is installed and the network distribution is successful, the user can directly control the intelligent equipment through the electronic equipment and test the intelligent equipment. When the network equipment and the equipment to be installed are the same equipment, the second installation information comprises the first installation information, a test control and test information. The test information is used for prompting a user to perform relevant tests on the distributed network equipment and then possible expected effects are achieved. The user can compare the expected effect displayed after clicking the test control with the actual test effect. The effect is consistent, and the network equipment can be normally used after passing the test. That is, the second installation information also provides an interaction mode for the user, and when the user clicks the control in the second installation information, the interaction between the user and the electronic device can be realized. The user determines the working state of the intelligent device through the interaction mode. The test control comprises, but is not limited to, a switch control, a gear adjustment control and a power adjustment control.
In the embodiment of the application, when the electronic device determines that the intelligent device which has completed installation and network distribution exists at the current position, information for prompting testing of the network-distributed device can be displayed on a user interface. The user can test, verify or debug the intelligent device according to the related information visually displayed on the user interface. Also, the user interface may display the expected effect after the test is performed. The user can compare the actual effect of the intelligent device after the test with the expected effect displayed by the user interface to determine whether the intelligent device can be used normally. The method is convenient for a user to realize direct test on the intelligent equipment through a user interface so as to ensure the working state of the intelligent equipment.
In a second aspect, there is provided an electronic device comprising: one or more processors; one or more memories; the one or more memories store one or more computer programs comprising instructions that, when executed by the one or more processors, cause the electronic device to: determining a target coordinate system; determining the relative coordinates of equipment to be installed, wherein the relative coordinates of the equipment to be installed are the coordinates in the target coordinate system; and displaying first installation information according to the relative coordinates of the equipment to be installed, wherein the first installation information is used for prompting a user to install the equipment to be installed.
With reference to the second aspect, in certain implementations of the second aspect, the determining the relative coordinates of the device to be installed, when the instructions are executed by the one or more processors, causes the electronic device to perform the steps of: and when any coordinate in the target coordinate system corresponds to the calibration coordinate in the design coordinate system and the distance between the position point corresponding to any coordinate in the target coordinate system and the design installation point on the reference plane of the target coordinate system is smaller than or equal to a preset threshold value, determining the relative coordinate of the equipment to be installed.
With reference to the second aspect, in certain implementations of the second aspect, the determining the target coordinate system, when the instructions are executed by the one or more processors, causes the electronic device to perform the steps of: calibrating a coordinate origin in response to a first operation of a user; and determining a target coordinate system according to the coordinate origin.
With reference to the second aspect, in certain implementations of the second aspect, the determining the target coordinate system, when the instructions are executed by the one or more processors, causes the electronic device to perform the steps of: acquiring position information of at least three base stations; and determining a target coordinate system according to the position information of the at least three base stations.
With reference to the second aspect, in certain implementations of the second aspect, the first installation information includes at least one of: the point position coordinates of the equipment to be installed, the relative coordinates of the equipment to be installed and the installation coordinates of the equipment to be installed.
With reference to the second aspect, in certain implementations of the second aspect, the first installation information further includes at least one of: the equipment identification of the equipment to be installed and the equipment image of the equipment to be installed.
With reference to the second aspect, in certain implementations of the second aspect, the instructions, when executed by the one or more processors, cause the electronic device to perform the steps of: determining the distributed network equipment in the target coordinate system; and in response to the determination of the distributed network device, displaying the second installation information, wherein the second installation information is used for prompting a user to test the distributed network device.
With reference to the second aspect, in some implementations of the second aspect, the second installation information includes a test control and test information, where the test information is used to prompt a user to perform a second operation on the test control to obtain an expected result.
In a third aspect, there is provided a communication apparatus comprising: a processor coupled with a memory for storing a computer program for running the computer program to cause the communication device to perform the method as in the first aspect and any one of its possible implementations described above.
With reference to the third aspect, in certain implementations of the third aspect, the communication device further includes one or more of the memory and a transceiver for receiving signals and/or transmitting signals.
In a fourth aspect, there is provided a computer readable storage medium comprising a computer program or instructions which, when run on a computer, cause the method as in the first aspect and any one of its possible implementations to be performed.
In a fifth aspect, a computer program product is provided, characterized in that the computer program product comprises a computer program or instructions which, when run on a computer, cause the method as in the first aspect and any one of its possible implementations to be performed.
In a sixth aspect, there is provided a computer program which, when run on a computer, causes the method as in the first aspect and any one of its possible implementations to be performed.
Drawings
Fig. 1 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Fig. 2 is a software structural block diagram of an electronic device provided in an embodiment of the present application.
Fig. 3 is a schematic diagram of an application scenario of a method for installing an intelligent device according to an embodiment of the present application.
Fig. 4 is a system architecture diagram of a method for installing a smart device according to an embodiment of the present application.
Fig. 5 is a schematic diagram of relative coordinate positioning of an intelligent device according to an embodiment of the present application.
Fig. 6 is a schematic flow chart of a method for installing an intelligent device according to an embodiment of the present application.
Fig. 7 is a schematic diagram of calculating a point-to-surface distance according to an embodiment of the present application.
Fig. 8 is a schematic diagram of another relative coordinate positioning of a smart device according to an embodiment of the present application.
Fig. 9 is a schematic flow chart of another method for installing a smart device according to an embodiment of the present application.
Fig. 10 is a schematic view of a display effect of a method for installing an intelligent device according to an embodiment of the present application.
Fig. 11 is a schematic flow chart of a method for installing an intelligent device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.
The terminology used in the following embodiments is for the purpose of describing particular embodiments only and is not intended to be limiting of the application. As used in the specification and the appended claims, the singular forms "a," "an," "the," and "the" are intended to include, for example, "one or more" such forms of expression, unless the context clearly indicates to the contrary. It should also be understood that in the various embodiments herein below, "at least one", "one or more" means one, two or more than two. The term "and/or" is used to describe an association relationship of associated objects, meaning that there may be three relationships; for example, a and/or B may represent: a alone, a and B together, and B alone, wherein A, B may be singular or plural. The character "/" generally indicates that the context-dependent object is an "or" relationship.
Reference in the specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure, or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Thus, appearances of the phrases "in one embodiment," "in some embodiments," "in other embodiments," and the like in the specification are not necessarily all referring to the same embodiment, but mean "one or more but not all embodiments" unless expressly specified otherwise. The terms "comprising," "including," "having," and variations thereof mean "including but not limited to," unless expressly specified otherwise.
An electronic device, a user interface for such an electronic device, and a method of operating such an electronic device are described below,And embodiments for using such electronic devices. In some embodiments, the electronic device may be a portable electronic device such as a cell phone, tablet computer, wearable electronic device (e.g., smart watch) with wireless communication capabilities, etc., that also includes other functionality such as personal digital assistant and/or music player functionality. Exemplary embodiments of portable electronic devices include, but are not limited to, piggy-back Or other operating system. The portable electronic device may also be other portable electronic devices such as a Laptop computer (Laptop) or the like. It should also be appreciated that in other embodiments, the electronic device described above may not be a portable electronic device, but rather a desktop computer.
By way of example, fig. 1 shows a schematic diagram of an electronic device 100. The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (universal serial bus, USB) interface 130, a charge management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, keys 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identity (subscriber identification module, SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, and the like.
It is to be understood that the structure illustrated in the embodiments of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, electronic device 100 may include more or fewer components than shown, or certain components may be combined, or certain components may be split, or different arrangements of components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.
The processor 110 may include one or more processing units, such as: the processor 110 may include an application processor (application processor, AP), a modem processor, a graphics processor (graphics processing unit, GPU), an image signal processor (image signal processor, ISP), a controller, a memory, a video codec, a digital signal processor (digital signal processor, DSP), a baseband processor, and/or a neural network processor (neural-network processing unit, NPU), etc. Wherein the different processing units may be separate devices or may be integrated in one or more processors.
The controller may be a neural hub and a command center of the electronic device 100, among others. The controller can generate operation control signals according to the instruction operation codes and the time sequence signals to finish the control of instruction fetching and instruction execution.
A memory may also be provided in the processor 110 for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may hold instructions or data that the processor 110 has just used or recycled. If the processor 110 needs to reuse the instruction or data, it can be called directly from the memory. Repeated accesses are avoided and the latency of the processor 110 is reduced, thereby improving the efficiency of the system.
In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an integrated circuit (inter-integrated circuit, I2C) interface, an integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, a pulse code modulation (pulse code modulation, PCM) interface, a universal asynchronous receiver transmitter (universal asynchronous receiver/transmitter, UART) interface, a mobile industry processor interface (mobile industry processor interface, MIPI), a general-purpose input/output (GPIO) interface, a subscriber identity module (subscriber identity module, SIM) interface, and/or a universal serial bus (universal serial bus, USB) interface, among others.
The wireless communication function of the electronic device 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, a modem processor, a baseband processor, and the like.
The antennas 1 and 2 are used for transmitting and receiving electromagnetic wave signals. Each antenna in the electronic device 100 may be used to cover a single or multiple communication bands. Different antennas may also be multiplexed to improve the utilization of the antennas. For example: the antenna 1 may be multiplexed into a diversity antenna of a wireless local area network. In other embodiments, the antenna may be used in conjunction with a tuning switch.
The mobile communication module 150 may provide a solution for wireless communication including 2G/3G/4G/5G, etc., applied to the electronic device 100. The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (low noise amplifier, LNA), etc. The mobile communication module 150 may receive electromagnetic waves from the antenna 1, perform processes such as filtering, amplifying, and the like on the received electromagnetic waves, and transmit the processed electromagnetic waves to the modem processor for demodulation. The mobile communication module 150 can amplify the signal modulated by the modem processor, and convert the signal into electromagnetic waves through the antenna 1 to radiate. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be disposed in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 may be provided in the same device as at least some of the modules of the processor 110.
The modem processor may include a modulator and a demodulator. The modulator is used for modulating the low-frequency baseband signal to be transmitted into a medium-high frequency signal. The demodulator is used for demodulating the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and then transferred to the application processor. The application processor outputs sound signals through an audio device (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or video through the display screen 194. In some embodiments, the modem processor may be a stand-alone device. In other embodiments, the modem processor may be provided in the same device as the mobile communication module 150 or other functional module, independent of the processor 110.
The wireless communication module 160 may provide solutions for wireless communication including wireless local area network (wireless local area networks, WLAN) (e.g., wireless fidelity (wireless fidelity, wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field wireless communication technology (near field communication, NFC), infrared technology (IR), etc., as applied to the electronic device 100. The wireless communication module 160 may be one or more devices that integrate at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the electromagnetic wave signals, filters the electromagnetic wave signals, and transmits the processed signals to the processor 110. The wireless communication module 160 may also receive a signal to be transmitted from the processor 110, frequency modulate it, amplify it, and convert it to electromagnetic waves for radiation via the antenna 2.
In some embodiments, antenna 1 and mobile communication module 150 of electronic device 100 are coupled, and antenna 2 and wireless communication module 160 are coupled, such that electronic device 100 may communicate with a network and other devices through wireless communication techniques. The wireless communication techniques may include the Global System for Mobile communications (global system for mobile communications, GSM), general packet radio service (general packet radio service, GPRS), code division multiple access (code division multiple access, CDMA), wideband code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), BT, GNSS, WLAN, NFC, FM, and/or IR techniques, among others. The GNSS may include a global satellite positioning system (global positioning system, GPS), a global navigation satellite system (global navigation satellite system, GLONASS), a beidou satellite navigation system (beidou navigation satellite system, BDS), a quasi zenith satellite system (quasi-zenith satellite system, QZSS) and/or a satellite based augmentation system (satellite based augmentation systems, SBAS).
The electronic device 100 implements display functions through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or change display information.
The display screen 194 is used to display images, videos, and the like. The display 194 includes a display panel. The display panel may employ a liquid crystal display (liquid crystal display, LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode (AMOLED) or an active-matrix organic light-emitting diode (matrix organic light emitting diode), a flexible light-emitting diode (flex), a mini, a Micro led, a Micro-OLED, a quantum dot light-emitting diode (quantum dot light emitting diodes, QLED), or the like. In some embodiments, the electronic device 100 may include 1 or N display screens 194, N being a positive integer greater than 1.
The electronic device 100 may implement photographing functions through an ISP, a camera 193, a video codec, a GPU, a display screen 194, an application processor, and the like.
The ISP is used to process data fed back by the camera 193. For example, when photographing, the shutter is opened, light is transmitted to the camera photosensitive element through the lens, the optical signal is converted into an electric signal, and the camera photosensitive element transmits the electric signal to the ISP for processing and is converted into an image visible to naked eyes. ISP can also optimize the noise, brightness and skin color of the image. The ISP can also optimize parameters such as exposure, color temperature and the like of a shooting scene. In some embodiments, the ISP may be provided in the camera 193.
The camera 193 is used to capture still images or video. The object generates an optical image through the lens and projects the optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (charge coupled device, CCD) or a Complementary Metal Oxide Semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, which is then transferred to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV, or the like format. In some embodiments, electronic device 100 may include 1 or N cameras 193, N being a positive integer greater than 1.
The digital signal processor is used for processing digital signals, and can process other digital signals besides digital image signals. For example, when the electronic device 100 selects a frequency bin, the digital signal processor is used to fourier transform the frequency bin energy, or the like.
Video codecs are used to compress or decompress digital video. The electronic device 100 may support one or more video codecs. In this way, the electronic device 100 may play or record video in a variety of encoding formats, such as: dynamic picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, etc.
The NPU is a neural-network (NN) computing processor, and can rapidly process input information by referencing a biological neural network structure, for example, referencing a transmission mode between human brain neurons, and can also continuously perform self-learning. Applications such as intelligent awareness of the electronic device 100 may be implemented through the NPU, for example: image recognition, face recognition, speech recognition, text understanding, etc.
The external memory interface 120 may be used to connect an external memory card, such as a Micro SD card, to enable expansion of the memory capabilities of the electronic device 100. The external memory card communicates with the processor 110 through an external memory interface 120 to implement data storage functions. For example, files such as music, video, etc. are stored in an external memory card.
The internal memory 121 may be used to store computer executable program code including instructions. The processor 110 executes various functional applications of the electronic device 100 and data processing by executing instructions stored in the internal memory 121. The internal memory 121 may include a storage program area and a storage data area. The storage program area may store an application program (such as a sound playing function, an image playing function, etc.) required for at least one function of the operating system, etc. The storage data area may store data created during use of the electronic device 100 (e.g., audio data, phonebook, etc.), and so on. In addition, the internal memory 121 may include a high-speed random access memory, and may further include a nonvolatile memory such as at least one magnetic disk storage device, a flash memory device, a universal flash memory (universal flash storage, UFS), and the like.
The electronic device 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playing, recording, etc.
The audio module 170 is used to convert digital audio information into an analog audio signal output and also to convert an analog audio input into a digital audio signal. The audio module 170 may also be used to encode and decode audio signals. In some embodiments, the audio module 170 may be disposed in the processor 110, or a portion of the functional modules of the audio module 170 may be disposed in the processor 110.
The speaker 170A, also referred to as a "horn," is used to convert audio electrical signals into sound signals. The electronic device 100 may listen to music, or to hands-free conversations, through the speaker 170A.
A receiver 170B, also referred to as a "earpiece", is used to convert the audio electrical signal into a sound signal. When electronic device 100 is answering a telephone call or voice message, voice may be received by placing receiver 170B in close proximity to the human ear.
Microphone 170C, also referred to as a "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or transmitting voice information, the user can sound near the microphone 170C through the mouth, inputting a sound signal to the microphone 170C. The electronic device 100 may be provided with at least one microphone 170C. In other embodiments, the electronic device 100 may be provided with two microphones 170C, and may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the electronic device 100 may also be provided with three, four, or more microphones 170C to enable collection of sound signals, noise reduction, identification of sound sources, directional recording functions, etc.
The pressure sensor 180A is used to sense a pressure signal, and may convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A may be disposed on the display screen 194. The pressure sensor 180A is of various types, such as a resistive pressure sensor, an inductive pressure sensor, a capacitive pressure sensor, and the like. The capacitive pressure sensor may be a capacitive pressure sensor comprising at least two parallel plates with conductive material. The capacitance between the electrodes changes when a force is applied to the pressure sensor 180A. The electronic device 100 determines the strength of the pressure from the change in capacitance. When a touch operation is applied to the display screen 194, the electronic apparatus 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 may also calculate the location of the touch based on the detection signal of the pressure sensor 180A. In some embodiments, touch operations that act on the same touch location, but at different touch operation strengths, may correspond to different operation instructions. For example, when a touch operation with a touch operation intensity greater than or equal to a first pressure threshold acts on the alarm clock application icon, an instruction to newly create an alarm clock is executed.
The fingerprint sensor 180H is used to collect a fingerprint. The electronic device 100 may utilize the collected fingerprint feature to unlock the fingerprint, access the application lock, photograph the fingerprint, answer the incoming call, etc. For example, when the mobile phone detects a touch operation of a user on the screen locking interface, the mobile phone can collect fingerprint information of the user through the fingerprint sensor 180H and match the collected fingerprint information with fingerprint information preset in the mobile phone. If the matching is successful, the mobile phone can enter the non-screen locking interface from the screen locking interface.
The touch sensor 180K, also referred to as a "touch panel". The touch sensor 180K may be disposed on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, which is also called a "touch screen". The touch sensor 180K is for detecting a touch operation acting thereon or thereabout. The touch sensor may communicate the detected touch operation to the application processor to determine the touch event type. Visual output related to touch operations may be provided through the display 194. In other embodiments, the touch sensor 180K may also be disposed on the surface of the electronic device 100 at a different location than the display 194.
Fig. 2 is a software configuration block diagram of the electronic device 100 according to the embodiment of the present application. The layered architecture divides the software into several layers, each with distinct roles and branches. The layers communicate with each other through a software interface. In some embodiments, the Android system is divided into four layers, from top to bottom, an application layer, an application framework layer, an Zhuoyun row (Android run) and system libraries, and a kernel layer, respectively. The application layer may include a series of application packages.
As shown in fig. 2, the application layer may include a camera, settings, skin modules, user Interfaces (UIs), three-way applications, and the like. The three-party application program can comprise a gallery, calendar, conversation, map, navigation, WLAN, bluetooth, music, video, short message, and the like.
The application framework layer provides an application programming interface (application programming interface, API) and programming framework for application programs of the application layer. The application framework layer may include some predefined functions.
As shown in FIG. 2, the application framework layer may include a window manager, a content provider, a view system, a telephony manager, a resource manager, a notification manager, and the like.
The window manager is used for managing window programs. The window manager can acquire the size of the display screen, judge whether a status bar exists, lock the screen, intercept the screen and the like. The content provider is used to store and retrieve data and make such data accessible to applications. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phonebooks, etc.
The view system comprises visual controls, such as controls for displaying characters, controls for displaying pictures, and the like, such as indication information for prompting a virtual shutter key in the embodiment of the application. The view system may be used to build applications. The display interface may be composed of one or more views. For example, a display interface including a text message notification icon may include a view displaying text and a view displaying a picture.
The telephony manager is used to provide the communication functions of the electronic device 100. Such as the management of call status (including on, hung-up, etc.).
The resource manager provides various resources for the application program, such as localization strings, icons, pictures, layout files, video files, and the like.
The notification manager allows the application to display notification information in a status bar, can be used to communicate notification type messages, can automatically disappear after a short dwell, and does not require user interaction. Such as notification manager is used to inform that the download is complete, message alerts, etc. The notification manager may also be a notification in the form of a chart or scroll bar text that appears on the system top status bar, such as a notification of a background running application, or a notification that appears on the screen in the form of a dialog window. For example, a text message is prompted in a status bar, a prompt tone is emitted, the electronic device vibrates, and an indicator light blinks, etc.
Android runtimes include core libraries and virtual machines. Android run time is responsible for scheduling and management of the Android system.
The core library consists of two parts: one part is a function which needs to be called by java language, and the other part is a core library of android.
The application layer and the application framework layer run in a virtual machine. The virtual machine executes java files of the application program layer and the application program framework layer as binary files. The virtual machine is used for executing the functions of object life cycle management, stack management, thread management, security and exception management, garbage collection and the like.
The system library may include a plurality of functional modules. For example: surface manager (surface manager), media library (media library), three-dimensional graphics processing library (e.g., openGL ES), 2D graphics engine (e.g., SGL), etc.
The surface manager is used to manage the display subsystem and provides a fusion of 2D and 3D layers for multiple applications.
Media libraries support a variety of commonly used audio, video format playback and recording, still image files, and the like. The media library may support a variety of audio and video encoding formats, such as MPEG4, h.264, MP3, AAC, AMR, JPG, PNG, etc.
The three-dimensional graphic processing library is used for realizing three-dimensional graphic drawing, image rendering, synthesis, layer processing and the like.
The 2D graphics engine is a drawing engine for 2D drawing.
In addition, the system library can also comprise a state monitoring service module and the like, such as a physical state recognition module, which is used for analyzing and recognizing gestures of a user; the sensor service module is configured to monitor sensor data uploaded by various sensors in the hardware layer, and determine a physical state of the electronic device 100.
The kernel layer is a layer between hardware and software. The inner core layer at least comprises a display driver, a camera driver, an audio driver and a sensor driver.
The hardware layer may include various sensors, such as the various sensors described in fig. 1, acceleration sensors, gyroscopic sensors, touch sensors, etc. referred to in embodiments of the present application.
In connection with the electronic device described in fig. 1 and fig. 2, in the embodiment of the present application, the physical devices involved in the electronic device 100 mainly include hardware components such as a sensor, a decision support system (decision support systems, DSS) display chip, a touch display screen, a fingerprint recognition module, and the like; the screen management module, the display driver, the fingerprint driver, the false touch prevention and other kernel software layers; anti-false touch input, screen control, off-screen display (always on display, AOD) service, power management, etc. application framework layer functions; application layer services such as special adaptation application (camera), three-party application, system dormancy, AOD and the like.
With the development of science and technology, more and more users choose to install intelligent devices in their home to provide a better quality home life experience, and more manufacturers choose to install intelligent devices in industry, such as intelligent sensors in mine holes for detecting various air quality parameters in mine holes. In the following, a smart device in a home is taken as an example when introducing the present application. The intelligent equipment in the home can connect various equipment (such as audio and video equipment, lighting equipment, curtain equipment, air conditioning equipment, indoor and outdoor remote control equipment and the like) together through the internet of things technology, and provide various functional services for users. Currently, the installation information of the intelligent device is mainly recorded in the description text of the table. The engineer determines specific installation positions, function types, loops and the like of the intelligent equipment through the installation information recorded in the table (for example, table 1 below), the specific installation process is complicated, and the accuracy is low. Moreover, the workload of engineers on the intelligent equipment test after installation is large, and the accuracy is not high. Therefore, in view of the above technical problems, the embodiments of the present application provide a method for installing an intelligent device, which is convenient for an engineer to confirm installation information of the intelligent device and to perform accurate and efficient installation work on the intelligent device.
Table 1 smart device installation information
Sequence number Room Name of the name Label (Label) Device type Label classification
1 Parlor (living room) Wall surface spot lamp 1 t:3;s:1 Tube spotlight Wall surface with key illumination
2 Restaurant Foundation spotlight t:3;s:2 Tube spotlight Important lighting table top
As shown in fig. 3, a scenario in which the method for installing an intelligent device provided in the embodiment of the present application is applied is shown. By way of example, a home scenario may be where a smart device is installed. The smart device may be, among other things, a smart screen 310, a sound 320, a projector 330, a router 340, etc. in the home scenario shown in fig. 3. The engineer (user) can directly obtain the specific installation position and configuration parameters of each intelligent device through a user interface, and complete the work of installation, power-on, configuration, test and the like for each intelligent device.
Fig. 4 shows a system architecture diagram to which the method for installing an intelligent device according to the embodiment of the present application is applicable. It should be understood that some of the modules in the system architecture diagram may be carried in the electronic device. The system architecture includes, but is not limited to, an engine module 401, a space design module 402, a device cloud 403, a device location matching module 404, and a configured network device management module 405. The functions of the respective modules are specifically described below.
An engine module 401. For acquiring a target space, or a target space coordinate system. The target space or target space coordinate system may be a space or space coordinate system where the smart device is to be installed. For example, the engine module may be an enhanced display technology (augmented reality, AR) engine module that may determine the target space or a coordinate system of the target space based on a coordinate origin calibrated by the electronic device and video frame data acquired by an image capture device of the electronic device.
A spatial design module 402. The module may store a list of devices to be installed (list of identifications of devices to be installed), and a list of coordinates of devices to be installed (including relative coordinates of the target space coordinate system, point coordinates, installation coordinates).
Device cloud 403. A list of allocated network devices (an identification list of allocated network devices) and a coordinate list of allocated network devices (including relative coordinates and point coordinates of a target space coordinate system) are stored.
The device location matching module 404. The module can be used for matching the position of the equipment to be installed and determining the specific installation information of the equipment to be installed. For example, when specific installation information of the device to be installed is determined, an installation guide floating window may be displayed in the user interface. The installation guide floating window can display specific installation information of equipment to be installed, wherein the specific installation information comprises product details of the equipment to be installed, images of the equipment to be installed, installation coordinates of the equipment to be installed, point position coordinates of the equipment to be installed and relative coordinates of the equipment to be installed.
The configured network device management module 405. The module can be used for managing equipment which is already installed and successfully distributed with the network. For example, the module may cause the user interface to display control floating windows. The control floating window can display state information of the network equipment. The state information of the configured network device includes: product details of the distributed network equipment, images of the distributed network equipment, installation coordinates of the distributed network equipment, point location coordinates of the distributed network equipment, relative coordinates of the distributed network equipment, test control of the distributed network equipment and test information of the distributed network equipment.
In the following, AR technology positioning is taken as an example. The embodiment of the application provides a method for installing intelligent equipment. It should be understood that, the method for determining the position in the present application includes, but is not limited to, AR technology, any method capable of determining the positional relationship of the device to be installed is within the scope of the present application, for example, the present application may also determine the relative coordinates of the electronic device by using methods such as ultrasonic positioning, laser radar positioning, and the like. As shown in fig. 5, a schematic diagram of the relative coordinate positioning of a smart device is shown. In the space shown in fig. 5, a plurality of rooms (restaurants, living rooms, bedrooms) are included, each room having a different room identification (roomID). The space is a target space, and the coordinate system where the space is located is a target coordinate system. The position of the device to be installed in the target coordinate system may be expressed as relative coordinates (ar point location). The point coordinates of the device to be installed may be used to represent a specific installation location of the device. A mounting point (reference point) of the device to be mounted may be used to represent a reference location, such as a wall surface, corner, etc., in the vicinity of the device. The mounting coordinates (relation location) of the device to be mounted may be used to indicate the specific positional relationship of the device relative to the mounting point, for example, the device to be mounted is at a horizontal distance of 50 cm from the wall surface.
Illustratively, the engineer carries electronics that support AR positioning. In the space shown in fig. 5, the ground door axis of the restaurant is first calibrated to the origin of coordinates (x 0, y0, z 0), and a coordinate system is established in the current target space, i.e., the target coordinate system, such that the target coordinate system is aligned with the design coordinate system in which the relative coordinates of the respective devices to be installed are marked. Subsequently, the engineer moves the electronic apparatus so that the image pickup device of the electronic apparatus scans the current space. While the electronic device is scanning, the AR engine module in the electronic device continuously calculates the relative coordinates of each location point within the field of view. In one aspect, when the relative coordinates of the device to be installed appear in the visual field of the electronic device, the window is displayed on the user interface of the electronic device, and the window can display information for prompting the user to install the device to be installed at the corresponding position of the relative coordinates. For example, when the electronic device scans the relative coordinates (x 1, y1, z 1) of the device to be installed in the living room (room identification 2), the information displayed in the user interface includes: room identification, relative coordinates, point location coordinates, mounting points, and mounting coordinates. The engineer can install the corresponding equipment to be installed according to the information displayed by the user interface. On the other hand, when the network-connected device appears in the field of view of the electronic device (that is, the original device to be installed is already installed and network connection is successful at this time), the user interface of the electronic device displays a window, which can display information about testing the network-connected device in addition to information about installation. E.g. test control, test information. The engineer may perform a smoke test on the devices of the distributed network based on the displayed information about the test.
AR engines can continually improve understanding of real world environments through feature points and planes. The AR engine makes these surfaces serve as planes by finding clustered feature points that lie on a common horizontal surface (e.g., a table). The AR engine may also determine the boundaries of each plane and provide this information to the corresponding application. The user can place the object on a flat surface based on this information.
As shown in fig. 6, a method 600 for installing a smart device is shown provided in an embodiment of the present application. The following is a detailed description taking AR technology positioning as an example.
S601, calibrating a coordinate origin, and determining a coordinate system.
It will be appreciated that various objects within the current field of view are displayed on the user interface of the electronic device by the camera device of the electronic device. The ground door axis can be calibrated as the origin of coordinates, and a coordinate system is established in the target space, which is aligned with the design coordinate system. The user interface may display a calibration control, and when a ground door spindle appears in the field of view of the electronic device, the user (engineer) clicks the calibration space, so that an operation of calibrating the ground door spindle as the origin of coordinates may be implemented.
S602, calculating relative coordinates in the visual field range.
It should be appreciated that the camera of the electronic device continues to scan the target space and the AR engine module calculates the relative coordinates of each location point within the field of view of the electronic device in real time. That is, the camera of the electronic device is continuously on starting from the calibrated origin of coordinates. The electronic equipment continuously calculates the relative coordinates of different position points in the current field of view while continuously moving.
S603, determining relative coordinates of the equipment to be installed.
In some possible implementations, when the electronic device determines that there is a relative coordinate of the device to be installed within the field of view, the user may install a corresponding smart device at the location of the relative coordinate.
For example, the corresponding intelligent device is installed at a position where some relative coordinates are marked in the design coordinate system. The relative coordinates (1, 1) appear in the field of view of the electronic device, which compares them with the calibrated relative coordinates in the design coordinate system. The intelligent screen needs to be installed at the position corresponding to the relative coordinates (1, 1) in the design coordinate system, and the electronic equipment further calculates the distance between the position point corresponding to the (1, 1) and the design installation point on the reference plane. Due to the features of AR positioning technology, a reference plane may exist in the field of view of the electronic device, and AR positioning has a certain error. When the distance between the location point and the design mounting point on the reference plane is less than or equal to a certain threshold value, then the location point can be considered to fall on the target plane. Wherein the thresholds of different sizes of target spaces are different, and the specific threshold can be determined according to the actual space size.
For ease of understanding, fig. 7 shows a schematic diagram of the point-to-face distance calculation. The distance from point P to the plane in which point O lies can be determined according to the following equation:
and calculating according to the formula to obtain the concrete |PO| of the plane from the point P to the point O, and when |PO| < Deltad, considering that the point P falls on the plane of the point O, namely, the intelligent equipment corresponding to the position of the point P falls on the plane of the point O.
S604, determining the network equipment.
In other possible implementations, the smart device is already installed and the distribution network is successful. When the electronic equipment determines that the network equipment is distributed in the visual field range, a user can perform testing, verification and other operations on the equipment. The specific method for determining the configured network device is similar to that of the device to be installed in step S603, and will not be described herein.
S605 displays the first installation information.
It should be appreciated that the first installation information is displayed when the electronic device determines that there are relative coordinates of the device to be installed within the field of view. The first installation information is used for prompting a user to install equipment to be installed. The first installation information comprises an equipment identifier of equipment to be installed, point position coordinates of the equipment to be installed, an equipment image of the equipment to be installed, relative coordinates of the equipment to be installed and installation coordinates of the equipment to be installed, wherein a user can intuitively determine the specific equipment to be installed according to the equipment image of the equipment to be installed.
S606, displaying the second installation information.
It should be appreciated that the second installation information is displayed when the electronic device determines that the network device already configured exists within the field of view. The second installation information is used for prompting a user to execute a smoking test on the network matched equipment. The second installation information may include the first installation information, the test control, or the test information. The user can execute corresponding test on the distributed network equipment by clicking the test control. After the user clicks the test control, test information may be displayed, where the test information is used to prompt the user for an expected effect after testing the configured network device.
The embodiment of the application provides a method for installing intelligent equipment. The user may determine the relative position of the device to be installed within the coordinate system via the electronic device and display the relevant information of the installation at the user interface. The user can intuitively acquire the installation information of the equipment to be installed, and the user can install the corresponding intelligent equipment conveniently. Furthermore, after the intelligent equipment is installed and distributed with the network, the user can intuitively acquire the test information of the intelligent equipment, and the operation of testing, maintaining, verifying and the like of the intelligent equipment by the user is facilitated, so that the intelligent equipment can work normally.
When the target space is large, the deviation is large when positioning by AR technology. Thus, as shown in fig. 8, another schematic diagram of relative coordinate positioning of a smart device is provided in an embodiment of the present application. For example, 3 Ultra Wide Band (UWB) base stations are installed indoors, electronic devices carried by engineers are mobile phones, and ultra wide band tags are bound to a mobile phone backboard. The 3 UWB base stations send their relative coordinates to the mobile phone, and the mobile phone determines the relative coordinates of itself in the coordinate system according to the relative coordinates of the 3 base stations. The number of the base stations may be 3 or more. After the relative coordinates of the mobile phone are determined, the user can obtain the relative coordinates of different positions of the mobile phone in the coordinate system by moving the mobile phone. When the current relative coordinates of the mobile phone are the relative coordinates of the equipment to be installed, the user interface displays information for prompting the user to install the corresponding equipment to be installed. When the network equipment is distributed at the position corresponding to the current relative coordinates of the mobile phone, the user interface displays information for prompting the user to test the corresponding network equipment.
It should be understood that the manner of determining the relative coordinates of the electronic device in the coordinate system according to the relative coordinates of the three base stations is only an example, the method for determining the relative coordinates of the electronic device is not limited in this application, and any method capable of determining the relative coordinates of the electronic device falls within the scope of protection of this application, for example, the present application may also determine the relative coordinates of the electronic device by using methods such as ultrasonic positioning, laser radar positioning, and the like.
As shown in fig. 9, a method 900 for installing a smart device according to an embodiment of the present application is shown. The following will describe in detail an example of positioning according to the relative coordinates of the base stations.
S901, determining a coordinate system.
It should be understood that, base stations with more than 3 base stations are arranged in the target space, the electronic device receives the relative coordinates of the base stations with more than 3 base stations, and determines the relative coordinates of the electronic device according to the relative coordinates of the base stations, so as to determine the coordinate system where the target space is located.
In step S901, compared with step S601, the method for determining the coordinate system in step S901 does not need to calibrate the origin of coordinates in advance, and the coordinate system can be determined according to the relative coordinates of more than 3 base stations.
S902, calculating the relative coordinates of the position.
It will be appreciated that the user moves the electronic device and the electronic device continually calculates the relative coordinates of the current location. Unlike step S602, in step S902, the electronic device can determine the relative coordinates only from the current location. That is, each time the electronic device moves, only the relative coordinates of the current location can be determined. In step S602, the electronic device may determine the relative coordinates of a plurality of positions within the current field of view.
S903, determining the relative coordinates of the device to be installed.
S904, determining the network equipment.
Step S903 and step S904 are similar to step S603 and step S604 described above, and are not repeated here.
S905, first installation information is displayed.
S906, second installation information is displayed.
Step S905 and step S906 are similar to step S605 and step S606 described above, and are not repeated here.
The embodiment of the application provides a method for installing intelligent equipment. The user may determine the relative position of the device to be installed within the coordinate system via the electronic device and display the relevant information of the installation at the user interface. The user can intuitively acquire the installation information of the equipment to be installed, and the user can install the corresponding intelligent equipment conveniently. Furthermore, after the intelligent equipment is installed and distributed with the network, the user can intuitively acquire the test information of the intelligent equipment, and the operation of testing, maintaining, verifying and the like of the intelligent equipment by the user is facilitated, so that the intelligent equipment can work normally.
For ease of understanding, fig. 10 shows a schematic diagram of a display effect of a method of installing a smart device. When determining the relative coordinates of the device to be installed, the user interface may display a window as shown in (a) of fig. 10. When it is determined that the network device has been provisioned, the user interface may display a window as shown in (b) of fig. 10.
In one implementation, when the electronic device determines that there is a relative coordinate of the device to be installed in the current field of view, or when the relative coordinate of the current location of the electronic device is the relative coordinate of the device to be installed, information for prompting the user to install the device to be installed is displayed on the user interface. It should be appreciated that this information may be displayed through a window. The information may include, among others, a name of the device to be installed (spotlight), a model of the device to be installed (BL 2002R), point coordinates of the device to be installed (t: 3; s: 1), relative coordinates of the device to be installed (x 1, y1, z 1), mounting points of the device to be installed (living room angle), mounting coordinates of the device to be installed (l, w, h), and an image of the device to be installed (spotlight image).
In another implementation, when the electronic device determines that the network-allocated device exists in the current field of view, or when the network-allocated device exists in the current location of the electronic device, information that prompts the user to test the network-allocated device is displayed on the user interface. The information can also comprise a test control besides the information for prompting the user to install the equipment to be installed. When the user clicks the test control, the expected effect after clicking the test control may be displayed, for example, when the user clicks the test control, a "click button" may be displayed, and the lamp is turned on; clicking again, the light off information. The user can be according to whether the shot-light shows the expected effect and confirm whether the shot-light passes the test to show that the shot-light can normal work.
Fig. 11 illustrates a method 1100 for installing a smart device according to an embodiment of the present application. The method can be applied in a framework as shown in fig. 4. The method 1100 is described in detail below.
S1101, determining a target coordinate system.
It should be appreciated that the target coordinate system is aligned with the design coordinate system. The relative coordinates of the individual devices to be installed are marked in the design coordinate system.
In some embodiments, calibrating the origin of coordinates in response to a first operation by a user; and determining a target coordinate system according to the coordinate origin.
The user opens the camera of the electronic device, and when the camera scans the ground door spindle, the user clicks the calibration control to calibrate the ground door spindle to be the origin of coordinates and the coordinate system with the ground door spindle to be the origin of coordinates to be the target coordinate system.
In some embodiments, location information of at least three base stations is obtained; and determining a target coordinate system according to the position information of at least three base stations.
The electronic device determines the relative coordinates of the electronic device according to the position information of at least three base stations, and determines the coordinate system in which the electronic device is located as the target coordinate system according to the relative coordinates of the current position of the electronic device.
S1102, determining the relative coordinates of the device to be installed.
It should be understood that the relative coordinates of the device to be installed are coordinates in the target coordinate system.
In some embodiments, when any one of the coordinates in the target coordinate system corresponds to a calibration coordinate in the design coordinate system, and a distance between a location point corresponding to any one of the coordinates in the target coordinate system and the design mounting point on the reference plane of the target coordinate system is less than or equal to a preset threshold, the relative coordinates of the device to be mounted are determined.
The electronic device calculates the relative coordinates of the different position points within the current field of view, or the electronic device calculates the relative coordinates of the current position. When the calibration coordinates and the relative coordinates exist in the design coordinates, and the distance between the position point corresponding to the relative coordinates and the design installation point on the reference plane is smaller than or equal to a preset threshold value, the position is required to be installed with equipment to be installed.
It should be appreciated that the specific value of the preset threshold may be determined based on the actual size of the target space. The larger the target space, the larger the preset threshold. For example, the accuracy of current AR positioning techniques may reach the order of 10cm, and the preset threshold may be set to 10cm as required.
S1103, displaying the first installation information according to the relative coordinates of the device to be installed.
It should be understood that the first installation information is used to prompt the user to install the device to be installed.
In some embodiments, the first installation information includes at least one of: the point position coordinates of the equipment to be installed, the relative coordinates of the equipment to be installed and the installation coordinates of the equipment to be installed.
In some embodiments, the first installation information further includes at least one of: device identification of the device to be installed, device image of the device to be installed.
In some embodiments, a network-allocated device is determined, wherein the network-allocated device is located within a target coordinate system; and in response to the determination of the network-allocated device, displaying second installation information, wherein the second installation information is used for prompting a user to test the network-allocated device.
In some embodiments, the second installation information includes a test control and test information for prompting a user to perform a second operation on the test control to obtain an intended result.
It should be understood that the configured network device and the device to be installed may be different phases of the same intelligent device. After the equipment to be installed is installed and the network distribution is successful, the user can directly control the intelligent equipment through the electronic equipment and test the intelligent equipment. When the network equipment and the equipment to be installed are the same equipment, the second installation information comprises the first installation information, a test control and test information. The test information is used for prompting a user to perform relevant tests on the distributed network equipment and then possible expected effects are achieved. The user can compare the expected effect displayed after clicking the test control with the actual test effect. The effect is consistent, and the network equipment can be normally used after passing the test.
The embodiment of the application provides a method for installing intelligent equipment. The user may determine the relative position of the device to be installed within the coordinate system via the electronic device and display the relevant information of the installation at the user interface. The user can intuitively acquire the installation information of the equipment to be installed, and the user can install the corresponding intelligent equipment conveniently. Furthermore, after the intelligent equipment is installed and distributed with the network, the user can intuitively acquire the test information of the intelligent equipment, and the operation of testing, maintaining, verifying and the like of the intelligent equipment by the user is facilitated, so that the intelligent equipment can work normally.
The embodiment of the application provides a computer program product, which when running on an electronic device, causes the electronic device to execute the technical scheme in the embodiment. The implementation principle and technical effects are similar to those of the related embodiments of the method, and are not repeated here.
An embodiment of the present application provides a readable storage medium, where the readable storage medium contains instructions that, when executed on an electronic device, cause the electronic device to execute the technical solution of the foregoing embodiment. The implementation principle and technical effect are similar, and are not repeated here.
The embodiment of the application provides a chip for executing instructions, and when the chip runs, the technical scheme in the embodiment is executed. The implementation principle and technical effect are similar, and are not repeated here.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the embodiments of the present application.
It will be clear to those skilled in the art that, for convenience and brevity of description, specific working procedures of the above-described systems, apparatuses and units may refer to corresponding procedures in the foregoing method embodiments, and are not repeated herein.
In the several embodiments provided in this application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed over a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present application may be essentially or, what contributes to the prior art, or part of the technical solutions, embodied in the form of a software product, which is stored in a storage medium, and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods of the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only memory (ROM), a random access memory (random access memory, RAM), a magnetic disk, or an optical disk, or other various media capable of storing program codes.
The foregoing is merely a specific implementation of the embodiments of the present application, but the protection scope of the embodiments of the present application is not limited thereto, and any person skilled in the art may easily think about changes or substitutions within the technical scope of the embodiments of the present application, and all changes and substitutions are included in the protection scope of the embodiments of the present application. Therefore, the protection scope of the embodiments of the present application shall be subject to the protection scope of the claims.

Claims (20)

1. A method of installing a smart device, comprising:
determining a target coordinate system;
determining relative coordinates of equipment to be installed, wherein the relative coordinates of the equipment to be installed are coordinates of the equipment to be installed in the target coordinate system;
and displaying first installation information according to the relative coordinates of the equipment to be installed, wherein the first installation information is used for prompting a user to install the equipment to be installed.
2. The method of claim 1, wherein the determining the relative coordinates of the device to be installed comprises:
and when any coordinate in the target coordinate system corresponds to a calibration coordinate in a design coordinate system, and when the distance between a position point corresponding to any coordinate in the target coordinate system and a design mounting point on a reference plane of the target coordinate system is smaller than or equal to a preset threshold value, determining the relative coordinate of equipment to be mounted.
3. The method according to claim 1 or 2, wherein said determining a target coordinate system comprises:
calibrating a coordinate origin in response to a first operation of a user;
and determining a target coordinate system according to the coordinate origin.
4. The method according to claim 1 or 2, wherein said determining a target coordinate system comprises:
acquiring position information of at least three base stations;
and determining a target coordinate system according to the position information of the at least three base stations.
5. The method of any one of claims 1 to 4, wherein the first installation information includes at least one of:
the point position coordinates of the equipment to be installed, the relative coordinates of the equipment to be installed and the installation coordinates of the equipment to be installed.
6. The method of any one of claims 1 to 5, wherein the first installation information further comprises at least one of:
the equipment identification of the equipment to be installed and the equipment image of the equipment to be installed.
7. The method according to any one of claims 1 to 6, further comprising:
determining the distributed network equipment located in the target coordinate system;
And responding to the determination of the network equipment, displaying the second installation information, wherein the second installation information is used for prompting a user to test the network equipment.
8. The method of claim 7, wherein the second installation information includes a test control and test information for prompting a user for an expected result from performing a second operation on the test control.
9. An electronic device, comprising:
one or more processors;
one or more memories;
the one or more memories store one or more computer programs comprising instructions that, when executed by the one or more processors, cause the electronic device to:
determining a target coordinate system;
determining relative coordinates of equipment to be installed, wherein the relative coordinates of the equipment to be installed are coordinates in the target coordinate system;
and displaying first installation information according to the relative coordinates of the equipment to be installed, wherein the first installation information is used for prompting a user to install the equipment to be installed.
10. The electronic device of claim 9, wherein the determining the relative coordinates of the device to be installed, when executed by the one or more processors, causes the electronic device to perform the steps of:
And when any coordinate in the target coordinate system corresponds to a calibration coordinate in a design coordinate system, and when the distance between a position point corresponding to any coordinate in the target coordinate system and a design mounting point on a reference plane of the target coordinate system is smaller than or equal to a preset threshold value, determining the relative coordinate of equipment to be mounted.
11. The electronic device of claim 9 or 10, wherein the determining a target coordinate system, when executed by the one or more processors, causes the electronic device to perform the steps of:
calibrating a coordinate origin in response to a first operation of a user;
and determining a target coordinate system according to the coordinate origin.
12. The electronic device of claim 9 or 10, wherein the determining a target coordinate system, when executed by the one or more processors, causes the electronic device to perform the steps of:
acquiring position information of at least three base stations;
and determining a target coordinate system according to the position information of the at least three base stations.
13. The electronic device of any one of claims 9-12, wherein the first installation information includes at least one of:
The point position coordinates of the equipment to be installed, the relative coordinates of the equipment to be installed and the installation coordinates of the equipment to be installed.
14. The electronic device of any one of claims 9-13, wherein the first installation information further comprises at least one of:
the equipment identification of the equipment to be installed and the equipment image of the equipment to be installed.
15. The electronic device of any one of claims 9-14, wherein the instructions, when executed by the one or more processors, cause the electronic device to perform the steps of:
determining the distributed network equipment located in the target coordinate system;
and responding to the determination of the network equipment, displaying the second installation information, wherein the second installation information is used for prompting a user to test the network equipment.
16. The electronic device of claim 15, wherein the second installation information includes a test control and test information for prompting a user for an expected result from performing a second operation on the test control.
17. A communication device, comprising: a processor coupled to a memory for storing a computer program, the processor for running the computer program to cause the communication device to perform the method of any one of claims 1 to 8.
18. The communication device of claim 17, further comprising one or more of the memory and a transceiver for receiving signals and/or transmitting signals.
19. A computer-readable storage medium, characterized in that the computer-readable storage medium comprises a computer program or instructions which, when run on a computer, cause the method of any one of claims 1 to 8 to be performed.
20. A computer program product, characterized in that the computer program product comprises a computer program or instructions which, when run on a computer, cause the method of any one of claims 1 to 8 to be performed.
CN202210904139.3A 2022-07-29 2022-07-29 Method for installing intelligent device and electronic device Pending CN117528399A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202210904139.3A CN117528399A (en) 2022-07-29 2022-07-29 Method for installing intelligent device and electronic device
PCT/CN2023/108889 WO2024022288A1 (en) 2022-07-29 2023-07-24 Method for installing smart device, and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210904139.3A CN117528399A (en) 2022-07-29 2022-07-29 Method for installing intelligent device and electronic device

Publications (1)

Publication Number Publication Date
CN117528399A true CN117528399A (en) 2024-02-06

Family

ID=89705468

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210904139.3A Pending CN117528399A (en) 2022-07-29 2022-07-29 Method for installing intelligent device and electronic device

Country Status (2)

Country Link
CN (1) CN117528399A (en)
WO (1) WO2024022288A1 (en)

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109032348B (en) * 2018-06-26 2021-09-14 亮风台(上海)信息科技有限公司 Intelligent manufacturing method and equipment based on augmented reality
US20210248824A1 (en) * 2020-02-10 2021-08-12 B/E Aerospace, Inc. System and Method for Locking Augmented and Mixed Reality Applications to Manufacturing Hardware

Also Published As

Publication number Publication date
WO2024022288A1 (en) 2024-02-01

Similar Documents

Publication Publication Date Title
CN115866121B (en) Application interface interaction method, electronic device and computer readable storage medium
JP2022525284A (en) Device control page display method, related equipment, and system
CN115473957B (en) Image processing method and electronic equipment
WO2020155014A1 (en) Smart home device sharing system and method, and electronic device
CN114173204B (en) Message prompting method, electronic equipment and system
CN113794801A (en) Method and device for processing geo-fence
CN112351156A (en) Lens switching method and device
JP7234379B2 (en) Methods and associated devices for accessing networks by smart home devices
WO2022007707A1 (en) Home device control method, terminal device, and computer-readable storage medium
CN116233300A (en) Method for controlling communication service state, terminal device and readable storage medium
CN113973398B (en) Wireless network connection method, electronic equipment and chip system
CN112087649B (en) Equipment searching method and electronic equipment
US20230388832A1 (en) Method for detecting video surveillance device and electronic device
CN114201738B (en) Unlocking method and electronic equipment
CN115914461B (en) Position relation identification method and electronic equipment
CN114095542A (en) Display control method and electronic equipment
CN115641867A (en) Voice processing method and terminal equipment
CN117528399A (en) Method for installing intelligent device and electronic device
CN116414500A (en) Recording method, acquisition method and terminal equipment for operation guide information of electronic equipment
CN115619628B (en) Image processing method and terminal equipment
CN116321265B (en) Network quality evaluation method, electronic device and storage medium
CN116450026B (en) Method and system for identifying touch operation
CN112840680A (en) Position information processing method and related device
CN116437293B (en) Geofence establishment method, server and communication system
CN117177216A (en) Information interaction method and device and electronic equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination