CN108828965B - Positioning method, electronic equipment, intelligent household system and storage medium - Google Patents
Positioning method, electronic equipment, intelligent household system and storage medium Download PDFInfo
- Publication number
- CN108828965B CN108828965B CN201810510651.3A CN201810510651A CN108828965B CN 108828965 B CN108828965 B CN 108828965B CN 201810510651 A CN201810510651 A CN 201810510651A CN 108828965 B CN108828965 B CN 108828965B
- Authority
- CN
- China
- Prior art keywords
- moving object
- audio
- image
- position information
- acquisition
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 53
- 238000004891 communication Methods 0.000 claims abstract description 28
- 238000012545 processing Methods 0.000 claims description 10
- 239000000126 substance Substances 0.000 claims description 6
- 238000012544 monitoring process Methods 0.000 description 19
- 241001122767 Theaceae Species 0.000 description 15
- 230000001360 synchronised effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 239000011521 glass Substances 0.000 description 3
- 230000003993 interaction Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000003068 static effect Effects 0.000 description 2
- 238000006467 substitution reaction Methods 0.000 description 2
- 241001270131 Agaricus moelleri Species 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000000284 extract Substances 0.000 description 1
- 238000003062 neural network model Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 239000004984 smart glass Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B15/00—Systems controlled by a computer
- G05B15/02—Systems controlled by a computer electric
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/20—Analysis of motion
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/70—Determining position or orientation of objects or cameras
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/20—Pc systems
- G05B2219/26—Pc applications
- G05B2219/2642—Domotique, domestic, home control, automation, smart house
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Engineering & Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Automation & Control Theory (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Evolutionary Computation (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Artificial Intelligence (AREA)
- Multimedia (AREA)
- Life Sciences & Earth Sciences (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Mobile Radio Communication Systems (AREA)
- Telephone Function (AREA)
Abstract
The embodiment of the invention provides a positioning method, which is applied to electronic equipment, wherein the electronic equipment can be communicated with at least one acquisition device, and the method comprises the following steps: obtaining data collected by the at least one collection device through the communication; and analyzing the at least one datum to determine the position information of the mobile object.
Description
Technical Field
The application relates to a positioning technology, in particular to a positioning method, electronic equipment, an intelligent home system and a computer storage medium.
Background
With the development of monitoring technology, intelligent security and intelligent home technology can be widely applied. Currently, in the fields of intelligent security and smart home, the following applications are limited: and monitoring the dynamic state in the range to be monitored from the video acquisition picture, wherein the monitoring is usually manual monitoring, and then abnormality is found manually. Even if the monitoring is automatic, only important events such as intrusion of strangers, gas leakage, fire occurrence and the like can be monitored. For refined monitoring events such as position change of a moving object in a monitoring range and loss of the object, the method cannot be realized at present. Therefore, how to realize the fine monitoring of the object becomes a technical problem to be solved urgently.
Disclosure of Invention
In order to solve the existing technical problems, embodiments of the present invention provide a positioning method, an electronic device, an intelligent home system, and a computer storage medium.
The technical scheme of the embodiment of the invention is realized as follows:
the embodiment of the invention provides a positioning method, which is applied to electronic equipment, wherein the electronic equipment can be communicated with at least one acquisition device, and the method comprises the following steps:
obtaining data collected by the at least one collection device through the communication;
and analyzing the at least one datum to determine the position information of the mobile object.
An embodiment of the present invention further provides an electronic device, where the electronic device is capable of communicating with at least one acquisition device, and the electronic device includes: a communication component and a processor; wherein the content of the first and second substances,
a processor for obtaining data acquired by the at least one acquisition device through the communication assembly;
and analyzing the at least one multimedia data to determine the position information of the mobile object.
The embodiment of the invention also provides an intelligent home system, which at least comprises electronic equipment and at least one acquisition device, wherein different acquisition devices in the at least one acquisition device are arranged at different acquisition positions; wherein the content of the first and second substances,
the at least one acquisition device for acquiring data generated for movement of the moving object at respective acquisition locations;
the electronic equipment is used for acquiring at least one piece of multimedia data aiming at the same moving object through communication with the at least one acquisition device; and analyzing the at least one multimedia data to determine the position information of the mobile object at the end of the movement.
The embodiment of the invention also provides a computer storage medium, wherein the computer storage medium stores computer executable instructions, and the computer executable instructions are used for executing the positioning method.
According to the positioning method, the electronic equipment, the intelligent home system and the computer storage medium provided by the embodiment of the invention, the data generated by the movement of the moving object is collected by the collecting device, and the electronic equipment analyzes at least one multimedia data collected by the collecting device to obtain the position information of the moving object, so that the positioning of the electronic equipment on the position of the moving object is realized, and the fine monitoring on the object is also realized. The object fine monitoring can greatly improve the use experience of users and reflect the usability of products.
Drawings
Fig. 1 is a schematic flow chart illustrating an implementation of a first embodiment of a positioning method according to an embodiment of the present invention;
fig. 2 is a schematic flow chart illustrating an implementation of a second embodiment of the positioning method according to the embodiment of the present invention;
FIG. 3 is a first diagram illustrating an application scenario according to an embodiment of the present invention;
fig. 4 is a schematic flow chart illustrating an implementation of a third embodiment of the positioning method according to the embodiment of the present invention;
FIG. 5 is a diagram illustrating a second exemplary application scenario according to an embodiment of the present invention;
FIG. 6 is a diagram illustrating a hardware configuration of an electronic device according to an embodiment of the invention;
fig. 7 is a schematic structural diagram of a smart home system according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and specific embodiments.
It should be understood by those skilled in the art that the electronic devices involved in the following embodiments of the present invention include, but are not limited to: industrial control computers, personal computers and the like, all types of computers, all-in-one computers, notebook computers, tablet computers, mobile phones, electronic readers and the like, and also can be wearable devices such as intelligent glasses, intelligent watches, intelligent shoes and the like. That is, the electronic device in the embodiment of the present invention is any reasonable communicable device that can be thought of. The mobile terminal in the embodiment of the invention is a mobile phone or intelligent glasses.
The first embodiment of the positioning method provided by the embodiment of the present invention is applied to an electronic device, where the electronic device is capable of communicating with at least one acquisition device, and each acquisition device in the at least one acquisition device is arranged at a different acquisition position. It should be understood by those skilled in the art that the acquisition device capable of communicating with the electronic device is not an integral part of the electronic device, is independent of the structure of the electronic device, and is disposed at different acquisition positions within a certain area. The acquisition device may be an audio acquisition device for acquiring audio, such as a microphone, a video acquisition device for acquiring video, such as a camera, or an acquisition device capable of acquiring both audio and video, and is not particularly limited. The electronic device can communicate with each acquisition device based on a network established in the area range, and the communication can be carried out through the network or through direct connection among the devices. The network may be a local area network or a wide area network. A wide area network such as the Internet. Local area networks such as bluetooth, wireless fidelity (WiFi), Zigbee protocol (Zigbee), and other short-range communication networks.
As shown in fig. 1, the implementation flowchart of the first embodiment of the positioning method provided in the embodiment of the present invention includes:
step 101: obtaining data collected by the at least one collection device through the communication;
here, the acquisition means acquire data, in particular multimedia data, such as audio data and/or image data generated by a moving object during movement. The acquisition devices acquire multimedia data of the mobile object generated by movement at respective acquisition positions and transmit the multimedia data to the electronic equipment through communication established between the acquisition devices and the electronic equipment, and the electronic equipment receives the multimedia data acquired by the acquisition devices.
Step 102: and analyzing the at least one datum to determine the position information of the mobile object.
Here, the electronic device analyzes the multimedia data acquired by the acquisition device to obtain the position information of the mobile object.
Therefore, the data generated by the movement of the moving object is collected by the collecting device, and the electronic equipment analyzes at least one multimedia data collected by the collecting device to obtain the position information of the moving object, so that the electronic equipment can position the position of the moving object, and the object can be finely monitored. The object fine monitoring can greatly improve the use experience of users and reflect the usability of products.
It can be understood that the moving object moves within a certain area range, each acquisition device arranged within the area range can monitor the movement of the object arranged within the area range at the respective acquisition position, and acquire multimedia data generated by the moving object due to the movement when the movement of the object is monitored. When at least one acquisition device in each acquisition device acquires multimedia data aiming at the same moving object (object), the acquired multimedia data is sent to the electronic equipment through the established network, and the electronic equipment receives the multimedia data acquired by each acquisition device in the at least one acquisition device. The multimedia data may be audio data generated when the moving object moves, such as natural audio generated during moving, sound generated by friction with the ground during moving, and the like. Here, it is understood that, just as the speaking sound of each person exists at a certain frequency, each object has certain ultrasonic characteristics, that is, each object has a certain ultrasonic frequency, and an ultrasonic wave signal is radiated outward at the ultrasonic frequency. It can be said that the ultrasonic frequency of each object can uniquely identify the object, and the inherent audio frequency in the present scheme can refer to the ultrasonic signal (ultrasonic frequency) inherent to each object. The sound of friction between different objects and the ground in the moving process is different due to the ultrasonic characteristic of each object, and the audio data generated by the moving object in the scheme can also be the frequency of the friction sound generated between different moving objects and the ground. In addition, the multimedia data may also be image data acquired during movement.
It can be understood that the electronic device in this embodiment can track the moving position of the moving object in real time, so as to embody cheapness and versatility of security. At all moving positions of the moving object, in some scenarios, the moving end position of the moving object is important, and the position information of the moving object at the moving end can be obtained by executing the following procedure in the present solution.
With respect to step 102, the electronic device may further perform the following process: analyzing the at least one multimedia data to obtain at least one analysis result; and determining the position information of the mobile object at the end of the movement based on the at least one resolution result.
Here, when the electronic device receives at least one multimedia data generated by at least one acquisition device for the movement of the same moving object, the electronic device analyzes each multimedia data to obtain at least one analysis result. And the electronic equipment determines the position of the moving object at the end of the movement based on the obtained at least one analysis result.
In a preferred embodiment, the position information of the moving object at the end of the movement can be output by at least one output unit; wherein at least one of the at least one output unit is an output unit provided in the electronic device or an output unit capable of communicating with the electronic device. The output unit may be an audio output unit and/or a video output unit. The position information where the moving object is located at the end of the movement may be output by an audio output unit and/or a video output unit inherent to the electronic device, such as a display, a speaker, etc., after the electronic device is located. The position information can also be sent by the electronic equipment to an audio output unit and/or a video output unit arranged in a certain area range for output. And is not particularly limited herein. It should be noted that the number of the output units may be equal to the number of the acquisition devices, and the output units may be arranged corresponding to the acquisition devices, for example, one of the acquisition devices and one of the output units are integrated to obtain an integrated unit, the integrated unit is arranged at an acquisition position, and the output unit at the acquisition position is used for outputting the position information of the moving object, which is obtained by the electronic device according to the information acquired by the acquisition device at the acquisition position. Therefore, the user can know the position information of the mobile object, and the user experience can be greatly improved.
In summary, in this embodiment, the acquisition device acquires multimedia data generated due to movement of the moving object, the electronic device analyzes at least one piece of multimedia data acquired by the acquisition device to obtain an analysis result, and determines the position information of the moving object at the end of movement according to the analysis result, so that the electronic device positions the position of the moving object, that is, the object is finely monitored. The object fine monitoring can greatly improve the use experience of users and reflect the usability of products.
As shown in fig. 2, a second embodiment of the positioning method provided in the embodiment of the present invention includes:
step 201: the electronic device is capable of communicating with at least three acquisition apparatuses, upon which the electronic device obtains audio data acquired by each of the at least three acquisition apparatuses for the moving object at the end of the movement, wherein the multimedia data is characterized as the audio data;
here, the at least three acquisition devices acquire audio data generated by movement of the same moving object at respective acquisition positions, and each acquisition device transmits information acquired by itself to the electronic device through a network established between the acquisition device and the electronic device, and the electronic device receives the audio data for the same moving object transmitted by each acquisition device.
Step 202: analyzing the obtained at least three audio data to obtain at least three analysis results;
step 203: and determining the position information of the mobile object at the end of the movement based on the at least three resolution results.
The audio data may be an ultrasonic frequency inherent to the moving object, a frequency of a frictional sound generated between the moving object and the ground during movement, or the like.
In the above solution, the electronic device may communicate with at least three capturing devices, and based on the communication, receive audio data generated by the capturing devices moving relative to the same moving object at respective capturing positions, and locate the position of the moving object at the end of the moving through analysis. Through the interaction between the at least three acquisition devices and the electronic equipment, the electronic equipment can position the position of the moving object, and fine monitoring of the object can be realized. The object fine monitoring can greatly improve the use experience of users and reflect the usability of products.
In a specific implementation, steps 202 and 203 may be implemented as follows:
obtaining the attribute of each audio data in the at least three audio data, wherein the attribute is characterized by the signal intensity of the audio data; obtaining at least three pieces of relative position information based on the attributes of the at least three pieces of audio data, wherein the relative position information is direction information of the same moving object relative to each acquisition device for acquiring the audio data of the same moving object; and determining the position information of the moving object at the end of the movement based on the at least three pieces of relative position information. It can be understood that, for the intensity information of the audio signal of the moving object at the end of the movement, which is acquired by each of the at least three acquisition devices, of the electronic device, the direction of the same moving object relative to each acquisition device at the end of the movement is obtained, and according to the direction information, the position of the moving object at the end of the movement is located.
The present embodiment will be further understood with reference to the scene diagram shown in fig. 3.
The scenario shown in fig. 3 is an application scenario of a smart home, a plurality of collecting devices are arranged in a home area, and only three collecting devices 1-3 are illustrated in fig. 3 in consideration of space occupation. Any household equipment (object) in the range of the household area can be moved, namely any household equipment can be regarded as a moving object. Assuming that a moving object is taken as an example of a tea table, it is assumed that the moving object moves from position 1 to position 2. The three acquisition devices establish a short-distance communication network with the electronic equipment through WiFi.
The method comprises the steps that each acquisition device arranged in a home area range monitors home equipment at an acquisition position where the acquisition device is located, and when the situation that the home equipment moves is monitored, each acquisition device acquires the inherent ultrasonic frequency of the moving home equipment or the frequency of friction sound generated between the home equipment and the ground in the moving process at the acquisition position where the acquisition device is located. The acquisition device can monitor the movement of an object through a built-in sensor, when the movement of the object is monitored, outline information of the moving object is constructed and is subjected to similarity matching with preset outline information of each piece of home equipment, the home equipment corresponding to the outline information with the highest similarity is determined to be the moving home equipment, and identification information of the moving home equipment is read from a preset home equipment and identification database thereof. The above scheme is to identify which home device moves among a plurality of home devices, and certainly is not limited to the above scheme, and any other reasonable scheme capable of identifying the moving home device is within the protection scope of the embodiment. The identification information of the home devices may be inherent identifications of the home devices, such as serial numbers of computers, factory serial numbers of refrigerators, or self-organized serial numbers, such as numbering all homes one by one from number 10, where number 10 represents a computer and number 11 represents a refrigerator.
Each acquisition device can acquire the acquisition information once every predetermined time, such as 5s, in the process of changing the position 2 of the mobile home equipment from the position 1. The collected information may also be collected once at certain specific location points during the movement, such as the movement start location, the movement intermediate location, and/or the movement end location, and sent to the electronic device. In this application scenario, it is preferable that each of the capturing devices (capturing devices 1 to 3) transmits the captured ultrasonic signal radiated from the tea table at the end position of the movement, for example, at the position 2, or the frequency of the friction sound generated between the position 2 and the ground to the electronic device through WiFi. It can be understood that the collected information sent by each collecting device includes the ultrasonic signal of the moving household equipment or the frequency of the friction sound generated between the household equipment and the ground in the moving process, and also includes the equipment identifier of the moving household equipment (tea table). Therefore, after the electronic equipment receives the acquisition information from two or more acquisition devices, the acquisition information aiming at the same moving object and acquired by different acquisition devices can be determined according to the equipment identification.
Taking the information acquired by the acquisition device as the ultrasonic signal of the home equipment as an example, in the process that the moving object moves from the position 1 to the position 2, the ultrasonic signal (with inherent ultrasonic frequency) radiated by the moving object will be dispersed all around, and the acquisition devices 1, 2 and 3 arranged at different acquisition positions have different radiation degrees of the ultrasonic signal received at the respective acquisition positions due to different distances from the moving object, so that the signal intensities of the ultrasonic signal radiated by the moving object, which are respectively acquired by the acquisition devices 1, 2 and 3 at different acquisition positions, are different. That is, the intensity of the ultrasonic signal collected by the collecting device 1-3 is different for the tea table at the position 2. Based on the intensity of the ultrasonic signal of the tea table at the movement ending position acquired by each acquisition device and the preset first corresponding relation, the electronic equipment can determine the position of the tea table relative to each acquisition device in the acquisition devices 1-3 at the movement ending time. Wherein, the first corresponding relation record has the different ultrasonic signal intensity of tea table and the information of the direction scope of tea table for the collection device who gathers this intensity signal when gathering each signal intensity, and the information that also is gathered to single collection device, electronic equipment can tentatively confirm the tea table like the tea table in this collection device's southeast direction for the scope of the direction that this single collection device is located, but can not accurately confirm specifically in southeast direction which position department. In this embodiment, based on the information that 3 collection devices gathered, can tentatively determine the direction of the removal final position department of tea table relative to each collection device. In an indoor three-dimensional space, intersecting the directions of the tea table relative to the 3 collecting devices to obtain coordinate point information of the tea table in the indoor three-dimensional space at the moving end position, wherein the coordinate point information can be regarded as position information of the tea table at the moving end.
In the above scheme, if 3 acquisition devices and 3 output units are correspondingly integrated, 3 integrated units (i.e. integrated units 1 and 2 and integrated unit 3) can be obtained, and the acquisition positions of the respective integrated units are the same as the acquisition positions of the respective acquisition units in fig. 3. When the electronic equipment positions the position of the tea table after the movement is finished, the position information is at least sent to one of the integrated units, and the audio output unit in the integrated unit is used for carrying out voice broadcast or the video output unit is used for carrying out position display. Therefore, the intelligent home user can know the mobile position information of the mobile object, and the user experience can be greatly improved.
In the above scheme, the electronic device obtains, for the intensity of the ultrasonic signal of the moving object at the end of movement of the moving object acquired by each of the three acquisition devices, 3 pieces of direction information of the moving object with respect to the 3 acquisition devices at the end of movement, and locates the position of the moving object at the end of movement according to the direction information. In the scheme, the electronic equipment is used for positioning the position of the moving object through interaction between the 3 acquisition devices and the electronic equipment, and fine monitoring of the object is realized. The object fine monitoring can greatly improve the use experience of users and reflect the usability of products.
As shown in fig. 4, a third embodiment of the positioning method according to the embodiments of the present invention includes:
step 401: the multimedia data obtained by the electronic equipment through the communication at least comprises an image shot by the at least one acquisition device when the movement of the moving object is finished;
the information acquired by the acquisition device is image data, specifically, the acquisition device photographs the moving object at the end of moving to obtain a photographed image at the end of moving, and transmits the photographed image to the electronic device through a network established between the acquisition device and the electronic device, and the electronic device receives the information transmitted by the acquisition device.
Step 402: processing the image;
step 403: and obtaining the position information of the moving object when the moving is finished according to the processing result of the image.
In the above scheme, the multimedia data acquired by the acquisition devices are image data, and the electronic device obtains the position of the moving object at the end of moving through processing the image according to the image acquired by at least one acquisition device. Through the interaction between at least one acquisition device and the electronic equipment, the electronic equipment can position the position of the moving object, and fine monitoring of the object can be realized. The object fine monitoring can greatly improve the use experience of users and reflect the usability of products.
In a specific implementation, steps 402 and 403 may be performed as follows: matching the image with the image in a database one by one according to the characteristic information of the image; determining a target image, wherein the target image is an image with similarity higher than a threshold value with the image characteristics of the shot image in a database; determining shooting position information of a target image; and determining the shooting position information of the target image as the position information of the moving object at the end of moving. The positioning accuracy can be greatly improved by using the mode of determining the position of the moving object when the moving is finished by using the image shot by the acquisition device and the characteristic elements of the image in the database.
The present embodiment will be further understood with reference to the application scenario shown in fig. 5.
Fig. 5 is a view of a home inside a home, only showing the acquisition devices 1 and 2. The electronic device is a pair of smart glasses. Assuming that the moving object is an automobile as an example,
the collection device 1 monitors whether an object in a courtyard moves or not, and when the object moves, it is determined that the moving object moves. For a specific implementation process of monitoring whether movement occurs and determining which device the object generating movement is, please refer to the foregoing description of fig. 3, which is not described herein again.
The collecting device 1 shoots the automobile when the automobile is moved to the end to obtain a shot image when the automobile is moved to the end, the shot image is sent to the electronic equipment through a Wifi network established between the collecting device 1 and the electronic equipment, and the electronic equipment receives information sent by the collecting device 1.
The electronic equipment extracts image features by utilizing a built-in neural network model, wherein the image features can refer to information such as image contours and edge details and also comprise information such as colors and gray scales, the electronic equipment searches images with higher similarity, such as higher than 80% of threshold value, with the image features of the shot images collected by the collecting device from a database, and the searched images are regarded as target images. The present embodiment is applied to a certain area range, and the area range is usually not large, so that all possible moving situations of an object in the area range can be photographed, photographs of different objects at different positions in the area range can be obtained, and the photographs and the photographing positions of the photographs can be correspondingly stored, so as to obtain a corresponding relationship. When the electronic device finds the target image according to the characteristics of the image shot by the acquisition device 1, the shooting position of the target image is read from the stored corresponding relation, and the shooting position of the target image is used as the position of the automobile when the movement is finished.
The intelligent glasses can display the position information of the automobile when the automobile is moved. Therefore, the position information of the moving object can be displayed for the user, and the user experience is greatly improved.
It should be noted that, in the above solution, the position of the moving object at the end of the movement is located by using only the captured image captured by one capturing device. In addition, two (the acquisition devices 1 and 2) or more than two acquisition devices can be used for positioning the position of the moving object at the end of the movement. It can be understood that the two acquisition devices are used for positioning the position of the moving object when the moving is finished, and the positioned position is more accurate. For example, similar to the foregoing solution, for an image captured by each of two capturing devices, the electronic device may locate two position information for the same moving object, and perform an average operation on the two positions to obtain final position information, where the position information after the average operation can more accurately reflect the position of the moving object at the end of movement than single position information.
The present embodiment also provides a computer storage medium, in which computer-executable instructions are stored, and the computer-executable instructions are used for executing the method described in any one of the first to third embodiments of the foregoing method.
The computer storage media may be implemented by any type of volatile or non-volatile storage device, or combination thereof. The nonvolatile Memory may be a Read Only Memory (ROM), a Programmable Read Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a magnetic Random Access Memory (FRAM), a Flash Memory (Flash Memory), a magnetic surface Memory, an optical Disc, or a Compact Disc Read-Only Memory (CD-ROM); the magnetic surface storage may be disk storage or tape storage. Volatile Memory can be Random Access Memory (RAM), which acts as external cache Memory. By way of illustration and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Enhanced Synchronous Dynamic Random Access Memory (Enhanced DRAM), Synchronous Dynamic Random Access Memory (SLDRAM), Direct Memory (DRmb Access), and Random Access Memory (DRAM). The computer storage media described in the embodiments of the invention are intended to comprise, without being limited to, these and any other suitable types of memory.
The present invention also provides an embodiment of an electronic device, the electronic device being capable of communicating with at least one acquisition apparatus, each acquisition apparatus of the at least one acquisition apparatus being arranged at a different acquisition location, as shown in fig. 6, the electronic device comprising: a communication component 601 and a processor 602; wherein the content of the first and second substances,
a processor 602 for obtaining data acquired by the at least one acquisition device via the communication component 601;
and analyzing the at least one multimedia data to determine the position information of the mobile object.
It can be understood that the electronic device in this embodiment can track the moving position of the moving object in real time, so as to embody cheapness and versatility of security. At all moving positions of the moving object, in some scenarios, the moving end position of the moving object is important, and the position information of the moving object at the moving end can be obtained by executing the following procedure in the present solution.
A processor 602, configured to obtain, through the communication component 601, at least one multimedia data for the same moving object, the electronic device obtaining, through the communication, multimedia data generated by the movement of the moving object acquired by the at least one acquisition device at the respective acquisition position;
analyzing the at least one multimedia data to obtain at least one analysis result;
and determining the position information of the mobile object at the end of the movement based on the at least one resolution result.
In a preferred embodiment, the electronic device is capable of communicating with at least three acquisition devices, wherein the multimedia data is characterized as the audio data;
the processor 602 is configured to obtain, through the communication component 601, one audio data for the moving object acquired by each of the at least three acquisition devices based on the communication;
analyzing the obtained at least three audio data to obtain at least three analysis results;
and determining the position information of the mobile object at the end of the movement based on the at least three resolution results.
In a preferred embodiment, the processor 602 is further configured to:
obtaining the attribute of each audio data in the at least three audio data, wherein the attribute is characterized by the signal intensity of the audio data;
obtaining at least three pieces of relative position information based on attributes of the at least three pieces of audio data, wherein the relative position information is direction information of the same moving object relative to each acquisition device for acquiring the audio data of the same moving object;
and determining the position information of the moving object at the end of the movement based on the at least three pieces of relative position information.
In a preferred embodiment, the multimedia data at least comprises an image taken by the at least one acquisition device at the end of the movement of the moving object;
the processor 602 is further configured to:
processing the image;
and obtaining the position information of the moving object when the moving is finished according to the processing result of the image.
In a preferred embodiment, the processor 602 is further configured to:
extracting the features of the image to obtain feature information of the image;
matching the image with the image in a database one by one according to the characteristic information of the image;
determining a target image, wherein the target image is an image with similarity higher than a threshold value with the image characteristics of the shot image in a database;
determining shooting position information of a target image;
and determining the shooting position information of the target image as the position information of the moving object at the end of moving.
In a preferred embodiment, the position information where the moving object is located at the end of the movement can be output by at least one output unit;
at least one of the at least one output unit is an output unit provided in the electronic apparatus or an output unit capable of communicating with the electronic apparatus.
It should be noted that, in order to implement the method, an embodiment of the present invention provides an electronic device, and since a principle of the electronic device for solving the problem is similar to that of the method, both an implementation process and an implementation principle of the electronic device may be described with reference to the implementation process and the implementation principle of the method, and repeated details are not described again.
The present invention further provides an embodiment of an intelligent home system, as shown in fig. 7, at least including an electronic device 701 and at least one collecting device 702, where different collecting devices in the at least one collecting device 702 are arranged at different collecting positions; wherein the content of the first and second substances,
the at least one acquisition means 702 for acquiring multimedia data generated for the movement of the moving object at respective acquisition positions;
the electronic device 701 is configured to acquire at least one multimedia data for the same moving object through communication with the at least one acquisition apparatus 702; analyzing the at least one multimedia data to obtain at least one analysis result;
and determining the position information of the mobile object at the end of the movement based on the at least one resolution result.
The system further includes at least one output unit (not illustrated in fig. 7), and each of the at least one output unit is configured to obtain and output position information of the moving object at the end of the movement based on the communication with the electronic device 701.
It should be noted that, in order to implement the method, an embodiment of the present invention provides an intelligent home system, and since a principle of solving the problem of the intelligent home system is similar to that of the method, both an implementation process and an implementation principle of the intelligent home system may be described with reference to the implementation process and the implementation principle of the method, and repeated details are not repeated.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.
Those of ordinary skill in the art will understand that: all or part of the steps for implementing the method embodiments may be implemented by hardware related to program instructions, and the program may be stored in a computer readable storage medium, and when executed, the program performs the steps including the method embodiments; and the aforementioned storage medium includes: a mobile storage device, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic or optical disk, or various other media that can store program code.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.
Claims (10)
1. A positioning method applied in an electronic device, the electronic device being capable of communicating with at least two audio acquisition devices, the method comprising:
obtaining audio data acquired by the at least two audio acquisition devices through the communication;
analyzing the at least two audio data to obtain the directions of the moving object relative to the at least two audio acquisition devices; wherein the at least two audio data are ultrasonic signals generated by the movement of the moving object and inherent to the moving object;
determining first position information of the moving object according to the acquisition positions of the at least two audio acquisition devices and the at least two relative directions;
wherein, the determining the first position information of the moving object according to the collecting positions of the at least two audio collecting devices and the at least two relative directions comprises:
determining an intersection of directions of a moving object with respect to at least two audio capturing devices as the first position information of the moving object.
2. The method according to claim 1, characterized in that it comprises:
the acquisition positions of the at least two audio acquisition devices are different;
the at least two audio data are audio data collected by each of the at least two audio collection devices at respective collection positions for the moving object at the end of the movement.
3. The method of claim 2, wherein analyzing the obtained at least two audio data to obtain a relative orientation of the moving object with respect to the at least two audio capture devices comprises:
obtaining the attribute of each audio data in the at least two audio data, wherein the attribute is characterized by the signal intensity of the audio data;
at least two relative directions are derived based on the properties of the at least two audio data.
4. The method according to claim 1, wherein the electronic device obtains, through the communication, an image taken by at least one of the at least two image acquisition devices at the end of the movement of the moving object;
processing the image;
and obtaining the position information of the moving object when the moving is finished according to the processing result of the image.
5. The method according to claim 4, wherein the processing the image and obtaining the position information of the moving object at the end of moving according to the processing result of the image comprises:
extracting the features of the image to obtain feature information of the image;
matching the image with the image in a database one by one according to the characteristic information of the image;
determining a target image, wherein the target image is an image with similarity higher than a threshold value with the image characteristics of the shot image in a database;
determining shooting position information of a target image;
determining shooting position information of a target image as position information of the moving object when the moving is finished;
the method further comprises the following steps:
and determining second position information of the mobile object based on the first position information and the position information of the mobile object at the end of the movement.
6. The method according to any one of claims 1 to 5, further comprising: outputting, by at least one output unit, position information where the moving object is located at the end of the movement;
at least one of the at least one output unit is an output unit provided in the electronic apparatus or an output unit capable of communicating with the electronic apparatus.
7. An electronic device capable of communicating with at least two audio capture devices, the electronic device comprising: a communication component and a processor; wherein the content of the first and second substances,
the processor is used for obtaining the audio data collected by the at least two audio collecting devices through the communication component;
analyzing the at least two audio data to obtain the directions of the moving object relative to the at least two audio acquisition devices; wherein the at least two audio data are ultrasonic signals generated by the movement of the moving object and inherent to the moving object;
determining first position information of the moving object according to the acquisition positions of the at least two audio acquisition devices and the at least two relative directions;
the processor is further configured to determine an intersection of directions of a moving object with respect to at least two audio capture devices as the first location information of the moving object.
8. An intelligent home system at least comprises electronic equipment and at least two audio acquisition devices, wherein different acquisition devices in the at least two audio acquisition devices are arranged at different acquisition positions; wherein the content of the first and second substances,
the at least two audio acquisition devices are used for acquiring audio data generated aiming at the movement of the moving object at respective acquisition positions;
the electronic equipment is used for acquiring at least two audio data aiming at the same moving object through communication with the at least two audio acquisition devices; analyzing the at least two audio data to obtain the directions of the moving object relative to the at least two audio acquisition devices; wherein the at least two audio data are ultrasonic signals generated by the movement of the moving object and inherent to the moving object; determining first position information of the moving object at the end of moving according to the acquisition positions of the at least two audio acquisition devices and the at least two relative directions;
the electronic device is further configured to determine an intersection of directions of a moving object with respect to at least two audio capture devices as the first location information of the moving object.
9. The smart home system of claim 8, further comprising at least one output unit,
the output unit is used for obtaining and outputting the position information of the moving object at the end of moving based on the communication with the electronic equipment.
10. A computer storage medium having computer-executable instructions stored therein for performing the method of any of the preceding claims 1 to 5.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810510651.3A CN108828965B (en) | 2018-05-24 | 2018-05-24 | Positioning method, electronic equipment, intelligent household system and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810510651.3A CN108828965B (en) | 2018-05-24 | 2018-05-24 | Positioning method, electronic equipment, intelligent household system and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108828965A CN108828965A (en) | 2018-11-16 |
| CN108828965B true CN108828965B (en) | 2021-09-14 |
Family
ID=64145468
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810510651.3A Active CN108828965B (en) | 2018-05-24 | 2018-05-24 | Positioning method, electronic equipment, intelligent household system and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108828965B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111343330A (en) * | 2019-03-29 | 2020-06-26 | 阿里巴巴集团控股有限公司 | Smart phone |
Family Cites Families (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH06318231A (en) * | 1993-05-06 | 1994-11-15 | Mitsubishi Precision Co Ltd | Information adding device for image |
| GB2456773A (en) * | 2008-01-22 | 2009-07-29 | In2Games Ltd | Sensing the position of a mobile object relative to a fixed object via ultrasound and infrared |
| CN201562168U (en) * | 2009-12-17 | 2010-08-25 | 长安大学 | Robot location device based on sound guide |
| CN205281720U (en) * | 2015-12-09 | 2016-06-01 | 深圳市智安物联科技有限公司 | Intelligence household security service robot system |
| CN107219766B (en) * | 2016-03-21 | 2020-11-17 | 创新先进技术有限公司 | Control method and device of intelligent household equipment |
| CN106406309A (en) * | 2016-09-30 | 2017-02-15 | 广西大学 | Sound guidance location system |
| CN106504287B (en) * | 2016-10-19 | 2019-02-15 | 大连民族大学 | Monocular vision object space positioning system based on template |
| CN107579883A (en) * | 2017-08-25 | 2018-01-12 | 上海肖克利信息科技股份有限公司 | Distributed pickup intelligent home furnishing control method |
-
2018
- 2018-05-24 CN CN201810510651.3A patent/CN108828965B/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CN108828965A (en) | 2018-11-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11916635B2 (en) | Self-learning based on Wi-Fi-based monitoring and augmentation | |
| TWI775091B (en) | Data update method, electronic device and storage medium thereof | |
| WO2021093375A1 (en) | Method, apparatus, and system for detecting people walking together, electronic device and storage medium | |
| US20210344434A1 (en) | Method, device, system, and storage medium for live broadcast detection and data processing | |
| JP2017538978A (en) | Alarm method and device | |
| US9792488B2 (en) | Adjacent person specifying apparatus, adjacent person specifying method, adjacent person specifying program, and adjacent person specifying system | |
| CN104994335A (en) | Alarm method and terminal | |
| CN111988729B (en) | Remote device discovery and connection | |
| CN107800998B (en) | Positioning early warning reminding method, computer equipment and storage medium | |
| CN110853095B (en) | Camera positioning method and device, electronic equipment and storage medium | |
| US10341616B2 (en) | Surveillance system and method of controlling the same | |
| US10896513B2 (en) | Method and apparatus for surveillance using location-tracking imaging devices | |
| CN106446185A (en) | Product recommendation method and device and server | |
| WO2023098287A1 (en) | Message pushing method and apparatus, storage medium and electronic apparatus | |
| CN105814518A (en) | Information processing method and smart bracelet | |
| CN105959502A (en) | Network picture compression method and device | |
| CN108063909A (en) | Video conferencing system, image trace acquisition method and device | |
| CN112749652A (en) | Identity information determination method and device, storage medium and electronic equipment | |
| US11514600B2 (en) | Information processing device and information processing method | |
| CN114529621B (en) | Household type graph generation method and device, electronic equipment and medium | |
| CN108828965B (en) | Positioning method, electronic equipment, intelligent household system and storage medium | |
| CN104994350B (en) | Information query method and device | |
| CN105100749A (en) | Image pick-up method and device as well as terminal | |
| WO2022156294A1 (en) | Video processing method and apparatus, computer readable storage medium, and electronic device | |
| TWI748439B (en) | Positioning method and device based on shared map, electronic equipment and computer readable storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |