CN113822133A - Data processing method, system, device and computer readable storage medium - Google Patents

Data processing method, system, device and computer readable storage medium Download PDF

Info

Publication number
CN113822133A
CN113822133A CN202110807965.1A CN202110807965A CN113822133A CN 113822133 A CN113822133 A CN 113822133A CN 202110807965 A CN202110807965 A CN 202110807965A CN 113822133 A CN113822133 A CN 113822133A
Authority
CN
China
Prior art keywords
information
article
storage
target
image recognition
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110807965.1A
Other languages
Chinese (zh)
Inventor
高宏斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Haier Technology Co Ltd
Haier Smart Home Co Ltd
Original Assignee
Qingdao Haier Technology Co Ltd
Haier Smart Home Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Haier Technology Co Ltd, Haier Smart Home Co Ltd filed Critical Qingdao Haier Technology Co Ltd
Priority to CN202110807965.1A priority Critical patent/CN113822133A/en
Publication of CN113822133A publication Critical patent/CN113822133A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/3331Query processing
    • G06F16/334Query execution
    • G06F16/3343Query execution using phonetics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06KGRAPHICAL DATA READING; PRESENTATION OF DATA; RECORD CARRIERS; HANDLING RECORD CARRIERS
    • G06K17/00Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations
    • G06K17/0022Methods or arrangements for effecting co-operative working between equipments covered by two or more of main groups G06K1/00 - G06K15/00, e.g. automatic card files incorporating conveying and reading operations arrangements or provisious for transferring data to distant stations, e.g. from a sensing device
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y10/00Economic sectors
    • G16Y10/80Homes; Buildings
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y20/00Information sensed or collected by the things
    • G16Y20/10Information sensed or collected by the things relating to the environment, e.g. temperature; relating to location
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y20/00Information sensed or collected by the things
    • G16Y20/20Information sensed or collected by the things relating to the thing itself
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16YINFORMATION AND COMMUNICATION TECHNOLOGY SPECIALLY ADAPTED FOR THE INTERNET OF THINGS [IoT]
    • G16Y40/00IoT characterised by the purpose of the information processing
    • G16Y40/10Detection; Monitoring

Abstract

The invention discloses a data processing method, a system, a device and a computer readable storage medium, wherein the system comprises: the image recognition device is arranged in the corresponding article storage space and used for recognizing articles to be stored and sending the article information and the ID information of the image recognition device to the server; the server is used for generating storage record information according to the article information and the ID information, receiving an inquiry instruction sent by the client and inquiring a storage result of the target article from the storage record information; and the client is used for establishing communication connection between the image recognition device and the server, sending the query instruction to the server and receiving the returned storage result. By adopting the technical scheme, the problem that in the related art, when articles are stored, a user needs to manually input the storage position information of the articles, and the input information is checked when the articles are searched, so that inconvenience in use is caused due to excessive man-machine interaction is solved.

Description

Data processing method, system, device and computer readable storage medium
Technical Field
The invention relates to the field of household appliances, in particular to a data processing method, a system, a device and a computer readable storage medium.
Background
Along with the acceleration of life rhythm, many people all have no time to take into the daily of house article and accomodate, place article at will, when needs use article, often look for all rooms, both waste time and hard, and at last not necessarily can find. Therefore, how to manage household articles efficiently and conveniently becomes a living demand of people.
The mode that adopts cell-phone APP to accomodate at home article has appeared among the correlation technique, but, the manual deposit positional information who types article of needs user at every turn looks into the record in the cell-phone APP again when treating to look for article, and the human-computer interaction is too much in the use, uses inconvenient, user experience is poor.
Aiming at the problems that in the prior art, when articles are stored, a user needs to manually input storage position information of the articles, input information is checked when the articles are searched, and inconvenience in use is caused by excessive man-machine interaction, an effective solution is not provided.
Disclosure of Invention
The embodiment of the invention provides a data processing method, a system and a device and a computer readable storage medium, which at least solve the problem that in the related technology, when articles are stored, a user needs to manually input storage position information of the articles, and when the articles are searched, the input information is checked, and the inconvenience is caused by excessive man-machine interaction.
According to an embodiment of the present invention, there is provided a data processing method including: photographing an article to be stored in an article storage space through an image recognition device to obtain a target image, wherein the image recognition device is arranged in the article storage space; identifying the target picture to obtain article information, wherein the article information at least comprises article name information and an article picture; and sending the article information and the ID information of the image recognition device to a server so as to store the article information in a target storage list, wherein the target storage list is a storage list of a target storage unit, and the target storage unit is a storage unit to which an article storage space corresponding to the ID information of the image recognition device belongs.
Optionally, the method further comprises: scanning a target identifier, wherein the target identifier carries communication connection parameters and information of a server; and connecting with the server through the communication connection parameters, and sending a connection request to the server to establish an association relationship between the image recognition device and the target storage unit in the server.
According to another embodiment of the present invention, there is provided another data processing method including: receiving article information and ID information of the image recognition device, wherein the article information is information of an article recognized by the image recognition device; storing the article information based on the ID information of the image recognition device to obtain storage record information; and receiving a query instruction of the target object sent by the client, and querying the storage result of the target object from the storage record information according to the query instruction.
Alternatively, storing the item information based on the ID information of the image recognition device, and obtaining the storage record information includes: determining an article storage space into which an article is stored and a storage unit to which the article storage space belongs according to ID information of an image recognition device, wherein the storage unit comprises at least one article storage space, position information is associated with each article storage space, and an image recognition device is arranged in each article storage space; and storing the article information in a storage list corresponding to the storage unit to which the article storage space belongs to obtain storage record information.
Optionally, the querying the storage result of the target item from the storage record information according to the query instruction includes: determining account information carried by the query instruction, and acquiring name information of the target object from the query instruction; determining a target storage unit associated with the account information, and acquiring a target storage list corresponding to the target storage unit; acquiring the object information of the target object and the target position information of the object storage space where the target object is located from the target storage list based on the name information of the target object; and determining the object information and the object position information of the object as the storage result of the object.
Optionally, in a case that the query instruction is a voice query instruction, the obtaining name information of the target item from the query instruction includes: and recognizing the voice query instruction by adopting a voice recognition engine to obtain a recognition result, and acquiring the name information of the target object from the recognition result by adopting a semantic recognition engine.
According to another embodiment of the present invention, there is provided a data processing system including: the image recognition device is arranged in the corresponding article storage space and used for recognizing articles to be stored in the article storage space and sending the recognized article information and the ID information of the image recognition device to the server; the server is used for generating storage record information according to the received article information and the ID information of the image recognition device, receiving an inquiry instruction of a target article sent by the client and inquiring a storage result of the target article from the storage record information; and the client is used for establishing communication connection between the image recognition device and the server, receiving a query instruction input by a user, sending the query instruction to the server, and receiving a storage result of the target object returned by the server based on the query instruction.
According to another embodiment of the present invention, there is also provided a data processing apparatus including: the photographing unit is used for photographing an article to be stored in the article storage space through the image recognition device to obtain a target image, wherein the image recognition device is arranged in the article storage space; the identification unit is used for identifying the target picture to obtain article information, wherein the article information at least comprises article name information and an article picture; and the first sending unit is used for sending the article information and the ID information of the image recognition device to the server so as to store the article information in a target storage list, wherein the target storage list is a storage list of a target storage unit, and the target storage unit is a storage unit to which an article storage space corresponding to the ID information of the image recognition device belongs.
According to another embodiment of the present invention, there is provided another data processing apparatus including: the receiving unit is used for receiving article information sent by the image recognition device and ID information of the image recognition device, wherein the article information is information of an article recognized by the image recognition device; a storage unit for storing the article information based on the ID information of the image recognition device to obtain storage record information; and the query unit is used for receiving a query instruction of the target object sent by the client and querying the storage result of the target object from the storage record information according to the query instruction.
According to a further aspect of the embodiments of the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the above-mentioned data processing method when running.
According to another aspect of the embodiments of the present invention, there is also provided an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the data processing method through the computer program.
In the embodiment of the invention, an object to be stored in an object storage space is photographed through an image recognition device to obtain a target picture, wherein the image recognition device is arranged in the object storage space; identifying the target picture to obtain article information, wherein the article information at least comprises article name information and an article picture; and sending the article information and the ID information of the image recognition device to a server so as to store the article information in a target storage list, wherein the target storage list is a storage list of a target storage unit, and the target storage unit is a storage unit to which an article storage space corresponding to the ID information of the image recognition device belongs. By adopting the technical scheme, the problem that the storage position information of the articles needs to be manually input by a user when the articles are stored in the related technology, the input information is checked when the articles are searched, and the inconvenience in use caused by too much man-machine interaction is solved, so that the effect of reducing the man-machine interaction in the process of storing the articles and improving the user experience is achieved.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
fig. 1 is a block diagram of a hardware configuration of a computer terminal of a data processing method according to an embodiment of the present invention;
FIG. 2 is a schematic diagram of a data processing system according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of an alternative data processing system according to an embodiment of the present invention;
FIG. 4 is a first timing diagram illustrating operation of an alternative data processing system according to an embodiment of the present invention;
FIG. 5 is a second operational timing diagram of an alternative data processing system according to an embodiment of the present invention;
FIG. 6 is a timing diagram third of the operation of an alternative data processing system according to an embodiment of the present invention;
FIG. 7 is a flow chart of a data processing method according to an embodiment of the present invention;
FIG. 8 is a schematic diagram of another data processing method according to an embodiment of the invention;
fig. 9 is a block diagram of a data processing apparatus according to an embodiment of the present invention;
fig. 10 is a block diagram of another data processing apparatus according to an embodiment of the present invention.
Detailed Description
In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
The method provided by the embodiment of the application can be executed in a computer terminal, a computer terminal or a similar operation device. Taking the example of being operated on a computer terminal, fig. 1 is a hardware structure block diagram of a computer terminal of a data processing method according to an embodiment of the present invention. As shown in fig. 1, the computer terminal may include one or more (only one shown in fig. 1) processors 102 (the processors 102 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA) and a memory 104 for storing data, and in an exemplary embodiment, may also include a transmission device 106 for communication functions and an input-output device 108. It will be understood by those skilled in the art that the structure shown in fig. 1 is only an illustration and is not intended to limit the structure of the computer terminal. For example, the computer terminal may also include more or fewer components than shown in FIG. 1, or have a different configuration with equivalent functionality to that shown in FIG. 1 or with more functionality than that shown in FIG. 1.
The memory 104 may be used to store computer programs, for example, software programs and modules of application software, such as computer programs corresponding to the data processing method in the embodiment of the present invention, and the processor 102 executes various functional applications and data processing by running the computer programs stored in the memory 104, so as to implement the method described above. The memory 104 may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include memory located remotely from the processor 102, which may be connected to a computer terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The transmission device 106 is used for receiving or transmitting data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal. In one example, the transmission device 106 includes a Network adapter (NIC), which can be connected to other Network devices through a base station so as to communicate with the internet. In one example, the transmission device 106 may be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In this embodiment, a data processing system is provided, and fig. 2 is a schematic diagram of a data processing system according to an embodiment of the present invention, the system including:
and at least one image recognition device 101, which is arranged in the corresponding article storage space, and is used for recognizing the article to be stored in the article storage space and sending the recognized article information and the ID information of the image recognition device 101 to the server 103.
Specifically, the article storage space may be a user's room at each article storage point, and the plurality of image recognition devices 101 are previously arranged at each article storage point in the room while the position information of the image recognition devices 101 is automatically synchronized to the server 103.
When an article is received at a storage location, the image recognition device 101 recognizes the article, and then synchronizes the article information and the ID information of the image recognition device 101 responsible for recognition with the server 103.
And the server 103 is used for generating storage record information according to the received article information and the ID information of the image recognition device 101, receiving an inquiry instruction of the target article sent by the client 105, and inquiring the storage result of the target article from the storage record information.
Specifically, the server 103 has an article storage management system corresponding to an application program in advance, and the article storage management system receives the article information and the ID information of the image recognition device 101, automatically generates a record (including image information and storage location information) of the article, and stores the record in the system. When the articles need to be found, only an instruction needs to be sent to the article storage management system, and the article storage management system prompts the user of the storage positions of the articles after retrieving the article storage records.
The client 105 is used for establishing a communication connection between the image recognition device 101 and the server 103, receiving a query instruction input by a user, sending the query instruction to the server 103, and receiving a storage result of the target item returned by the server 103 based on the query instruction.
Specifically, the management APP is accomodate to the article in the operation of customer end 105, and the management APP is accomodate to the article can receive the characters inquiry command of user's input, can also receive voice inquiry command, and after receiving the storage result of the target article that server 103 returned based on the inquiry command, the storage result of target article can be reported to the form that can adopt voice broadcast to reduce manual operation, promote and accomodate management efficiency and user experience.
The method comprises the steps that at least one image recognition device 101 is arranged in a corresponding article storage space and used for recognizing articles to be stored in the article storage space and sending recognized article information and ID information of the image recognition device 101 to a server 103; a server 103 for generating storage record information according to the received article information and the ID information of the image recognition device 101, receiving an inquiry instruction of the target article sent by the client 105, and inquiring a storage result of the target article from the storage record information; the client 105 is used for establishing a communication connection between the image recognition device 101 and the server 103, receiving a query instruction input by a user, sending the query instruction to the server 103, and receiving a storage result of the target item returned by the server 103 based on the query instruction. By adopting the technical scheme, the problem that the storage position information of the articles needs to be manually input by a user when the articles are stored in the related technology, the input information is checked when the articles are searched, and the inconvenience in use caused by too much man-machine interaction is solved, so that the effect of reducing the man-machine interaction in the process of storing the articles and improving the user experience is achieved.
In an alternative implementation, another data processing system is provided, and fig. 3 is a schematic diagram of an alternative data processing system according to an embodiment of the invention, as shown in fig. 3, the system including: the system comprises a plurality of article identification devices, an article storage management server and a client provided with an article storage management APP used by a user.
The article identification device is equipment with an embedded operating system and is provided with a camera and a WiFi module, so that the article identification device has photographing and networking capabilities. The article identification device is connected with the article storage management server through a WiFi router in a family after the distribution network is set, and information interaction can be carried out by adopting a data transmission protocol based on MQTT. The article recognition device runs an article recognition program which is responsible for continuously capturing a camera image, recognizing whether a home article appears from the image, and transmitting article-related information (article name, article image) to the article storage management server if the home article is recognized.
The article storage management server runs an article storage management service program, and the program is responsible for managing a communication link with the article identification device, receiving home article information sent by the article identification device and managing the home article information according to the relationship hierarchy of home, storage point and article; on the other hand, a voice-based article query function is provided for the user, the article storage management service program is provided with a voice recognition engine, after the user inputs a voice search instruction, the voice search instruction input by the user can be recognized, a search target is analyzed through the semantic recognition engine, and finally a search result is returned to the user.
The article storage management APP is an entrance of a storage management function used by a user, and can perform data interaction with an article storage management server based on a communication protocol of HTTP (hyper text transport protocol) to perform configuration management on an article identification device in a family; the family article list in the family managed in the article storage management server can be inquired; and a text or voice article searching instruction can be sent to the server, and then a searching result of the server is received and is informed to the user in a voice broadcasting mode.
It should be noted that, in the working process of the data processing system of this embodiment, the interaction includes the interaction of binding configuration of the article identification device, the interaction when storing the home article, and the interaction when searching for the home article.
Specifically, first, a user needs to configure and bind an article identification device before using the device, which relates to configuring a WiFi for the device and binding the device to a home where the user is located, as shown in fig. 4, it is a first operation sequence diagram of an optional data processing system according to an embodiment of the present invention, that is, a sequence diagram of an article identification device configuration and binding interaction:
1, the device is brought into a configuration state.
2, the user starts an article storage management APP.
2.1, entering a configuration page, filling in family WiFi connection parameters and requesting a binding token from an article storage server.
2.2, the item accommodation server returns the token.
And 2.3, after the token is obtained, generating a two-dimensional code in the APP.
2.4, the user places the two-dimensional code on the APP in front of a camera of the article identification device, so that the device can scan the two-dimensional code; 2.4.1, analyzing WiFi connection parameters and binding tokens in the two-dimensional codes by the article identification device; 2.4.2, connecting the object identification device with the in-home WiFi router by using the WiFi connection parameters; 2.4.3, logging the article identification device in an article storage management server; 2.4.4, the article storage management server returns a login result; 2.4.5, the article identification device submits a configuration binding request to the article storage management server; 2.4.6, the article storage management server firstly returns the configuration binding result to the article identification device.
And 3, the article storage management server returns the configuration binding result to the article storage management APP.
3.1, the article storage management APP displays the configuration binding result to the user.
Further, after the device is bound to the home of the user, the home goods may be stored, as shown in fig. 5, which is a second operation sequence diagram of the optional data processing system according to the embodiment of the present invention, that is, an interaction diagram when the home goods are stored:
1, the user places the article to be stored in front of the camera of the intelligent household article identification device.
1.1, the intelligent household article recognition device collects images of articles through the camera and recognizes the articles.
1.2, the intelligent household article identification device submits the identified article information (article name, article image) and the device ID of the device to an article storage management server.
1.2.1, after receiving the storage article request submitted by the intelligent household article identification device, the article storage management server finds the corresponding storage point of the family according to the equipment ID of the device, and stores the article information into the database.
1.2.2, the article storage management server returns an article storage result to the intelligent household article identification device.
1.2.3, the intelligent household article recognition device prompts the user for an article storage result.
Still further, after storing the home item, the home item may be searched, as shown in fig. 6, which is a third operation timing diagram of the optional data processing system according to the embodiment of the present invention, that is, an interaction timing diagram for searching the home item:
1, the user reaches the voice instruction of looking for the article under article storage management APP.
1.1, the article storage management APP sends the voice instruction data of the searched article and the family ID of the user to an article storage management server.
1.1.1, the article storage management server performs voice recognition on the received article searching voice instruction.
1.1.2, the article storage management server carries out semantic analysis on the voice recognition result to obtain the name of the article to be searched.
1.1.3, the article storage management server searches article storage information in the corresponding family according to the family ID received in the second step.
1.1.4, return the search result to article storage management APP.
1.1.5, management APP is accomodate to article carries out voice broadcast to the search result.
In the embodiment, the household article intelligent identification device can automatically acquire the article information to be stored and automatically synchronize the article information and the storage position information to the article storage management system; accomodate management APP through article and also adopt the voice interaction's form when article are accomodate to article in management system, realize that high-efficient convenient article at home accomodate the management to the manual operation that significantly reduces, management efficiency and user experience are accomodate in very big promotion.
In the present embodiment, a data processing method is provided, which is applied to the computer terminal, and fig. 7 is a flowchart of a data processing method according to an embodiment of the present invention, as shown in fig. 7, the flowchart includes the following steps:
step S702, taking a picture of an article to be stored in the article storage space through an image recognition device to obtain a target picture, wherein the image recognition device is arranged in the article storage space.
Specifically, the article storage space may be each article storage point in a user's room, to which a plurality of image recognition devices are previously arranged, and the articles are photographed by the image recognition device 101 when they are to be received at the storage points.
Step S704, identifying the target picture to obtain item information, where the item information at least includes item name information and a picture of the item.
Step S706, sending the article information and the ID information of the image recognition device to the server, so as to store the article information in a target storage list, where the target storage list is a storage list of a target storage unit, and the target storage unit is a storage unit to which an article storage space corresponding to the ID information of the image recognition device belongs.
Specifically, the target storage unit may be a home unit, the item information and the ID information of the image recognition device are sent to the server, the storage point may be determined according to the ID information of the image recognition device, so as to determine the home unit to which the storage point belongs, and the item information is stored in the storage list corresponding to the home unit.
In one exemplary embodiment, the method further comprises: scanning a target identifier, wherein the target identifier carries communication connection parameters and information of a server; and connecting with the server through the communication connection parameters, and sending a connection request to the server to establish an association relationship between the image recognition device and the target storage unit in the server.
Specifically, the target identifier may be a two-dimensional code, which may be generated based on the home WiFi connection parameter and the binding token information of the server, and thus contains the WiFi connection parameter and the information of the server, and the two-dimensional code may be displayed on a display interface of the client for requesting the binding token information of the server.
The image recognition device scans the target identification, connects the in-home WiFi router by using the WiFi connection parameters, logs in the server and submits the configuration binding request, and because the information of the target storage unit is stored in the server, the binding relationship between the target storage unit and the image recognition device can be established, so that the information of the article recognized by the image recognition device can be conveniently stored in the storage list corresponding to the target storage unit.
Through the steps, the object to be stored in the object storage space is photographed through the image recognition device to obtain a target picture, wherein the image recognition device is arranged in the object storage space; identifying the target picture to obtain article information, wherein the article information at least comprises article name information and an article picture; and sending the article information and the ID information of the image recognition device to a server so as to store the article information in a target storage list, wherein the target storage list is a storage list of a target storage unit, and the target storage unit is a storage unit to which an article storage space corresponding to the ID information of the image recognition device belongs. By adopting the technical scheme, the problem that the storage position information of the articles needs to be manually input by a user when the articles are stored in the related technology, the input information is checked when the articles are searched, and the inconvenience in use caused by too much man-machine interaction is solved, so that the effect of reducing the man-machine interaction in the process of storing the articles and improving the user experience is achieved.
In this embodiment, another data processing method is provided, which is applied to the computer terminal, and fig. 8 is a flowchart of a data processing method according to an embodiment of the present invention, where the flowchart includes the following steps:
step S802, receiving article information and ID information of the image recognition device, where the article information is information of an article recognized by the image recognition device.
Specifically, an article to be stored is identified by an image identification device, article information is obtained, and the article information and the ID information of the image identification device itself are sent to a server.
In step S804, the article information is stored based on the ID information of the image recognition device, and the storage record information is obtained.
In one exemplary embodiment, storing the item information based on the ID information of the image recognition apparatus, the obtaining the storage record information includes: determining an article storage space into which an article is stored and a storage unit to which the article storage space belongs according to ID information of an image recognition device, wherein the storage unit comprises at least one article storage space, position information is associated with each article storage space, and an image recognition device is arranged in each article storage space; and storing the article information in a storage list corresponding to the storage unit to which the article storage space belongs to obtain storage record information.
Specifically, the image recognition device is disposed in the article storage space, the ID information of the image recognition device corresponds to the location information of the article storage space, and the location of the article storage space is located in a storage unit, such as a storage unit in a family unit, and the article information can be stored in a storage list corresponding to the storage unit by using the ID information of the image recognition device, so as to obtain the storage record information.
Step S806, receiving an inquiry command of the target item sent by the client, and inquiring the storage result of the target item from the storage record information according to the inquiry command.
In one exemplary embodiment, querying the stored result of the target item from the storage record information according to the query instruction comprises: determining account information carried by the query instruction, and acquiring name information of the target object from the query instruction; determining a target storage unit associated with the account information, and acquiring a target storage list corresponding to the target storage unit; acquiring the object information of the target object and the target position information of the object storage space where the target object is located from the target storage list based on the name information of the target object; and determining the object information and the object position information of the object as the storage result of the object.
Specifically, an article management APP is logged in from a client, and an account of the APP is associated with storage unit information, for example, the article management APP is logged in, an account of zhang san is input, and a query instruction is sent, so that the query instruction carries a home unit to which zhang san belongs.
Therefore, the target storage unit associated with the account information can be determined, the target storage list corresponding to the target storage unit is obtained, because the instruction content of the query instruction includes the item name, the item information and the item storage location of the target item can be queried from the target storage list through the item name, the item information can include the name and the picture, and the item storage location is the location of the item storage space where the image recognition device for recognizing the item is located.
In order to facilitate the user query, in an exemplary embodiment, in the case that the query instruction is a voice query instruction, the obtaining the name information of the target item from the query instruction includes: and recognizing the voice query instruction by adopting a voice recognition engine to obtain a recognition result, and acquiring the name information of the target object from the recognition result by adopting a semantic recognition engine.
Specifically, a voice instruction can be input at the client, the query result is obtained in a voice query mode, and the query result is broadcasted at the client in a voice broadcast mode, so that user interaction is reduced, and user experience is improved.
Through the steps, receiving article information and ID information of the image recognition device, wherein the article information is the information of an article recognized by the image recognition device; storing the article information based on the ID information of the image recognition device to obtain storage record information; and receiving a query instruction of the target object sent by the client, and querying the storage result of the target object from the storage record information according to the query instruction. By adopting the technical scheme, the problem that the storage position information of the articles needs to be manually input by a user when the articles are stored in the related technology, the input information is checked when the articles are searched, and the inconvenience in use caused by too much man-machine interaction is solved, so that the effect of reducing the man-machine interaction in the process of storing the articles and improving the user experience is achieved.
Fig. 9 is a block diagram of a data processing apparatus according to an embodiment of the present invention; as shown in fig. 9, includes:
the photographing unit 902 is configured to photograph an article to be stored in an article storage space through an image recognition device to obtain a target picture, where the image recognition device is disposed in the article storage space.
The identifying unit 904 is configured to identify the target picture to obtain item information, where the item information at least includes item name information and a picture of an item.
A first sending unit 906, configured to send the item information and the ID information of the image recognition apparatus to the server, so as to store the item information in a target storage list, where the target storage list is a storage list of a target storage unit, and the target storage unit is a storage unit to which an item storage space corresponding to the ID information of the image recognition apparatus belongs.
Through the above embodiment, the photographing unit 902 is configured to photograph an article to be stored in an article storage space through an image recognition device to obtain a target picture, where the image recognition device is disposed in the article storage space; an identifying unit 904, configured to identify the target picture to obtain item information, where the item information at least includes item name information and a picture of an item; a first sending unit 906, configured to send the item information and the ID information of the image recognition apparatus to the server, so as to store the item information in a target storage list, where the target storage list is a storage list of a target storage unit, and the target storage unit is a storage unit to which an item storage space corresponding to the ID information of the image recognition apparatus belongs. By adopting the technical scheme, the problem that the storage position information of the articles needs to be manually input by a user when the articles are stored in the related technology, the input information is checked when the articles are searched, and the inconvenience in use caused by too much man-machine interaction is solved, so that the effect of reducing the man-machine interaction in the process of storing the articles and improving the user experience is achieved.
In one exemplary embodiment, the apparatus further comprises: the scanning unit is used for scanning a target identifier, wherein the target identifier carries communication connection parameters and information of the server; and the second sending unit is used for connecting with the server through the communication connection parameters and sending a connection request to the server so as to establish an association relationship between the image recognition device and the target storage unit in the server.
FIG. 10 is a block diagram of another data processing apparatus according to an embodiment of the present invention; as shown in fig. 10, includes:
the receiving unit 1002 is configured to receive article information and ID information of the image recognition device, where the article information is information of an article recognized by the image recognition device.
A storage unit 1004 for storing the article information based on the ID information of the image recognition apparatus to obtain the storage record information.
The query unit 1006 is configured to receive a query instruction of the target item sent by the client, and query the storage result of the target item from the storage record information according to the query instruction.
With the above embodiment, the receiving unit 1002 is configured to receive article information sent by the image recognition device and ID information of the image recognition device, where the article information is information of an article recognized by the image recognition device; a storage unit 1004 for storing the article information based on the ID information of the image recognition apparatus, resulting in stored record information; the query unit 1006 is configured to receive a query instruction of the target item sent by the client, and query the storage result of the target item from the storage record information according to the query instruction. By adopting the technical scheme, the problem that the storage position information of the articles needs to be manually input by a user when the articles are stored in the related technology, the input information is checked when the articles are searched, and the inconvenience in use caused by too much man-machine interaction is solved, so that the effect of reducing the man-machine interaction in the process of storing the articles and improving the user experience is achieved.
In an exemplary embodiment, the storage unit 1004 includes: the first determining module is used for determining an article storage space where an article is stored and a storage unit to which the article storage space belongs according to ID information of the image recognition device, wherein the storage unit comprises at least one article storage space, position information is associated with each article storage space, and an image recognition device is arranged in each article storage space; and the storage module is used for storing the article information in a storage list corresponding to the storage unit to which the article storage space belongs to obtain storage record information.
In an exemplary embodiment, the query unit 1006 includes: the second determining module is used for determining the account information carried by the query instruction and acquiring the name information of the target object from the query instruction; the third determining module is used for determining a target storage unit associated with the account information and acquiring a target storage list corresponding to the target storage unit; the acquisition module is used for acquiring the object information of the target object and the target position information of the object storage space where the target object is located from the target storage list based on the name information of the target object; and the fourth determining module is used for determining the object information and the object position information of the target object as the storage result of the target object.
In an exemplary embodiment, the obtaining module is further configured to recognize the voice query instruction by using a voice recognition engine to obtain a recognition result, and obtain name information of the target item from the recognition result by using a semantic recognition engine.
An embodiment of the present invention further provides a storage medium including a stored program, wherein the program executes any one of the methods described above.
Alternatively, in the present embodiment, the storage medium may be configured to store program codes for performing the following steps:
step S702, taking a picture of an article to be stored in the article storage space through an image recognition device to obtain a target picture, wherein the image recognition device is arranged in the article storage space.
Step S704, identifying the target picture to obtain item information, where the item information at least includes item name information and a picture of the item.
Step S706, sending the article information and the ID information of the image recognition device to the server, so as to store the article information in a target storage list, where the target storage list is a storage list of a target storage unit, and the target storage unit is a storage unit to which an article storage space corresponding to the ID information of the image recognition device belongs.
Alternatively, in the present embodiment, the storage medium may be configured to store program codes for performing the following steps:
step S802, receiving article information and ID information of the image recognition device, where the article information is information of an article recognized by the image recognition device.
In step S804, the article information is stored based on the ID information of the image recognition device, and the storage record information is obtained.
Step S806, receiving an inquiry command of the target item sent by the client, and inquiring the storage result of the target item from the storage record information according to the inquiry command.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
step S702, taking a picture of an article to be stored in the article storage space through an image recognition device to obtain a target picture, wherein the image recognition device is arranged in the article storage space.
Step S704, identifying the target picture to obtain item information, where the item information at least includes item name information and a picture of the item.
Step S706, sending the article information and the ID information of the image recognition device to the server, so as to store the article information in a target storage list, where the target storage list is a storage list of a target storage unit, and the target storage unit is a storage unit to which an article storage space corresponding to the ID information of the image recognition device belongs.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
step S802, receiving article information and ID information of the image recognition device, where the article information is information of an article recognized by the image recognition device.
In step S804, the article information is stored based on the ID information of the image recognition device, and the storage record information is obtained.
Step S806, receiving an inquiry command of the target item sent by the client, and inquiring the storage result of the target item from the storage record information according to the inquiry command.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.

Claims (10)

1. A data processing method, comprising:
photographing an article to be stored in an article storage space through an image recognition device to obtain a target image, wherein the image recognition device is arranged in the article storage space;
identifying the target picture to obtain article information, wherein the article information at least comprises article name information and an article picture;
and sending the article information and the ID information of the image recognition device to a server so as to store the article information in a target storage list, wherein the target storage list is a storage list of a target storage unit, and the target storage unit is a storage unit to which the article storage space corresponding to the ID information of the image recognition device belongs.
2. The data processing method of claim 1, wherein the method further comprises:
scanning a target identifier, wherein the target identifier carries communication connection parameters and information of the server;
and connecting with the server through the communication connection parameters, and sending a connection request to the server to establish an association relationship between the image recognition device and the target storage unit in the server.
3. A data processing method, comprising:
receiving article information sent by an image recognition device and ID information of the image recognition device, wherein the article information is information of an article recognized by the image recognition device;
storing the article information based on the ID information of the image recognition device to obtain storage record information;
and receiving a query instruction of the target object sent by the client, and querying the storage result of the target object from the storage record information according to the query instruction.
4. The data processing method according to claim 3, wherein the storing the article information based on the ID information of the image recognition device, and obtaining stored record information includes:
determining an article storage space into which the article is stored and a storage unit to which the article storage space belongs according to ID information of the image recognition device, wherein the storage unit comprises at least one article storage space, each article storage space is associated with position information, and one image recognition device is arranged in each article storage space;
and storing the article information in a storage list corresponding to the storage unit to which the article storage space belongs to obtain the storage record information.
5. The data processing method according to claim 4, wherein the querying the stored result of the target item from the storage record information according to the query instruction comprises:
determining account information carried by the query instruction, and acquiring name information of the target object from the query instruction;
determining a target storage unit associated with the account information, and acquiring a target storage list corresponding to the target storage unit;
acquiring the object information of the target object and the target position information of the object storage space where the target object is located from the target storage list based on the name information of the target object;
determining the object information of the target object and the target position information as the storage result of the target object.
6. The data processing method according to claim 5, wherein in a case that the query instruction is a voice query instruction, the obtaining name information of the target item from the query instruction comprises:
and recognizing the voice query instruction by adopting a voice recognition engine to obtain a recognition result, and acquiring the name information of the target object from the recognition result by adopting a semantic recognition engine.
7. A data processing system, comprising:
the system comprises at least one image recognition device, a server and a storage device, wherein the image recognition device is arranged in a corresponding article storage space and used for recognizing articles to be stored in the article storage space and sending the recognized article information and the ID information of the image recognition device to the server;
the server is used for generating storage record information according to the received article information and the ID information of the image recognition device, receiving an inquiry instruction of a target article sent by a client, and inquiring a storage result of the target article from the storage record information;
the client is used for establishing communication connection between the image recognition device and the server, receiving the query instruction input by the user, sending the query instruction to the server, and receiving a storage result of the target object returned by the server based on the query instruction.
8. A data processing apparatus, comprising:
the photographing unit is used for photographing an article to be stored in an article storage space through an image recognition device to obtain a target image, wherein the image recognition device is arranged in the article storage space;
the identification unit is used for identifying the target picture to obtain article information, wherein the article information at least comprises article name information and an article picture;
a first sending unit, configured to send the item information and the ID information of the image recognition device to a server, so as to store the item information in a target storage list, where the target storage list is a storage list of a target storage unit to which the item storage space belongs, and the target storage list is corresponding to the ID information of the image recognition device.
9. A data processing apparatus, comprising:
a receiving unit, configured to receive article information and ID information of an image recognition device, where the article information is information of an article recognized by the image recognition device;
a storage unit configured to store the article information based on ID information of the image recognition device, to obtain storage record information;
and the query unit is used for receiving a query instruction of the target object sent by the client and querying the storage result of the target object from the storage record information according to the query instruction.
10. A computer-readable storage medium, comprising a stored program, wherein the program is operable to perform the data processing method of any one of claims 1 to 2 or the data processing method of any one of claims 3 to 6.
CN202110807965.1A 2021-07-16 2021-07-16 Data processing method, system, device and computer readable storage medium Pending CN113822133A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110807965.1A CN113822133A (en) 2021-07-16 2021-07-16 Data processing method, system, device and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110807965.1A CN113822133A (en) 2021-07-16 2021-07-16 Data processing method, system, device and computer readable storage medium

Publications (1)

Publication Number Publication Date
CN113822133A true CN113822133A (en) 2021-12-21

Family

ID=78912657

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110807965.1A Pending CN113822133A (en) 2021-07-16 2021-07-16 Data processing method, system, device and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN113822133A (en)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000142925A (en) * 1998-11-04 2000-05-23 Ntt Data Corp Article managing system and terminal
JP2012193873A (en) * 2011-03-15 2012-10-11 Nikon Corp Storage device
CN108718328A (en) * 2018-04-04 2018-10-30 珠海宜心家居有限公司 A kind of accommodation method of virtual memory
CN109784319A (en) * 2019-03-25 2019-05-21 珠海格力电器股份有限公司 Article control method, device, storage medium and mobile terminal
CN109993045A (en) * 2017-12-29 2019-07-09 杭州海康威视系统技术有限公司 Articles seeking method and lookup device search system and machine readable storage medium
WO2019145914A1 (en) * 2018-01-26 2019-08-01 Danby Products Limited Item depository operated responsive to data bearing records
CN110278262A (en) * 2019-06-17 2019-09-24 华北科技学院 A kind of Intelligent storage system based on Internet of Things
US20200143315A1 (en) * 2018-11-07 2020-05-07 Adolf Würth GmbH & Co. KG Inventory Management System With Position Determination of Storage Goods and Associated Storage Regions

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000142925A (en) * 1998-11-04 2000-05-23 Ntt Data Corp Article managing system and terminal
JP2012193873A (en) * 2011-03-15 2012-10-11 Nikon Corp Storage device
CN109993045A (en) * 2017-12-29 2019-07-09 杭州海康威视系统技术有限公司 Articles seeking method and lookup device search system and machine readable storage medium
WO2019145914A1 (en) * 2018-01-26 2019-08-01 Danby Products Limited Item depository operated responsive to data bearing records
CN108718328A (en) * 2018-04-04 2018-10-30 珠海宜心家居有限公司 A kind of accommodation method of virtual memory
US20200143315A1 (en) * 2018-11-07 2020-05-07 Adolf Würth GmbH & Co. KG Inventory Management System With Position Determination of Storage Goods and Associated Storage Regions
CN109784319A (en) * 2019-03-25 2019-05-21 珠海格力电器股份有限公司 Article control method, device, storage medium and mobile terminal
CN110278262A (en) * 2019-06-17 2019-09-24 华北科技学院 A kind of Intelligent storage system based on Internet of Things

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
GEONWOO KIM等: "An MQTT-based Contex-Aware Autonomous System in oneM2M Architecturet", 《IEEE INTERNET OF THINGS JOURNAL》 *
于亦潇等: "基于语音识别和MQTT协议的智能家居系统实现", 《物联网技术》 *
李忠成: "智能仓储物联网的设计与实现", 《计算机系统应用》 *

Similar Documents

Publication Publication Date Title
CN110134829B (en) Video positioning method and device, storage medium and electronic device
CN106506433B (en) Login authentication method, authentication server, authentication client and login client
CN101155324B (en) Instant communication method and system based on or containing mobile phone book
CN113129526A (en) Cabinet opening control method, server, computing device and computer storage medium
CN110807085B (en) Fault information query method and device, storage medium and electronic device
CN103916626A (en) Monitoring video information providing method and device and video monitoring system
CN112738265A (en) Equipment binding method and device, storage medium and electronic device
CN114244644B (en) Control method and device for intelligent home, storage medium and electronic device
CN103347065A (en) Service information processing system and method
CN107645789B (en) Network access method, device and system
CN112908321A (en) Device control method, device, storage medium, and electronic apparatus
CN112507211A (en) Message pushing method and device, storage medium and electronic device
CN112738019B (en) Method and device for displaying device information, storage medium and electronic device
CN105163171A (en) File transmission method between set top box and mobile terminal and system
CN111859127A (en) Subscription method and device of consumption data and storage medium
CN113822133A (en) Data processing method, system, device and computer readable storage medium
CN111884938A (en) Router information acquisition method and device
CN110750601A (en) Interaction method and device based on connection path, storage medium and electronic device
CN113839991A (en) Method and device for confirming equipment information, storage medium and electronic device
KR101742697B1 (en) System and method for providing common-interest information push service among users of a user group
CN113709187B (en) Multi-server data request method, device, equipment and storage medium
CN110941711A (en) Electronic search report acquisition method and apparatus, storage medium, and electronic apparatus
CN113192250A (en) Access control image processing method and device and storage medium
CN112738803B (en) Terminal equipment networking method and device and gateway equipment
CN113961735A (en) Method and device for establishing mapping relation, storage medium and electronic device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination