CN110445821B

CN110445821B - Information pushing method, device and system for household appliance and information processing method

Info

Publication number: CN110445821B
Application number: CN201810413969.XA
Authority: CN
Inventors: 孙东方
Original assignee: Alibaba Group Holding Ltd
Current assignee: Alibaba Group Holding Ltd
Priority date: 2018-05-03
Filing date: 2018-05-03
Publication date: 2022-05-31
Anticipated expiration: 2038-05-03
Also published as: CN110445821A

Abstract

The invention discloses a method, a device and a system for pushing information of a household appliance and an information processing method. Wherein, the method comprises the following steps: the method comprises the following steps of collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information; determining a push object by analyzing commodity information; acquiring push information corresponding to a push object, wherein the push information comprises attribute information of the push object; and controlling the household appliance to display the push information corresponding to the push object. The invention solves the technical problem of single function of the intelligent household appliance in the prior art.

Description

Information pushing method, device and system for household appliance and information processing method

Technical Field

The invention relates to the field of smart home, in particular to a method, a device and a system for pushing information of household appliances and an information processing method.

Background

At present, smart homes are used for realizing home automation through communication networks such as wireless networks. Fig. 1 is a schematic diagram of an intelligent magic mirror in the prior art, and as shown in fig. 1, the current intelligent magic mirror not only can implement the functions of the mirror, but also includes a display device and a communication module, and obtains predetermined information from a network through the communication module, for example: location, stock information, weather conditions, etc., and present the information via a display device.

Although certain convenience is brought to users, the functions are still single when the users are limited to displaying certain information.

Aiming at the problem of single function of the intelligent household appliance in the prior art, an effective solution is not provided at present.

Disclosure of Invention

The embodiment of the invention provides a method, a device and a system for pushing information of a household appliance and an information processing method, and at least solves the technical problem that the intelligent household appliance in the prior art is single in function.

According to an aspect of an embodiment of the present invention, there is provided an information push method for a home appliance, including: the method comprises the following steps of collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information; determining a push object by analyzing commodity information; acquiring push information corresponding to a push object, wherein the push information comprises attribute information of the push object; and controlling the household appliance to display the push information corresponding to the push object.

According to another aspect of the embodiments of the present invention, there is also provided a home appliance including: the image acquisition device is used for acquiring the image information of the commodity to be purchased; the voice acquisition device is used for acquiring voice information representing commodities needing to be purchased; the controller is used for determining a push object by analyzing the image information and/or the voice information and acquiring push information corresponding to the push object, wherein the push information comprises attribute information of the push object; and the multimedia playing device is connected with the controller and is used for displaying the pushing information corresponding to the pushing object.

According to another aspect of the embodiments of the present invention, there is also provided an information processing method of a home appliance, including: the method comprises the following steps of collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information; pushing corresponding push information according to the commodity information, wherein the push information comprises attribute information of a push object, and the push object is determined according to the commodity information; generating payment information for transacting the push object in the event that an instruction to select the push object is received; receiving payment credentials, wherein the payment credentials include any one or more of: a payment password, a facial image payment credential, or a voice payment credential; determining whether the transaction of the push object is successful according to the payment credential.

According to another aspect of the embodiments of the present invention, there is also provided an information pushing method for a home appliance, including: displaying a push object, wherein the push object is determined according to commodity information of commodities required to be purchased, and the commodity information comprises: image information and/or voice information; displaying push information corresponding to the push object, wherein the push information comprises: the first attribute information of the push object in the target offline trading body and/or the second attribute information of the push object in the online trading body.

According to another aspect of the embodiments of the present invention, there is also provided an information pushing apparatus for a home appliance, including: the acquisition module is used for acquiring the commodity information of the commodity needing to be purchased, wherein the commodity information comprises: image information and/or voice information; the determining module is used for determining a pushing object by analyzing the commodity information; the acquisition module is used for acquiring push information corresponding to a push object, wherein the push information comprises attribute information of the push object; and the display module is used for controlling the household appliance to display the push information corresponding to the push object.

According to another aspect of the embodiments of the present invention, there is also provided a storage medium, wherein the storage medium includes a stored program, and wherein, when the program runs, the apparatus on which the storage medium is controlled performs the following steps: the method comprises the following steps of collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information; determining a pushing object by analyzing commodity information; acquiring push information corresponding to a push object, wherein the push information comprises attribute information of the push object; and controlling the household appliance to display the push information corresponding to the push object.

According to another aspect of the embodiments of the present invention, there is further provided a processor, wherein the processor is configured to execute a program, and the program executes the following steps: the method comprises the following steps of collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information; determining a push object by analyzing commodity information; acquiring push information corresponding to a push object, wherein the push information comprises attribute information of the push object; and controlling the household appliance to display the push information corresponding to the push object.

According to another aspect of the embodiments of the present invention, there is also provided an information push system for a home appliance, including: a processor; and a memory coupled to the processor for providing instructions to the processor for processing the following processing steps: the method comprises the following steps of collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information; determining a push object by analyzing commodity information; acquiring push information corresponding to a push object, wherein the push information comprises attribute information of the push object; and controlling the household appliance to display the push information corresponding to the push object.

According to another aspect of the embodiments of the present invention, there is also provided an information processing method of a home appliance, including: determining a pushing object according to the collected commodity information, wherein the commodity information comprises: image information and/or voice information; acquiring attribute information of a push object in at least one channel, wherein the at least one channel comprises: a target offline transaction agent and/or an online transaction agent; verifying whether the target transaction is successful according to the received payment voucher, wherein the target transaction is a transaction performed on the selected pushing object; and under the condition that the target transaction is successful, sending the position information of the position of the household appliance.

In the embodiment of the invention, the commodity information of the commodity to be purchased is collected, the push object is determined by analyzing the commodity information, the push information corresponding to the push object is obtained, the household appliance is controlled to display the push information corresponding to the push object, the household appliance is combined with the intelligent camera and the voice recognition system, the purpose of pushing the commodity for a user through the household appliance is achieved, the user can purchase the commodity while performing other actions, and a shopping scene separated from a mobile terminal is realized.

Therefore, the technical problem of single function of the intelligent household appliance in the prior art is solved by the embodiment of the application.

Drawings

The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:

FIG. 1 is a schematic diagram of a prior art intelligent magic mirror;

fig. 2 illustrates a hardware configuration block diagram of a computer terminal (or mobile device) for implementing an information push method of a home appliance;

fig. 3 is a flowchart of an information pushing method of a home appliance according to embodiment 1 of the present application;

FIG. 4 is a schematic view of a mirror according to embodiment 1 of the present application;

FIG. 5 is a schematic view of a mirror for collecting image information according to embodiment 1 of the present application;

FIG. 6 is a schematic diagram of a mirror displaying push information in a display area according to embodiment 1 of the present application;

fig. 7 is a schematic view of a household appliance being a refrigerator according to embodiment 1 of the present application;

fig. 8 is a schematic view of a home appliance according to embodiment 2 of the present application;

fig. 9 is a flowchart of an information processing method of a home appliance according to embodiment 3 of the present application;

fig. 10 is a flowchart of an information push method of a home appliance according to embodiment 4 of the present application;

fig. 11 is a schematic view of an information pushing device of a household appliance according to embodiment 5 of the present application;

fig. 12 is a schematic view of an information processing apparatus of a home appliance according to embodiment 6 of the present application;

fig. 13 is a schematic view of an information push apparatus of a home appliance according to embodiment 7 of the present application;

fig. 14 is a flowchart of an information push method of a home appliance according to embodiment 8 of the present application;

fig. 15 is a schematic view of an information push apparatus of a home appliance according to embodiment 9 of the present application; and

fig. 16 is a block diagram of a computer terminal according to embodiment 10 of the present application.

Detailed Description

In order to make the technical solutions of the present invention better understood, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be obtained by a person skilled in the art without making any creative effort based on the embodiments in the present invention, shall fall within the protection scope of the present invention.

It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the invention described herein are capable of operation in sequences other than those illustrated or described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.

Example 1

According to an embodiment of the present invention, there is also provided an information pushing method embodiment of a home appliance, where it should be noted that the steps shown in the flowchart of the attached drawings may be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described may be executed in an order different from that shown or described herein.

The method provided by the first embodiment of the present application may be executed in a mobile terminal, a computer terminal, or a similar computing device. Fig. 2 shows a hardware configuration block diagram of a computer terminal (or mobile device) for implementing an information push method of a home appliance. As shown in fig. 2, the computer terminal 20 (or mobile device 20) may include one or more (shown as 202a, 202b, … …, 202 n) processors 202 (the processors 202 may include, but are not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA, etc.), a memory 204 for storing data, and a transmission module 206 for communication functions. Besides, the method can also comprise the following steps: a display, an input/output interface (I/O interface), a Universal Serial Bus (USB) port (which may be included as one of the ports of the I/O interface), a network interface, a power source, and/or a camera. It will be understood by those skilled in the art that the structure shown in fig. 2 is only an illustration and is not intended to limit the structure of the electronic device. For example, the computer terminal 20 may also include more or fewer components than shown in FIG. 2, or have a different configuration than shown in FIG. 2.

It should be noted that the one or more processors 202 and/or other data processing circuitry described above may be referred to generally herein as "data processing circuitry". The data processing circuitry may be embodied in whole or in part in software, hardware, firmware, or any combination thereof. Further, the data processing circuit may be a single stand-alone processing module, or incorporated in whole or in part into any of the other elements in the computer terminal 20 (or mobile device). As referred to in the embodiments of the application, the data processing circuit acts as a processor control (e.g. selection of a variable resistance termination path connected to the interface).

The memory 204 may be used to store software programs and modules of application software, such as program instructions/data storage devices corresponding to the information pushing method of the home appliance in the embodiment of the present invention, and the processor 202 executes various functional applications and data processing by running the software programs and modules stored in the memory 204, that is, implements the information pushing method of the home appliance. Memory 204 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 204 may further include memory located remotely from the processor 202, which may be connected to the computer terminal 20 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The transmission means 206 is used for receiving or sending data via a network. Specific examples of the network described above may include a wireless network provided by a communication provider of the computer terminal 20. In one example, the transmission device 206 includes a Network adapter (NIC) that can be connected to other Network devices through a base station to communicate with the internet. In one example, the transmission device 206 can be a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.

The display may be, for example, a touch screen type Liquid Crystal Display (LCD) that may enable a user to interact with a user interface of the computer terminal 20 (or mobile device).

It should be noted here that in some alternative embodiments, the computer device (or mobile device) shown in fig. 2 described above may include hardware elements (including circuitry), software elements (including computer code stored on a computer-readable medium), or a combination of both hardware and software elements. It should be noted that fig. 2 is only one example of a particular specific example and is intended to illustrate the types of components that may be present in the computer device (or mobile device) described above.

Under the operating environment, the application provides an information pushing method of the household appliance as shown in fig. 3. Fig. 3 is a flowchart of an information push method for a household appliance according to embodiment 1 of the present application.

Step S31, collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information.

The above step S31 is performed by the household appliance having the image pickup device and the sound pickup device mounted thereon, and the image information may be picked up by the image pickup device on the household appliance and the voice information may be picked up by the sound pickup device on the household appliance. The image acquisition device may be a camera and the sound acquisition device may be a microphone. The position of image acquisition device and sound acquisition device installation can carry out corresponding setting with domestic appliance's outward appearance, and this application contrast is not as specifically restricting.

In an alternative embodiment, a household appliance is taken as a mirror for explanation, fig. 4 is a schematic view of a mirror according to embodiment 1 of the present application, and as shown in fig. 4, the mirror includes a mirror surface 40, the mirror surface 40 is also used as a display interface, and may have a touch control function, and displays an interface displayed by a display module located behind the mirror surface 40; the camera 41 is arranged on the upper part of the mirror surface and used for collecting image information; a microphone 42 for collecting voice information; and a left speaker 43 and a right speaker 44 for voice interaction and broadcasting some information. In the following embodiments, a home appliance will be described as an example of the mirror.

Based on the mirror shown in fig. 4, the user can aim the existing merchandise at the camera so that the mirror identifies the merchandise. Fig. 5 is a schematic diagram of a mirror acquiring image information according to embodiment 1 of the present application, and in combination with fig. 5, a user holds a lipstick in a hand to aim at a camera of the mirror, where the lipstick is a commodity that the user needs to purchase, and the camera of the mirror acquires the image information shown in fig. 5.

In an alternative embodiment, the mirror can also collect voice information through the microphone 42. When the user does not have the commodity needing to be purchased on hand, the commodity cannot be displayed in front of the camera of the mirror. At this time, the user can make the mirror acquire the voice information by means of "speaking" the commodity to the mirror. The voice message that the user "speaks" into the mirror may include parameters such as the name of the item, the brand, etc., while the user may "speak" the item to be purchased using a fixed sentence pattern to make the mirror easier to identify.

Step S33, determining the push object by analyzing the image information and/or the voice information.

Specifically, the push object is a commodity which is determined by the household appliance according to the image information and/or the voice information and is required by the user.

In an optional embodiment, after the mirror acquires the image information, the mirror analyzes an area where the push object is located in the image information, and extracts an image of the push object from the image information. With reference to the example of fig. 5, the user extracts an image of lipstick from the image information, and then performs image matching in the website according to the image of lipstick, so as to obtain a similar lipstick to the lipstick in the image, thereby determining the push object.

In another optional embodiment, after the mirror acquires the voice information, voice recognition is performed on the voice information to obtain characters corresponding to the voice information, and information such as names of push objects is extracted from the characters by processing the characters such as extracting keywords, so that the push objects are determined. For example: the user sends out voice information 'I want to buy No. 43 Kaempferia lipstick' to the mirror, the mirror extracts keywords, 'No. 43', 'Kaempferia' and 'lipstick', and therefore the pushing object can be determined to be No. 43 Kaempferia lipstick.

It should be noted that the website for searching the image and the search keyword may be a shopping website, and the obtained push object is a product that is allowed to be purchased by the user in the shopping website.

It should be further noted that one or more of the above-mentioned push objects may be used. For example, still referring to fig. 5, the lipstick held by the user is the lipstick of the lipstick number 43, but since the shape of the lipstick is similar to that of some lipsticks of other brands and the lipstick number 43 has multiple choices on the shopping website, the push object includes multiple recognition results for the user to select.

Step S35, obtaining push information corresponding to the push object, where the push information includes attribute information of the push object.

Specifically, the attribute information of the push object may include information of a source, a price, a product model, and the like of the push object. The push information is used for facilitating the selection of the push object by the user. For example: after the push object is determined, the shopping website returns the attribute information corresponding to the push object.

Since the same commodity may have different prices when purchased through different channels, that is, the same pushed object may have different attribute information in different shopping channels, the pushed information may be the attribute information corresponding to the pushed object in different channels.

And step S37, controlling the household appliance to display the push information corresponding to the push object.

In the above step S37, the home appliance displays the push information in the display area according to a predetermined display mode.

In an alternative embodiment, in combination with the mirror shown in fig. 4, a rectangle in the mirror is a display area, and the home mirror displays the push information corresponding to the push object in the rectangular display area in the mirror.

Fig. 6 is a schematic diagram of a mirror displaying push information in a display area according to embodiment 1 of the present application. As shown in fig. 6, after the push information is acquired in step S35, the determined push object is displayed on the left side of the display interface in the screen, and the attribute information of the push object in the plurality of different shopping channels is displayed on the right side. Specifically, in this embodiment, it is determined that the push target is a lipstick/lipstick of a baby, and attribute information such as time to market, product specification, place of production, and the like; the right side is the specific attribute information of the pushed object in several shopping channels of convenience stores (off-line brick-and-mortar stores), Jingdong and small red books. The user may select any one or more of the right-hand sides for purchase.

Therefore, according to the embodiment of the application, the commodity information of commodities needing to be purchased is collected, the push object is determined by analyzing the commodity information, the push information corresponding to the push object is obtained, the household appliance is controlled to display the push information corresponding to the push object, the household appliance is combined with the intelligent camera and the voice recognition system, the purpose of pushing the commodities for a user through the household appliance is achieved, the user can purchase the commodities while performing other actions, and a shopping scene separated from a mobile terminal is achieved.

As an alternative embodiment, determining the push object by analyzing the image information and/or the voice information includes: acquiring image information of a commodity in the image information by performing image recognition on the image information, and/or acquiring text information corresponding to the commodity by performing voice recognition on the voice information; determining a first object according to the image information of the commodity and/or the text information corresponding to the commodity; the first object is determined to be a push object.

Specifically, the steps may be executed by a camera and a microphone of the household appliance, or may be executed by a controller of the household appliance. The commodity in the image information can be a handheld object of a user, namely, an object of the user aiming at the camera, and the image information of the commodity can be extracted from the image information through a preset neural network model.

After the image information of the commodity is obtained, the image information of the commodity is further identified, and the commodity which needs to be purchased by the user, namely the first object, can be determined in a mode of comparing the image of the commodity with a large number of commodity images in the database.

After the text information corresponding to the voice information is obtained, keywords may be extracted from the text information according to a predetermined sentence pattern rule, and the first object may be determined by a combination of one or more keywords.

In an alternative embodiment, when the household appliance acquires both the image information and the voice information, the household appliance may determine the push object by using the image information and the voice information, and the determined push object is more accurate because more information is acquired. For example, the user holds the commodity and aims at the camera of the mirror, and sends out voice information "i want to buy lipstick of the same color, and the mirror can combine image information and voice information to determine a pushing object at the moment, and filters out the commodity of the same color as lipstick in the image information.

As an alternative embodiment, after determining that the first object is a push object, determining the push object by analyzing the commodity information further includes: acquiring a second object associated with the first object, wherein the second object comprises any one or more of the following items: an object of the same type as the first object and an object having a trade relationship with the first object; determining the second object as a push object.

Specifically, the type may indicate a type of a commodity, and the object having a transaction relationship with the first object is used to indicate that a purchase with a push object has a special event, or that another push object is sold together with the push object as a package.

In an alternative embodiment, as shown in fig. 6, when the user further wants to know a second object of the same type as the first object, the user may click "search around" or speak an instruction of "search around", and the mirror may search according to the lipstick to obtain other brands of lipstick or other cosmetics (e.g., eyebrow pencil, foundation) or other goods.

In another alternative embodiment, as shown in fig. 6, the user may purchase a cosmetic package more favorably, so if the user needs to purchase a cosmetic package, the user may click "package recommendation" or vocally issue an instruction of "package recommendation", and the mirror may search for a package of the current push object or a package of the same brand as the current push object according to the current push object to push to the user as the second object.

As an optional embodiment, the obtaining push information corresponding to a push object includes: acquiring first attribute information of the push object in a target offline transaction main body and/or second attribute information of the push object in an online transaction main body.

Specifically, the off-line transaction subject is a physical store, and the on-line transaction subject is an online shopping website. The first attribute information may include a price, a production date, and a geographical location of the target offline transaction body of the push object in the target offline transaction body, and the second attribute information may include a price, a production date, and the like of the push object in various shopping websites.

In the scheme, a plurality of shopping channels are provided for the user, and the shopping channel is not limited to a shopping website.

In an alternative embodiment, still referring to fig. 6, in the push information shown in fig. 6, information corresponding to the convenience stores in the first column on the right side is first attribute information, and information corresponding to the jingdong and the small red book in the second column is second attribute information.

It should be noted that, the target offline transaction principal may be an offline transaction principal that satisfies a predetermined condition, and the predetermined condition may be: and the offline transaction main body is away from the position of the household appliance by a distance less than a preset distance. Thereby being convenient for the user to carry or deliver goods.

The scheme provides at least two purchase modes of the push object for the user, and if the things purchased by the user are urgent commodities, the user can select from the target offline transaction main body, so that the push object can be purchased quickly.

Fig. 7 is a schematic diagram of a household appliance as a refrigerator according to embodiment 1 of the present application, and as shown in fig. 7, when a user finds that soy sauce in a home is used up and needs to be purchased as soon as possible during cooking, the user sends a voice message "i want to buy marine soy sauce" to the refrigerator, and the refrigerator displays, in a display area at an upper right portion, push information corresponding to a push object "marine soy sauce", including attribute information of marine soy sauce in convenience stores and marine soy sauce in a shopping website, so that the user can purchase soy sauce from different channels according to his own purchase demand. Since the user is in urgent need of soy sauce, the user can choose to purchase soy sauce through the channel of a convenience store.

As an optional embodiment, before obtaining the first attribute information of the push object in the target offline transaction main body and/or the second attribute information of the push object in the online transaction main body, the method further includes: receiving a recommendation instruction for selecting a recommendation range, wherein the instruction comprises: offline recommendation and online recommendation; if the instruction is an online recommendation, acquiring first attribute information of a pushed object in a target offline transaction main body; and if the instruction is online recommendation, acquiring second attribute information of the pushing object in the online transaction main body.

Specifically, the recommendation instruction is used to determine whether the user wishes to purchase online or online. The recommendation instruction can be sent by a control of the touch display area of the user, and can also be sent by the user in a voice instruction mode. And if the household appliance receives an online recommendation instruction or an offline recommendation instruction, recommending the pushing object according to the received instruction.

As an optional embodiment, the obtaining first attribute information of the push object in the target offline transaction main body and/or second attribute information of the push object in the online transaction main body includes: acquiring the position information of the household appliance; detecting whether a target offline transaction main body comprising a push object exists in a preset range of the position information or not according to the position information; if the target offline trading main body comprising the pushed object exists, acquiring first attribute information of the pushed object in the target offline trading main body according to the monitored target offline trading main body; and if the target offline trading main body comprising the push object does not exist, acquiring second attribute information of the push object in the online trading main body.

Specifically, the position information of the household appliance may be input by a user when the household appliance is used for the first time, or may be located by a gyroscope in the household appliance. The target offline transaction main body comprising the push object is used for showing, and the sold commodity comprises an offline physical store of the push object.

In an alternative embodiment, and the predetermined range is 1.5 km for example, first, a convenience store within 1.5 km from the home appliance is searched for, centering on the home appliance. And then detecting whether the searched convenience store sells the push object, and if the push object is sold, determining the attribute information of the push object in the convenience store as the first attribute information. As described above, in the case of buying soy sauce, since 5 convenience stores are included within 1.5 km and 2 convenience stores sell the marine soy sauce requested by the user among the 5 convenience stores, the attribute information of the marine soy sauce in the 2 convenience stores is acquired as the first attribute information, for example: price, date of production, and address of convenience store, etc.

Still in the above embodiment, if there is no convenience store within 1.5 km of the home appliance, or no marine soy sauce is sold in any convenience store within 1.5 km, it is a case where there is no target offline transaction subject. And under the condition that the target offline transaction main body does not exist, acquiring second attribute information of the object in the online transaction main body.

As an optional embodiment, the obtaining of the second attribute information in the online transaction main body by the push object includes: searching for a push object in objects included in a preset online transaction subject; and acquiring a search result, wherein the search result comprises second attribute information of the pushing object in the online transaction main body.

Specifically, the preset online transaction subject is a preset shopping website, for example: jingdong, Small Red book, Weipin Hui, Amazon, etc. The push object is searched on the preset online transaction main body, the name of the push object can be searched, and the search result is the push object sold in the shopping website.

In an alternative embodiment, still taking the above-mentioned push object as the number 43 xiangnaier lipstick as an example, the preset online transaction main body is the kyoto and small red book. And searching 43 th-Chanel lipstick on the Beijing east and the small red book respectively, wherein the obtained attribute information of the commodity is the second attribute information.

As an optional embodiment, after controlling the home appliance to display the push information corresponding to the push object, the method further includes: receiving an instruction for selecting a push object; and displaying payment information for trading the pushed object.

Specifically, the instruction for selecting the push object is a purchase instruction sent by the user, and the selected push object is a commodity which the user needs to purchase. The payment information may include information such as payment amount and payment method.

In an alternative embodiment, the user may issue the selection instruction by touching the selection control of the display area, or by issuing a voice message.

As an optional embodiment, after presenting the payment information for trading the push object, in the case that the push object is a push object in the target offline trading subject, the method further includes: detecting whether the transaction is completed; and receiving a delivery instruction for selecting whether to deliver the pushed object or not when the transaction is completed.

Specifically, the delivery instruction is used to determine whether the goods purchased by the user are self-provided by the user to the target offline transaction main body or delivered by the target offline transaction main body.

In an alternative embodiment, the user selects the goods of the physical convenience store, and after the user pays the goods in a voice payment or facial payment mode, the screen displays a delivery mode selection interface, and the user selects the required delivery mode.

As an optional embodiment, after presenting the payment information for the transaction push object, the method includes: receiving payment credentials for conducting a transaction with a pushed object, wherein the payment credentials include any one or more of: a payment password, a facial image payment credential, and a voice payment credential.

Specifically, the payment credentials correspond to a payment mode selected by the user.

In an alternative embodiment, the household appliance is associated with a bank card of a user, when the user uses the household appliance to purchase goods, the household appliance automatically jumps to a third party payment interface, and the user inputs a corresponding password to complete the payment of the purchase.

In another optional embodiment, the household appliance binds an account of the third party payment application of the user, and when the user uses the household appliance for payment, the user jumps to a payment interface of the third party payment application. The face information of the user in the third-party payment application has a binding relation with the specified account, and when the third-party payment application detects the face information of the user, the face image information of the user is used as a face image payment certificate, and payment is carried out by using the specified account.

In yet another alternative embodiment, the household appliance binds to an account of the third party payment application of the user, and when the user determines to purchase goods, jumps to a payment interface of the third party payment application. And the voice information of the user in the third-party payment application has a binding relationship with the specified account, the household appliance displays preset characters, and the user reads the characters displayed by the household appliance. The household appliance takes voice information of the user reading the preset characters as a voice payment certificate, and the user uses a designated account to pay under the condition that the voice payment certificate is verified successfully.

As an alternative embodiment, the household appliance is any one of: mirrors, refrigerators, and televisions.

Specifically, the mirror may be a mirror disposed in various positions, for example: vestibule mirror, bathroom mirror, dressing mirror, etc. It can also be applied in various scenarios, such as: home scenes, hotels, public space scenes, beauty institution scenes, retail terminal scenes for homes/wardrobes/clothing.

It should be noted that, for simplicity of description, the above-mentioned method embodiments are described as a series of acts or combination of acts, but those skilled in the art will recognize that the present invention is not limited by the order of acts, as some steps may occur in other orders or concurrently in accordance with the invention. Further, those skilled in the art should also appreciate that the embodiments described in the specification are preferred embodiments and that the acts and modules referred to are not necessarily required by the invention.

Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (such as a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.

Example 2

According to an embodiment of the present invention, there is also provided a household appliance, fig. 8 is a schematic diagram of a household appliance according to embodiment 2 of the present application, and as shown in fig. 8, the household appliance 800 includes:

and the image acquisition device 80 is used for acquiring the image information of the commodity needing to be purchased.

Specifically, above-mentioned image acquisition device can be the camera, and the position of image acquisition device installation can carry out corresponding setting with domestic appliance's outward appearance, and this application contrast is not as specific restriction.

In an alternative embodiment, shown in connection with fig. 4, in which the household appliance is a mirror, the user aims the existing article at the camera so that the mirror identifies the article. Referring to fig. 5, a user holds a lipstick in his/her hand to be directed at the camera of the mirror, where the lipstick is a commodity that the user needs to purchase, and the camera of the mirror acquires an image as shown in fig. 5.

And the sound acquisition device 82 is used for acquiring the voice information of the commodity needing to be purchased.

Specifically, above-mentioned sound collection system can be the microphone, and the position of sound collection system installation can carry out corresponding setting with domestic appliance's outward appearance, and this application contrast is not as specific restriction.

In another optional embodiment, the household appliance can also collect voice information through a microphone. When the user does not have the commodity to purchase on hand, the commodity cannot be displayed in front of the camera of the household appliance. At this time, the user can make the household appliance obtain the voice information in a mode of "speaking" the commodity to the household appliance. The goods "spoken" by the user to the home appliance may include parameters such as name, brand, etc., or may use a fixed sentence pattern to make the home appliance easier to recognize.

The controller 84 determines a push object by analyzing the image information and/or the voice information, and acquires push information corresponding to the push object, wherein the push information includes attribute information of the push object.

Specifically, the controller is configured to execute step S31 to step S355 in embodiment 1, which is specifically shown in embodiment 1.

And the multimedia playing device 86 is connected with the controller and is used for displaying the pushing information corresponding to the pushing object.

Specifically, the multimedia playing device may include an image playing device, for example: display screens, etc., and may also include sound playing means, such as: a sound box, etc. Through the multimedia playing device, push information in various forms such as videos, images and audios can be displayed.

In an alternative embodiment, a household appliance is taken as a mirror for explanation, fig. 4 is a schematic view of a mirror according to embodiment 1 of the present application, and as shown in fig. 4, the mirror includes a mirror surface 40, the mirror surface 40 is also used as a display interface, and may have a touch control function, and displays an interface displayed by a display module located behind the mirror surface 40; the camera 41 is arranged on the upper part of the mirror surface and used for collecting image information; a microphone 42 for collecting voice information; and a left speaker 43 and a right speaker 44 for performing voice interaction, broadcasting some information, and the like. In the following embodiments, a home appliance will be described as an example of the mirror.

It is worth noting that in the above embodiments of the present application, the image acquisition device and the sound acquisition device are used to collect the commodity information of the commodity to be purchased, the controller is used to analyze the commodity information to determine the push object, the push information corresponding to the push object is obtained, the household appliance is controlled to display the push information corresponding to the push object, the household appliance is combined with the smart camera and the voice recognition system, so as to achieve the purpose of pushing the commodity for the user through the household appliance, so that the user can purchase the commodity while performing other actions, thereby realizing a shopping scene separated from the mobile terminal, and the household appliance provided in the above embodiments can be any one of the electric devices, so that the application of the smart home in the home scene is wider.

As an optional embodiment, the image capturing device is further configured to capture a facial image payment certificate, and the sound capturing device is further configured to capture a sound payment certificate.

Specifically, the facial image payment credential may be facial image information of the user, and the voice payment may be a specified text read by the voice of the user.

The user can select any payment method to pay for the selected push object. In an optional embodiment, the household appliance binds an account of the third party payment application of the user, and when the user uses the household appliance for payment, the user jumps to a payment interface of the third party payment application. The face information of the user in the third-party payment application has a binding relation with the account of the user, and after the third-party payment application detects the face information of the user, the face image information of the user is used as a face image payment certificate, and the user account is used for complete payment.

In yet another optional embodiment, the household appliance binds an account of the third party payment application of the user, and when the user uses the household appliance for payment, jumps to a payment interface of the third party payment application. And after the third-party payment application detects the facial information of the user, displaying preset characters, and reading the characters displayed by the household appliance by the user. The household appliance takes the voice information of the user reading the preset characters as a voice payment certificate and uses the account of the user for complete payment.

Specifically, the mirror may be a mirror disposed in various positions, for example: hallway mirror, bathroom mirror, dressing mirror, etc. It can also be applied in various scenarios, such as: home scenes, hotels, public space scenes, beauty institution scenes, retail terminal scenes for homes/wardrobes/clothing.

It should be further noted that the household appliance in this embodiment may also perform other steps in embodiment 1.

Example 3

According to an embodiment of the present invention, there is also provided an information processing method of a home appliance, and fig. 9 is a flowchart of an information processing method of a home appliance according to embodiment 3 of the present application, which is shown in conjunction with fig. 9, and includes:

step S91, collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information.

The above step S91 is performed by the household appliance having the image pickup device and the sound pickup device mounted thereon, and the image information may be picked up by the image pickup device on the household appliance and the voice information may be picked up by the sound pickup device on the household appliance. The image acquisition device may be a camera and the sound acquisition device may be a microphone. The position of image acquisition device and sound acquisition device installation can carry out corresponding setting with domestic appliance's outward appearance, and this application contrast is not as specifically restricting.

In an alternative embodiment, the user holds the commodity to be purchased by hand and aims at the camera of the household appliance, so that the household appliance acquires the commodity information of the commodity.

In another alternative embodiment, the user "says" the name, brand, or other commodity features of the commodity to be purchased to the home appliance, and the home appliance also obtains the commodity information of the commodity.

And step S93, pushing corresponding push information according to the commodity information, wherein the push information comprises attribute information of a push object, and the push object is determined according to the commodity information.

Specifically, the above steps determine a push object corresponding to the commodity information by analyzing the commodity information of the commodity required to be purchased, so as to determine recommendation information according to the push object. The method comprises the following specific steps: determining a pushing object by analyzing commodity information; acquiring push information corresponding to a push object; and pushing the pushing information.

In an optional embodiment, taking a household appliance as an example of a mirror, after the mirror acquires the image information, the mirror analyzes an area where a push object is located in the image information, and extracts an image of the push object from the image information. With reference to the example of fig. 5, the user extracts an image of lipstick from the image information, and then performs image matching in the website according to the image of lipstick, so as to obtain a similar lipstick to the lipstick in the image, thereby determining the push object.

Specifically, the push information may include information such as a source, a price, and a product model of the push object. The push information is used for facilitating the selection of the push object by the user. For example: after the push object is determined, the shopping website returns the push information corresponding to the push object.

It should be noted that, because the same product may have different prices when purchased through different channels, that is, the same pushed object may have different attribute information in different shopping channels, the pushed information may be attribute information of the pushed object when purchased through different channels.

In step S95, in the case of receiving an instruction for selecting a push object, payment information for trading the push object is generated.

Specifically, the instruction for selecting the push object is a purchase instruction.

In an alternative embodiment, the home appliance displays push information corresponding to push objects in a plurality of shopping channels, the user determines a desired one to purchase by comparing the push information of different shopping channels, and the user may touch a touch panel of the home appliance to issue an instruction for the user to select a push object, or issue an instruction for the user to select a push object by voice.

After receiving the instruction for selecting the push object, the household appliance generates an order, wherein the order at least comprises payment information for trading the push object, and the payment information can comprise information such as payment amount and payment mode.

Step S97, receiving a payment credential, wherein the payment credential includes any one or more of the following: a payment password, a facial image payment credential, or a voice payment credential.

In particular, the payment credentials correspond to a payment method for the selection.

In another optional embodiment, the household appliance is bound to an account of the third party payment application of the user, and when the user uses the household appliance to make payment, the user jumps to a payment interface of the third party payment application. The third party payment application enables the face information of the user to have a binding relation with the appointed account, and when the third party payment application detects the face information of the user, the face image information of the user is used as a face image payment certificate, and payment is completed through the appointed account.

In another optional embodiment, the household appliance is bound to an account of the third party payment application of the user, and when the user uses the household appliance to make payment, the user jumps to a payment interface of the third party payment application. The third party payment application enables the sound information of the user to have a binding relation with the specified account, when the third party payment application detects the face information of the user, preset characters are displayed, and the user reads the characters displayed by the household appliance. The household appliance takes the voice information of the user reading the preset characters as a voice payment certificate, and payment is completed by using the appointed account.

Step S99, determining whether the transaction of the push object is successful according to the payment credentials.

In the step S99, after the household appliance obtains the payment credential, the payment credential is transmitted to the third party payment application, and the third party payment application verifies the payment credential according to the predetermined payment logic, and determines that the payment is successful if the verification is successful.

In the above-mentioned embodiment of this application, combine domestic appliance with intelligent camera and speech recognition system, realized for the purpose of the convenient purchase commodity of user through domestic appliance, make the user can carry out other actions while buying commodity, and the payment can use the mode of making sound payment voucher or facial payment voucher to pay, and further liberation user's both hands practices thrift the time that the user spent shopping. The household appliance provided by the embodiment can be any one device in a home scene, so that the intelligent home can be widely applied in the home scene.

As an optional embodiment, acquiring push information corresponding to a push object includes: acquiring first attribute information of the push object in a target offline transaction main body and/or second attribute information of the push object in an online transaction main body.

Therefore, the embodiment of the application realizes the combination of shopping scenes of the off-line physical store and the on-line online store, and the user can complete shopping while doing housework through face payment and voice recognition, so that the shopping scene of the mobile terminal is separated, and the purpose of knowing and releasing the hands of the user is achieved.

Example 4

According to an embodiment of the present invention, there is further provided an information push method for a home appliance, and fig. 10 is a flowchart of an information push method for a home appliance according to embodiment 3 of the present application, and with reference to fig. 10, the method includes:

step S101, displaying a push object, wherein the push object is determined according to commodity information of a commodity needing to be purchased, and the commodity information comprises: image information and/or voice information.

The step S101 is performed by the household appliance equipped with the image acquisition device and the sound acquisition device, and may acquire image information through the image acquisition device on the household appliance and acquire voice information through the sound acquisition device on the household appliance. The image acquisition device may be a camera and the sound acquisition device may be a microphone. The position of image acquisition device and sound acquisition device installation can carry out corresponding setting with domestic appliance's outward appearance, and this application contrast is not as specifically restricting.

The specific manner of determining the push object according to the commodity information of the commodity required to be purchased may be as shown in embodiment 1, and is not described herein again.

In the above step S101, after determining the push object, the household appliance displays the image information of the push object through the display device installed at the predetermined position, specifically, the left side of the display interface as shown in fig. 6.

Step S103, displaying push information corresponding to the push object, wherein the push information comprises: the first attribute information of the push object in the target offline trading main body and/or the second attribute information of the push object in the online trading main body.

In an alternative embodiment, and still referring to FIG. 6, the push information of the push object in a plurality of different shopping channels is displayed on the right side. Specifically, in this embodiment, it is determined that the push target is a lipstick/lipstick of a baby, and attribute information such as time to market, product specification, place of production, and the like; on the right side, specific attribute information of objects pushed in several shopping channels, namely a convenience store (off-line brick and mortar store), the kyoto and a small red book, is shown. The user may select any one or more of the right-hand sides for purchase.

Therefore, according to the scheme provided by the embodiment of the application, the household appliance is combined with the intelligent camera and the voice recognition system, the purpose of pushing commodity information for the user is achieved, information corresponding to the online transaction main body and information corresponding to the offline transaction main body are recommended to the user, online shopping and offline shopping are combined, and the user can select the corresponding shopping mode according to the requirement. The household appliance provided by the embodiment can be any one device in a home scene, so that the intelligent home can be widely applied in the home scene.

As an alternative embodiment, the method further includes: and displaying a first pushing control, wherein when the first pushing control is triggered, pushing information of other pushing objects having a transaction relation with the pushing object is displayed.

Specifically, the transaction relationship is used to indicate that other push objects having a preference are purchased together with the push object, sold together with the push object as a package, or the like.

In an alternative embodiment, shown in fig. 6, the "package recommendation" control in fig. 6 is the first push control. The user can click the package recommendation or send a package recommendation instruction by voice, and the mirror can search the package including the current push object or the package with the same brand as the current push object according to the current push object to be pushed to the user as other push objects.

As an alternative embodiment, the method further comprises:

and displaying a second pushing control, wherein when the second pushing control is triggered, pushing information of other pushing objects with the same type as the pushing object is displayed.

Specifically, the above type may identify a commodity type.

In an alternative embodiment, as shown in fig. 6, the "peripheral search" control in fig. 6 is the second push control. When the user wants to know other pushed objects of the same type as the pushed objects, the user can click the periphery search instruction or send the periphery search instruction by voice, and the mirror can search according to the lipstick to obtain lipsticks of other brands or other types of cosmetics (such as eyebrow pencils and foundation) and other products.

As an optional embodiment, after displaying the push information corresponding to the push object, the method further includes: in the event that an instruction is received to select a push object, payment information for transacting the push object is displayed.

As an alternative embodiment, in case of receiving an instruction for selecting a push object, displaying payment information for transacting the push object includes: and displaying the preset characters, wherein the preset characters are used for acquiring the corresponding voice payment voucher.

Specifically, the voice payment voucher is voice information sent by the user during voice payment, the third-party payment application compares the voice information of the user with pre-stored voice information associated with the account through voiceprint so as to verify the voice payment, and the preset characters are characters for guiding the user to read aloud.

In an alternative embodiment, the predetermined text may be: voice payment is convenient for you and me. The home appliance displays payment information such as payment amount and displays information for prompting a user to perform voice payment, for example: if you choose voice payment, please read the following: voice payment is convenient for you and me.

As an optional embodiment, in case of receiving an instruction for selecting a push object, after displaying payment information for transacting the push object, the method further comprises: and displaying a payment result, wherein the payment result is used for indicating whether the payment is successful or not.

In an alternative embodiment, if the user does not present any payment credentials within a predetermined time, or the third party payment application fails to verify the payment credentials, the payment result is a payment failure, and the home appliance displays the payment result of the payment failure.

In another alternative embodiment, if the payment credentials presented by the user are successfully verified by the third party payment application, the transaction is completed and the payment results of the successful payment are displayed.

Example 5

According to an embodiment of the present invention, there is also provided an information push apparatus for implementing the home appliance of embodiment 1 above, as shown in fig. 11, the apparatus 110 includes:

the collecting module 112 is configured to collect commodity information of a commodity that needs to be purchased, where the commodity information includes: image information and/or voice information.

And the determining module 114 is used for determining the pushing object by analyzing the commodity information.

The obtaining module 116 is configured to obtain push information corresponding to a push object, where the push information includes attribute information of the push object.

And the display module 118 is configured to control the home appliance to display the push information corresponding to the push object.

It should be noted here that the acquiring module 112, the determining module 114, the obtaining module 116 and the displaying module 118 correspond to steps S31 to S37 in embodiment 1, and the two modules are the same as the corresponding steps in the implementation example and the application scenario, but are not limited to the disclosure in the first embodiment. It should be noted that the modules described above as part of the apparatus may be run in the computer terminal 10 provided in the first embodiment.

As an alternative embodiment, the determining module includes: the first acquisition sub-module is used for acquiring image information of the commodity in the image information by carrying out image identification on the image information and/or acquiring text information corresponding to the commodity by carrying out voice identification on the voice information; the first determining submodule is used for determining a first object according to the image information of the commodity and/or the text information corresponding to the commodity; and the second determining submodule is used for determining the first object as a push object.

As an optional embodiment, the determining module further comprises: after determining that the first object is a push object, a second obtaining sub-module, configured to obtain a second object associated with the first object, where the second object includes any one or more of: an object of the same type as the first object and an object having a trade relationship with the first object; and the third determining submodule is used for determining the second object as the push object.

As an alternative embodiment, the obtaining module includes: and the third acquisition submodule is used for acquiring the first attribute information of the push object in the target offline transaction main body and/or the second attribute information of the push object in the online transaction main body.

As an alternative embodiment, the apparatus further comprises: the receiving submodule is used for receiving a recommendation instruction for selecting a recommendation range before acquiring first attribute information of a push object in a target offline transaction main body and/or second attribute information of the push object in an online transaction main body, wherein the recommendation instruction comprises: offline recommendation and online recommendation; the fourth obtaining sub-module is used for obtaining first attribute information of the pushed object in the target offline transaction main body if the instruction is offline pushing; and the fifth obtaining submodule is used for obtaining second attribute information of the pushing object in the online trading main body if the instruction is online recommendation.

As an alternative embodiment, the receiving submodule includes: the acquisition unit is used for acquiring the position information of the household appliance; the detection unit is used for detecting whether a target offline transaction main body comprising a push object exists in a preset range of the position information or not according to the position information; the first obtaining unit is used for obtaining first attribute information of the pushed object in the target offline transaction main body according to the monitored target offline transaction main body if the target offline transaction main body comprising the pushed object exists; and the second acquisition unit is used for acquiring second attribute information of the push object in the online transaction main body if the target offline transaction main body comprising the push object does not exist.

As an alternative embodiment, the third obtaining sub-module includes: the search unit is used for searching for a push object in objects included in a preset online trading subject; and the acquisition unit is used for acquiring a search result, wherein the search result comprises second attribute information of the pushing object in the online trading main body.

As an alternative embodiment, the apparatus further comprises: the first receiving module is used for receiving an instruction for selecting a push object after controlling the household appliance to display the push information corresponding to the push object; and the display module is used for displaying payment information for trading the pushed object.

As an alternative embodiment, the apparatus further comprises: the detection module is used for detecting whether the transaction is finished or not under the condition that the pushing object is the pushing object in the target offline transaction main body after the payment information used for transacting the pushing object is displayed; and the second receiving module is used for receiving a distribution instruction for selecting whether to distribute the push object or not under the condition that the transaction is completed.

As an alternative embodiment, the apparatus further comprises: after the payment information for trading the pushed object is displayed, a third receiving module is used for receiving payment credentials for trading the pushed object, wherein the payment credentials include any one or more of the following items: a payment password, a facial image payment credential, and a voice payment credential.

Example 6

According to an embodiment of the present invention, there is also provided an information processing apparatus for implementing the home appliance of embodiment 3 above, as shown in fig. 12, the apparatus 120 including:

the collecting module 122 is configured to collect commodity information of a commodity that needs to be purchased, where the commodity information includes: image information and/or voice information.

And the pushing module 124 is configured to push corresponding pushing information according to the commodity information, where the pushing information includes attribute information of a pushing object, and the pushing object is determined according to the commodity information.

A generating module 126, configured to generate payment information for trading the push object in case of receiving an instruction for selecting the push object.

A receiving module 128, configured to receive payment credentials, where the payment credentials include any one or more of: a payment password, a facial image payment credential, or a voice payment credential.

A determining module 130, configured to determine whether the transaction of the push object is successful according to the payment credential.

It should be noted here that the above-mentioned acquiring module 122, pushing module 124, generating module 126, receiving module 128 and determining module 130 correspond to steps S91 to S99 in embodiment 3, and the two modules are the same as the corresponding steps in the implementation example and application scenario, but are not limited to the disclosure in the first embodiment. It should be noted that the modules described above as part of the apparatus may be run in the computer terminal 10 provided in the first embodiment.

As an alternative embodiment, the push module comprises: the determining submodule is used for determining a pushing object by analyzing the commodity information; the acquisition submodule is used for acquiring push information corresponding to a push object; and the pushing submodule is used for pushing the pushing information.

As an alternative embodiment, the obtaining sub-module includes: the acquisition unit is used for acquiring first attribute information of the push object in the target offline transaction main body and/or second attribute information of the push object in the online transaction main body.

Example 7

According to an embodiment of the present invention, there is also provided an information push apparatus for implementing the home appliance of embodiment 4 above, as shown in fig. 13, the apparatus 130 includes:

the first display module 132 is configured to display a push object, where the push object is determined according to commodity information of a commodity that needs to be purchased, where the commodity information includes: image information and/or voice information;

a second display module 132, configured to display push information corresponding to the push object, where the push information includes: the first attribute information of the push object in the target offline trading main body and/or the second attribute information of the push object in the online trading main body.

It should be noted that the first display module 132 and the second display module 132 correspond to steps S101 to S103 in embodiment 4, and the two modules are the same as the corresponding steps in the implementation example and application scenario, but are not limited to the disclosure of the first embodiment. It should be noted that the modules described above as part of the apparatus may be run in the computer terminal 10 provided in the first embodiment.

As an alternative embodiment, the apparatus further comprises: and the third display module is used for displaying the first push control, wherein when the first push control is triggered, the third display module displays push information of other push objects having a transaction relation with the push object.

As an alternative embodiment, the apparatus further comprises: and the fourth display module is used for displaying the second pushing control, wherein when the second pushing control is triggered, the pushing information of other pushing objects with the same type as the pushing object is displayed.

As an optional embodiment, the apparatus further comprises: and the fifth display module is used for displaying the payment information for trading the push object under the condition that an instruction for selecting the push object is received after the push information corresponding to the push object is displayed.

As an alternative embodiment, the fifth display module includes: and the display submodule is used for displaying preset characters, wherein the preset characters are used for acquiring the corresponding voice payment voucher.

As an optional embodiment, the apparatus further comprises: and the sixth display module is used for displaying a payment result after displaying the payment information for trading the push object under the condition that the instruction for selecting the push object is received, wherein the payment result is used for indicating whether the payment is successful.

Example 8

According to an embodiment of the present invention, there is also provided an information processing method for a home appliance, and fig. 14 is a flowchart of an information processing method for a home appliance according to embodiment 8 of the present application, and with reference to fig. 14, the method includes:

step S141, determining a pushing object according to the collected commodity information, wherein the commodity information comprises: image information and/or voice information.

The above step S141 may be performed by a server of the home appliance. The household appliance collects the image information of the commodity through the image collecting device and collects the voice information of the commodity through the voice collecting device. The processor acquires the commodity information acquired by the image acquisition device and the sound acquisition device, and performs image analysis and/or voice analysis on the commodity information, so as to determine the commodity required to be purchased by the user, namely the push object determined in the above steps.

Step S143, obtaining attribute information of the push object in at least one channel, where the at least one channel includes: a target offline transaction principal and/or an online transaction principal.

Specifically, the channel is used to indicate a purchase channel through which a push object can be purchased, the offline transaction main body is an entity store, and the online transaction main body is an online shopping website. The attribute information can comprise commodity price, production date and the like of the push object in different shopping channels.

In an alternative embodiment, the server of the home appliance searches the determined push object through a network, the search scope includes an offline brick and mortar store (target offline transaction subject) and an online shopping website (online transaction subject), and attribute information of the push object in a plurality of channels is obtained through the search. More specifically, as shown in fig. 6, the column of the convenience store shows the push object in the target offline transaction body searched by the server, and the column of the kyoto and the small red book shows the push object in the terminal of the online transaction body searched by the server.

Step S145, verifying whether the target transaction is successful according to the received payment credential, wherein the target transaction is a transaction performed on the selected pushed object.

Specifically, the payment credential may be a password, a voice payment credential, a facial image payment credential, or the like. The target transaction begins with a user selecting a push object to generate an order, and the order to purchase the selected push object may be used to represent the target transaction.

In an optional embodiment, the user selects one or more push objects to be purchased according to the attribute information of the push objects in multiple channels acquired by the household appliance. At the moment, the order is generated and enters a payment link, in order to further liberate the two hands of the user, the user can send a facial image payment certificate or a voice payment certificate to the household appliance, the household appliance transmits the received payment certificate to a third-party payment application, and the payment certificate is verified by the third-party payment application.

And step S147, under the condition that the target transaction is successful, transmitting the position information of the position of the household appliance.

Specifically, the position information of the home appliance may be input by a user when the home appliance is used for the first time, or may be located by a gyroscope in the home appliance.

In an alternative embodiment, the push object selected by the user is a push object in an offline physical store, and the server of the home appliance sends the address of the user, that is, the position information of the position where the home appliance is located, to a terminal of the offline physical store (for example, a mobile phone of a store owner of the physical store, a cash register terminal in the physical store, and the like), so that the physical store owner can send goods according to the address.

In another alternative embodiment, the push object selected by the user is a push object in an online shopping website, and the server of the home appliance sends the address of the user, that is, the location information of the location of the home appliance, to the server of the online shopping website, so that the store of the online shopping website delivers goods according to the address.

As can be seen from the above, in the above embodiments of the present application, the pushing object is determined according to the collected commodity information, where the commodity information includes: acquiring attribute information of a push object in a plurality of channels by using image information and/or voice information, wherein the plurality of channels comprise: and the target off-line transaction main body and/or the on-line transaction main body verify whether the target transaction is successful according to the received payment certificate, wherein the target transaction is the transaction performed on the selected push object, and under the condition that the target transaction is successful, the position information of the position of the household appliance is sent. The shopping mode provided by the scheme does not need a user to go to a physical store for shopping in person, and does not need the user to manually search on the network through the mobile terminal, so that the shopping mode of releasing both hands is provided for the user, and a shopping scene separated from the mobile terminal is provided.

As an optional embodiment, the target offline transaction main body is an offline transaction main body whose distance from the household appliance is within a preset range.

Specifically, the preset range may be 1 km or 1.5 km, so that the user can conveniently go to a store for self-pickup or deliver goods at the store when purchasing emergency goods.

As an optional embodiment, in case that the target transaction is successful, the method further comprises: and if the selected push object is the push object in the target offline transaction main body, displaying the position information of the target offline transaction main body, and detecting a distribution instruction for selecting whether to distribute the push object or not.

Specifically, the position information of the target offline transaction main body is the position information of the physical store to which the push object selected by the user belongs, and after the transaction is completed, the position information of the physical store is displayed, so that the user can select whether to need store delivery according to the position of the physical store.

Example 9

According to an embodiment of the present invention, there is also provided an information processing apparatus for a home appliance implementing the home appliance of embodiment 8 above, as shown in fig. 15, the apparatus 150 including:

the determining module 152 is configured to determine a pushing object according to the collected commodity information, where the commodity information includes: image information and/or voice information.

An obtaining module 154, configured to obtain attribute information of the push object in multiple channels, where the multiple channels include: a target offline transaction principal and/or an online transaction principal.

The verifying module 156 is configured to verify whether the target transaction is successful according to the received payment credential, where the target transaction is a transaction performed on the selected pushed object.

The sending module 158 is configured to send location information of a location where the home appliance is located when the target transaction is successful.

As an alternative embodiment, the apparatus further comprises: and the display module is used for displaying the position information of the target offline transaction main body and detecting a distribution instruction for selecting whether to distribute the pushed object if the selected pushed object is the pushed object in the target offline transaction main body.

Example 10

The embodiment of the invention can provide a computer terminal which can be any computer terminal device in a computer terminal group. Optionally, in this embodiment, the computer terminal may also be replaced with a terminal device such as a mobile terminal.

Optionally, in this embodiment, the computer terminal may be located in at least one network device of a plurality of network devices of a computer network.

In this embodiment, the computer terminal may execute program codes of the following steps in the information push method for a home appliance: the method comprises the following steps of collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information; determining a pushing object by analyzing commodity information; acquiring push information corresponding to a push object, wherein the push information comprises attribute information of the push object; and controlling the household appliance to display the push information corresponding to the push object.

Alternatively, fig. 16 is a block diagram of a computer terminal according to embodiment 10 of the present application. As shown in fig. 16, the computer terminal 1600 may include: one or more processors 1602 (only one of which is shown), a memory 1604, and a transmission device 1606.

The memory may be configured to store software programs and modules, such as program instructions/modules corresponding to the information pushing method and apparatus for the home appliance in the embodiments of the present invention, and the processor executes various functional applications and data processing by running the software programs and modules stored in the memory, that is, implements the information pushing method for the home appliance. The memory may include high speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memories may further include a memory located remotely from the processor, which may be connected to terminal 1400 through a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.

The processor can call the information and application program stored in the memory through the transmission device to execute the following steps: the method comprises the following steps of collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information; determining a pushing object by analyzing commodity information; acquiring push information corresponding to a push object, wherein the push information comprises attribute information of the push object; and controlling the household appliance to display the push information corresponding to the push object.

Optionally, the processor may further execute the program code of the following steps: acquiring image information of a commodity in the image information by performing image recognition on the image information, and/or acquiring text information corresponding to the commodity by performing voice recognition on the voice information; determining a first object according to the image information of the commodity and/or the text information corresponding to the commodity; the first object is determined to be a push object.

Optionally, the processor may further execute the program code of the following steps: acquiring a second object associated with the first object, wherein the second object comprises any one or more of the following items: an object of the same type as the first object and an object having a trade relationship with the first object; determining the second object as a push object.

Optionally, the processor may further execute the program code of the following steps: acquiring first attribute information of the push object in a target offline transaction main body and/or second attribute information of the push object in an online transaction main body.

Optionally, the processor may further execute the program code of the following steps: receiving a recommendation instruction for selecting a recommendation range, wherein the instruction comprises: offline recommendation and online recommendation; if the instruction is an online recommendation, acquiring first attribute information of a pushed object in a target offline transaction main body; and if the instruction is online recommendation, acquiring second attribute information of the pushing object in the online transaction main body.

Optionally, the processor may further execute the program code of the following steps: acquiring the position information of the household appliance; detecting whether a target offline transaction main body comprising a push object exists in a preset range of the position information or not according to the position information; if the target offline trading main body comprising the pushed object exists, acquiring first attribute information of the pushed object in the target offline trading main body according to the monitored target offline trading main body; and if the target offline trading main body comprising the push object does not exist, acquiring second attribute information of the push object in the online trading main body.

Optionally, the processor may further execute the program code of the following steps: searching for a push object in objects included in a preset online transaction subject; and acquiring a search result, wherein the search result comprises second attribute information of the pushing object in the online trading subject.

Optionally, the processor may further execute the program code of the following steps: receiving an instruction for selecting a push object; and displaying payment information for trading the pushed object.

Optionally, the processor may further execute the program code of the following steps: detecting whether the transaction is completed; and receiving a delivery instruction for selecting whether to deliver the pushed object or not when the transaction is completed.

Optionally, the processor may further execute the program code of the following steps: receiving payment credentials for conducting a transaction with a pushed object, wherein the payment credentials include any one or more of: a payment password, a facial image payment credential, and a voice payment credential.

Optionally, the processor may further execute the program code of the following steps: the household appliance is any one of: mirrors, refrigerators, and televisions.

The embodiment of the invention provides a scheme for pushing information of household appliances. The commodity information of commodities needing to be purchased is collected, the push object is determined by analyzing the commodity information, the push information corresponding to the push object is obtained, the household appliance is controlled to display the push information corresponding to the push object, the household appliance is combined with the intelligent camera and the voice recognition system, the purpose of pushing the commodities for a user through the household appliance is achieved, the user can purchase the commodities while performing other actions, and a shopping scene separated from a mobile terminal is achieved.

It can be understood by those skilled in the art that the structure shown in fig. 16 is only an illustration, and the computer terminal may also be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palmtop computer, a Mobile Internet Device (MID), a PAD, and the like. Fig. 16 is a diagram illustrating a structure of the electronic device. For example, computer terminal 1600 may also include more or fewer components (e.g., network interfaces, display devices, etc.) than shown in FIG. 16, or have a different configuration than shown in FIG. 16.

Those skilled in the art will appreciate that all or part of the steps in the methods of the above embodiments may be implemented by a program instructing hardware associated with the terminal device, where the program may be stored in a computer-readable storage medium, and the storage medium may include: flash disks, Read-Only memories (ROMs), Random Access Memories (RAMs), magnetic or optical disks, and the like.

Example 11

The embodiment of the invention also provides a storage medium. Optionally, in this embodiment, the storage medium may be configured to store the program code executed by the information pushing method for a home appliance provided in the first embodiment.

Optionally, in this embodiment, the storage medium may be located in any one of computer terminals in a computer terminal group in a computer network, or in any one of mobile terminals in a mobile terminal group.

Optionally, in this embodiment, the storage medium is configured to store program code for performing the following steps: the method comprises the following steps of collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information; determining a push object by analyzing commodity information; acquiring push information corresponding to a push object, wherein the push information comprises attribute information of the push object; and controlling the household appliance to display the push information corresponding to the push object. The invention solves the technical problem of single function of the intelligent household appliance in the prior art.

The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

In the above embodiments of the present invention, the descriptions of the respective embodiments have respective emphasis, and for parts that are not described in detail in a certain embodiment, reference may be made to related descriptions of other embodiments.

In the embodiments provided in the present application, it should be understood that the disclosed technology can be implemented in other ways. The above-described embodiments of the apparatus are merely illustrative, and for example, the division of the units is only one type of division of logical functions, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, units or modules, and may be in an electrical or other form.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit may be implemented in the form of hardware, or may also be implemented in the form of a software functional unit.

The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic or optical disk, and other various media capable of storing program codes.

The foregoing is only a preferred embodiment of the present invention, and it should be noted that, for those skilled in the art, various modifications and decorations can be made without departing from the principle of the present invention, and these modifications and decorations should also be regarded as the protection scope of the present invention.

Claims

1. An information push method of a household appliance, comprising:

collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information;

determining a pushing object by analyzing the commodity information;

acquiring push information corresponding to the push object, wherein the push information comprises attribute information of the push object;

controlling the household appliance to display the pushing information corresponding to the pushing object;

wherein, acquiring the push information corresponding to the push object includes:

acquiring first attribute information of the pushed object in a target offline transaction main body and/or second attribute information of the pushed object in an online transaction main body, wherein the target offline transaction main body is an offline transaction main body meeting preset conditions, and the preset conditions are as follows: the distance between the offline transaction main body and the position of the household appliance is less than the preset distance.

2. The method of claim 1, wherein determining a push object by analyzing the merchandise information comprises:

acquiring image information of a commodity in the image information by performing image recognition on the image information, and/or acquiring text information corresponding to the commodity by performing voice recognition on the voice information;

determining a first object according to the image information of the commodity and/or the text information corresponding to the commodity;

determining that the first object is the push object.

3. The method of claim 2, wherein determining a push object by analyzing the merchandise information after determining that the first object is the push object further comprises:

acquiring a second object associated with the first object, wherein the second object comprises any one or more of the following items: an object of the same type as the first object and an object having a trade relationship with the first object;

determining that the second object is the push object.

4. The method of claim 1, wherein before obtaining the first attribute information of the push object in the target offline trading body and/or the second attribute information of the push object in the online trading body, the method further comprises:

receiving a recommendation instruction for selecting a recommendation range, wherein the instruction comprises: offline recommendation and online recommendation;

if the instruction is the offline recommendation, acquiring first attribute information of the push object in a target offline transaction main body;

and if the instruction is the online recommendation, acquiring second attribute information of the pushed object in the online transaction main body.

5. The method of claim 4, wherein obtaining first attribute information of the push object in a target offline transaction body and/or second attribute information of the push object in an online transaction body comprises:

acquiring the position information of the household appliance;

detecting whether a target offline transaction main body comprising the push object exists in a preset range of the position information or not according to the position information;

if the target offline transaction main body comprising the pushed object exists, acquiring first attribute information of the pushed object in the target offline transaction main body according to the monitored target offline transaction main body;

and if the target offline transaction main body comprising the push object does not exist, acquiring second attribute information of the push object in the online transaction main body.

6. The method of claim 5, wherein obtaining second attribute information of the pushed object in the online transaction body comprises:

searching the pushed object in objects included in a preset online transaction main body;

and acquiring a search result, wherein the search result comprises second attribute information of the push object in the online trading subject.

7. The method according to claim 1, wherein after controlling the household appliance to display the push information corresponding to the push object, the method further comprises:

receiving an instruction for selecting a push object;

and displaying payment information for trading the push object.

8. The method of claim 7, wherein after presenting payment information for transacting the push object, in the event that the push object is the push object in a targeted offline transacting principal, the method further comprises:

detecting whether the transaction is completed;

and receiving a delivery instruction for selecting whether to deliver the pushed object or not when the transaction is completed.

9. The method of claim 7, wherein after presenting payment information for transacting the pushed object, the method comprises:

receiving payment credentials for conducting a transaction with the push object, wherein the payment credentials include any one or more of: a payment password, a facial image payment credential, and a voice payment credential.

10. The method according to claim 1, wherein the household appliance is any one of: mirrors, refrigerators, and televisions.

11. A household appliance, characterized in that it comprises:

the image acquisition device is used for acquiring the image information of the commodity to be purchased;

the voice acquisition device is used for acquiring voice information representing commodities needing to be purchased;

the controller is used for determining a push object by analyzing the image information and/or the voice information and acquiring push information corresponding to the push object, wherein the push information comprises attribute information of the push object;

the multimedia playing device is connected with the controller and used for displaying the pushing information corresponding to the pushing object;

12. The household appliance of claim 11, wherein the image capture device is further configured to capture facial image payment credentials and the sound capture device is further configured to capture sound payment credentials.

13. The household appliance according to claim 11, wherein the household appliance is any one of: mirrors, refrigerators, and televisions.

14. An information processing method of a household appliance is characterized by comprising the following steps:

pushing corresponding push information according to the commodity information, wherein the push information comprises attribute information of a push object, and the push object is determined according to the commodity information;

generating payment information for trading the push object in case an instruction for selecting the push object is received;

receiving payment credentials, wherein the payment credentials include any one or more of: a payment password, a facial image payment credential, or a voice payment credential;

determining whether the transaction of the pushed object is successful according to the payment certificate;

wherein, according to the corresponding propelling movement information of commodity information propelling movement, include:

determining the push object by analyzing the commodity information;

acquiring the pushing information corresponding to the pushing object;

pushing the pushing information;

and acquiring first attribute information of the push object in a target offline transaction main body and/or second attribute information of the push object in an online transaction main body.

15. An information push method for a household appliance is characterized by comprising the following steps:

displaying a push object, wherein the push object is determined according to commodity information of commodities needing to be purchased, and the commodity information comprises: image information and/or voice information;

displaying push information corresponding to the push object, wherein the push information comprises: first attribute information of the pushed object in a target offline transaction main body and/or second attribute information of the pushed object in an online transaction main body, wherein the target offline transaction main body is an offline transaction main body meeting a preset condition, and the preset condition is as follows: the distance between the offline transaction main body and the position of the household appliance is less than the preset distance.

16. The method of claim 15, further comprising:

displaying a first pushing control, wherein when the first pushing control is triggered, pushing information of other pushing objects having a transaction relation with the pushing object is displayed.

17. The method of claim 16, further comprising:

18. The method of claim 17, wherein after displaying the push information corresponding to the push object, the method further comprises:

in the event that an instruction is received to select a push object, payment information for transacting the push object is displayed.

19. The method of claim 18, wherein displaying payment information for transacting the push object upon receiving an instruction to select the push object comprises:

displaying preset characters, wherein the preset characters are characters used for acquiring the corresponding voice payment voucher.

20. The method of claim 19, wherein upon receiving an instruction to select a push object, after displaying payment information for transacting the push object, the method further comprises:

and displaying a payment result, wherein the payment result is used for indicating whether the payment is successful or not.

21. An information push device of a household appliance, comprising:

the acquisition module is used for acquiring commodity information of commodities needing to be purchased, wherein the commodity information comprises:

image information and/or voice information;

the determining module is used for determining a pushing object by analyzing the commodity information;

the acquisition module is used for acquiring push information corresponding to the push object, wherein the push information comprises attribute information of the push object;

the display module is used for controlling the household appliance to display the push information corresponding to the push object;

the obtaining module is further configured to obtain first attribute information of the pushed object in a target offline transaction main body and/or second attribute information of the pushed object in an online transaction main body, where the target offline transaction main body is an offline transaction main body that meets a predetermined condition, and the predetermined condition is: the distance between the offline transaction main body and the position of the household appliance is less than the preset distance.

22. A storage medium, characterized in that the storage medium includes a stored program, wherein when the program runs, a device on which the storage medium is located is controlled to execute the following steps: collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information; determining a pushing object by analyzing the commodity information; acquiring push information corresponding to the push object, wherein the push information comprises attribute information of the push object; controlling the household appliance to display the pushing information corresponding to the pushing object; wherein, acquiring the push information corresponding to the push object includes: acquiring first attribute information of the pushed object in a target offline transaction main body and/or second attribute information of the pushed object in an online transaction main body, wherein the target offline transaction main body is an offline transaction main body meeting preset conditions, and the preset conditions are as follows: the distance between the offline transaction main body and the position of the household appliance is less than the preset distance.

23. A processor, wherein the processor is configured to execute a program, wherein the program executes to perform the following steps: collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information; determining a pushing object by analyzing the commodity information; acquiring push information corresponding to the push object, wherein the push information comprises attribute information of the push object; controlling the household appliance to display the pushing information corresponding to the pushing object; wherein, acquiring the push information corresponding to the push object includes: acquiring first attribute information of the pushed object in a target offline transaction main body and/or second attribute information of the pushed object in an online transaction main body, wherein the target offline transaction main body is an offline transaction main body meeting preset conditions, and the preset conditions are as follows: the distance between the offline transaction main body and the position of the household appliance is less than the preset distance.

24. An information push system of a home appliance, comprising:

a processor; and

a memory coupled to the processor for providing instructions to the processor for processing the following processing steps: collecting commodity information of commodities needing to be purchased, wherein the commodity information comprises: image information and/or voice information;

determining a pushing object by analyzing the commodity information;

wherein, acquiring the push information corresponding to the push object includes: acquiring first attribute information of the pushed object in a target offline transaction main body and/or second attribute information of the pushed object in an online transaction main body, wherein the target offline transaction main body is an offline transaction main body meeting preset conditions, and the preset conditions are as follows: the distance between the offline transaction main body and the position of the household appliance is less than the preset distance.

25. An information processing method of a home appliance, comprising:

determining a push object according to the collected commodity information, wherein the commodity information comprises: image information and/or voice information;

acquiring attribute information of the push object in at least one channel, wherein the at least one channel comprises: the method comprises the following steps that a target offline transaction main body and/or an online transaction main body are/is provided, wherein the target offline transaction main body is an offline transaction main body meeting preset conditions, and the preset conditions are as follows: the distance between the offline transaction main body and the position of the household appliance is less than a preset distance;

verifying whether a target transaction is successful according to the received payment voucher, wherein the target transaction is a transaction performed on the selected pushed object;

and under the condition that the target transaction is successful, sending the position information of the position of the household appliance.

26. The method of claim 25, wherein the target offline transaction body is an offline transaction body within a preset range of distance from the household appliance.

27. The method of claim 26, wherein in the event that the target transaction is successful, the method further comprises:

and if the selected push object is a push object in the target offline transaction main body, displaying the position information of the target offline transaction main body, and detecting a distribution instruction for selecting whether to distribute the push object.