JP6724819B2 - Product ordering system, product ordering method, image forming apparatus, and electronic device - Google Patents

Description

The present invention relates to a product ordering system, a product ordering method, an image forming apparatus, and an electronic device.

A technique related to a display device that displays data is disclosed in Japanese Patent Laid-Open No. 2014-71499 (Patent Document 1).

The display device disclosed in Patent Document 1 displays an image corresponding to each of the user's eyes when worn, thereby detecting a display unit that three-dimensionally displays an object and a real object that operates the object. And a control unit that changes the object according to the movement of the real object and updates order data for ordering a product corresponding to the object.

JP, 2014-71499, A

The display device disclosed in Patent Document 1 only three-dimensionally displays the object and changes the object in accordance with the movement of the actual object, and cannot simply order the product desired by the user.

An object of the present invention is to provide a product ordering system, a product ordering method, an image forming apparatus, and an electronic device that can easily order a product desired by a user.

In one aspect of the present invention, the product ordering system can communicate with an image forming apparatus that forms an image, an external apparatus that can communicate with the image forming apparatus, and the image forming apparatus, and an object can be visually recognized by the user's eyes. The electronic device is provided with a lens that is The external device includes an external device storage unit and an external device communication unit. The external device storage unit stores data regarding product information and/or printing data for printing the data on a product ordering card. The external device communication unit communicates with the image forming device. The image forming apparatus includes a first authentication section, an image forming section, an image forming apparatus communication section, a first receiving section, an identification mark generating section, an image forming control section, and a second receiving section. And a first transmission control unit. The first authentication unit authenticates a user who operates the image forming apparatus. The image forming unit forms an image. The image forming apparatus communication unit communicates with each of the external device and the electronic device. The first reception unit receives a request to print a product order card used when ordering a product. If the identification mark generation unit receives a print request for the product ordering card from the first receiving unit, the information of the user authenticated by the first authenticating unit and the product ordering card received by the first receiving unit. An identification mark including information corresponding to is generated. If the identification mark is generated by the identification mark generation unit, the image formation control unit displays the identification mark, the function button indicating the function for ordering the product, and the image of the product ordering card received by the first reception unit. And the print data are formed by the image forming unit and controlled to be printed on the paper. The second accepting unit accepts an operation accompanied by an order for a product from the electronic device. The first transmission control unit controls the product ordering data to be transmitted to the external device by the operation received by the second reception unit. The electronic device includes a reading unit, a determination unit, a second authentication unit, a display control unit, a detection unit, a third reception unit, and a second transmission control unit. The reading unit reads an image on a sheet. The determination unit determines whether or not the image on the sheet read by the reading unit has an identification mark. If the determination unit determines that the image on the sheet has an identification mark, the second authentication unit authenticates the user who is operating the electronic device based on the user information included in the identification mark. The display control unit displays the image and, when the user is authenticated by the second authentication unit, displays the function button printed on the product ordering card through the electronic device so that the function can be performed by pressing the function button. The detection unit detects whether or not the function button displayed by the display control unit has an operation corresponding to the pressing. The third receiving unit receives the order of the product when the detecting unit detects the operation corresponding to the pressing. The second transmission control unit controls to transmit the product order data to the image forming apparatus when the product order is accepted by the third accepting unit.

In another aspect of the present invention, a product ordering method includes an image forming apparatus that forms an image, an external device that can communicate with the image forming apparatus, and an image forming apparatus that can communicate with the external apparatus. A product ordering method for ordering a product in a product ordering system including an electronic device having a visible lens . In the product ordering method , the image forming apparatus authenticates a user who operates the image forming apparatus including an image forming unit that forms an image. The image forming apparatus communicates with each of an external device and an electronic device that reads an image on a sheet and controls the image to be displayed. The image forming apparatus receives a request for printing a product order card used when ordering a product. When receiving the request for printing the product order card , the image forming apparatus generates an identification mark including information on the authenticated user and information corresponding to the received product order card. If the identification mark is generated , the image forming apparatus, the identification mark, a function button showing a function for ordering a product, an image of the received product ordering card, data regarding product information and/or the data thereof. And the print data for printing on the commodity ordering card are controlled by the image forming unit and printed on the paper. The image forming apparatus receives an operation accompanied by an order for a product from an electronic device. The image forming apparatus controls to send the order data of the product to the external device by the received operation. The electronic device determines whether or not the image of the sheet read by the electronic device has an identification mark. If it is determined that the image on the paper has the identification mark, the electronic device authenticates the user who is operating the electronic device based on the information of the user included in the identification mark. If the user is authenticated, the electronic device displays the function button printed on the product ordering card through the electronic device so that the function can be performed by pressing the function button. The electronic device detects whether or not there is an operation corresponding to the pressing of the displayed function button. The electronic device accepts the order of the product when the operation corresponding to the pressing is detected. If the electronic device accepts an order for a product, the electronic device transmits data for ordering the product to the image forming apparatus.

In still another aspect of the present invention, the image forming apparatus forms an image. The image forming apparatus is used in a product ordering system including an external apparatus capable of communicating with the image forming apparatus and an electronic apparatus including a lens capable of communicating with the image forming apparatus and visually recognizing an object with a user's eyes. The external device includes an external device storage unit and an external device communication unit. The external device storage unit stores data regarding product information and/or printing data for printing the data on a product ordering card. The external device communication unit communicates with the image forming device. The image forming apparatus includes a first authentication section, an image forming section, an image forming apparatus communication section, a first receiving section, an identification mark generating section, an image forming control section, and a second receiving section. And a first transmission control unit. The first authentication unit authenticates a user who operates the image forming apparatus. The image forming unit forms an image. The image forming apparatus communication unit communicates with each of the external device and the electronic device. The first reception unit receives a request to print a product order card used when ordering a product. If the identification mark generation unit receives a print request for the product ordering card from the first receiving unit, the information of the user authenticated by the first authenticating unit and the product ordering card received by the first receiving unit. An identification mark including information corresponding to is generated. If the identification mark is generated by the identification mark generation unit, the image formation control unit displays the identification mark, the function button indicating the function for ordering the product, and the image of the product ordering card received by the first reception unit. And the print data are formed by the image forming unit and controlled to be printed on the paper. The second accepting unit accepts an operation accompanied by an order for a product from the electronic device. The first transmission control unit controls the product ordering data to be transmitted to the external device by the operation received by the second reception unit. The electronic device includes a reading unit, a determination unit, a second authentication unit, a display control unit, a detection unit, a third reception unit, and a second transmission control unit. The reading unit reads an image on a sheet. The determination unit determines whether or not the image on the sheet read by the reading unit has an identification mark. If the determination unit determines that the image on the sheet has the identification mark, the second authentication unit authenticates the user who is operating the electronic device based on the user information included in the identification mark. The display control unit displays the image and, when the user is authenticated by the second authentication unit, displays the function button printed on the product ordering card through the electronic device so that the function can be performed by pressing the function button. The detection unit detects whether or not the function button displayed by the display control unit has an operation corresponding to the pressing. The third receiving unit receives the order of the product when the detecting unit detects the operation corresponding to the pressing. The second transmission control unit controls to transmit the product order data to the image forming apparatus when the product order is accepted by the third accepting unit.

In still another aspect of the present invention, an electronic device includes a lens that is communicable with an image forming apparatus including an image forming unit that forms an image and that an object can be visually recognized by a user's eyes. The electronic device includes an image forming apparatus and is used in a product ordering system for ordering products. The image forming apparatus includes a first authentication section, an image forming section, an image forming apparatus communication section, a first receiving section, an identification mark generating section, an image forming control section, and a second receiving section. And a first transmission control unit. The first authentication unit authenticates a user who operates the image forming apparatus. The image forming unit forms an image. The image forming apparatus communication unit communicates with each of the external device and the electronic device. The first reception unit receives a request to print a product order card used when ordering a product. If the identification mark generation unit receives a print request for the product ordering card from the first receiving unit, the information of the user authenticated by the first authenticating unit and the product ordering card received by the first receiving unit. An identification mark including information corresponding to is generated. The image formation control unit, when the identification mark is generated by the identification mark generation unit, the identification mark, the function button indicating the function for ordering the product, and the image of the product ordering card received by the first reception unit. And data related to product information and/or print data for printing the data on the product ordering card are controlled by the image forming unit and printed on a sheet. The second accepting unit accepts an operation accompanied by an order for a product from the electronic device. The first transmission control unit controls the product ordering data to be transmitted to the external device by the operation received by the second reception unit. The electronic device includes a reading unit, a determination unit, a second authentication unit, a display control unit, a detection unit, a third reception unit, and a second transmission control unit. The reading unit reads an image on a sheet. The determination unit determines whether or not the image on the sheet read by the reading unit has an identification mark. If the determination unit determines that the image on the sheet has an identification mark, the second authentication unit authenticates the user who is operating the electronic device based on the user information included in the identification mark. The display control unit displays the image and, when the user is authenticated by the second authentication unit, displays the function button printed on the product ordering card through the electronic device so that the function can be performed by pressing the function button. The detection unit detects whether or not the function button displayed by the display control unit has an operation corresponding to the pressing. The third receiving unit receives the order of the product when the detecting unit detects the operation corresponding to the pressing. The second transmission control unit controls to transmit the product order data to the image forming apparatus when the product order is accepted by the third accepting unit.

According to such a product ordering system, a product ordering method, an image forming apparatus, and an electronic device, a user can easily order a desired product.

FIG. 1 is a block diagram showing a configuration of a product ordering system including a multifunction peripheral when the image forming apparatus according to the embodiment of the present invention is applied to the multifunction peripheral. FIG. 3 is a block diagram showing a configuration of a multifunction machine control unit and a configuration of a smart glass control unit. It is a flow chart which shows a part of processing flow by the side of a compound machine when ordering goods using a goods ordering system. It is a figure which shows an example of a goods ordering card. It is a flowchart which shows the flow of a process on the smart glass side when ordering a product using a product ordering system. It is a figure which shows an example of the image of the pop-up key controlled to display by a display control part. It is a figure which shows an example of a pop-up image. It is a figure which shows an example of the inquiry image which inquires about the order of another product. It is a figure showing the state where a plurality of goods order cards were displayed.

Hereinafter, embodiments of the present invention will be described. FIG. 1 is a block diagram showing a configuration of a product ordering system 24 including a multi-function peripheral when the image forming apparatus included in the product ordering system according to the embodiment of the present invention is applied to the multi-function peripheral.

With reference to FIG. 1, the product ordering system 24 includes a multi-function peripheral 11, a smart glasses 41 which is a glasses-type wearable terminal as an electronic device, and a server 26 as an external device. The multifunction machine 11 and the server 26 are connected via the network 23. The multifunction device 11 and the server 26 are each connectable to the Internet via the network 23. The multifunction device 11 and the smart glasses 41 are configured to be capable of wireless communication, for example, near field communication (NFC (Near Field Communication)). The smart glasses 41 are also called AR (Augmented Reality) glasses and AR glasses.

First, the configuration of the multifunction machine 11 will be described. The multifunction device 11 includes a multifunction device control unit 12, an operation unit 13, a multifunction device reading unit 14, an image forming unit 15, a paper feed cassette 16, a multifunction device hard disk 17, and a multifunction device for connecting to the network 23. A machine network interface section 18 and a multifunction machine communication section 19 are provided. The multifunction machine control unit 12 controls the entire multifunction machine 11. The multi-function peripheral control unit 12 includes a CPU (Central Processing Unit) and the like, and includes a main memory 20 that temporarily stores data. The operation unit 13 includes a touch-panel type display screen 21 that displays information transmitted from the multifunction device 11 side and input contents of the user. The operation unit 13 receives inputs from the user regarding image formation such as image formation conditions such as the number of print copies and gradation. The multifunction device reading unit 14 reads an image of a document set on the ADF or the mounting table. A plurality of paper feed cassettes 16 are provided, and a plurality of paper sheets can be stored in each of them. The image forming unit 15 forms an image on a sheet conveyed from the sheet feeding cassette 16 or the like, based on the image data of the document read by the multifunction peripheral reading unit 14 and the image data transmitted via the network 23. .. The multi-function peripheral hard disk 17 stores image formation data such as transmitted image data and input image formation conditions. Specifically, on the multi-function peripheral hard disk 17, data of product information such as product titles and product images handled by the product ordering system 24, profile data of an orderer who ordered the product, that is, a user who is a customer, and an order for the product. The data of ordering information to be executed and the like are stored. It should be noted that the data of related product information and the like are associated and stored in the MFP hard disk 17. The multifunction device communication unit 19 wirelessly communicates with the smart glasses 41, that is, wirelessly transmits data to the smart glasses 41 and wirelessly receives data from the smart glasses 41. Further, the multi-function peripheral 11 can communicate with the server 26 via the multi-function peripheral network interface unit 18 and the server network interface unit 28.

Next, the configuration of the multifunction machine control unit 12 included in the multifunction machine 11 will be described. FIG. 2 is a block diagram showing the configuration of the multifunction machine control unit and the configuration of the smart glass control unit. The upper side of FIG. 2 shows the configuration of the multi-functional peripheral control unit 12, and the lower side of FIG. 2 shows the configuration of smart glasses to be described later. Referring to FIG. 2, the multi-functional peripheral control unit 12 includes a first authentication unit 31, a first reception unit 32, an identification mark generation unit 33, an image formation control unit 34, and a second reception unit 35. And a first transmission control unit 36. The first authentication unit 31 authenticates a user who operates the multifunction machine 11. The first reception unit 32 receives a request for printing a product ordering card used when ordering a product. When the identification mark generation unit 33 receives a request for printing the product ordering card from the first reception unit 32, the identification mark generation unit 33 receives the information of the user authenticated by the first authentication unit 31 and the first reception unit 32. An identification mark including information corresponding to the commodity ordering card is generated. The image formation control unit 34, when the identification mark is generated by the identification mark generation unit 33, the identification mark, the function button showing the function for ordering the product, and the product order received by the first receiving unit 32. The image of the card and the print data are controlled by the image forming unit 15 to be printed on a sheet. The second reception unit 35 receives an order for a product from the smart glass 41. The first transmission control unit 36 controls to transmit the ordering data of the product to the server 26 by the operation received by the second receiving unit 35. These configurations will be described later in detail.

Next, the configuration of the server 26 will be described. The server 26 includes a server control unit 27, a server network interface unit 28 for connecting to the network 23, and a server hard disk 29. The server control unit 27 controls the entire server 26. The server hard disk 29 stores image data and various data. That is, the server hard disk 29 is a kind of so-called database server, and specifically, similar to the above-described multifunction machine hard disk 17, specifically, data of product information handled by the product ordering system 24, user profile data, and products. Stores data related to merchandise information, such as ordering information data for ordering, and printing data for printing the data on a merchandise ordering card. Further, the server 26 receives the order data of the product from the multi-function peripheral 11 to start the process of confirming the order of the product and transporting the product to the order recipient. The server hard disk 29 may store data relating to product information, or print data for printing the data on a product ordering card. In this case, any data that is not stored in the server hard disk 29 is acquired from another device via the network 23 or the like.

Next, the configuration of the smart glass 41 will be described. The smart glasses 41 include a smart glasses control unit 42, a smart glasses communication unit 43, a smart glasses storage unit 44, a smart glasses reading unit 45, and a pair of left and right optically transmissive lenses 46 that display information on the lens surface. , A pair of left and right temple parts (not shown) that hold the smart glasses 41 on the user's head over the user's ear. The smart glass control unit 42 controls the entire smart glass 41. The smart glass communication unit 43 performs wireless communication with the multifunction machine 11. The smart glass storage unit 44 stores image data and various data. The lens 46 is an optically transmissive type. The user wearing the smart glasses 41 can see the object through the lens 46. The smart glass reading unit 45 reads an image of a sheet or an object located on the side where the user wearing the smart glass 41 can see through the lens 46 by using a camera function or the like.

Next, the configuration of the smart glass controller 42 will be described. With reference to FIG. 2 again, the smart glass control unit 42 includes the determination unit 52, the second authentication unit 53, the display control unit 54, the detection unit 55, the third reception unit 56, and the second reception unit 56. And a transmission control unit 57. The determination unit 52 determines whether or not the image on the sheet read by the smart glass reading unit 45 has an identification mark. If the determination unit 52 determines that the image on the sheet has the identification mark, the second authentication unit 53 authenticates the user who operates the smart glasses 41 based on the user information included in the identification mark. To do. The display control unit 54 displays an image, and when the user is authenticated by the second authentication unit 53, the function button printed on the product ordering card is pushed through the smart glasses 41 so that the function can be performed. indicate. The detection unit 55 detects whether or not the function button displayed by the display control unit 54 has an operation corresponding to the pressing. The third accepting unit 56 accepts the order of the product when the detecting unit 55 detects the operation corresponding to the pressing. When the third receiving unit 56 accepts an order for the product, the second transmission control unit 57 controls to send the order data for the product to the multifunction machine 11. These configurations will be described in detail later.

Next, a case of ordering a product using the product ordering system 24 described above will be described. FIG. 3 is a flowchart showing a part of the processing flow on the side of the multi-function peripheral 11 when ordering a product using the product ordering system 24.

First, the flow of processing on the side of the multi-function peripheral 11 will be described with reference to FIG. The first authentication unit 31 provided in the multi-function peripheral 11 authenticates a user who operates the multi-function peripheral 11 (step S11 in FIG. 3, hereinafter, “step” is omitted). In this case, for example, whether or not the user ID and password input by the user using the operation unit 13 and the so-called registered user ID and password of the user stored in the MFP hard disk 17 match. Authenticate.

Next, if authenticated, the first reception unit 32 included in the multi-function peripheral 11 determines whether or not a print request for the product order card has been received (S12). The print request is accepted, for example, by accepting an input of the print request from the user via the display screen 21 of the operation unit 13.

If the first acceptance unit 32 accepts the print request for the merchandise ordering card (YES in S12), the identification mark generation unit 33 determines the information of the user authenticated by the first authentication unit 31 and the first reception. An identification mark including information corresponding to the product ordering card for which the printing request is accepted by the unit 32 is generated (S13). In this case, in addition to the data of the registered user's personal information stored in the multifunction device hard disk 17, the password data for authenticating the user on the side of the smart glass 41, which will be described later, and the history information of the products ordered in the past. Incorporate data etc. to generate an identification mark. The identification mark is made up of a two-dimensional code or the like whose contents cannot be grasped by the user or a third party.

When the identification mark generation unit 33 generates the identification mark, the image formation control unit 34 generates the identification mark generated by the identification mark generation unit 33 and an order button which is a function button indicating a function for ordering the product. The image forming unit 15 controls the image of the commodity ordering card received by the first receiving unit 32 and the print data to be printed on a sheet (S14). That is, the product order card is formed by printing an image on the paper stored in the paper feed cassette 16.

FIG. 4 is a diagram showing an example of a product ordering card. The upper side of FIG. 4 shows the printed state, and the lower side of FIG. 4 shows the state seen through the lens 46 when the ordering button described later can be pressed. Referring to FIG. 4, the product ordering card 61 includes a product name notation 62 such as “product name: XXX”, an image 63 of the appearance of the product, and a two-dimensional code generated by the identification mark generation unit 33. An identification mark 64 to be displayed and an ordering button 65, which is described as "ordering" and which is composed of a round external shape figure, are printed. An image 63 of the appearance of the product is shown below the product name notation 62. An identification mark 64 and an order button 65 are printed next to the image 63 of the appearance of the product so as to be vertically aligned. The multifunction device 11 outputs the product order card 61 printed on the paper in this way.

Next, the flow of processing on the smart glass 41 side will be described. FIG. 5 is a flowchart showing the flow of processing on the side of the smart glasses 41 when ordering a product using the product ordering system 24.

Referring to FIG. 5, the user wears the smart glass 41 on the head and looks at the output product ordering card 61 through the lens 46. Then, the smart glass reading unit 45 reads the image of the product order card 61 (S21).

The determination unit 52 determines whether or not the identification mark 64 is present in the image of the sheet read by the smart glass reading unit 45, in this case, the image of the product ordering card 61 (S22). If the determination unit 52 determines that the identification mark 64 is present in the image of the product ordering card 61 (YES in S22), the second authentication unit 53 authenticates the user (S23). That is, the user is authenticated on the smart glass 41 side. Specifically, it is performed as follows.

FIG. 6 is a diagram showing an example of an image of a pop-up key controlled to be displayed by the display control unit 54. With reference to FIG. 6, the display control unit 54 controls the user wearing the smart glasses 41 to visually recognize the image of the pop-up key 68 shown in FIG. 6 through the lens 46. The pop-up key 68 is composed of keys 69a and 69b showing numerical values from 0 to 9, a key 69c displayed as "cancel", and a key 69d displayed as "enter". The user inputs the password by sight line recognition. Then, the password input by the line-of-sight recognition and the password extracted from the identification mark 64 are compared, and if they match, the second authentication unit 53 determines that the authentication has succeeded (YES in S23). ).

When the user is authenticated by the second authentication unit 53, the display control unit 54 enables the function by pressing the order button 65, which is the function button printed on the product order card 61, in this case. , So that the product can be ordered (S24).

Referring again to FIG. 4, when the output product ordering card 61 is viewed through the lens 46, the ordering button 66 looks bright, for example. The ordering button 66 of the product ordering card 61 that can be pressed is illustrated by hatching. Such a display is performed by the display control by the display control unit 54. That is, when the smart glasses 41 are not worn, the order button 66 cannot be seen as shining. Here, the function is enabled means that, for example, when the order buttons 65 and 66 are viewed through the lens 46, they are displayed differently from a state in which the function is not enabled, and the function is displayed on the order button 66. When the action of pressing with a finger is detected, it means that the product is ready to be ordered. That is, before the function is enabled, the order button 65 simply indicates an image printed as “order”, and no matter what operation such as pressing with a finger on the image, the order button 65 Will not be ordered.

After enabling the order button 66 to be pressed, the detection unit 55 detects whether or not there is an operation corresponding to the pressing of the order button 66 that can be pressed by the display control unit 54 (S25). That is, for example, the presence/absence of a pressing operation of the order button 66 by the user's finger is detected for 5 minutes set as the predetermined period. In this case, the detection is performed based on the reading of the movement of the image near the order button 66 by the smart glass reading unit 45.

The third receiving unit 56 receives the order of the product when the detecting unit 55 detects the operation corresponding to the pressing (YES in S25).

Here, the following inquiries are made when the third receiving unit 56 receives an order for a product. First, the display control unit 54 displays a pop-up screen, which is the content of the previous order, (S26), and inquires whether it is the same as the content of the previous order.

FIG. 7 is a diagram showing an example of a pop-up image. With reference to FIG. 7, the pop-up image 71 is visible by the user through the lens 46 under the control of display by the display control unit 54. In the pop-up image 71, the characters 72 "previous order condition", detailed information 73 when the previous order was placed, the image 74 showing the quantity, and "order" are shown, and the order is confirmed by the line-of-sight recognition. An order confirmation image 75a to be displayed and a “condition change” are displayed, and a condition change image 75b for shifting to a screen for changing the order condition by line-of-sight recognition is displayed. Regarding the price, the difference from the last purchase is also displayed. In response to a request, the user makes various settings by recognizing the line of sight of the order confirmation image 75a. Then, the third reception unit 56 receives an order for the product (S27). In this case, the third reception unit 56 is for receiving an order for the product XXX.

Next, the third reception unit 56 inquires about an order for another product. Specifically, the following image is displayed. FIG. 8 is a diagram showing an example of an inquiry image for inquiring about the order of another product. Referring to FIG. 8, the inquiry image 76 includes a message 77 for inquiring “Do you want to continue to purchase other registered products?” and “Continuous purchase”. A selection key 78a for shifting to a product purchase screen and a selection key 78b for ending the ordering of the product by line-of-sight recognition are displayed. The display of the inquiry image 76 is also controlled by the display controller 54. That is, the display control unit 54 controls the user wearing the smart glasses 41 to visually recognize the inquiry image 76 shown in FIG. 8 through the lens 46.

Here, a case will be described in which another registered product is continuously purchased by the line-of-sight recognition of the selection key 78a. When the line-of-sight recognition on the selection key 78a is detected, the display control unit 54 shifts to the screen shown in FIG.

FIG. 9 is a diagram showing an image in which a plurality of product order cards are displayed. Referring to FIG. 9, a plurality of merchandise ordering cards 79a, 79b, 79c are displayed so as to sequentially flow in a direction indicated by a predetermined arrow D ₁ . Specifically, an image of a product ordering card 79a that can accept an order for a product name: VVV, an image of a product ordering card 79b that can accept an order for a product name: UUU, and a product name: TTT An image of the product ordering card 79c capable of accepting an order and another product ordering card are displayed. Such product ordering cards 79a to 79c are derived based on user information, for example. The user orders the product by selecting the product ordering cards 79a to 79c corresponding to the products desired to be purchased from the product ordering cards 79a to 79c displayed in a flowing manner by line-of-sight recognition. Ordering of products is as shown in FIG. 4 and the like. Note that the display may be in the opposite direction of the arrow D ₁ .

When the order for the other product is received (YES in S28), the third reception unit 56 receives the order for the other product (S29). Then, when the third receiving unit 56 receives the order for the product, the second transmission control unit 57 controls to send the information about the order of the product to the multifunction machine 11 (S30).

After that, on the multi-function peripheral 11 side, the second reception unit 35 receives an order for a product from the smart glass 41. Specifically, on the multifunctional device 11 side, the multifunctional device communication unit 19 receives the ordering information of the product which is accepted by the third acceptance unit 56 on the smart glass 41 side and transmitted by the second transmission control unit 57. Then, the second acceptance unit 35 accepts. After that, the first transmission control unit 36 controls to transmit the ordering information of the product accepted by the second accepting unit 35 to the server 26.

On the server 26 side, the order of the product is confirmed by receiving the information about the order of the corresponding product. Also, the user information of the user who has ordered the product and the data of the product information stored in the server hard disk 29 are updated.

According to the merchandise ordering system 24 as described above, the merchandise ordering card 61 relating to the merchandise desired by the user can be printed in the multi-function peripheral 11 and the merchandise can be ordered by the smart glasses 41. it can. In this case, since the ordering button 66 can be pressed after the user is authenticated, it is possible to prevent the ordering from the unauthenticated user and eliminate the risk of an ordering error. Therefore, according to such a product ordering system 24, it is possible to easily order a product desired by the user.

That is, according to the product ordering system 24 as described above, the product ordering card 61 in which the ordering button which matches the product desired by the user is described is not limited to the one hardware configuration of the button for ordering the product. It can be easily created using the machine 11. Then, using the product ordering card 61, it is possible to easily order a product.

Further, in this case, the display control unit 54 displays so that the user can visually recognize the images of the plurality of keys 69a to 69d through the lens 46, and the second authentication unit 53 displays the key 69a based on the line-of-sight recognition on the keys 69a to 69d. Since the input of ~69d is received, the input at the time of authentication can be performed more easily.

Further, in this case, the smart glass 41 controls the display control unit 54 to display the information related to the product different from the product described in the product ordering card 61 so as to be visible to the user, and describes it in the product ordering card 61. Since an order for a product different from the registered product is accepted, it becomes easier for the user to order another product.

That is, the user can place an order for a desired product or a desired product by a simple method. In this case, the seller who sells the product can bring the customer's eyes into contact with the user as a product promotion or campaign by a simple method. In addition, the user can easily change the shop or the number of items to place an order or consider a product, so that a user-friendly system can be provided.

The above-described embodiment is configured to further include a keyboard in which the physical position of the hard key changes when pressed. That is, a so-called stand-alone keyboard is prepared. Then, the display control unit 54 controls to display the plurality of keys in the area corresponding to the position of the hard key. When the detection unit 55 detects a depression caused by pressing a key, it detects an action corresponding to the pressing. By doing so, it is possible to realistically perform ordering of products and the like while maintaining the user's touch of pressing a key on the keyboard.

Further, in the above-described embodiment, the display control unit 54 may control the order button 65 to be grayed out and displayed when the user is not authenticated by the second authentication unit 53. By doing so, it is possible to reduce the operation of the order button when the user is not authenticated.

Although the commodity ordering system 24 is configured to include the server 26 in the above-described embodiment, the configuration is not limited to this, and the multifunction peripheral 11 may also include a function of the so-called server 26. That is, data of product information handled by the product ordering system 24, user profile data, data of ordering information for ordering products, and the like are stored in the multifunctional device hard disk 17 included in the multifunction device 11. Then, the order of the product is confirmed in the multifunction machine 11. By doing so, it is possible to further simplify the configuration of the product ordering system 24.

Referring again to FIGS. 1 and 2, that is, a product ordering system 81 according to another embodiment of the present invention is a multifunction machine 11 as an image forming apparatus for forming an image, and a smart glass as an eyeglass-type wearable terminal. Including 41. The smart glasses 41 include a lens 46 that can communicate with the multi-function peripheral 11 and that can be worn by the user and can see an object with the eyes of the user when worn by the user. The product ordering system 81 and the product ordering system 24 are different from each other in that the network 23 and the server 26 are not provided in the product ordering system 81. That is, the multifunction device 11 includes the server 26.

The multifunction device 11 includes a multifunction device hard disk 17 as an image forming device storage unit, a first authentication unit 31, an image forming unit 15, a multifunction device communication unit 19 as an image forming device communication unit, and a first reception. The unit 32, the identification mark generation unit 33, and the image formation control unit 34 are provided. The multi-function peripheral hard disk 17 stores data regarding product information and print data for printing the data on a product ordering card. The first authentication unit 31 authenticates a user who operates the multifunction machine 11. The image forming unit 15 forms an image. The multifunction device communication unit 19 communicates with the smart glasses 41. The first reception unit 32 receives a request for printing a product ordering card used when ordering a product. When the identification mark generation unit 33 receives a request for printing the product order card from the first reception unit 32, the identification mark generation unit 33 receives the information of the user authenticated by the first authentication unit 31 and the first reception unit 32. An identification mark including information corresponding to the commodity ordering card is generated. The image formation control unit 34, when the identification mark is generated by the identification mark generation unit 33, the identification mark, a function button indicating a function for ordering a product, and the product ordering received by the first receiving unit. The image of the card and the print data are controlled by the image forming unit and printed on the paper. The second reception unit 35 receives an order for a product from the smart glass 41. The multi-function peripheral hard disk 17 may store data relating to product information or printing data for printing the data on a product ordering card. In this case, any data not stored in the multi-function peripheral hard disk 17 is obtained from another device via the network 23 or the like.

The smart glass 41 includes a smart glass reading unit 45 as a reading unit, a determination unit 52, a second authentication unit 53, a display control unit 54, a detection unit 55, a third reception unit 56, and a second reception unit 56. And a transmission control unit 57 of. The smart glass reading unit 45 reads an image on a sheet. The determination unit 52 determines whether or not the image on the sheet read by the smart glass reading unit 45 has an identification mark. If the determination unit 52 determines that the image on the sheet has an identification mark, the second authentication unit 53 authenticates the user wearing the smart glasses 41 based on the user information included in the identification mark. To do. The display control unit 54 displays the image and, when the user is authenticated by the second authentication unit, displays the function button printed on the product ordering card through the electronic device so that the function can be performed by pressing the function button. .. The detection unit 55 detects whether or not there is an operation corresponding to the pressing of the order button displayed by the display control unit 54. The third accepting unit 56 accepts the order of the product when the detecting unit 55 detects the operation corresponding to the pressing. When the third receiving unit 56 accepts an order for the product, the second transmission control unit 57 controls to send the order data for the product to the multifunction machine 11.

By adopting such a configuration, the configuration of the product ordering system 81 can be further simplified.

The function buttons may have a product ordering function, a quantity changing function, a shop selecting function, and a desired price input function.

The electronic device according to the present invention has the following configuration. That is, the electronic device includes a lens that can communicate with an image forming apparatus including an image forming unit that forms an image and that can visually recognize an object with the eyes of the user. The electronic device includes an image forming apparatus and is used in a product ordering system for ordering products. The image forming apparatus includes a first authentication section, an image forming section, an image forming apparatus communication section, a first receiving section, an identification mark generating section, an image forming control section, and a second receiving section. And a first transmission control unit. The first authentication unit authenticates a user who operates the image forming apparatus. The image forming unit forms an image. The image forming apparatus communication unit communicates with each of the external device and the electronic device. The first reception unit receives a request to print a product order card used when ordering a product. If the identification mark generation unit receives a print request for the product ordering card from the first receiving unit, the information of the user authenticated by the first authenticating unit and the product ordering card received by the first receiving unit. An identification mark including information corresponding to is generated. If the identification mark is generated by the identification mark generation unit, the image formation control unit displays the identification mark, the function button indicating the function for ordering the product, and the image of the product ordering card received by the first reception unit. And the print data are formed by the image forming unit and controlled to be printed on the paper. The second accepting unit accepts an operation accompanied by an order for a product from the electronic device. The first transmission control unit controls the product ordering data to be transmitted to the external device by the operation received by the second reception unit. The electronic device includes a reading unit, a determination unit, a second authentication unit, a display control unit, a detection unit, a third reception unit, and a second transmission control unit. The reading unit reads an image on a sheet. The determination unit determines whether or not the image on the sheet read by the reading unit has an identification mark. If the determination unit determines that the image on the sheet has an identification mark, the second authentication unit authenticates the user who is operating the electronic device based on the user information included in the identification mark. The display control unit displays the image and, when the user is authenticated by the second authentication unit, displays the function button printed on the product ordering card through the electronic device so that the function can be performed by pressing the function button. The detection unit detects whether or not the function button displayed by the display control unit has an operation corresponding to the pressing. The third receiving unit receives the order of the product when the detecting unit detects the operation corresponding to the pressing. The second transmission control unit controls to transmit the product order data to the image forming apparatus when the product order is accepted by the third accepting unit. You may comprise in this way.

A product ordering method according to the present invention has the following configuration. That is, the product ordering method is a product ordering method for ordering a product. The product ordering method authenticates a user who operates an image forming apparatus including an image forming unit that forms an image. An external device that can communicate with the image forming apparatus, and a lens that allows an object to be visually recognized by a user's eyes, communicate with each of electronic devices that read an image on a sheet and control the image to be displayed. We accept requests to print product order cards used when ordering products. When a request for printing the product order card is received, an identification mark including information of the authenticated user and information corresponding to the received product order card is generated. When the identification mark is generated, the identification mark, the function button indicating the function for ordering the product, the image of the received product order card, and the printing data are formed by the image forming unit and printed on the paper. Control to do so. Accepts operations that involve ordering products from electronic devices. The received operation is controlled to send the data of ordering the product to the external device. It is determined whether or not the image of the sheet read by the electronic device has an identification mark. If it is determined that the image on the paper has the identification mark, the user operating the electronic device is authenticated based on the information of the user included in the identification mark. If the user is authenticated, the function button printed on the product ordering card is displayed over the electronic device so that the function can be performed by pressing the function button. The presence/absence of an operation corresponding to the pressing of the displayed function button is detected. If the action corresponding to the pressing is detected, the product order is accepted. If the product order is accepted, the product order data is transmitted to the image forming apparatus. You may comprise in this way.

It should be understood that the embodiments disclosed this time are exemplifications in all respects and are not restrictive in any way. The scope of the present invention is defined by the scope of the claims, not by the above description, and is intended to include meanings equivalent to the scope of the claims and all modifications within the scope.

The product ordering system, the product ordering method, the image forming apparatus, and the electronic device according to the present invention are particularly effectively used when a simple ordering of a product desired by the user is required.

11 multi-function machine, 12 multi-function machine control section, 13 operation section, 14 multi-function machine reading section, 15 image forming section, 16 paper feed cassette, 17 multi-function machine hard disk, 18 multi-function machine network interface section, 19 multi-function machine communication section, 20 main Storage memory, 21 display screen, 23 network, 24, 81 product ordering system, 26 server, 27 server control unit, 28 server network interface unit, 29 server hard disk, 31 first authentication unit, 32 first acceptance unit, 33 Identification mark generation unit, 34 image formation control unit, 35 second reception unit, 36 first transmission control unit, 41 smart glasses, 42 smart glasses control unit, 43 smart glasses communication unit, 44 smart glasses storage unit, 45 smart Glass reading unit, 46 lens, 52 determination unit, 53 second authentication unit, 54 display control unit, 55 detection unit, 56 third reception unit, 57 second transmission control unit, 61, 79a, 79b, 79c Ordering card, 62 notation, 63,74 image, 64 identification mark, 65,66 ordering button, 68 pop-up key, 69a, 69b, 69c, 69d key, 71 pop-up image, 72 characters, 73 information, 75a order confirmation image, 75b Condition change image, 76 inquiry image, 77 message, 78a, 78b selection key.

Claims (10)

A commodity ordering system including an image forming apparatus for forming an image, an external apparatus capable of communicating with the image forming apparatus, and an electronic device including a lens capable of communicating with the image forming apparatus and visually recognizing an object by a user's eye. And
The external device is
An external device storage unit for storing data relating to product information and/or print data for printing the data on a product ordering card;
An external device communication unit that communicates with the image forming apparatus,
The image forming apparatus,
A first authentication unit for authenticating a user who operates the image forming apparatus;
An image forming unit for forming an image,
An image forming apparatus communication unit that communicates with each of the external device and the electronic device,
A first reception unit that receives a request for printing a product order card used when ordering products,
If the request for printing the product ordering card is accepted by the first accepting unit, the information of the user authenticated by the first authenticating unit, and the product ordering card accepted by the first accepting unit An identification mark generation unit that generates an identification mark including information corresponding to
When the identification mark is generated by the identification mark generation unit, the identification mark, a function button indicating a function for ordering a product, and an image of the product ordering card received by the first reception unit An image forming control unit that controls the print data to be formed on the image forming unit and printed on a sheet,
A second reception unit that receives an operation involving ordering of a product from the electronic device,
A first transmission control unit that controls to transmit the ordering data of the product to the external device by an operation received by the second reception unit,
The electronic device is
A reading unit that reads the image on the paper,
A determination unit that determines whether or not the identification mark is present in the image of the sheet read by the reading unit;
If the determination unit determines that the image on the sheet has the identification mark, a second user who operates the electronic device is authenticated based on the information of the user included in the identification mark. An authentication department,
When an image is displayed and the user is authenticated by the second authentication unit, the function button printed on the product ordering card is displayed over the electronic device so that the function can be performed by pressing the function button. A display control unit,
With respect to the function button displayed by the display control unit, a detection unit that detects the presence or absence of an operation corresponding to pressing,
If the detection unit detects an operation corresponding to the pressing, a third reception unit that receives an order for the product,
A product ordering system comprising: a second transmission control unit that controls to send the ordering data of the product to the image forming apparatus when the third ordering unit receives the ordering of the product. The product ordering system according to claim 1, wherein the function button has a product ordering function, a quantity changing function, a shop selecting function, and a desired price input function. The display control unit, when a predetermined function button is pressed, displays so that the user can visually recognize images of a plurality of keys through the electronic device,
The product ordering system according to claim 1 or 2, wherein the second authentication unit receives an input of the key by line-of-sight recognition with respect to the key. The electronic device controls the display controller to display information related to a product different from the product described in the product ordering card so that the user can visually recognize the information, and the electronic device described in the product ordering card is displayed. The product ordering system according to any one of claims 1 to 3, which receives an order for a product different from the product. Further equipped with a keyboard that changes the physical position of the hard key when pressed,
The display control unit controls to display a plurality of keys in an area corresponding to the position of the hard key,
The product ordering system according to any one of claims 1 to 4, wherein the detection unit detects an operation corresponding to the pressing when detecting a depression caused by pressing the key. The product according to any one of claims 1 to 5, wherein the display control unit controls the function button to be grayed out and displayed when the user is not authenticated by the second authentication unit. Ordering system. The product ordering system according to claim 1, wherein the image forming apparatus includes the external device. A commodity ordering system including an image forming apparatus for forming an image, an external apparatus capable of communicating with the image forming apparatus, and an electronic device including a lens capable of communicating with the image forming apparatus and visually recognizing an object by a user's eye. a commodity ordering method for ordering the goods in,
The image forming apparatus authenticates a user who operates the image forming apparatus including an image forming unit that forms an image,
The image forming apparatus communicates with each of the external device and the electronic device that controls reading of an image on a sheet and display of the image,
The image forming apparatus receives a request for printing a product ordering card used when ordering a product,
If the image forming apparatus receives a request to print the product ordering card, it generates an identification mark including information on the authenticated user, and information corresponding to the received product ordering card,
When the identification mark is generated , the image forming apparatus, the identification mark, a function button indicating a function for ordering a product, an image of the received product ordering card, data regarding product information, and And/or control that the image forming unit forms print data for printing the data on the commodity ordering card and prints on a sheet,
The image forming apparatus accepts an operation accompanied by an order for a product from the electronic device,
The image forming apparatus controls to transmit the ordering data of the product to the external apparatus by the received operation,
The electronic device determines whether or not the image of the sheet read by the electronic device has the identification mark,
If the electronic device is determined to have the identification mark in the image of the paper, based on the information of the user included in the identification mark, to authenticate the user operating the electronic device,
The electronic device, if the user is authenticated, the function button which is printed on the merchandise ordering card, to be displayed on the electronic device over so that the function is possible by pressing,
The electronic device detects, with respect to the displayed function button, whether or not there is an operation corresponding to pressing,
The electronic device receives an order for the product when an operation corresponding to the pressing is detected,
The electronic device transmits a product order data to the image forming apparatus when the electronic device accepts an order for the product. An image forming apparatus for forming an image,
An external device communicable with the image forming apparatus, and communicable with the image forming apparatus, used in a product ordering system including an electronic device including a lens capable of visually recognizing an object by a user's eyes,
The external device is
An external device storage unit for storing data relating to product information and/or printing data for printing the data on a product ordering card;
An external device communication unit that communicates with the image forming apparatus,
The image forming apparatus,
A first authentication unit for authenticating a user who operates the image forming apparatus;
An image forming unit for forming an image,
An image forming apparatus communication unit that communicates with each of the external device and the electronic device,
A first reception unit that receives a request for printing a product order card used when ordering products,
If the request for printing the product ordering card is accepted by the first accepting unit, the information of the user authenticated by the first authenticating unit, and the product ordering card accepted by the first accepting unit An identification mark generation unit that generates an identification mark including information corresponding to
When the identification mark is generated by the identification mark generation unit, the identification mark, a function button indicating a function for ordering a product, and an image of the product ordering card received by the first reception unit An image forming control unit that controls the print data to be formed on the image forming unit and printed on a sheet,
A second reception unit that receives an operation involving ordering of a product from the electronic device,
A first transmission control unit that controls to transmit the ordering data of the product to the external device by an operation received by the second reception unit,
The electronic device is
A reading unit that reads the image on the paper,
A determination unit that determines whether or not the identification mark is present in the image of the sheet read by the reading unit;
If the determination unit determines that the image on the sheet has the identification mark, a second user who operates the electronic device is authenticated based on the information of the user included in the identification mark. An authentication department,
In addition to displaying the image, if the user is authenticated by the second authentication unit, the function button printed on the product ordering card is displayed over the electronic device so that the function can be performed by pressing the function button. A display control unit,
With respect to the function button displayed by the display control unit, a detection unit that detects the presence or absence of an operation corresponding to pressing,
If the detection unit detects an operation corresponding to the pressing, a third reception unit that receives an order for the product,
An image forming apparatus comprising: a second transmission control unit that controls to transmit the order data of the product to the image forming apparatus when the third receiving unit receives the order of the product. An electronic device that includes a lens that can communicate with an image forming apparatus including an image forming unit that forms an image and that can visually recognize an object by a user's eyes.
Used in a product ordering system for ordering products, including the image forming apparatus,
The image forming apparatus,
A first authentication unit for authenticating a user who operates the image forming apparatus;
An image forming unit for forming an image,
An image forming apparatus communication unit that communicates with each of the electronic devices,
A first reception unit that receives a request for printing a product order card used when ordering products,
If the request for printing the product ordering card is accepted by the first accepting unit, the information of the user authenticated by the first authenticating unit, and the product ordering card accepted by the first accepting unit An identification mark generation unit that generates an identification mark including information corresponding to
When the identification mark is generated by the identification mark generation unit, the identification mark, a function button indicating a function for ordering a product, and an image of the product ordering card received by the first reception unit An image forming control unit configured to control the data related to product information and/or the print data for printing the data on the product ordering card by the image forming unit and to print on a sheet,
A second reception unit that receives an operation involving ordering of a product from the electronic device,
A first transmission control unit that controls to transmit the order data of the product to an external device by an operation received by the second reception unit,
The electronic device is
A reading unit that reads the image on the paper,
A determination unit that determines whether or not the identification mark is present in the image of the sheet read by the reading unit;
If the determination unit determines that the image on the sheet has the identification mark, a second user who operates the electronic device is authenticated based on the information of the user included in the identification mark. An authentication department,
In addition to displaying the image, if the user is authenticated by the second authentication unit, the function button printed on the product ordering card is displayed over the electronic device so that the function can be performed by pressing the function button. A display control unit,
With respect to the function button displayed by the display control unit, a detection unit that detects the presence or absence of an operation corresponding to pressing,
If the detection unit detects an operation corresponding to the pressing, a third reception unit that receives an order for the product,
An electronic device comprising: a second transmission control unit that controls to transmit the order data of the product to the image forming apparatus when the third receiving unit receives the order of the product.

Images