WO2022107863A1 - 情報処理装置、情報処理システム、情報処理方法及びプログラム - Google Patents

情報処理装置、情報処理システム、情報処理方法及びプログラム Download PDF

Info

Publication number
WO2022107863A1
WO2022107863A1 PCT/JP2021/042500 JP2021042500W WO2022107863A1 WO 2022107863 A1 WO2022107863 A1 WO 2022107863A1 JP 2021042500 W JP2021042500 W JP 2021042500W WO 2022107863 A1 WO2022107863 A1 WO 2022107863A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
server device
response
information processing
question
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/042500
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
司 竹中
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
At Robotics Inc
Original Assignee
At Robotics Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by At Robotics Inc filed Critical At Robotics Inc
Priority to EP21894735.6A priority Critical patent/EP4250213A4/en
Priority to US18/037,265 priority patent/US12619637B2/en
Priority to CN202180078065.6A priority patent/CN116615741A/zh
Publication of WO2022107863A1 publication Critical patent/WO2022107863A1/ja
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/332—Query formulation
    • G06F16/3329—Natural language query formulation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/01—Customer relationship services
    • G06Q30/015—Providing customer assistance, e.g. assisting a customer within a business location or via helpdesk
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33—Querying
    • G06F16/338—Presentation of query results
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G06Q10/08—Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/08—Payment architectures
    • G06Q20/20—Point-of-sale [POS] network systems
    • G06Q20/208—Input by product or record sensing, e.g. weighing or scanner processing
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/308—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using the Internet of Things
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00—Payment architectures, schemes or protocols
    • G06Q20/30—Payment architectures, schemes or protocols characterised by the use of specific devices or networks
    • G06Q20/32—Payment architectures, schemes or protocols characterised by the use of specific devices or networks using wireless devices
    • G06Q20/322—Aspects of commerce using mobile devices [M-devices]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0623—Electronic shopping [e-shopping] by investigating goods or services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0631—Recommending goods or services
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0639—Locating goods or services, e.g. based on physical position of the goods or services within a shopping facility
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00—Commerce
    • G06Q30/06—Buying, selling or leasing transactions
    • G06Q30/0601—Electronic shopping [e-shopping]
    • G06Q30/0641—Electronic shopping [e-shopping] utilising user interfaces specially adapted for shopping
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00—Scenes; Scene-specific elements
    • G06V20/60—Type of objects
    • G06V20/68—Food, e.g. fruit or vegetables
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P80/00—Climate change mitigation technologies for sector-wide applications
    • Y02P80/10—Efficient use of energy, e.g. using compressed air or pressurized fluid as energy carrier

Definitions

  • the present invention relates to an information processing device, an information processing system, an information processing method and a program.
  • Patent Document 1 discloses a plurality of lighting devices connected to the Internet.
  • an information processing device has a control unit.
  • the control unit reads information from a captured image including a predetermined mark attached to the object, and the information includes object information about the object and connection information of the server device. Connect to the server device based on the connection information.
  • the question information about the object is transmitted to the server device.
  • the response information generated in the server device based on the question information and the object information is received from the server device. Output response information as a response from an object.
  • FIG. 1 is a diagram showing an example of a system configuration of an information processing system.
  • FIG. 2 is a diagram showing an example of the hardware configuration of the client device.
  • FIG. 3 is a diagram showing an example of the hardware configuration of the server device.
  • FIG. 4 is a sequence diagram showing an example of information processing in an information processing system.
  • FIG. 5 is a diagram showing the concept of the function of the information processing system.
  • FIG. 6 is an example of a screen displaying information on other items included in the recipe and information on the selling place where the items are sold, which are displayed in the input / output section of the client device of the first modification. It is a figure which shows.
  • FIG. 7 is a diagram showing an example of the system configuration of the information processing system of the modification 2.
  • the program for realizing the software appearing in the present embodiment may be provided as a non-transitory recording medium (Non-Transity Computer-Readable Medium) that can be read by a computer, or may be downloaded from an external server. It may be provided as possible, or it may be provided so that the program is started by an external computer and the function is realized by the client terminal (so-called cloud computing).
  • Non-Transity Computer-Readable Medium Non-Transity Computer-Readable Medium
  • the "part" may include, for example, a combination of hardware resources implemented by a circuit in a broad sense and information processing of software specifically realized by these hardware resources. ..
  • various information is handled in this embodiment, and these information are, for example, physical values of signal values representing voltage and current, and signal values as a bit aggregate of binary numbers composed of 0 or 1. It is represented by high-low or quantum superposition (so-called quantum bit), and communication / operation can be executed on a circuit in a broad sense.
  • a circuit in a broad sense is a circuit realized by at least appropriately combining a circuit, a circuit, a processor, a memory, and the like. That is, an integrated circuit for a specific application (Application Special Integrated Circuit: ASIC), a programmable logic device (for example, a simple programmable logic device (Simple Programmable Logic Device: SPLD), a composite programmable logic device (Complex Program)) It includes a programmable gate array (Field Programmable Gate Array: FPGA) and the like.
  • FIG. 1 is a diagram showing an example of the system configuration of the information processing system 1000.
  • the information processing system 1000 includes a server device 100, a client device 110, and an object 130 to which the talk mark 120 is attached as a system configuration.
  • the server device 100 and the client device 110 are communicably connected to each other via the network 150.
  • the client device 110 is an example of an information processing device. (Outline of processing of information processing system 1000)
  • the client device 110 captures the talk mark 120 attached to the object 130 based on the user operation.
  • the client device 110 reads information from the captured image including the talk mark 120 attached to the object 130.
  • the information read by the client device 110 includes the object information about the object 130 and the connection information of the server device 100.
  • the client device 110 connects to the server device 100 based on the connection information.
  • the client device 110 displays an icon indicating the object 130 based on the object information.
  • the user asks the displayed icon a question or the like to the object 130.
  • the client device 110 transmits the inquiry information for the object 130 and the object information to the server device 100.
  • the client device 110 receives the response information generated in the server device 100 based on the question information and the object information from the server device 100.
  • the client device 110 outputs response information as a response from the object 130.
  • FIG. 2 is a diagram showing an example of the hardware configuration of the client device 110.
  • the client device 110 includes a control unit 201, a storage unit 202, an image pickup unit 203, an input / output unit 204, an audio input / output unit 205, and a communication unit 206 as hardware configurations.
  • the control unit 201 controls the entire client device 110.
  • the storage unit 202 stores data and the like used when the program and the control unit 201 execute processing based on the program.
  • the function of the client device 110 is realized by the control unit 201 executing the process based on the program stored in the storage unit 202.
  • the image pickup unit 203 takes an image of the subject.
  • the imaging unit 203 images the talk mark 120 attached to the object 130.
  • the talk mark is an example of a predetermined mark.
  • the input / output unit 204 inputs information to the control unit 201 according to the operation of the user, and displays the information according to the information processing of the control unit 201.
  • the voice input / output unit 205 inputs the user's voice and outputs the voice according to the control of the control unit 201.
  • the communication unit 206 connects the client device 110 to the network 150 and controls communication with other devices.
  • the storage unit 202 is an example of a storage medium.
  • FIG. 3 is a diagram showing an example of the hardware configuration of the server device 100.
  • the server device 100 includes a control unit 301, a storage unit 302, and a communication unit 303 as a hardware configuration.
  • the control unit 301 controls the entire server device 100.
  • the storage unit 302 stores data and the like used when the program and the control unit 301 execute processing based on the program.
  • the function of the server device 100 is realized by the control unit 301 executing the process based on the program stored in the storage unit 302.
  • the communication unit 303 connects the server device 100 to the network 150 and controls communication with other devices.
  • FIG. 4 is a sequence diagram showing an example of information processing of the information processing system 1000.
  • the control unit 201 captures the talk mark 120 attached to the object 130 based on the user operation.
  • the product 130 a food product, particularly a beverage contained in a PET bottle, will be described as an example.
  • the control unit 201 analyzes the captured image including the talk mark 120 attached to the object 130, and reads the information from the captured image.
  • the information read by the control unit 201 includes the object information regarding the object 130 and the connection information of the server device 100.
  • the control unit 201 connects to the server device 100 based on the connection information.
  • the control unit 201 transmits a connection request to the server device 100 based on the connection information acquired in SQ401.
  • the server device 100 receives the connection request from the client device 110.
  • the server device 100 executes a process related to the connection between the server device 100 and the client device 110 based on the connection request.
  • the server device 100 transmits a connection result indicating whether or not the connection was successful to the client device 110.
  • the server device 100 will be described as assuming that the connection is successful and the connection result indicating that the connection is successful is transmitted to the client device 110.
  • the control unit 201 causes the input / output unit 204 to display an icon indicating an object based on the captured image. FIG.
  • the icon 500 shown in FIG. 5 is a diagram showing an example of an object showing an object based on a captured image.
  • the icon is a symbol that retains the shape of the original object.
  • the user inputs a question to the object 130 displayed on the input / output unit 204, more specifically, the icon corresponding to the object 130.
  • the question is a question, a question, an inquiry, or the like for the object 130 to which the talk mark 120 is attached. More specifically, when the product 130 is a food product, the question includes a question about food information, a question about event information about food, a question about sales promotion information, and the like. Further, as will be described later, the question may include a purchase request (settlement request) or the like indicating the purchase intention of the product 130.
  • the client device 110 inputs a user's question by voice.
  • the control unit 201 converts the input question information into text and displays it as a character string in the input / output unit 204 ( 510 in FIG. 5). Further, when the question information for the object 130 is input by the user, in the SQ405, the control unit 201 makes a question request including the question information for the object 130 (for example, the question information converted into text) and the object information. It is transmitted to the server device 100.
  • the server device 100 receives the question request.
  • the server device 100 is a sales management server device or the like that manages the sales of food.
  • the server device 100 When the server device 100 receives the question request, the server device 100 inputs the question information to the object to the trained model identified by the object information included in the inquiry request, and the response information to the question to the object is input from the trained model. get.
  • This trained model is a trained model that has learned the correct answer to the question to the expected object. Questions include, if the product is a PET bottle of tea, the origin of the tea, the producer of the tea, the health benefits of the tea, the recipe for cooking with the tea, and how to drink it deliciously. Further, the trained model is prepared in advance for each object and stored in the storage unit 302.
  • the server device 100 generates a question response including the acquired response information and transmits it to the client device 110.
  • the control unit 201 outputs response information as a response from the object 130. More specifically, the control unit 201 outputs response information from the icon 500 as a response from an object. In the present embodiment, the control unit 201 outputs the response information by voice via the voice input / output unit 205, as is output from the icon 500 as a response from the object. Further, the control unit 201 displays the response information on the input / output unit 204 as a character string (520 in FIG. 5).
  • the information processing system 1000 repeats the processes from SQ405 to SQ407.
  • the user When the user tries to purchase the product 130 as a result of asking a question, the user inputs the purchase intention for the product 130 displayed on the input / output unit 204, more specifically, the icon corresponding to the product 130.
  • the purchase intention is a word that suggests a purchase intention, such as "buy” or "buy”.
  • the client device 110 inputs the user's purchase intention by voice.
  • the control unit 201 in the SQ408 receives information indicating that the product is to be purchased, information indicating that the product 130 is to be purchased, and information on the product that identifies the product 130.
  • a purchase request including identification information identifying the client device 110 is transmitted to the server device 100.
  • the server device 100 Upon receiving the purchase request, the server device 100 identifies the user based on the identification information that identifies the client device 110 included in the purchase request, and identifies the payment information or the like registered in advance by the user.
  • the payment information includes, for example, a credit card number, a bank name, an account number of a bank account, and the like.
  • the server device 100 transmits a payment request including the payment information, the price of the item 130 identified by the item identification information, and the like to the payment system 400 that makes the payment based on the specified payment information.
  • the server device 100 receives the payment processing result from the payment system 400.
  • the server device 100 will be described as receiving information indicating that the payment has been completed.
  • the server device 100 and the payment system 400 have different configurations, but the server device 100 may include the function of the payment system 400.
  • the server device 100 transmits the result of the payment process to the client device 110.
  • the control unit 201 receives the result of the payment process from the server device 100. That is, the control unit 201 receives from the server device 100 the result of the settlement process processed by the server device 100 based on the information indicating the purchase of the item, the item information, and the identification information for identifying the client device 110. do.
  • the control unit 201 outputs the result of the payment process from the server device 100. For example, the control unit 201 displays the result of the settlement process on the input / output unit 204, or outputs the result of the settlement process by voice from the audio input / output unit 205.
  • the server device 100 when the item 130 is placed in the store and the payment is completed, the payment for the item 130 has already been completed for the gate installed at the exit or the like of the store. It is also possible to send a signal to the effect that the door does not close at the gate even if the user brings back the object 130 as it is.
  • the server device 100 transmits information indicating that the payment has already been made for the thing 130 to the client device 110. Then, the client device 110 may store information indicating that the payment has already been made for the object 130 in the storage unit 202, and make the information readable at the gate. In this way, the door may not be closed at the gate even if the user brings back the object 130 as it is.
  • the user can acquire information about the object while talking with the object that is not connected to the Internet.
  • the user likes the item he / she can make a payment (or settle) and take the item home without going through a cash register or the like.
  • the user likes the thing 130 he / she purchases a plurality of things 130, and may send a request to the server device 100 to deliver the plurality of things to his / her home.
  • the server device 100 makes the above-mentioned payment based on the information of the number of pieces included in the request, and sends the requested delivery request to an external server device or the like that manages the delivery.
  • a food product will be described as an example of the product 130. More specifically, as shown in FIG. 6 described later, a description will be given using green onions as an example.
  • the control unit 201 asks the question information about the recipe using the food and the thing information.
  • the request is sent to the server device 100.
  • the server device 100 receives the question request.
  • the server device 100 inputs the question information regarding the recipe using food to the trained model identified by the object information included in the question request, and responds to the question regarding the recipe using food. Get the response information from the trained model.
  • the response information includes information on recipes using food.
  • the server device 100 generates a question response including the acquired response information and transmits it to the client device 110.
  • the control unit 201 receives the inquiry response from the server device 100. That is, the control unit 201 receives from the server device 100 the response information regarding the recipe generated in the server device 100 based on the question information and the object information.
  • the control unit 201 outputs response information as a response from the object 130.
  • the control unit 201 controls the question information about the place where other foods used in the recipe are sold.
  • a question request including other food information regarding other foods, food information for the thing 130, and position information of the client device 110 is transmitted to the server device 100.
  • the server device 100 Upon receiving the question request, the server device 100 receives the question information about the place where other foods used in the recipe are sold for the trained model identified by the object information included in the question request. A model in which other food information about other foods and the position information of the client device 110 are input, and information on the place where other foods existing within a predetermined distance from the position of the client device 110 are sold is learned. Get more.
  • the server device 100 uses the acquired information as response information, and transmits a question response including the response information to the client device 110.
  • the control unit 201 receives the inquiry response from the server device 100.
  • control unit 201 receives from the server device 100 the response information regarding the place where the other food is sold, which is generated in the server device based on the question information, the other food information, and the position information.
  • the control unit 201 displays map information around the position where the client device 110 exists in the input / output unit 204, and outputs information on the place where other foods are sold on the map information based on the response information. ..
  • FIG. 6 is a screen showing information on other items included in the recipe and information on the selling place where the items are sold, which are displayed in the input / output unit 204 of the client device 110 of the first modification. It is a figure which shows an example.
  • the object 130 is a green onion.
  • a talk mark 120 is attached to the green onion, which is the object 130.
  • the object 600 indicates the current position of the user. Further, on the screen of FIG. 6, it is shown that the user is at a greengrocer 622 in a certain shopping district.
  • beef 610 and tofu 611 are displayed as other foods included in the recipe of sukiyaki, which is one of the dishes using green onions. Further, in the screen of FIG.
  • the control unit 201 generates a screen as shown in FIG. 6 based on the information from the server device 100 and displays it on the input / output unit 204, so that the user can find out where other foods used in the recipe are sold. Information can be obtained immediately.
  • the client device 110 generates the screen, but the server device 100 may generate the screen and send it to the client device 110. Then, the screen received by the client device 110 from the server device 100 may be displayed on the input / output unit 204 or the like.
  • FIG. 7 is a diagram showing an example of the system configuration of the information processing system 1000 of the modification 2.
  • the object 130 is a machine.
  • the talk mark 120 when the talk mark 120 is attached to the machine, the user can talk with the machine using the client device 110 and obtain the operating status of the machine, the transition of power consumption, and the like.
  • the user who can grasp the transition of the power consumption of the machine from the information acquired from the server device 100 can change the setting according to the purpose, for example, stopping the operation of the machine at night.
  • the question by the user includes a question about equipment usage information, handling information, operation information, operation information, maintenance information, and the like.
  • the server device 100 is a production control server device or the like that manages the production equipment.
  • the object 130 with the talk mark 120 may be a physical distribution item.
  • the question by the user includes a question such as management information, route information, maintenance information, etc. of the physical distribution product.
  • the server device 100 is a physical distribution management server device or the like that manages physical distribution products.
  • a voice is used as an example for explanation.
  • the input is not limited to voice, and may be input of text information such as chat.
  • the client device 110 has information related to the object 130 as information of the object 130 to which the talk mark 120 is attached from the server device 100, for example, information on the campaign of the object, information on the store actually using the object. , Etc. may be received and these information may be output. Further, since the server device 100 can identify the user who purchased the product 130, the server device 100 can provide the user who purchased the product 130 with a place where users who have purchased the same product can communicate with each other, a URL, or the like. You may send it.
  • the control unit displays an object indicating the object based on the captured image on the input / output unit, and outputs the response information from the object as a response from the object.
  • the control unit transmits the question information for the object and the object information to the server device, and the information processing device transmits the question information to the server device.
  • An information processing device that outputs the response information from the object by voice as a response to the above.
  • the control unit when the user inputs a purchase intention regarding the product, the control unit includes information indicating that the product is to be purchased, the product information, and identification information for identifying the information processing device. , To the server device, and the result of the payment process processed by the server device based on the information indicating that the item is purchased, the item information, and the identification information for identifying the information processing device. An information processing device that receives from the server device and outputs the result of the payment process.
  • the information processing apparatus has an image pickup unit, the image pickup unit captures a predetermined mark attached to an object, and the control unit captures an image captured by the image pickup unit and includes the predetermined mark.
  • An information processing device that reads information.
  • the thing is an information processing device which is food.
  • the control unit when the user inputs question information about a recipe using the food, the control unit makes a question request including the question information about the recipe using the food and the product information. It is transmitted to the server device, receives the response information about the recipe generated in the server device based on the question information and the object information from the server device, and outputs the response information as a response from the object. , Information processing equipment.
  • the control unit when the control unit inputs question information about a place where other foods used in the recipe are sold, the control unit asks a question about a place where other foods used in the recipe are sold.
  • Information, other food information about the other food, and the position information of the information processing device are transmitted to the server device, and based on the question information, the other food information, and the position information.
  • Response information regarding the place where the other food is sold generated in the server device is received from the server device, and based on the response information, the place where the other food is sold is displayed on the map information.
  • Information processing device that outputs the information of.
  • the thing is an information processing device which is a machine of a production facility. When information is read from a captured image including a predetermined mark attached to an object in an information processing system, the information includes the object information about the object, and the user inputs question information about the object.
  • Question information for the object is input to the trained model identified by the object information, response information for the question to the object is acquired from the trained model, and the response information is used as a response from the object.
  • Information processing system that outputs.
  • an information processing system that displays an object indicating the object based on the captured image on an input / output unit and outputs the response information from the object as a response from the object.
  • the question information by the user for the object is input
  • the question information for the object and the object information are input to the trained model, and the response information for the question to the object is input. Is obtained from the trained model, and the response information is output by voice from the object as a response from the object.
  • the information processing method executed by the information processing apparatus includes the first step, the second step, the third step, the fourth step, and the fifth step, and the first step is described above.
  • the step information is read from the captured image including a predetermined mark attached to the object, and the information includes the object information about the object and the connection information of the server device.
  • the server device is connected based on the connection information and the user inputs the question information to the object
  • the third step the question information to the object and the object information are transmitted to the server device.
  • the response information generated in the server device based on the question information and the object information is received from the server device, and in the fifth step, the response from the object is received.
  • An information processing method that outputs the response information as.
  • An information processing method executed by an information processing system which includes a first step, a second step, and a third step, and in the first step, a predetermined mark attached to an object is placed.
  • Information is read from the captured image including the image, and the information includes the object information about the object.
  • the question information about the object in the second step, the question information about the object and the inquiry information are described.
  • the object information is input to the trained model, the response information to the question to the object is acquired from the trained model, and in the third step, the response information is output as a response from the object.
  • Information processing method A program for making a computer function as a control unit of the information processing apparatus. Of course, this is not the case.
  • the target to which the talk mark 120 is attached may be a physical distribution product.
  • the user talks with the physical distribution product using the client device 110 as if the physical distribution product management information, route information, maintenance information (support information), purchase information, etc. You can get payment information and so on.
  • Server device 110 Client device 120: Talk mark 130: Object 150: Network 201: Control unit 202: Storage unit 203: Imaging unit 204: Input / output unit 205: Audio input / output unit 206: Communication unit 301: Control unit 302 : Storage unit 303: Communication unit 400: Payment system 500: Icon 600: Object 610: Beef 611: Tofu 622: Yahyakuya 1000: Information processing system

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Accounting & Taxation (AREA)
  • General Physics & Mathematics (AREA)
  • Finance (AREA)
  • Strategic Management (AREA)
  • General Business, Economics & Management (AREA)
  • Economics (AREA)
  • Marketing (AREA)
  • Development Economics (AREA)
  • Computational Linguistics (AREA)
  • Databases & Information Systems (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • General Engineering & Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Mathematical Physics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Acoustics & Sound (AREA)
  • Operations Research (AREA)
  • Human Resources & Organizations (AREA)
  • Computing Systems (AREA)
  • Entrepreneurship & Innovation (AREA)
  • Tourism & Hospitality (AREA)
  • Quality & Reliability (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Telephonic Communication Services (AREA)
PCT/JP2021/042500 2020-11-20 2021-11-18 情報処理装置、情報処理システム、情報処理方法及びプログラム Ceased WO2022107863A1 (ja)

Priority Applications (3)

Application Number Priority Date Filing Date Title
EP21894735.6A EP4250213A4 (en) 2020-11-20 2021-11-18 INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING SYSTEM, INFORMATION PROCESSING METHOD AND PROGRAM
US18/037,265 US12619637B2 (en) 2020-11-20 2021-11-18 Information processing device, information processing system, information processing method, and program
CN202180078065.6A CN116615741A (zh) 2020-11-20 2021-11-18 信息处理装置、信息处理系统、信息处理方法以及计算机程序

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020193545A JP7175025B2 (ja) 2020-11-20 2020-11-20 情報処理装置、情報処理システム、情報処理方法及びプログラム
JP2020-193545 2020-11-20

Publications (1)

Publication Number Publication Date
WO2022107863A1 true WO2022107863A1 (ja) 2022-05-27

Family

ID=81709079

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/042500 Ceased WO2022107863A1 (ja) 2020-11-20 2021-11-18 情報処理装置、情報処理システム、情報処理方法及びプログラム

Country Status (4)

Country Link
EP (1) EP4250213A4 (https=)
JP (2) JP7175025B2 (https=)
CN (1) CN116615741A (https=)
WO (1) WO2022107863A1 (https=)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7175025B2 (ja) * 2020-11-20 2022-11-18 株式会社アットロボティクス 情報処理装置、情報処理システム、情報処理方法及びプログラム

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005327077A (ja) * 2004-05-14 2005-11-24 Sony Corp 買い物支援システム、買い物支援方法、携帯端末装置
JP2011113417A (ja) * 2009-11-27 2011-06-09 Amitsukusu:Kk 賃貸物件管理装置、通信端末、賃貸物件管理方法、賃貸物件管理プログラム及び賃貸物件管理システム
JP2014074813A (ja) * 2012-10-04 2014-04-24 Yahoo Japan Corp 広告配信装置、広告配信システム及び広告配信方法
JP2015041438A (ja) 2013-08-21 2015-03-02 アプリックスＩｐホールディングス株式会社 照明制御システム、端末およびその照明制御方法
US20160203352A1 (en) * 2013-09-20 2016-07-14 Flashback Survey, Inc. Using scanable codes to obtain a service
JP2018005626A (ja) * 2016-07-04 2018-01-11 株式会社フューチャーアプリケーション 販売支援システムおよび販売支援装置並びに販売支援方法
US20190347319A1 (en) * 2018-05-11 2019-11-14 Citrix Systems, Inc. Generating Conversation Models From Documents
JP2019207564A (ja) * 2018-05-29 2019-12-05 クックパッド株式会社 情報処理システム、情報処理装置、情報処理方法、およびプログラム

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002208072A (ja) 2001-01-09 2002-07-26 Ricoh Co Ltd 顧客サービスシステム
JP2003157477A (ja) * 2001-11-19 2003-05-30 Hitachi Ltd タグ管理サーバとこれを用いた情報の取得・活用システム
JP3609398B1 (ja) 2003-11-11 2005-01-12 株式会社青山キャピタル 商品情報提供システム
US20090289764A1 (en) * 2008-05-21 2009-11-26 Fu-Sheng Chiu Instant promotional media using an identification tag
CN102741874B (zh) * 2009-12-13 2016-08-24 因特伟特公司 用于使用移动设备从零售机构购买产品的系统和方法
CN103902598B (zh) 2012-12-27 2018-11-09 北京京东尚科信息技术有限公司 移动终端及商品信息查询方法
JP6207848B2 (ja) 2013-03-07 2017-10-04 三井造船株式会社 バイオエタノールの回収方法及び回収システム
CN105931103A (zh) 2016-04-21 2016-09-07 聂迪 基于扫描的购物的方法及购物系统
US9864949B1 (en) 2016-10-31 2018-01-09 International Business Machines Corporation Cognition model-based product assist
KR20180083228A (ko) * 2017-01-12 2018-07-20 삼성전자주식회사 전자 장치 및 전자 장치에서의 전자 구매 방법
JP6604612B2 (ja) 2018-04-06 2019-11-13 Ｚホールディングス株式会社 算出装置、算出方法及び算出プログラム
JP7175025B2 (ja) 2020-11-20 2022-11-18 株式会社アットロボティクス 情報処理装置、情報処理システム、情報処理方法及びプログラム

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005327077A (ja) * 2004-05-14 2005-11-24 Sony Corp 買い物支援システム、買い物支援方法、携帯端末装置
JP2011113417A (ja) * 2009-11-27 2011-06-09 Amitsukusu:Kk 賃貸物件管理装置、通信端末、賃貸物件管理方法、賃貸物件管理プログラム及び賃貸物件管理システム
JP2014074813A (ja) * 2012-10-04 2014-04-24 Yahoo Japan Corp 広告配信装置、広告配信システム及び広告配信方法
JP2015041438A (ja) 2013-08-21 2015-03-02 アプリックスＩｐホールディングス株式会社 照明制御システム、端末およびその照明制御方法
US20160203352A1 (en) * 2013-09-20 2016-07-14 Flashback Survey, Inc. Using scanable codes to obtain a service
JP2018005626A (ja) * 2016-07-04 2018-01-11 株式会社フューチャーアプリケーション 販売支援システムおよび販売支援装置並びに販売支援方法
US20190347319A1 (en) * 2018-05-11 2019-11-14 Citrix Systems, Inc. Generating Conversation Models From Documents
JP2019207564A (ja) * 2018-05-29 2019-12-05 クックパッド株式会社 情報処理システム、情報処理装置、情報処理方法、およびプログラム

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP4250213A4

Also Published As

Publication number Publication date
JP7535326B2 (ja) 2024-08-16
EP4250213A1 (en) 2023-09-27
EP4250213A4 (en) 2024-01-24
JP7175025B2 (ja) 2022-11-18
CN116615741A (zh) 2023-08-18
US20240020325A1 (en) 2024-01-18
JP2022082154A (ja) 2022-06-01
JP2023011785A (ja) 2023-01-24

Similar Documents

Publication Publication Date Title
US10580052B2 (en) Systems and methods for controlling shelf display units and for graphically presenting information on shelf display units
JP2005115843A (ja) サービス提供システム、サーバ、端末装置及びサービス提供方法
JP7772183B2 (ja) 情報処理装置、制御方法、及びプログラム
JP2023159448A (ja) 情報処理方法、プログラム、及び情報処理装置
CN108694535A (zh) 信息生成方法和装置
US10163094B2 (en) Light-life system and application
WO2018218859A1 (zh) 一种发送电子券的方法及装置
KR20120132179A (ko) 촬영 이미지를 이용한 의사 전달 방법 및 장치
WO2018038081A1 (ja) 在庫管理装置、顧客端末、商品販売システム、在庫管理方法、表示制御方法および記録媒体
CN110276623A (zh) 控制、展示、播放方法、服务器、电子价签、设备和系统
JP7535326B2 (ja) 情報処理装置、情報処理システム、情報処理方法及びプログラム
CN114820104A (zh) 商品展示方法、相关装置、系统及计算机存储介质
JP2020086813A (ja) 食物アレルゲン情報管理システムおよび食物アレルゲン情報管理方法ならびに食物アレルゲン情報管理プログラム
JP5783154B2 (ja) 顧客管理装置、顧客管理方法、及びプログラム
US12619637B2 (en) Information processing device, information processing system, information processing method, and program
JP2020154445A (ja) プログラム、情報処理方法、及び情報処理装置
EP3336792A1 (en) Computer implemented item recommendation
KR20110100029A (ko) 포스 시스템을 이용한 상품 판매 장치 및 그 방법
KR20180069792A (ko) 예를 들어 학교에서 분실물의 관리를 가능하게 하도록 구성된 체계 및 방법론
US20220076294A1 (en) Processing apparatus, processing method, and non-transitory storage medium
KR102557545B1 (ko) 증강 현실 기반의 구매 물품 리뷰 서비스 제공 방법 및 이에 사용되는 관리 서버
CN107451860B (zh) 信息推送方法和装置
JP2018160080A (ja) データ送信装置、制御方法及び制御プログラム
CN109547226B (zh) 社群商家交互方法及装置
JP2024018708A (ja) 情報交換支援装置、情報交換支援方法、プログラム及び記録媒体

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21894735

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 18037265

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 202180078065.6

Country of ref document: CN

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2021894735

Country of ref document: EP

Effective date: 20230620