KR102445263B1 - Apparatus, method, and computer readable recoding medium for providing shopping service - Google Patents

Abstract

The present embodiment includes the steps of: detecting, by a shopping service providing apparatus, one or more objects through a sensor unit; selecting a first object having a distance between the one or more objects and a shopping service providing device within a predetermined threshold distance in consideration of the detected strength of the signal from the one or more objects; receiving the first object information from the first object and outputting the first object information through an output unit; Disclosed is a method of providing a shopping service including; receiving an input for the first object from a user.

Description

Apparatus, method and computer-readable recording medium for providing shopping service

The present invention relates to an apparatus, method, and computer-readable recording medium for providing a shopping service, and more particularly, by detecting an object located in the vicinity of a user and transmitting a stimulus corresponding to the object using one or more protrusions, It relates to a shopping service providing apparatus, method, and computer-readable recording medium for recognizing an object located in the vicinity of the object and making a purchase for the object.

Recently, the development of smart devices such as smart phones, smart watches, and smart glasses has made remarkable growth, providing a convenient environment for the public in their daily life. However, since most smart devices are based on a graphical user interface (GUI), it is difficult for the visually impaired to grasp the location of a mouse pointer or touch, making it difficult to utilize such smart devices. Therefore, in order for visually impaired people to use these smart devices, there is an urgent need for a user environment in which information can be transmitted using sound or tactile sense.

The above-mentioned background art is technical information possessed by the inventor for the derivation of the present invention or acquired in the process of derivation of the present invention, and cannot necessarily be said to be a known technique disclosed to the general public prior to the filing of the present invention.

Domestic Patent Publication No. 2013-0065887

Embodiments of the present invention detect an object located in the vicinity of the user, and transmit a stimulus corresponding to the object using one or more protrusions, so that an object located in the vicinity of the user is recognized and a purchase for the object is made. A shopping service providing apparatus, method, and computer-readable recording medium are provided.

In addition, embodiments of the present invention provide a shopping service providing apparatus, method, and computer-readable recording medium capable of confirming the existence of an object by recognizing the object within a predetermined distance without actually putting the object provided in the vicinity of the user in the cart. provides

A shopping service providing method according to embodiments of the present invention may include: detecting, by a shopping service providing apparatus, one or more objects through a sensor unit; selecting a first object having a distance between the one or more objects and a shopping service providing device within a predetermined threshold distance in consideration of the detected strength of the signal from the one or more objects; receiving the first object information from the first object and outputting the first object information through an output unit; It may include; receiving an input for the first object from the user.

A shopping service providing method according to embodiments of the present invention may include: extracting, by a shopping service providing apparatus, one or more objects included in an image input through an input unit; selecting a first object at a closest position among the one or more objects by determining a perspective relationship between the one or more objects using an image processing technique; receiving the first object information from the first object and outputting the first object information through an output unit; It may include; receiving an input for the first object from the user.

The shopping service providing method according to the embodiments of the present invention provides a method for enabling the shopping service providing device to directly pay for the first object through a preset credit card when the input for the first object is a purchase input. controlling; may include.

A shopping service providing method according to embodiments of the present invention may include, when the input for the first object is a selection input, processing, by the shopping service providing apparatus, information on the first object to be included in a purchase schedule list; may further include.

A method of providing a shopping service according to embodiments of the present invention may include controlling to receive purchase information of one or more second objects in response to an input for selecting one or more second objects included in the purchase schedule list; Purchasing the one or more second objects according to purchase information of the one or more second objects; may include.

In the step of receiving the first object information from the first object and outputting the first object information through an output unit, the type of the first object information to be output is determined in consideration of the category of the first object, and the type It is possible to extract the first object information corresponding to , and output it through the output unit.

A shopping service providing method according to embodiments of the present invention further comprises: generating a signal for changing the state information of the first object to a payment completion state, and transmitting the signal to the first object or a management server may include

An apparatus for providing a shopping service according to embodiments of the present invention includes: a signal detection unit configured to detect one or more objects through a sensor unit; an object extracting unit for selecting a first object having a distance to the one or more objects within a predetermined threshold distance in consideration of the strength of the detected signal from the one or more objects; an object information receiver configured to receive the first object information from the first object; an output control unit for outputting the first object information through an output unit; and an input control unit that receives an input for the first object from a user.

An apparatus for providing a shopping service according to embodiments of the present invention includes: an image input unit for extracting one or more objects included in an image input through the input unit; an object extracting unit that selects a first object at a closest position among the one or more objects by determining a perspective relationship between the one or more objects by using an image processing technology; an object information receiver configured to receive the first object information from the first object; an output control unit controlling to output the first object information through an output unit; and an input control unit controlling to receive an input for the first object from the user.

In the shopping service providing apparatus according to embodiments of the present invention, when the input for the first object is a purchase input, the shopping service providing apparatus may process the direct payment for the first object through a preset credit card. It may include a; purchase processing unit to control so that.

In the shopping service providing apparatus according to embodiments of the present invention, when the input for the first object is a selection input, the shopping service providing apparatus includes a selection processing unit for processing the information on the first object to be included in a purchase schedule list ; may be further included.

The purchase processing unit controls to receive purchase information of the one or more second objects in response to an input for selecting one or more second objects included in the purchase schedule list, and according to the purchase information of the one or more second objects The one or more second objects may be purchased.

The output control unit may determine a type of the first object information to be output in consideration of the category of the first object, extract the first object information corresponding to the type, and output the extracted first object information through the output unit.

The purchase processing unit may generate a signal for changing the state information of the first object to a payment completion state, and transmit the signal to the first object or the management server.

The output unit may include one or more protrusions, and all or some of the one or more protrusions may be driven to hit the user's skin according to the first object information.

The output unit is adjacent to the user's skin, and includes a plurality of protrusions disposed at positions corresponding to at least one of nerves and blood vessels of the user, and drives the plurality of protrusions according to the first object information to provide the user with the information. stimuli can be transmitted.

The computer program according to an embodiment of the present invention may be stored in a medium to execute any one of the methods of providing a shopping service according to an embodiment of the present invention using a computer.

In addition to this, another method for implementing the present invention, another system, and a computer-readable recording medium for recording a computer program for executing the method are further provided.

Other aspects, features and advantages other than those described above will become apparent from the following drawings, claims, and detailed description of the invention.

The present invention detects an object located in the vicinity of the user, and transmits a stimulus corresponding to the object using one or more protrusions, thereby recognizing an object located in the vicinity of the user and making a purchase for the object. .

In addition, the present invention can confirm the existence of the object by recognizing the object provided in the vicinity of the user within a predetermined distance without actually putting the object in the cart.

1 is a block diagram illustrating a structure of an apparatus for providing a shopping service according to embodiments of the present invention.
2 is a block diagram showing the structure of a control unit.
3A to 3C are diagrams illustrating a relationship between an output control unit and an output unit.
4 is a diagram schematically illustrating an appearance of an apparatus for providing a shopping service according to an embodiment of the present invention.
5 to 8 are diagrams illustrating a shopping service providing method according to embodiments of the present invention.
9 to 10 are diagrams illustrating examples of use of an apparatus for providing a shopping service according to an embodiment of the present invention.

Since the present invention can apply various transformations and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail in the detailed description. Effects and features of the present invention, and a method for achieving them, will become apparent with reference to the embodiments described below in detail in conjunction with the drawings. However, the present invention is not limited to the embodiments disclosed below and may be implemented in various forms.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, and when described with reference to the drawings, the same or corresponding components are given the same reference numerals, and the overlapping description thereof will be omitted. .

In the following embodiments, terms such as first, second, etc. are used for the purpose of distinguishing one component from another, not in a limiting sense.

In the following examples, the singular expression includes the plural expression unless the context clearly dictates otherwise.

In the following embodiments, terms such as include or have means that the features or components described in the specification are present, and the possibility that one or more other features or components will be added is not excluded in advance.

In cases where certain embodiments are otherwise practicable, a specific process sequence may be performed different from the described sequence. For example, two processes described in succession may be performed substantially simultaneously, or may be performed in an order opposite to the order described.

In the embodiments below, “circuitry” refers to, for example, hardwired circuitry, programmable circuitry, state machine circuitry, and/or firmware that stores instructions to be executed by programmable circuitry, alone or in any combination. may include Applications may be implemented as code or instructions that may be executed on programmable circuitry, such as a host processor or other programmable circuitry. As used in any of the embodiments herein, a module may be implemented as a circuit. The circuit may be implemented as an integrated circuit, such as an integrated circuit chip.

In the following examples, when a part "includes" a certain component, this means that other components may be further included, rather than excluding other components, unless otherwise stated. In addition, terms such as “…unit”, “…group”, and “module” described in the specification mean a unit that processes at least one function or operation, which may be implemented as hardware or software or a combination of hardware and software. have.

1 is a diagram illustrating an apparatus 100 for providing a shopping service according to an embodiment of the present invention.

Referring to FIG. 1 , an apparatus 100 for providing a shopping service according to an embodiment of the present invention may include a communication unit 110 , a control unit 120 , a memory 130 , an input unit 140 , and an output unit 150 . have.

The shopping service providing apparatus 100 according to an embodiment of the present invention may detect an object located in a store, a department store, etc. in daily life, and immediately process a purchase for the detected object. The shopping service providing apparatus 100 detects and recognizes an object located in the vicinity without accessing the shopping application, so that the corresponding object can be purchased. In addition, the shopping service providing apparatus 100 detects and recognizes an object that is displayed or sold without the effort of putting it in a cart to purchase an object sold at a store, a mart, and the like, so that the object can be purchased. In addition, the shopping service providing apparatus 100 may process to purchase an object that is the same product as the object displayed or sold but has different options (color, size, gender information, etc.). Also, the shopping service providing apparatus 100 may process not only an actual object but also an object recognized through an image so that purchase is possible. Through this, the shopping service providing apparatus 100 may provide a free shopping opportunity to users with poor visual ability by sensing or recognizing a surrounding object and providing information on the object. In addition, the shopping service providing apparatus 100 enables the purchase without the effort of lifting an object that is difficult to be put in a shopping cart or moved until it is calculated. Also, the shopping service providing apparatus 100 may directly check and purchase a product, unlike purchasing through the Internet, where the moments of purchase and acquisition are different. Also, the shopping service providing apparatus 100 may convert the sensed or recognized object and information related to the object into other types of data and provide it. Through the shopping service providing apparatus 100 , the user may check information related to the recognized object without the effort of directly holding the product, checking the back side, or checking detailed information related to the product.

The shopping service providing apparatus 100 may detect an object through a recognition mark included in the object. In this specification, for convenience, recognizing a recognition mark included in an object will be described as sensing and recognizing the object itself.

Here, the shopping service providing apparatus 100 may be a user's personal computer or a user's portable terminal, and a terminal equipped with an application capable of web browsing may be borrowed without limitation.

In more detail, the shopping service providing apparatus 100 includes a computer (eg, desktop, laptop, tablet, etc.), a media computing platform (eg, cable, satellite set-top box, digital video recorder), and handheld computing. It may include, but is not limited to, any type of device (eg, PDA, email client, etc.), a mobile phone, or any other type of computing or communication platform.

The communication unit 110 may include one or more components that enable communication between the shopping service providing apparatus 100 and an external server (a search service providing server, a portal service providing server, a news providing server, etc.). The communication unit 110 may include one or more components that enable communication between the shopping service providing apparatus 100 and the user's mobile phone.

In addition, the communication unit 110 may enable communication with objects located in the vicinity. The communication unit 110 may communicate with each object according to a communication protocol of a tag attached to an object located nearby. For example, the communication unit 110 is a Bluetooth communication unit, a BLE (Bluetooth Low Energy) communication unit, a near field communication unit (Near Field Communication unit), a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, infrared (IrDA, infrared Data Association) It may include a communication unit, a Wi-Fi Direct (WFD) communication unit, an ultra wideband (UWB) communication unit, an Ant+ communication unit, and the like, but is not limited thereto.

The communication unit 110 may include a wireless identification reader for detecting the wireless identification tag. The wireless identification tag included in the object is an IC chip or resin card with a built-in non-volatile memory and wireless communication function, and may be a device that can send and receive various data wirelessly using a certain frequency band. Recording, correcting, erasing and reading can be done contactless using wireless. Predetermined information related to an object may be stored in a volatile and/or non-volatile memory in the wireless identification tag 210 .

The wireless identification reader may modulate the interrogation signal (CW signal) and transmit it to the wireless identification tag. The modulated interrogation signal may be transmitted to the wireless identification tag through a predetermined channel. The wireless identification tag receives the modulated signal to obtain power, and by using the acquired power, the above-described information stored therein can be modulated and transmitted to the wireless identification reader, and the wireless identification reader receives the modulated information and related to the object. information can be generated.

Referring to FIG. 2B , if the identification mark included in the object is the short-range wireless communication tag 220 , the communication unit 110 may include a short-range wireless communication reader. A short-distance wireless communication tag as an identification tag is an IC chip with a built-in non-volatile memory and wireless communication function. It can communicate by sensing a simple touch or proximity. Predetermined information related to an object may be stored in a volatile and/or non-volatile memory in the short-range wireless communication tag 220 .

When the short-range wireless communication reader touches the short-range wireless communication tag or approaches within a predetermined distance, for example, within 10 cm, a change in magnetic field occurs, and a current is generated in the short-range wireless communication tag by the change of the magnetic field, Information stored in the short-range wireless communication tag may be transmitted to the short-range wireless communication reader.

Here, the communication unit 110 may be a device including hardware and software necessary for transmitting and receiving signals such as control signals or data signals through wired/wireless connection with other network devices.

The control unit 120 performs a function of controlling overall operations of the communication unit 110 , the memory 130 , the input unit 140 , the output unit 150 , and the sensor unit 160 .

Here, the controller 120 may include all kinds of devices capable of processing data, such as a processor. Here, the 'processor' may refer to a data processing device embedded in hardware, for example, having a physically structured circuit to perform a function expressed as a code or an instruction included in a program. As an example of the data processing device embedded in the hardware as described above, a microprocessor, a central processing unit (CPU), a processor core, a multiprocessor, an application-specific integrated (ASIC) circuit) and a processing device such as a field programmable gate array (FPGA), but the scope of the present invention is not limited thereto.

The memory 130 may store a program for processing and control of the controller 120 , and may store input/output data (eg, a plurality of menus, a plurality of first hierarchical sub-menus corresponding to each of the plurality of menus, a plurality of A plurality of second hierarchical submenu, etc. corresponding to each of the first hierarchical submenus of

The memory 130 may store in advance sample data for each type of auditory data and characteristic information of the sample data. The memory 130 may store characteristic information of the sensed auditory data for a predetermined time, for example, one week. The memory 130 may delete the auditory data when a predetermined time elapses after the auditory data is sensed.

The memory 130 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (eg, SD or XD memory), and a RAM. (RAM, Random Access Memory) SRAM (Static Random Access Memory), ROM (Read-Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory), magnetic memory, magnetic disk , may include at least one type of storage medium among optical disks. Also, the shopping service providing apparatus 100 may operate a web storage or a cloud server that performs a storage function of the memory 130 on the Internet.

Programs stored in the memory 130 may be classified into a plurality of modules according to their functions, for example, may be classified into a UI module, a touch screen module, a notification module, and the like.

The input unit 140 may include a microphone for inputting auditory data. The microphone receives an external sound signal and processes it as electrical voice data. For example, the microphone may receive an acoustic signal from an external device or a speaker. The microphone may use various noise removal algorithms to remove noise generated in the process of receiving an external acoustic signal.

The output unit 150 may include a plurality of protrusions 151 or a vibration motor 152 . Although the output unit 150 is included in the shopping service providing apparatus 100 in FIG. 1 , the output unit 150 may be a separate device and may be connected to the shopping service providing apparatus 100 electrically or through a communication network. . A more detailed description thereof will be given in the description of FIG. 4 .

The output unit 150 is a component for transmitting data to the user, and may transmit data to the user in a direct contact with the user or in a non-contact manner. The output unit 150 may transmit data to the user through one or more protrusions. Each of the protrusions may be coupled to a device attachable to a body part of the user so as to be positioned at a predetermined position. The device combined with one or more protrusions is illustrated in the same shape as the upper body of the human body, but is not limited thereto, and may be implemented in a shape such as a glove, a shape like a socks, or a shape like a bottom. Each of the protrusions may provide a one-dimensional point-like stimulus to the user by linear motion in the vertical direction, or may provide a two-dimensional line-like stimulus to the user by linear motion in the left and right directions. In addition, the plurality of protrusions may simultaneously hit the user or sequentially hit the user, thereby generating an action in the real world and a stimulus corresponding to the action in the virtual world. The output control signal may include a direction in which one or more protrusions move, a moving time point, a duration, and the like for controlling the motion of the protrusion.

The output unit 150 is disposed at a position corresponding to the user's nerves, cells, or blood vessels to transmit data through the user's nerves, cells, or blood vessels, and the output unit 150 is a stimulus that the user can feel through the nerves. , and/or a signal. Also, the output unit 150 may be connected to the user's brain and transmit data that can be understood through the user's brain.

The sensor unit 160 performs a function of confirming a location and an existing object in the vicinity. The sensor unit 160 may include one of a proximity sensor, an infrared sensor, an RGB sensor, and an image sensor, and may be used to determine whether an object exists in the vicinity of the shopping service providing apparatus 100 .

If the recognition mark included in the object is an image code, the sensor unit 160 may include a scanner having an image code decoding function. The image code as the identification mark may include a bar code, a QR code (quick response code) or other image code. The QR code is a two-dimensional barcode of a matrix type that represents information in a black and white grid pattern. In other words, QR code is a two-dimensional barcode that overcomes the capacity limitations of general barcodes and expands its format and content, and can store data of characters in addition to numbers by having vertical and horizontal information. The QR code has a two-dimensional shape, so it can have more information and can store character data such as alphabets and Chinese characters in addition to numbers. These QR codes include a quiet zone, a position detection pattern (including a separator), a timing pattern, an alignment pattern, format information, version information, and a data area (including an error correction code area) to facilitate data expression and reading. area is divided. In the data area of the QR code, predetermined information related to an object may be stored.

The scanner is equipped with software or an application for decrypting the image code, and the scanner scans the image code to obtain an image according to it, then decrypts the encrypted image code of a specific format to obtain predetermined information stored in the data area can do. The scanner may be a dedicated camera in a portable terminal in which software or an application for decoding an image code is loaded.

The shopping service providing apparatus 100 may include a photographing unit (not shown) and a recognition unit (not shown). In order to obtain predetermined information from the recognition mark provided on the object, the photographing unit may include a camera for photographing an image of the object. The recognition unit having a character recognition function may recognize a character from an image of an object captured by the photographing unit, and generate the recognized character as information related to the object. For example, if the object is a product, when the photographing unit shoots an image of a product that includes text such as the product name, price, and seller, the recognition unit performs character recognition on the image of the product to determine the name of the product, You can create information related to an object including price, vendor, and the like.

2 is a block diagram showing the structure of the control unit 120 .

Referring to FIG. 2 , the control unit 120 includes an object detection unit 121 , an object extraction unit 122 , an object information receiving unit 123 , an output control unit 124 , an input control unit 125 , an image input unit 126 , It may include a purchase processing unit 127 , a selection processing unit 128 , and a location search unit 129 .

The object detection unit 121 may control one or more objects to be detected through the communication unit 110 or the sensor unit 160 . The object detecting unit 121 may generate a communication signal that can be received by a nearby object through the communication unit 110 or the sensor unit 160 . The object detection unit 121 may control to transmit a signal requesting a response to an object located nearby and receive a response to the signal requesting the response. The object detection unit 121 detects one or more objects to which a response has been transmitted. Activation or deactivation of the object detection unit 121 is determined by the user, and in the activated state, the object detection unit 121 may generate and continuously transmit a communication signal that can be received by an unspecified object located in the vicinity at a predetermined time interval. In this case, the object detection unit 121 may detect an object located in the vicinity by using radio frequency (RF), Bluetooth, infrared rays, Wi-Fi, wireless Internet, and the like. The object detection unit 121 may generate a signal for detecting an object according to a communication protocol of each communication network. In another embodiment, the object detecting unit 121 may detect one or more objects located in the vicinity by sensing a magnetic field generated by the object. The object detecting unit 121 may detect a surrounding object using an image sensor. The object detecting unit 121 may detect a surrounding object by converting the surrounding into an image or image, and extracting the image or an object included in the image.

The object extractor 122 may select a first object whose distance to the one or more objects is within a predetermined threshold distance in consideration of signal strengths from the one or more objects from among the detected one or more objects. When an object is sensed using a radio frequency (RF) signal, it may be considered that the object is located at a closer position as the intensity of the RF signal increases. The object extraction unit 122 calculates the distance to each object by using an algorithm or formula representing the relationship between the signal strength and the distance set in advance, and determines whether the distance to the object is within a predetermined threshold distance will do

In this case, the relationship between the signal strength and the distance may vary depending on the surrounding environment, weather such as temperature, humidity, and the like. In order to reflect the difference in distance according to the surrounding environment, the object extraction unit 122 receives the first distance of the object for which the user knows the distance to the object, and is calculated using the intensity of the signal from the object. By comparing the second distance to the object, the distance to the object may be corrected. The surrounding environment information may be acquired through a temperature/humidity sensor, an air pressure sensor, a position sensor, etc. included in the sensor unit 160 .

The object information receiving unit 123 receives the first object information from the selected first object. The first object information refers to information received from an object, and may include serial number, trademark, product name, manufacturer, raw material, origin, color, measured size, and dimension information assigned to the object. The object information receiving unit 123 generates a signal to read and transmit a specific area of a memory included in the selected first object, transmits it to the first object, and receives a response to the signal, thereby The first object information may be received. Also, the object information receiver 123 may receive various data input to the object. For example, the object information receiver 123 may receive data such as an advertisement message related to an object, a user review input related to the object, a comment, a review, and the like. The object information receiver 123 may evaluate the price of the object. For example, the object information receiving unit 123 may receive information such as whether the price of the object is higher or lower than that of a competing object of the object. Also, the object information receiving unit 123 may receive information about an object superior in price to the object.

The output control unit 124 may control to output the first object information through the output unit 150 . In this case, the output controller 124 may determine the category of the object through the serial number of the object of the first object information, and determine the type of object information to be output according to the category. The output control unit 124 may determine the type of output information matched according to a category based on preset data. Specifically, the output control unit 124 may control to preferentially output price information, which is information important for determining whether to purchase an object.

When the category of the first object is food, the output controller 124 controls to preferentially output the expiration date, which is information indicating the freshness of the first object. When the category of the first object is a product purchased to give a visual design effect, such as clothing, kitchenware, furniture, etc., the output control unit 124 may determine the visual effect of the first object, such as information such as color. is controlled to output preferentially.

When the second object is detected after the first object is detected through the object detection unit 121, the output control unit 124 controls the output control unit 124 to control the second object after a predetermined time elapses after the second object is detected. control to output the information of

The output controller 124 may control to output representative information of the selected object in consideration of the category of the object, and may control to output detailed information of the object according to a predetermined input. Here, the representative information of the object may vary depending on the category of the object. For example, representative information of food is the expiration date, representative information of electronic products is the date of manufacture, representative information of fruit is arrival date, and representative information of meat is It could be the date of slaughter, etc. The output control unit 124 may control to sequentially output information of the detected object, and when a user input is received while outputting the information of the first object, detailed information of the first object may be provided.

When an input for outputting information of all objects is received, the output controller 124 may control to output representative information or detailed information of one or more objects detected during a predetermined threshold period, for example, one day. When an input for outputting object information is received, the output controller 124 may control the movement of one or more protrusions to output representative information or detailed information of the object. The output control unit 124 controls one or more protrusions included in the output unit 150 to move up and down or left and right according to the representative information or detailed information of the object. The output control unit 124 controls one or more protrusions included in the output unit 150 to move up and down or left and right to convey the meaning included in the representative information or detailed information of the object. The output control unit 124 may control the protrusion positioned at a point corresponding to the representative information or detailed information of the object to move, and the output control unit 124 may control the duration time proportional to the degree corresponding to the representative information or detailed information of the object. It can be controlled to move the protrusion by duration or intensity.

The input controller 125 may control to receive an input for the first object. The input controller 125 may control to receive one of a purchase input and a purchase plan input for the first object. In response to the input input by the input control unit 125 , the control unit 120 may control subsequent operations to be processed by other components (purchase processing unit, selection processing unit, etc.).

The input controller 125 may control to receive a purchase input or purchase plan input for a currently sensed object or a sensed object. The purchase input or purchase plan input may be generated through sound data, may be generated through an input such as pressing a button, or may be generated through a user's gesture. When a predetermined input is received, the input control unit 125 may cause an event, such as purchase or purchase plan, to occur with respect to an object corresponding to information output when the predetermined input is received.

Next, a subsequent operation for the purchase input for the first object will be described.

The purchase processing unit 125 may control the payment for the first object to be processed through a preset credit card according to a purchase input for the inputted first object. For purchase and payment, the input control unit 125 controls to receive credit card information used for payment from the user in advance. The user determines a payment method used for purchase, and inputs information about the payment method in advance. When payment is not completely made by the purchase processing unit 125 , the purchase processing unit 125 may control to generate and output an error message.

The purchase processing unit 125 may also perform a function such as a household account book for limiting the purchase amount of the user or managing the total purchase amount. For example, if the user is set to purchase up to 1 million won for a predetermined period, the purchase processing unit 125 determines whether the accumulated purchase amount purchased during the predetermined period exceeds 1 million won, and the purchase of the object is can be controlled to make it happen. In addition, the purchase processing unit 125 may also perform a function of summing up the total amount paid from the 1st of every month for a predetermined period input by the user, for example.

The shopping service providing apparatus 100 according to embodiments of the present invention receives one or more credit card information or account information in advance by a user, and purchases the detected object, such as credit card information or account information, etc. can utilize

The selection processing unit 126 may process the first object to be included in the purchase plan list according to the purchase plan input for the input first object. Here, the purchase schedule list may include one or more objects selected by the user. Through this, the shopping service providing apparatus 100 according to embodiments of the present invention may process a purchase for an object stored in the purchase schedule list even if the distance from the object to be purchased increases.

In another embodiment, the apparatus 100 for providing a shopping service according to embodiments of the present invention analyzes a captured image or image, and controls to receive a purchase or selection input for an object included in the image or image. can To this end, the shopping service providing apparatus 100 according to embodiments of the present invention may further include an image input unit 126 that performs a function of receiving an image or an image. The image input unit 126 may receive an image from an external device (a computer, a smart phone, etc.) or control to receive an image captured around it, and may extract one or more objects included in the input image. A code for extracting an image or an object included in the image may be stored in advance in the shopping service providing apparatus 100 according to embodiments of the present invention.

The apparatus 100 for providing a shopping service according to embodiments of the present invention may include a location search unit 129 that searches for a location of a second object corresponding to a search word input by a user. The location search unit 129 may match a search word input by the user or determine a second object included in the search word, search for the second object in the vicinity, or generate location information corresponding to the second object have. For example, when 'shampoo' is input from the user, the location search unit 129 may search for a location for shampoo by communicating with an external server or a reader located for each zone. In this case, while searching for a location for the shampoo, a function of guiding a route to the location of the shampoo may be performed. For example, when a user moving from the first zone to the second zone searches for an object located in the second zone, the location search unit 129 performs a function of notifying that the object is located in the next zone can do. Through this, the shopping service providing apparatus 100 according to embodiments of the present invention can more easily find a product to be purchased in a wide space such as a department store, a mart, or a store.

FIG. 3 is a diagram for explaining the structure and operation of the output control unit 124 and the output unit 150 .

The protrusion controller 1241 generates output data corresponding to the object information generated by the object information receiver 123 and controls the protrusions 151 to be driven according to the output data.

Referring to FIG. 3A , the output unit 150 may include a plurality of protrusions 151 , a plurality of driving units 153 , and a protrusion control unit 1241 . Here, the plurality of projections 151 may include, for example, a total of 24 in 8 horizontal columns and 3 vertical rows, and the plurality of driving units 134 may include a total of 24 connected to each of the 24 projections 151 . can Each of the plurality of protrusions 151 is electrically connected to each of the plurality of driving units 134 , and each of the plurality of driving units 134 receives a driving control signal from the second control unit 135 and selects one or more protrusions 151 . can be moved in a straight line. Here, the selected protrusion may be linearly moved to a position higher than the unselected protrusion. The protrusion control unit 1241 generates a driving control signal corresponding to the second recognition information received from the first conversion unit 120, that is, at least one of a previously agreed protrusion selection signal, a protrusion protrusion time, and a protrusion protrusion period to generate a driving unit One or more driving units 153 output to 134 and receiving the driving control signal may linearly move the corresponding projection 151 . From this, a user equipped with the user terminal T1 including the shopping service information providing system 100 can recognize the first recognition information to be described by the object through the linear motion of the protrusion 151 .

Referring to FIG. 3B , each of the plurality of protrusions 151 included in the output unit 150 is electrically connected to one driving unit 151 , and the driving unit 151 receives a driving control signal from the protrusion control unit 1241 . It is possible to linearly move one or more protrusions 151 that are received and selected.

Referring to FIG. 3C , each of some of the protrusions 151 among the plurality of protrusions 151 included in the output unit 150 is electrically connected to any one of the plurality of driving units 153 , and each The driving unit 153 may receive a driving control signal from the projection control unit 1241 to linearly move one or more selected projections 151 .

The vibration motor 152 may output a vibration signal. The vibration motor 152 is electrically connected to the vibration controller 1242 to receive a control signal related to driving the vibration motor, and is driven according to the control signal.

4 is a diagram schematically illustrating an appearance of an apparatus 100 for providing a shopping service according to an embodiment of the present invention.

The shopping service providing apparatus 100 may include an output unit 150 provided to face the user on the expression surface. Accordingly, the protrusion signal due to the selective entry and exit of the protrusions 151 protruding on the expression surface can be recognized as a direct and local blow to the user, and the user is directly hit at the location hit by the protrusions 151 . may vibrate. Unlike a general vibration signal of a portable electronic device, the protrusion signal formed by such a direct and local blow does not cause a small vibration to be generated around the target, so that an accurate signal can be delivered to the user. Therefore, it is possible to implement a signal acquired through tactile sense such as braille by the protrusion signal as described above, and in addition, various signals such as a military signal, a picture signal, a code signal, and a direction signal can be accurately implemented. That is, the expression surface of the shopping service providing apparatus 100 shown in FIG. 4 is positioned so as to be in contact with the user's skin.

Referring to FIG. 4A , the external appearance of the apparatus 100 for providing an independent shopping service including protrusions 151 is illustrated, and is implemented in the form of a smart watch including a watch strap. An output control unit 124 is provided inside the shopping service providing apparatus 100 implemented as a smart watch. The shopping service providing apparatus 100 may be a braille display device that displays the first output data by linear motion of the protrusion 151 . The shopping service providing apparatus 100 illustrated in FIG. 10A may recognize the output data corresponding to object information by directly touching the protrusion 151 with a user's hand. Additionally, the shopping service providing apparatus 100 may include a vibration motor.

Referring to FIG. 4B , an exterior of the shopping service providing apparatus 100 including the user terminal T1 as a smart watch interlocked with a smart phone and the protrusions 151 is combined. In the case of FIG. 4B , the upper part of the smart watch is implemented as one of an organic light emitting display unit, an inorganic light emitting display unit, or a liquid crystal display unit, and the protrusion 151 of the shopping service providing device 100 may be implemented in the lower part of the smart watch. is showing In the case of the user terminal T1 as a smart watch combined with the shopping service providing device 100 shown in FIG. 4B , the part of the body on which the user wears the smart watch detects the linear motion of the protrusion 151 to obtain object information and Corresponding output data can be recognized. Additionally, the shopping service providing apparatus 100 may include a vibration motor.

Referring to FIG. 4C , an exterior of the shopping service providing apparatus 100 including the user terminal T1 as a smart watch interworking with a smart phone and the protrusions 151 is combined. 4C illustrates that the display unit and the protrusion 151 of the shopping service providing apparatus 100 may be implemented on the upper part of the smart watch. In the case of the user terminal T1 as a smart watch combined with the shopping service providing apparatus 100 shown in FIG. 4C , the user may directly touch the protrusion 151 with his/her hand to recognize the output data corresponding to the auditory data. . Additionally, the shopping service providing apparatus 100 may include a vibration motor.

Referring to FIG. 4D , an external appearance in which the user terminal T1 as a smart phone and the shopping service providing apparatus 100 including the protrusions 151 are combined is shown. Additionally, the shopping service providing apparatus 100 may include a vibration motor.

5 to 8 are diagrams illustrating a shopping service providing method according to embodiments of the present invention.

Referring to FIG. 5 , a shopping service providing method according to embodiments of the present invention includes an object detection step (S110), an object information reception step (S120), an output data generation step (S130), a purchase input step (S140), and payment. It may include a processing step (S150).

In S110, the shopping service providing apparatus 100 may detect or recognize a first object located nearby. In this case, the shopping service providing apparatus 100 uses the communication unit 110 or the sensor unit 160 to detect a nearby object, or through the image or image input by the image input unit 126 , to the image or image. You can extract contained objects.

In S120, the shopping service providing apparatus 100 selects a first object whose distance to the one or more objects is within a predetermined threshold distance in consideration of the signal strength from the one or more objects among the detected one or more objects. can The shopping service providing apparatus 100 receives the first object information from the selected first object. The first object information refers to information received from an object, and may include serial number, trademark, product name, manufacturer, raw material, origin, color, measured size, and dimension information assigned to the object. The shopping service providing apparatus 100 generates a signal to read and transmit a specific area of a memory included in the selected first object, transmits the signal to the first object, and receives a response to the signal, so that the first object may receive first object information of Since the operation of S120 is the same as that of the object detecting unit 121 , a detailed description thereof will be omitted.

In S130 , the shopping service providing apparatus 100 may control to output the first object information through the output unit 150 . In this case, the shopping service providing apparatus 100 may determine the category of the object through the serial number of the object of the first object information, and determine the type of object information to be output according to the category. The shopping service providing apparatus 100 may determine the type of output information matched according to a category based on preset data. Of course, the shopping service providing apparatus 100 may control to preferentially output price information, which is information important for determining whether to purchase an object. Since the operation of S130 is the same as that of the output control unit 124, a detailed description thereof will be omitted.

In S140 , the shopping service providing apparatus 100 may control to receive a purchase input for the first object. Since the operation of S140 is the same as that of the input control unit 125, a detailed description thereof will be omitted.

In S150 , the shopping service providing apparatus 100 may control the payment for the first object to be processed through a preset credit card according to a purchase input for the inputted first object. For purchase and payment, the input control unit 125 controls to receive credit card information used for payment from the user in advance. The user determines a payment method used for purchase, and inputs information about the payment method in advance. When payment is not completely made by the purchase processing unit 125 , the shopping service providing apparatus 100 may generate and output an error message.

The shopping service providing apparatus 100 may also perform a function such as a household account book for limiting the purchase amount of the user or managing the total purchase amount. For example, when the user sets to purchase up to 1 million won during a predetermined period, the shopping service providing apparatus 100 determines whether the accumulated purchase amount purchased during the predetermined period exceeds 1 million won, You can control the purchase. In addition, the shopping service providing apparatus 100 may also perform a function of summing up and informing the total amount paid from the first day of each month for a predetermined period input by the user, for example.

Referring to FIG. 6 , a method of providing a shopping service according to embodiments of the present invention includes an object detection step S210 , an object information receiving step S220 , an output data generation step S230 , a selection input step S240 , and a purchase. It may include a schedule list generation step (S250).

In S210, the shopping service providing apparatus 100 may detect or recognize a second object located nearby. In this case, the shopping service providing apparatus 100 uses the communication unit 110 or the sensor unit 160 to detect a nearby object, or through the image or image input by the image input unit 126 , to the image or image. You can extract contained objects.

In S220, the shopping service providing apparatus 100 selects a second object whose distance to the one or more objects is within a predetermined threshold distance in consideration of the signal strength from the one or more objects among the detected one or more objects. can The shopping service providing apparatus 100 receives the second object information from the selected second object. The second object information refers to information received from an object, and may include serial number, trademark, product name, manufacturer, raw material, origin, color, measured size, and dimension information given to the object. The shopping service providing apparatus 100 generates a signal to read and transmit a specific area of a memory included in the selected second object, transmits the signal to the second object, and receives a response to the signal, so that the second object may receive second object information of

In S230 , the shopping service providing apparatus 100 may control to output the second object information through the output unit 150 . In this case, the shopping service providing apparatus 100 may determine the category of the object through the serial number of the object of the second object information, and determine the type of object information to be output according to the category. The shopping service providing apparatus 100 may determine the type of output information matched according to a category based on preset data. Of course, the shopping service providing apparatus 100 may control to preferentially output price information, which is important information for determining whether to purchase the second object.

In S240 , the shopping service providing apparatus 100 may control to receive a selection input for the second object.

In S250 , the shopping service providing apparatus 100 may process to include the first object in the purchase schedule list according to a selection input for the input first object. Here, the purchase schedule list may include one or more objects selected by the user. Through this, the shopping service providing apparatus 100 according to embodiments of the present invention may process a purchase for an object stored in the purchase schedule list even if the distance from the object to be purchased increases.

Referring to FIG. 7 , the method for providing a shopping service according to embodiments of the present invention may include a removal input step ( S310 ) and a purchase schedule list processing step ( S320 ).

In S310, the shopping service providing apparatus 100 controls to receive a removal input for the third object included in the purchase schedule list.

In S320 , the shopping service providing apparatus 100 may control to remove the third object from the purchase schedule list in response to a removal input for the third object. The purchase schedule list refers to an array stored in a memory, and may be stored by designating a predetermined memory area by an administrator.

Referring to FIG. 8 , the method of providing a shopping service according to embodiments of the present invention may include a purchase input step (S410), a total amount calculation step (S420), and an output data generation step (S430) in the purchase schedule list. have.

In S410, the shopping service providing apparatus 100 may receive a purchase input for a purchase schedule list.

In S420 , the shopping service providing apparatus 100 calculates a total amount obtained by adding up prices of one or more objects included in the purchase schedule list in response to the purchase input.

In S430 , the shopping service providing apparatus 100 generates output data including the total amount and controls it to be provided through the output unit 150 .

9 to 10 are diagrams illustrating examples of use of an apparatus for providing a shopping service according to an embodiment of the present invention.

The user wears the shopping service providing apparatus 100 in the form of a wrist watch 910 on the wrist, and recognizes or senses the objects 901 , 902 , and 903 while moving. Without wearing a wrist watch, the user may wear the shopping service providing apparatus 100 by pushing the cart 920 and actually purchasing the product. The user may input a purchase or selection input for the object by sensing a tag attached to the object using the shopping service providing apparatus 100 or capturing an image of a QR code. In this case, even if the user does not put the real objects 901 , 902 , and 903 in the cart, through an operation such as sensing or recognition, the user can put all or part of the objects in the virtual cart.

As shown in FIG. 10 , when a predetermined area for calculation is passed through the shopping service providing device 1010 worn by the user, one or more objects that the user puts in a virtual cart and price information 1030 of the objects are displayed. It may be displayed through an external device 1020 .

The embodiment according to the present invention described above may be implemented in the form of a computer program that can be executed through various components on a computer, and such a computer program may be recorded in a computer-readable medium. In this case, the medium includes a hard disk, a magnetic medium such as a floppy disk and a magnetic tape, an optical recording medium such as a CD-ROM and DVD, a magneto-optical medium such as a floppy disk, and a ROM. , RAM, flash memory, and the like, hardware devices specially configured to store and execute program instructions.

Meanwhile, the computer program may be specially designed and configured for the present invention, or may be known and used by those skilled in the computer software field. Examples of the computer program may include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like.

The specific implementations described in the present invention are only examples, and do not limit the scope of the present invention in any way. For brevity of the specification, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connections or connecting members of the lines between the components shown in the drawings exemplify functional connections and/or physical or circuit connections, and in an actual device, various functional connections, physical connections that are replaceable or additional may be referred to as connections, or circuit connections. In addition, unless there is a specific reference such as "essential", "importantly", etc., it may not be a necessary component for the application of the present invention.

In the specification of the present invention (especially in the claims), the use of the term "above" and similar referential terms may be used in both the singular and the plural. In addition, when a range is described in the present invention, each individual value constituting the range is described in the detailed description of the invention as including the invention to which individual values belonging to the range are applied (unless there is a description to the contrary). same as Finally, the steps constituting the method according to the present invention may be performed in an appropriate order, unless the order is explicitly stated or there is no description to the contrary. The present invention is not necessarily limited to the order in which the steps are described. The use of all examples or exemplary terms (eg, etc.) in the present invention is merely for the purpose of describing the present invention in detail, and the scope of the present invention is limited by the examples or exemplary terms unless defined by the claims. it's not going to be In addition, those skilled in the art will appreciate that various modifications, combinations, and changes may be made in accordance with design conditions and factors within the scope of the appended claims or their equivalents.

100: shopping service providing device

Claims (7)

detecting, by the shopping service providing device, one or more objects through a sensor unit;
Using an algorithm representing a relationship between a preset signal strength and a distance, calculating a distance to the one or more objects according to the detected signal strength from the one or more objects, and providing the one or more objects and a shopping service selecting a first object whose distance is within a predetermined threshold distance;
receiving first object information from the first object and outputting the first object information through an output unit;
controlling to output information on a second object after a predetermined time elapses after the second object is detected when the second object is detected after the first object is detected;
including,
The first object information is
Includes user reviews, comments, and reviews related to the first object,
It is characterized in that it includes information on whether the price of the first object is higher or lower than that of the competing object of the first object,
The step of outputting the first object information through an output unit includes:
determining a category of the first object based on a serial number of the first object information;
obtaining representative information of the first object information matched according to the category based on preset data;
outputting representative information of the first object information; including,
If the category is food, the representative information is the expiration date; if the category is an electronic product, the representative information is the manufacturing date
The method for providing a shopping service, characterized in that the output unit includes one or more protrusions and outputs information by driving the one or more protrusions. According to claim 1,
the output unit
All or part of the one or more protrusions are driven to hit the user's skin according to the first object information, a shopping service providing method. According to claim 1,
the output unit
Adjacent to the user's skin and comprising a plurality of protrusions disposed at positions corresponding to at least one of the user's nerves and blood vessels, and driving the plurality of protrusions according to the first object information to deliver stimulation to the user , how to provide shopping services. According to claim 1,
After the step of outputting the first object information through the output unit,
receiving an input for the first object from a user; further comprising,
When the input to the first object is a purchase input, controlling, by the shopping service providing device, direct payment for the first object through a preset credit card; . According to claim 1,
After the step of outputting the first object information through the output unit,
receiving an input for the first object from a user; further comprising,
When the input for the first object is a selection input, processing, by the shopping service providing apparatus, information on the first object to be included in a purchase schedule list; further comprising a shopping service providing method. 6. The method of claim 5,
controlling to receive purchase information of the one or more third objects in response to an input of selecting one or more third objects included in the purchase schedule list;
Purchasing the one or more third objects according to the purchase information of the one or more second objects; further comprising, a shopping service providing method. 5. The method of claim 4,
Generating a signal for changing the state information of the first object to a payment completion state, and transmitting the signal to the first object or a management server; further comprising, a shopping service providing method.

Images