WO2023035442A1 - Self-service store interaction method, and self-service store and storage medium - Google Patents

Self-service store interaction method, and self-service store and storage medium Download PDF

Info

Publication number
WO2023035442A1
WO2023035442A1 PCT/CN2021/136491 CN2021136491W WO2023035442A1 WO 2023035442 A1 WO2023035442 A1 WO 2023035442A1 CN 2021136491 W CN2021136491 W CN 2021136491W WO 2023035442 A1 WO2023035442 A1 WO 2023035442A1
Authority
WO
WIPO (PCT)
Prior art keywords
information
user
commodity
processor
unmanned store
Prior art date
Application number
PCT/CN2021/136491
Other languages
French (fr)
Chinese (zh)
Inventor
李祥
丁明内
杨伟樑
高志强
Original Assignee
广景视睿科技(深圳)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 广景视睿科技(深圳)有限公司 filed Critical 广景视睿科技(深圳)有限公司
Publication of WO2023035442A1 publication Critical patent/WO2023035442A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • G06Q30/0281Customer communication at a business location, e.g. providing product or service information, consulting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N9/00Details of colour television systems
    • H04N9/12Picture reproducers
    • H04N9/31Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
    • H04N9/3179Video signal processing therefor

Definitions

  • the second information includes description information of the first information.
  • Fig. 5 is a flow chart of the unmanned store interaction method of the embodiment of the present application.
  • first and second are used for description purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features.
  • orientation or positional relationship indicated by “horizontal” and “vertical” is based on the orientation and positional relationship shown in the drawings, and is only for describing the present application or for convenience of description, rather than indicating or implying that the referred device or element must Having a particular orientation, being constructed and operating in a particular orientation, and therefore not to be construed as limiting the application.
  • the projection device 10 is used for projecting a projection image onto a projection bearing surface for display, and the projection bearing surface may be any suitable flat or curved surface, such as a wall.
  • the projection device 10 may be any suitable projection device with a projection function, such as a projector, and may use any suitable projection technology, such as CRT, LCD, DLP or DLV technology.
  • a projection device generally includes a light source, a lens, and the like.
  • Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
  • the start button can also be set on the function keyboard.
  • the function keyboard When the user presses the start button, the function keyboard generates a key signal corresponding to the start button.
  • the control system receives the key signal, it responds to the user's pressing operation , controlling the projection device to project the first information of the product.
  • the first commodity information includes the place of origin, manufacturer, shelf life, material content, nutritional content, number of parts, and deformation mode of the commodity, for example.
  • the first product information is used for the user to get a general idea of the product.
  • the key information is used to indicate the function keys on the function keyboard, for example, to indicate the function corresponding to the function keys, and to indicate to the user which function key to press to obtain the information when they want to know more about a certain aspect of the product.
  • the explanatory information included in the second information may be an animation demonstration of commodity content, such as commodity demonstration, commodity component demonstration, commodity deformation demonstration, installation demonstration and disassembly demonstration, and the like.
  • an animation demonstration of commodity content such as commodity demonstration, commodity component demonstration, commodity deformation demonstration, installation demonstration and disassembly demonstration, and the like.
  • At least one product information can be displayed outside the unmanned store, such as projecting or displaying hot products, special products or other product information in the store outside the store, and the user can select one or more of the products, then The user is an interested user, and the product selected by the user is an interested product.
  • the first projection device is used to project the first virtual animal, and the first virtual animal is controlled to move in the direction of the commodity that the user is interested in, so as to indicate the location of the commodity to the user. It can effectively help users find products, and provide guidance in the form of virtual animals, which is fresh and interesting, and improves the user's shopping experience.
  • control system can control the third projection device to project a third virtual pet, and control the third virtual pet to continue to guide the interested user, Until the interested user arrives at the location of the interested product.

Abstract

A self-service store interaction method, and a self-service store and a storage medium. The method comprises: a projection apparatus projecting first information, wherein the first information comprises first commodity information and key information, and the key information is used to indicate a functional key on a functional keyboard device; and the projection apparatus projecting second information in response to a pressing operation of a user to the functional key, wherein the second information comprises descriptive information of the first information. The embodiments of the present application provide a method for interaction between a user and a self-service store, providing the user with an approach of further understanding a commodity. Moreover, the user may further understand commodity information by pressing a key on the functional keyboard device, such that the shopping experience of the user can be improved.

Description

一种无人商店交互方法、无人商店及存储介质An unmanned store interaction method, unmanned store and storage medium
相关申请的交叉参考Cross References to Related Applications
本申请要求于2021年9月9日提交中国专利局,申请号为202111055963.8,发明名称为“一种无人商店交互方法、无人商店及存储介质”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application submitted to the China Patent Office on September 9, 2021, the application number is 202111055963.8, and the invention title is "An unmanned store interaction method, unmanned store and storage medium", the entire content of which Incorporated in this application by reference.
技术领域technical field
本申请涉及无人商店技术领域,尤其是涉及一种无人商店交互方法、无人商店及存储介质。The present application relates to the technical field of unmanned stores, in particular to an unmanned store interaction method, an unmanned store and a storage medium.
背景技术Background technique
现有的无人商店内的经营流程通过技术手段进行智能化、自动化处理,不存在或极少存在人工干预,为人们购物提供了一定程度的便利。但是,目前的无人商店仅依托简单的智能处理设备和程序,为用户提供简单的购物指示,当用户在商店内想对某一商品进行详细了解时,在现有的无人商店内几乎得不到相应的咨询帮助,给用户带来了不愉快的购物体验。The business processes in the existing unmanned stores are intelligently and automatically processed through technical means, and there is no or very little manual intervention, which provides a certain degree of convenience for people to shop. However, the current unmanned stores only rely on simple intelligent processing equipment and programs to provide users with simple shopping instructions. When users want to learn more about a product in the store, almost no Without corresponding consultation and help, it brings unpleasant shopping experience to users.
发明内容Contents of the invention
本申请提供一种无人商店交互方法、无人商店及存储介质,用户可以通过按压功能键盘器上的按键了解商品信息,能提高用户的购物体验。The present application provides an unmanned store interaction method, an unmanned store and a storage medium. Users can learn product information by pressing buttons on a functional keyboard, which can improve the user's shopping experience.
第一方面,本申请实施例提供了一种无人商店交互方法,应用于无人商店,所述无人商店设置有投影装置和功能键盘器,所述方法包括:In the first aspect, the embodiment of the present application provides an unmanned store interaction method, which is applied to an unmanned store. The unmanned store is equipped with a projection device and a functional keyboard. The method includes:
投影出第一信息,所述第一信息包括第一商品信息和按键信息,所述按键信息用于指示所述功能键盘器上的功能按键;Projecting first information, the first information includes first product information and key information, the key information is used to indicate the function keys on the function keyboard;
响应于用户对所述功能按键的按压操作,投影出第二信息;projecting second information in response to the user pressing the function key;
其中,所述第二信息包括所述第一信息的说明信息。Wherein, the second information includes description information of the first information.
在一些实施例中,所述方法还包括:In some embodiments, the method also includes:
响应于用户对所述功能按键的按压操作,投影出第三信息,所述第三信息包括第二商品信息;In response to the user's pressing operation on the function button, third information is projected, and the third information includes the second commodity information;
所述第二商品信息和所述第一商品信息属于不同的商品。The second commodity information and the first commodity information belong to different commodities.
在一些实施例中,所述说明信息包括商品内容的动画演示。In some embodiments, the description information includes an animation presentation of the product content.
在一些实施例中,所述动画演示包括安装演示、拆卸演示、商品演示、商品变形演示、商品零部件演示中的至少一种。In some embodiments, the animation demonstration includes at least one of installation demonstration, disassembly demonstration, commodity demonstration, commodity transformation demonstration, and commodity parts demonstration.
在一些实施例中,所述无人商店还包括语音装置,所述方法还包括:In some embodiments, the unmanned store also includes a voice device, and the method also includes:
在投影的第二信息包括动画演示时,通过语音装置播放说明语音。When the projected second information includes an animation demonstration, an explanatory voice is played through the voice device.
在一些实施例中,所述方法还包括:In some embodiments, the method also includes:
投影出虚拟导购员;Project a virtual shopping guide;
配合所述虚拟导购员的动作,发出所述兴趣商品的语音介绍。Cooperating with the actions of the virtual shopping guide, a voice introduction of the commodity of interest is issued.
在一些实施例中,所述功能键盘器还包括启动按键,所述投影出第一信息,包括:In some embodiments, the functional keyboard further includes a start button, and the projected first information includes:
响应于用户按压所述启动按键的操作,投影出第一信息。The first information is projected in response to the user's operation of pressing the start button.
第二方面,本申请实施例提供了一种无人商店,包括:In the second aspect, the embodiment of the present application provides an unmanned store, including:
投影装置,所述投影装置用于投射虚拟影像;a projection device, the projection device is used for projecting a virtual image;
功能键盘器,所述功能键盘器包括至少一个功能按键;A functional keyboard, the functional keyboard includes at least one function key;
控制系统;Control System;
所述控制系统包括:The control system includes:
至少一个处理器,所述至少一个处理器分别与所述投影装置和功能键盘器连接;以及At least one processor, the at least one processor is respectively connected with the projection device and the functional keyboard; and
存储器,所述存储器与所述至少一个处理器通信连接,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行上述的方法。memory, the memory is connected in communication with the at least one processor, the memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor, so that the at least one The processor is capable of performing the methods described above.
在一些实施例中,所述无人商店还包括:In some embodiments, the unmanned store also includes:
语音装置,所述语音装置与所述处理器连接,用于语音识别和输出语音。A speech device, the speech device is connected with the processor, and is used for speech recognition and output speech.
第三方面,本申请实施例提供了一种可读存储介质,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现上述的方法。In a third aspect, an embodiment of the present application provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and the above method is implemented when the program or instruction is executed by a processor.
第四方面,本申请实施例提供了一种计算机程序产品,所述计算机程序产品包括存储在非易失性计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被处理器执行时,使所述处理器执行上述的方法。In a fourth aspect, an embodiment of the present application provides a computer program product, the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, the computer program includes program instructions, and when the program When executed by the processor, the instructions cause the processor to execute the above method.
本申请实施方式的有益效果是:区别于现有技术的情况,本申请实施例可以在无人商店中投影出包括第一商品信息和按键信息的第一信息,且按键信息指示功能键盘器上的功能按键,当用户对功能键盘器的功能按键进行按压操作时,无人商店投影出包括第一信息的说明信息的第二信息。通过第二信息,用户可以进一步了解商品的情况。本申请实施例提供了一种用户和无人商店的交互手段,为用户提供了进一步了解商品的途径,用户可以通过按压功能键盘器上的按键进一步了解商品信息,能提高用户的购物体验。The beneficial effect of the embodiment of the present application is: different from the situation of the prior art, the embodiment of the present application can project the first information including the first product information and key information in the unmanned store, and the key information indicates the function on the keyboard. function keys, when the user presses the function keys of the function keyboard, the unmanned store projects the second information including the explanatory information of the first information. Through the second information, the user can further understand the situation of the commodity. The embodiment of the present application provides a means of interaction between the user and the unmanned store, which provides a way for the user to further understand the product. The user can further understand the product information by pressing the button on the functional keyboard, which can improve the user's shopping experience.
附图说明Description of drawings
一个或多个实施例通过与之对应的附图中的图片进行示例性说明,这些示例性说明并不构成对实施例的限定,附图中具有相同参考数字标号的元件表示为类似的元件,除非有特别申明,附图中的图不构成比例限制。One or more embodiments are exemplified by the pictures in the corresponding drawings, and these exemplifications do not constitute a limitation to the embodiments. Elements with the same reference numerals in the drawings represent similar elements. Unless otherwise stated, the drawings in the drawings are not limited to scale.
图1是本申请实施例应用的无人商店的结构示意图;Fig. 1 is a schematic structural diagram of an unmanned store applied in the embodiment of the present application;
图2是本申请实施例应用的无人商店的电器部分的结构示意图;Fig. 2 is a schematic structural diagram of the electrical part of the unmanned store applied in the embodiment of the present application;
图3是本申请实施例应用的无人商店中功能键盘器的结构示意图;Fig. 3 is a schematic structural diagram of a functional keyboard in an unmanned store applied in the embodiment of the present application;
图4是本申请实施例应用的无人商店中控制系统的硬件结构示意图;Fig. 4 is a schematic diagram of the hardware structure of the control system in the unmanned store applied in the embodiment of the present application;
图5是本申请实施例无人商店交互方法的流程图;Fig. 5 is a flow chart of the unmanned store interaction method of the embodiment of the present application;
图6是本申请无人商店交互方法的一个实施例中第一信息的示意图;Fig. 6 is a schematic diagram of the first information in an embodiment of the unmanned store interaction method of the present application;
图7是本申请无人商店交互方法的另一实施例中第一信息的示意 图;Fig. 7 is a schematic diagram of the first information in another embodiment of the unmanned store interaction method of the present application;
图8是本申请无人商店交互方法的一实施例中第三信息的示意图;Fig. 8 is a schematic diagram of the third information in an embodiment of the unmanned store interaction method of the present application;
图9是本申请实施例无人商店交互方法的流程图。Fig. 9 is a flow chart of an unmanned store interaction method according to an embodiment of the present application.
具体实施方式Detailed ways
为了使本申请的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本申请进行进一步详细说明。应当理解,此处所描述的具体实施例仅用以解释本申请,并不用于限定本申请。In order to make the purpose, technical solution and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present application, not to limit the present application.
除非另有定义,本说明书所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同。本说明书中在本申请的说明书中所使用的术语只是为了描述具体的实施方式的目的,不是用于限制本申请。Unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by one of ordinary skill in the technical field of this application. The terminology used in the description of the present application is only for the purpose of describing a specific embodiment, and is not used to limit the present application.
在本申请的描述中,需要理解的是,术语“第一”和“第二”仅用于描述目的,而不能理解为指示或暗示相对重要性或者隐含指明所指示的技术特征的数量。此外,属于“水平”和“垂直”等指示方位或位置关系为基于附图所示的方位和位置关系,仅是为了描述本申请或便于描述,而不是指示或暗示所指的设备或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本申请的限制。In the description of the present application, it should be understood that the terms "first" and "second" are used for description purposes only, and cannot be interpreted as indicating or implying relative importance or implicitly specifying the quantity of indicated technical features. In addition, the orientation or positional relationship indicated by "horizontal" and "vertical" is based on the orientation and positional relationship shown in the drawings, and is only for describing the present application or for convenience of description, rather than indicating or implying that the referred device or element must Having a particular orientation, being constructed and operating in a particular orientation, and therefore not to be construed as limiting the application.
本申请实施例提供的无人商店交互方法可以应用于无人商店,图1示出了无人商店100的一种建筑结构形式,无人商店通常以房屋等建筑形式形成内部空间和外部空间,内部空间用于存放商品,内部空间具有入口和出口,用户可以从入口进入进行自主购物。The unmanned store interaction method provided by the embodiment of the present application can be applied to unmanned stores. Figure 1 shows an architectural structure of an unmanned store 100. Unmanned stores usually form internal spaces and external spaces in architectural forms such as houses. The inner space is used to store goods, and the inner space has an entrance and an exit, and users can enter from the entrance for independent shopping.
图2示出了无人商店的电器部分的结构示意图,如图2所示,无人商店100包括投影装置10、功能键盘器20和控制系统30。投影装置10和功能键盘器20分别与控制系统30通信连接。FIG. 2 shows a schematic structural view of the electrical part of the unmanned store. As shown in FIG. 2 , the unmanned store 100 includes a projection device 10 , a functional keyboard 20 and a control system 30 . The projection device 10 and the function keyboard 20 are respectively connected to the control system 30 in communication.
其中,投影装置10用于将投影画面投射到投影承载面上进行显示,投影承载面可以为任何合适的平面或曲面,例如墙面。投影装置10可以为任何合适的具有投影功能的投影设备,例如投影仪等,可以利用任何合适的投影技术,例如CRT、LCD、DLP或DLV技术等。投影装置通常包括光源、镜头等。Wherein, the projection device 10 is used for projecting a projection image onto a projection bearing surface for display, and the projection bearing surface may be any suitable flat or curved surface, such as a wall. The projection device 10 may be any suitable projection device with a projection function, such as a projector, and may use any suitable projection technology, such as CRT, LCD, DLP or DLV technology. A projection device generally includes a light source, a lens, and the like.
投影装置10可以在无人商店中投射各种合适的虚拟影像,例如商品信息、商品推荐信息、商品信息的进一步说明信息、虚拟动物和虚拟导购员等。The projection device 10 can project various suitable virtual images in the unmanned store, such as product information, product recommendation information, further description information of product information, virtual animals, virtual shopping guides, and the like.
功能键盘器20包括多个功能按键,功能按键被按压时,功能键盘器将产生一个按键信号,控制系统30接收到该按键信号后,识别出该按键信号对应的功能按键,可以控制投影装置10投射该功能按键对应的商品信息。The function keyboard 20 includes a plurality of function keys. When the function keys are pressed, the function keyboard will generate a key signal. After receiving the key signal, the control system 30 will recognize the function key corresponding to the key signal, and can control the projection device 10. Project the product information corresponding to the function button.
功能键盘器20还可以包括启动按键,当启动按键被按压时,功能键盘器会生成另一按键信号,控制系统30接收到该按键信号后,识别出该按键信号对应的启动按键,开始控制投影装置10对商品的信息进行投影显示。The function keyboard 20 can also include a start button. When the start button is pressed, the function keyboard will generate another button signal. After receiving the button signal, the control system 30 will recognize the start button corresponding to the button signal and start to control the projection. The device 10 projects and displays product information.
功能键盘器20还可以包括转译按键,所述转译按键设置在功能键盘器上,用于进行语言切换,以使投影出的文字为用户看得懂的语言。The functional keyboard 20 may also include a translation button, which is arranged on the functional keyboard and used for language switching, so that the projected text is in a language that the user can understand.
图3示出了一种功能键盘器的结构,在图3所示的实施例中,功能键盘器20包括启动按键、转译按键和10个功能按键。在其他实施例中,功能键盘器还可以包括更多的按键,或省略其中的部分按键。FIG. 3 shows the structure of a functional keyboard. In the embodiment shown in FIG. 3 , the functional keyboard 20 includes a start button, a translation button and 10 function buttons. In other embodiments, the functional keyboard may also include more keys, or omit some of the keys.
功能键盘器可以采用类似于键盘类的装置,例如机械式键盘,可以包括接触式开关和按键电路,当接触式开关被按压时,使接触式开关的触点导通,按键电路被接通,按键电路产生一按键信号。The functional keyboard can use a device similar to a keyboard, such as a mechanical keyboard, which can include a touch switch and a key circuit. When the touch switch is pressed, the contacts of the touch switch are turned on, and the key circuit is turned on. The key circuit generates a key signal.
控制系统30为无人商店100的控制中心,用于协调无人商店100的各个部件,实现无人商店100的功能。控制系统30可以为一个控制器,也可以包括多个控制器,包括多个控制器的场合,控制系统30可以是设置于各部件(例如功能键盘器、投影装置)中控制器的组合。The control system 30 is the control center of the unmanned store 100 and is used to coordinate various components of the unmanned store 100 to realize the functions of the unmanned store 100 . The control system 30 may be one controller, or may include multiple controllers. If multiple controllers are included, the control system 30 may be a combination of controllers provided in various components (eg, functional keyboard, projection device).
图3示例性的示出了控制系统30的硬件结构,如图3所示,控制器包括存储器31和处理器32。FIG. 3 exemplarily shows the hardware structure of the control system 30 . As shown in FIG. 3 , the controller includes a memory 31 and a processor 32 .
其中,存储器31作为一种非易失性计算机可读存储介质,可用于存储非易失性软件程序、非易失性计算机可执行程序指令。如本申请实施例中的无人商店交互方法对应的程序指令。Wherein, the memory 31 is a non-volatile computer-readable storage medium, and can be used to store non-volatile software programs and non-volatile computer-executable program instructions. For example, the program instructions corresponding to the unmanned store interaction method in the embodiment of the present application.
存储器31可以包括存储程序区和存储数据区,其中,存储程序区可存储操作系统、至少一个功能所需要的应用程序;存储数据区可存 储根据无人商店的使用所创建的数据等。The memory 31 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and at least one application required by a function; the data storage area may store data created according to the use of the unmanned store.
此外,存储器31可以包括高速随机存取存储器,还可以包括非易失性存储器,例如至少一个磁盘存储器件、闪存器件、或其他非易失性固态存储器件。在一些实施例中,存储器31可选包括相对于处理器32远程设置的存储器,这些远程存储器可以通过网络连接至无人商店。In addition, the memory 31 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other non-volatile solid-state storage devices. In some embodiments, the storage 31 may optionally include storages that are set remotely relative to the processor 32, and these remote storages may be connected to the unmanned store through a network.
上述网络的实例包括但不限于互联网、企业内部网、局域网、移动通信网及其组合。Examples of the aforementioned networks include, but are not limited to, the Internet, intranets, local area networks, mobile communication networks, and combinations thereof.
处理器32利用各种接口和线路连接整个无人商店100的各个部分,通过运行或执行存储在存储器31内的软件程序,以及调用存储在存储器31内的数据,执行无人商店100的各种功能和处理数据,例如实现本申请部分实施例所述的交互方法或导购方法。The processor 32 utilizes various interfaces and lines to connect various parts of the entire unmanned store 100, and executes various functions of the unmanned store 100 by running or executing software programs stored in the memory 31 and calling data stored in the memory 31. Functions and processing data, such as implementing the interaction method or shopping guidance method described in some embodiments of this application.
处理器32可以为一个或多个,图4中以一个处理器32为例。处理器32和存储器31可以通过总线或者其他方式连接,图4中以通过总线连接为例。There may be one or more processors 32 , one processor 32 is taken as an example in FIG. 4 . The processor 32 and the memory 31 may be connected through a bus or in other ways. In FIG. 4 , connection through a bus is taken as an example.
处理器32可包括中央处理单元(CPU)、数字信号处理器(DSP)、专用集成电路(ASIC)、现场可编程门阵列(FPGA)设备等。处理器32还可以被实现为计算设备的组合,例如,DSP与微处理器的组合、多个微处理器、结合DSP核心的一个或多个微处理器、或者任何其它此类配置。Processor 32 may include a central processing unit (CPU), a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) device, and the like. Processor 32 may also be implemented as a combination of computing devices, eg, a combination of a DSP and a microprocessor, multiple microprocessors, one or more microprocessors in conjunction with a DSP core, or any other such configuration.
在另一些实施例中,无人商店100还可以包括摄像装置,摄像装置用于获取图像,并将图像传输给控制系统30,以使控制系统30基于图像进行图像识别等,例如身份确认识别(包括人脸识别)、商品识别、位置识别等。摄像装置可以为任何合适的具有图像获取功能的装置,例如摄像头、监控器等。In some other embodiments, the unmanned store 100 can also include a camera device, which is used to acquire images and transmit the images to the control system 30, so that the control system 30 can perform image recognition based on the images, such as identity confirmation ( Including face recognition), product recognition, location recognition, etc. The camera device may be any suitable device with an image acquisition function, such as a camera, a monitor, and the like.
无人商店100还可以包括语音装置,语音装置与控制系统30通信连接,用于发出语音或识别语音,可以包括例如麦克风、扬声器和语音识别芯片等。The unmanned store 100 may also include a voice device, which is communicatively connected with the control system 30 for making or recognizing voice, and may include, for example, a microphone, a loudspeaker, and a voice recognition chip.
无人商店还可以包括转动装置,转动装置与投影装置10固定连接,转动装置还与控制系统30通信连接。转动装置用于带动投影装置10转动,以使投影装置10投射的虚拟影像在现实空间内移动。转动装置 可以为任何合适的具有转动功能的装置,例如云台等。转动装置可以调整投影装置的角度,例如调整水平角度和俯仰角度。The unmanned store may also include a rotating device, which is fixedly connected to the projection device 10 and communicated with the control system 30 . The rotating device is used to drive the projection device 10 to rotate, so that the virtual image projected by the projection device 10 moves in the real space. The rotating device can be any suitable device with a rotating function, such as a cloud platform and the like. The rotating device can adjust the angle of the projection device, such as adjusting the horizontal angle and pitch angle.
转动装置通常包括本体和设置于本体的驱动机构、传动机构和电机等,在转动装置用于调整投影装置的水平角度和俯仰角度的场合,电机可以包括水平电机和俯仰电机。The rotating device usually includes a body and a drive mechanism, a transmission mechanism, and a motor arranged on the body. When the rotating device is used to adjust the horizontal angle and pitch angle of the projection device, the motor may include a horizontal motor and a pitch motor.
驱动机构可以与控制系统30通信连接,接收控制系统30的控制信号,并基于控制信号生成驱动信号,电机可以在驱动机构的驱动下旋转,从而带动传动机构运动,传动机构可以带动投影装置运动,例如实现投影装置水平和俯仰角度的调整。The driving mechanism can communicate with the control system 30, receive the control signal of the control system 30, and generate a driving signal based on the control signal, the motor can rotate under the drive of the driving mechanism, thereby driving the transmission mechanism to move, and the transmission mechanism can drive the projection device to move, For example, the adjustment of the horizontal and pitch angles of the projection device is realized.
本领域技术人员可以理解的,以上仅是对无人商店100硬件结构的举例说明,在实际应用中,还可以根据实际功能需要,为无人商店100设置更多部件,当然,也可以根据功能需要,省略其中一个或者多个部件。Those skilled in the art can understand that the above is only an example of the hardware structure of the unmanned store 100. In practical applications, more components can be set for the unmanned store 100 according to actual functional needs. If necessary, omit one or more components.
上述无人商店可执行本申请实施例所提供的方法,具备执行方法相应的功能模块和有益效果。未在本实施例中详尽描述的技术细节,可参见本申请实施例所提供的方法。The above-mentioned unmanned store can execute the method provided by the embodiment of the present application, and has corresponding functional modules and beneficial effects for executing the method. For technical details not described in detail in this embodiment, refer to the method provided in the embodiment of this application.
在实际应用时,投影装置和摄像装置可以放置于无人商店的内部空间顶部或者墙面上,功能键盘器可以放置于用于放置商品的台桌上。In practical application, the projection device and camera device can be placed on the top or wall of the interior space of the unmanned store, and the functional keyboard can be placed on the table for placing goods.
目前,无人商店仅依托简单的智能处理设备和程序,为用户提供简单的购物指示,当用户在商店内想对某一商品进行详细了解时,无法得到相应的帮助。At present, unmanned stores only rely on simple intelligent processing equipment and programs to provide users with simple shopping instructions. When users want to learn more about a product in the store, they cannot get corresponding help.
本申请实施例在无人商店中设置投影装置和功能键盘器,通过投影装置投射出包括第一商品信息和按键信息的第一信息,且按键信息指示功能键盘器上的功能按键。当用户对功能键盘器的功能按键进行按压操作时,无人商店投影出包括第一商品信息的说明信息的第二信息。通过第二信息,用户可以进一步了解商品的情况。In the embodiment of the present application, a projection device and a functional keyboard are installed in an unmanned store, and the projection device projects first information including first product information and key information, and the key information indicates the function keys on the functional keyboard. When the user presses the function keys of the function keyboard, the unmanned store projects the second information including the explanatory information of the first commodity information. Through the second information, the user can further understand the situation of the product.
本申请实施例提供了一种无人商店交互方法,可以应用于无人商店,例如图1中的无人商店100,如图5所示,该方法包括:The embodiment of this application provides an unmanned store interaction method, which can be applied to unmanned stores, such as the unmanned store 100 in Figure 1, as shown in Figure 5, the method includes:
101:投影出第一信息,所述第一信息包括第一商品信息和按键信息,所述按键信息用于指示所述功能键盘器上的功能按键。101: Project first information, where the first information includes first product information and key information, where the key information is used to indicate a function key on the function keyboard.
在其中一些实施例中,可以通过摄像装置实时拍摄商品货架前的图像,并将图像传输给控制系统,当控制系统通过图像识别确定某一商品货架前有用户停留时,则控制投影装置投射针对该商品的第一信息。In some of these embodiments, the image in front of the commodity shelf can be captured by the camera device in real time, and the image can be transmitted to the control system. The first information for this item.
在另一些实施例中,也可以在功能键盘器上设置启动按键,当用户按压启动按键时,功能键盘器生成启动按键对应的按键信号,控制系统接收到该按键信号后,响应用户的按压操作,控制投影装置投射出商品的第一信息。In some other embodiments, the start button can also be set on the function keyboard. When the user presses the start button, the function keyboard generates a key signal corresponding to the start button. After the control system receives the key signal, it responds to the user's pressing operation , controlling the projection device to project the first information of the product.
其中,第一商品信息例如商品的产地、生产厂商、保质期、材质含量、营养含量、零部件个数和变形方式等。第一商品信息用于用户大概了解商品的情况。按键信息用于指示功能键盘器上的功能按键,例如指示功能按键对应的功能,用于向用户指示想要进一步了解商品某一方面的信息时,可以通过按压哪个功能按键获得该信息。Wherein, the first commodity information includes the place of origin, manufacturer, shelf life, material content, nutritional content, number of parts, and deformation mode of the commodity, for example. The first product information is used for the user to get a general idea of the product. The key information is used to indicate the function keys on the function keyboard, for example, to indicate the function corresponding to the function keys, and to indicate to the user which function key to press to obtain the information when they want to know more about a certain aspect of the product.
102:响应于用户对所述功能按键的按压操作,投影出第二信息,所述第二信息包括所述第一信息的说明信息。102: Project second information in response to the user pressing the function button, where the second information includes description information of the first information.
第二信息包括第一信息的进一步说明信息,第一信息通常仅能使用户大概了解商品情况,往往不能满足用户想全面了解商品的需求。通过在第一信息中显示按键信息,使用户对各功能按键对应的功能进行了解,从而可以通过按压对应的按键,产生按键信号,控制系统收到按键信号后切换投影装置的投影画面,使投影装置投影出第二信息,用户可以通过第二信息进一步了解商品的情况。The second information includes further explanatory information of the first information, and the first information usually only enables the user to get a general understanding of the product, and often cannot satisfy the user's need for a comprehensive understanding of the product. By displaying the button information in the first information, the user can understand the function corresponding to each function button, so that a button signal can be generated by pressing the corresponding button, and the control system can switch the projection screen of the projection device after receiving the button signal, so that the projection The device projects the second information, and the user can further understand the situation of the product through the second information.
第二信息通常包括第一信息的说明信息,例如对第一信息中的某一商品信息进行进一步说明的信息,如,第一商品信息为2种变形方式,则说明信息可以是对该2种变形方式的进一步说明,例如2种变形方式的具体投影画面。The second information usually includes explanatory information of the first information, for example, information that further explains a certain product information in the first information. Further description of the deformation methods, such as the specific projection screens of the two deformation methods.
其中,在一些实施例中,第二信息包括的说明信息可以是对商品内容的动画演示,例如商品演示、商品零部件演示、商品变形演示、安装演示和拆卸演示等。用户想要购买一件商品时,往往产地、品牌等信息仅能给用户提供辅助参考。而用户更关心的往往是商品内容,通过对商品内容进行动画演示,可以以非常直观的展示方式将商品信 息提供给用户参考。Wherein, in some embodiments, the explanatory information included in the second information may be an animation demonstration of commodity content, such as commodity demonstration, commodity component demonstration, commodity deformation demonstration, installation demonstration and disassembly demonstration, and the like. When a user wants to buy a product, the place of origin, brand and other information can only provide the user with auxiliary reference. Users are often more concerned about product content, and through animation demonstration of product content, product information can be provided to users for reference in a very intuitive way.
其中,商品演示指对包装盒内的商品进行演示,商品往往带有外包装,目前用户仅能通过外包装上的商品图片了解商品,本申请实施例通过投影装置为用户展示商品的虚拟影像,可以使用户直观的了解商品。Among them, the product demonstration refers to the demonstration of the product in the packaging box. The product often has an outer package. At present, the user can only understand the product through the product picture on the outer package. In the embodiment of the present application, the virtual image of the product is shown to the user through a projection device. It can make users understand the products intuitively.
商品零部件演示,是指通过投影装置投影出商品的各个零部件,例如,商品为积木的场合,可以投影出每块积木的形态。Commodity parts demonstration refers to the projection of each component of the product through a projection device. For example, when the product is a building block, the shape of each building block can be projected.
商品变形演示,指通过投影装置投影出商品的各种变形方式。Commodity deformation demonstration refers to various deformation modes of commodities projected by projection devices.
安装演示和拆卸演示,是指通过投影装置投影出商品的安装方式和拆卸方式。Installation demonstration and disassembly demonstration refer to the installation and disassembly methods of products projected by projection devices.
需要说明的是,除以动画演示的方式外,上述商品内容也可以采用静态演示的方式。It should be noted that, in addition to the way of animation demonstration, the above-mentioned product content can also be presented in the form of static demonstration.
图6以玩具A(例如积木)为例示出了第一信息的一种形式,在图6所示的实施例中,在投影画面上投射出第一商品信息(包括产地、生产商、保质期、生产日期、零部件和变形方式),同时投影出按键信息(包括“零部件展示---按键3”、“变形展示---按键2”),该按键信息用于指示用户,如果想了解零部件的详细信息,可以通过按压按键3获得零部件展示,如果想了解变形的具体情况,可以通过按压按键2获得变形展示。Fig. 6 shows a form of the first information by taking toy A (such as building blocks) as an example. In the embodiment shown in Fig. 6, the first commodity information (including place of origin, manufacturer, shelf life, Production date, parts and deformation mode), and project button information (including "parts display --- button 3", "deformation display --- button 2"), the button information is used to instruct the user, if you want to know For the detailed information of the parts, you can press the button 3 to get the parts display. If you want to know the details of the deformation, you can press the button 2 to get the deformation display.
当投影装置投影出图6所示的第一信息后,用户若想进一步了解该商品的信息,例如想了解该商品的变形情况,可以按压功能键盘器上的按键2,控制系统30接收到该按键2对应的按键信号后,切换投影装置的投影内容,使投影装置投影出玩具A的两种变形方式,两种方式可以间隔一段时间显示,例如10S钟。通过该变形方式的虚拟影像展示,用户可以直观的了解商品的各种变形状态。在本实施例中,第二信息为玩具A的各变形方式的投影画面。After the projection device projects the first information shown in Fig. 6, if the user wants to know more about the information of the product, such as wanting to know the deformation of the product, he can press the button 2 on the function keyboard, and the control system 30 receives the information. After the button signal corresponding to button 2, switch the projection content of the projection device, so that the projection device projects two deformation modes of toy A, and the two modes can be displayed at intervals, such as 10 seconds. Through the virtual image display of the deformation mode, the user can intuitively understand various deformation states of the product. In this embodiment, the second information is the projected images of various deformation modes of the toy A.
本申请实施例可以在无人商店中投影出包括第一商品信息和按键信息的第一信息,且按键信息指示功能键盘器上的功能按键,当用户对功能键盘器的功能按键进行按压操作时,无人商店投影出包括第一信息的说明信息的第二信息。通过第二信息,用户可以进一步了解商 品的情况。本申请实施例提供了一种用户和无人商店的交互手段,为用户提供了进一步了解商品的途径,用户可以通过按压功能键盘器上的按键进一步了解商品信息,能提高用户的购物体验。In the embodiment of the present application, the first information including the first commodity information and key information can be projected in the unmanned store, and the key information indicates the function keys on the function keyboard. When the user presses the function keys of the function keyboard , the unmanned store projects the second information including the explanatory information of the first information. Through the second information, the user can further understand the situation of the commodity. The embodiment of the present application provides a means of interaction between the user and the unmanned store, which provides a way for the user to further understand the product. The user can further understand the product information by pressing the button on the functional keyboard, which can improve the user's shopping experience.
在另一些实施例中,为给用户提供更多参考,使用户更好的了解商品,在针对商品内容进行展示时,控制系统还可以通过语音装置播放针对商品的说明语音。使用户可以同时从影像和声音两方面了解商品。In some other embodiments, in order to provide more references for the user and enable the user to better understand the product, when displaying the content of the product, the control system can also play an explanatory voice for the product through the voice device. So that users can understand the product from two aspects of image and sound at the same time.
在另一些实施例中,控制系统还可以控制投影装置投影出虚拟导购员,并配合所述虚拟导购员的动作,使语音装置发出语音介绍。In some other embodiments, the control system can also control the projection device to project a virtual shopping guide, and cooperate with the actions of the virtual shopping guide to make the voice device issue a voice introduction.
具体的,控制系统可以通过一个投影装置投影出商品内容的展示画面,例如安装方式的动画演示,并通过另一个投影装置投影出虚拟导购员。控制系统一方面控制这两个投影装置投影,另一方面控制语音装置发出相应的语音。Specifically, the control system can project a display screen of product content through a projection device, such as an animation demonstration of the installation method, and project a virtual shopping guide through another projection device. The control system controls the projection of the two projection devices on the one hand, and controls the voice device to emit corresponding voices on the other hand.
例如,控制系统一方面控制投影装置投射的虚拟导购员用手指向展示画面,另一方面控制语音装置发出对该该展示画面的语音介绍(例如当对商品的安装方式进行解说),以使虚拟导购员的动作与语音介绍相配合。For example, on the one hand, the control system controls the virtual shopping guide projected by the projection device to point to the display screen with fingers; The actions of the shopping guide are matched with the voice introduction.
其中,虚拟导购员可以是人的形象也可以是动物形象。Wherein, the virtual shopping guide can be a human image or an animal image.
商品货架上摆放着各种商品,可以一个商品使用一个功能键盘器,通过该功能键盘器获取该商品的信息。也可以多个商品共用一个功能键盘器,通过一个功能键盘器获取多个商品的信息。在本申请的一些实施例中,出于成本的考虑,多个商品共用一个功能键盘器,则所述交互方法还包括:Various commodities are placed on the commodity shelf, and a functional keyboard can be used for each commodity, and the information of the commodity can be obtained through the functional keyboard. It is also possible for multiple commodities to share one functional keyboard, and obtain information of multiple commodities through one functional keyboard. In some embodiments of the present application, for cost considerations, a plurality of commodities share a functional keyboard, then the interaction method further includes:
响应于用户对所述功能按键的按压操作,投影出第三信息,所述第三信息包括第二商品信息;In response to the user's pressing operation on the function button, third information is projected, and the third information includes the second product information;
所述第二商品信息和所述第一商品信息属于不同的商品。The second commodity information and the first commodity information belong to different commodities.
在本实施例中,第一信息的按键信息包括指示其他商品的按键信息,例如,通过某一按键可以切换为其他商品的信息。图7示出了第一信息的另一种形式,在图7所示的实施例中,还包括按键信息“切换为玩具B---按键0”。In this embodiment, the button information of the first information includes button information indicating other commodities, for example, information that other commodities can be switched by pressing a certain button. Fig. 7 shows another form of the first information. In the embodiment shown in Fig. 7, it also includes key information "switch to toy B --- key 0".
第三信息包括第二商品信息,当用户按压对应的功能按键时,控制系统接收到该功能按键对应的按键信号后,控制投影装置投影出第三信息。还以图7为例,在用户按压按键0时,投影装置投影出玩具B的信息。图8示出了第三信息的一种形式。The third information includes the second product information. When the user presses the corresponding function key, the control system controls the projection device to project the third information after receiving the key signal corresponding to the function key. Still taking FIG. 7 as an example, when the user presses button 0, the projection device projects information about toy B. Fig. 8 shows a form of the third information.
可以实现建立每个功能键盘器与商品的对应关系,例如,功能键盘器1对应玩具A-玩具E。针对每个商品,可以事先建立商品需要展示的信息与功能按键的对应关系,当投影装置对商品信息进行投影时,可以通过第一信息将该对应关系展示出来,用户可以通过第一信息,了解功能按键的功能,,从而可以通过按压对应的按键获得想要的信息。It is possible to establish a correspondence between each functional keyboard and a product, for example, functional keyboard 1 corresponds to toy A-toy E. For each product, the corresponding relationship between the information to be displayed and the function keys can be established in advance. When the projection device projects the product information, the corresponding relationship can be displayed through the first information, and the user can understand the information through the first information. The function of the function button, so that the desired information can be obtained by pressing the corresponding button.
需要说明的是,第一信息和第三信息中的“第一”和“第三”仅便于说明第一信息和第三信息属于不同的商品,并不购成限定。例如对于玩具B来说,第三信息即是玩具B的第一信息,对于玩具A来说,为玩具B的第三信息。It should be noted that the "first" and "third" in the first information and the third information are only for the purpose of illustrating that the first information and the third information belong to different commodities, and are not intended to be limited. For example, for toy B, the third information is the first information of toy B, and for toy A, it is the third information of toy B.
本申请实施例还提供了一种无人商店导购方法,可以应用于无人商店,例如图1中的无人商店100,如图9所示,该方法包括:The embodiment of the present application also provides a shopping guide method for unmanned stores, which can be applied to unmanned stores, such as the unmanned store 100 in Figure 1, as shown in Figure 9, the method includes:
901:获取兴趣商品和与所述兴趣商品对应的兴趣用户。901: Obtain an interest commodity and interested users corresponding to the interest commodity.
所述兴趣商品指用户感兴趣的商品,所述兴趣用户指对该兴趣商品感兴趣的人。The interested commodity refers to a commodity that a user is interested in, and the interested user refers to a person who is interested in the interested commodity.
在其中一些实施例中,兴趣商品和与所述兴趣商品对应的兴趣用户,可以通过用户对商品的选择操作确定。In some of these embodiments, the interested commodity and the interested user corresponding to the interested commodity may be determined through a user's selection operation on the commodity.
例如,可以在无人商店外部显示至少一个商品信息,如在商店外投影出或通过显示屏显示出商店里热卖产品、特价产品或者其他商品信息,用户可以选择其中的一或多个商品,则该用户即为兴趣用户,该用户选择的商品为兴趣商品。For example, at least one product information can be displayed outside the unmanned store, such as projecting or displaying hot products, special products or other product information in the store outside the store, and the user can select one or more of the products, then The user is an interested user, and the product selected by the user is an interested product.
可以提供多种选择方式,例如,在商店外投影出商品信息,用户对投影的画面作出选择操作(例如用手指点某一商品),则摄像装置捕捉到用户选择商品的动作,控制系统通过图像识别,识别出用户对商品的选择动作,并识别出用户的人脸特征和商品特征,对该用户进行记录。并将该记录存储于控制系统的存储器中,该记录至少包括人脸特征和商品特征,人脸特征对应兴趣用户,商品特征对应兴趣商品。A variety of selection methods can be provided. For example, product information is projected outside the store, and the user performs a selection operation on the projected screen (for example, pointing to a certain product with a finger), then the camera device captures the user's action of selecting the product, and the control system passes through the image. Recognition: Identify the user's selection action on the product, and recognize the user's facial features and product features, and record the user. And store the record in the memory of the control system, the record at least includes facial features and commodity features, the facial features correspond to interested users, and commodity features correspond to interested commodities.
902:利用第一投影装置投影出第一虚拟动物,并控制所述第一虚拟动物向所述兴趣商品的方向移动,所述第一虚拟动物用于为所述兴趣用户指示所述兴趣商品的位置。902: Use the first projection device to project a first virtual animal, and control the first virtual animal to move in the direction of the commodity of interest, where the first virtual animal is used to indicate the commodity of interest to the interested user. Location.
在用户进入无人商品时,摄像装置获取用户的图像,并将该图像传输给控制系统,控制系统提取该用户的人脸特征,并与兴趣用户的人脸特征进行对比。若配对成功,则说明该用户为兴趣用户,则获取该兴趣用户对应的兴趣商品的特征,并确定兴趣商品的位置。When the user enters the unmanned product, the camera device captures the image of the user and transmits the image to the control system, and the control system extracts the user's facial features and compares them with those of the interested user. If the pairing is successful, it means that the user is an interested user, and the characteristics of the interested product corresponding to the interested user are obtained, and the position of the interested product is determined.
控制系统控制第一投影装置投影出第一虚拟动物,并使该第一虚拟动物呈现出动画效果,向兴趣商品的方向移动,以为该兴趣用户指示兴趣商品的位置。具体的,可以控制转动装置转动,以使转动装置带动投影装置运动,从而使第一虚拟动物移动。第一虚拟动物可以为任何合适的动物形象,例如大熊猫、考拉、蜥蜴等。The control system controls the first projection device to project the first virtual animal, and makes the first virtual animal show an animation effect and move toward the commodity of interest, so as to indicate the location of the commodity of interest to the interested user. Specifically, the rotating device can be controlled to rotate, so that the rotating device drives the projection device to move, thereby moving the first virtual animal. The first virtual animal can be any suitable animal image, such as giant panda, koala, lizard and so on.
本申请实施例利用第一投影装置投影出第一虚拟动物,并控制第一虚拟动物向用户感兴趣的商品的方向移动,为用户指示商品位置。能有效帮助用户找到商品,且以虚拟动物的方式提供指引,新鲜有趣,提高用户购物体验。In the embodiment of the present application, the first projection device is used to project the first virtual animal, and the first virtual animal is controlled to move in the direction of the commodity that the user is interested in, so as to indicate the location of the commodity to the user. It can effectively help users find products, and provide guidance in the form of virtual animals, which is fresh and interesting, and improves the user's shopping experience.
由于无人商店内大多设置有多个货架,第一投影装置投射的虚拟影像往往容易被货架遮挡,从而无法使虚拟影像覆盖无人商店的各个角落。例如,当第一投影装置设置于某一面墙时,若兴趣用户由拐弯处走到另一面墙,则第一虚拟动物可能会被货架遮挡,从而无法完整呈现于兴趣用户面前。Since most unmanned stores are equipped with multiple shelves, the virtual image projected by the first projection device is often easily blocked by the shelves, so that the virtual image cannot cover every corner of the unmanned store. For example, when the first projection device is installed on a certain wall, if the interested user walks from a corner to another wall, the first virtual animal may be blocked by the shelf, so that it cannot be completely presented in front of the interested user.
因此,在一些实施例中,无人商店导购方法还包括:Therefore, in some embodiments, the unmanned store shopping guide method also includes:
获取所述兴趣用户的位置,当所述兴趣用户的位置位于所述无人商店的拐弯处时,利用第二投影装置投影出第二虚拟动物,并控制所述第二虚拟动物向所述兴趣商品的方向移动,所述第二虚拟动物用于为所述兴趣用户指示所述兴趣商品的位置。Obtain the location of the interested user, and when the location of the interested user is at the corner of the unmanned store, use the second projection device to project a second virtual animal, and control the second virtual animal to move toward the interested user. The direction of the commodity moves, and the second virtual animal is used to indicate the position of the interested commodity to the interested user.
即实时获取兴趣用户的位置,具体的,可以通过摄像装置实时获取兴趣用户的图像,并将图像传输给控制系统,控制系统进行图像识别,确定用户所处的位置是否为无人商店中的拐弯处。That is to obtain the location of the interested user in real time. Specifically, the image of the interested user can be obtained in real time through the camera device, and the image is transmitted to the control system. The control system performs image recognition to determine whether the user's location is a corner in the unmanned store place.
当兴趣用户的位置位于无人商店的拐弯处时,控制系统控制第二 投影装置投影出第二虚拟动物,并控制第二虚拟动物向兴趣商品的方向移动,以继续为用户指示兴趣商品的位置。When the position of the interested user is at the corner of the unmanned store, the control system controls the second projection device to project a second virtual animal, and controls the second virtual animal to move in the direction of the product of interest, so as to continue to indicate the position of the product of interest to the user .
可以理解的,如果兴趣用户走到另一拐弯处时,仍未到达兴趣商品的位置,则控制系统可以控制第三投影装置投影出第三虚拟宠物,并控制第三虚拟宠物继续指引兴趣用户,直至兴趣用户到达兴趣商品所在的位置。It can be understood that if the interested user has not reached the position of the interested product when he walks to another corner, the control system can control the third projection device to project a third virtual pet, and control the third virtual pet to continue to guide the interested user, Until the interested user arrives at the location of the interested product.
其中,第二虚拟动物的形象可以和第一虚拟动物的形象相同,也可以不同。第二虚拟动物可以为任何合适的动物形象,例如大熊猫、考拉、蜥蜴等。Wherein, the image of the second virtual animal can be the same as that of the first virtual animal, or it can be different. The second virtual animal can be any suitable animal image, such as giant panda, koala, lizard and so on.
兴趣用户在走向兴趣商品的过程中,可能被其他商品所吸引,从而驻足观看。在一些实施例中,为进一步提高导引效果,所述方法还包括:Interested users may be attracted by other products in the process of walking towards the products they are interested in, so they stop to watch. In some embodiments, in order to further improve the guiding effect, the method further includes:
当所述兴趣用户停止走动时,控制所述第一虚拟动物或所述第二虚拟动物停止移动。和/或,When the interested user stops walking, control the first virtual animal or the second virtual animal to stop moving. and / or,
当所述兴趣用户重新开始走动时,控制所述第一虚拟动物或所述第二虚拟动物继续向所述兴趣商品的位置移动。When the interested user starts walking again, control the first virtual animal or the second virtual animal to continue to move to the position of the interested commodity.
即当兴趣用户停止走动时,第一虚拟动物或第二虚拟动物亦停止移动,当兴趣用户开始走动时,第一虚拟动物或第二虚拟动物也开始移动,呈现出第一虚拟动物或第二虚拟动物陪伴并指引兴趣用户走向兴趣商品的效果。That is, when the interested user stops walking, the first virtual animal or the second virtual animal stops moving, and when the interested user starts walking, the first virtual animal or the second virtual animal also starts to move, presenting the first virtual animal or the second virtual animal. The effect of virtual animals accompanying and guiding interested users towards interesting products.
在实际应用中,可以实时获取兴趣用户的图像,并传输给控制系统,当控制系统通过图像识别,确定兴趣用户处于停止状态时,则控制转动装置停止转动。当控制系统确定兴趣用户又处于走动状态时,则控制转动装置开始转动,以使虚拟宠物(第一虚拟宠物、第二虚拟宠物或其他虚拟宠物中的其中一个,以下简称虚拟宠物)开始移动。In practical applications, images of interested users can be obtained in real time and transmitted to the control system. When the control system determines that the interested user is in a stopped state through image recognition, it controls the rotating device to stop rotating. When the control system determines that the interested user is in the walking state again, the control rotating device starts to rotate so that the virtual pet (one of the first virtual pet, the second virtual pet or other virtual pets, hereinafter referred to as the virtual pet) starts to move.
在另一些实施例中,所述导购方法还包括:In other embodiments, the shopping guide method also includes:
响应于用户的输入操作,投影出第三虚拟动物,控制所述第三虚拟动物向出口方向移动,所述第三虚拟动物用于为所述用户指示出口位置。In response to the user's input operation, a third virtual animal is projected, and the third virtual animal is controlled to move toward the exit direction, and the third virtual animal is used to indicate the location of the exit for the user.
当用户购物结束,想要离开无人商店时,可以按压某一按键(例 如设置于功能键盘器上的离店指示按键),该按键将产生一按键信号,控制系统接收到该按键信号后,控制投影装置投影出第三虚拟动物,并控制第三虚拟动物向出口方向移动,为用户指示出口方向。When the user finishes shopping and wants to leave the unmanned store, he can press a certain button (for example, the departure instruction button arranged on the function keyboard), and the button will generate a button signal. After the control system receives the button signal, The projection device is controlled to project the third virtual animal, and the third virtual animal is controlled to move toward the exit direction to indicate the exit direction for the user.
第三虚拟动物可以为任何合适的动物形象,例如大熊猫、考拉、蜥蜴等。The third virtual animal can be any suitable animal image, such as giant panda, koala, lizard and so on.
本申请实施例,通过投影装置投影出虚拟动物,立体、逼真的虚拟动物可以吸引用户的注意力,在为用户指引方向时,给用户带来清晰的方向感。虚拟动物可以表现不同的行为状态,例如爬行、抬腿、摇头、颔首等。In the embodiment of the present application, the virtual animal is projected by the projection device, and the three-dimensional and lifelike virtual animal can attract the user's attention, and give the user a clear sense of direction when guiding the user. The virtual animal can show different behavior states, such as crawling, raising legs, shaking head, nodding and so on.
本申请实施例还提供了一种可读存储介质,所述可读存储介质上存储程序或指令,上述程序或指令被一个或多个处理器执行,例如图4中的一个处理器31,可使得上述一个或多个处理器可执行上述任意方法实施例中的导购方法或交互方法,例如,执行以上描述的图5中的方法步骤101至步骤102、图9中的方法步骤901-902。The embodiment of the present application also provides a readable storage medium, on which programs or instructions are stored, and the above-mentioned programs or instructions are executed by one or more processors, such as a processor 31 in FIG. The above-mentioned one or more processors can execute the shopping guide method or the interactive method in any of the above method embodiments, for example, execute the method steps 101 to 102 in FIG. 5 and the method steps 901-902 in FIG. 9 described above.
本申请实施例还提供了一种计算机程序产品,所述计算机程序产品包括存储在非易失性计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被无人商店执行时,使所述无人商店执行上述的导购方法或交互方法,,例如,执行以上描述的图5中的方法步骤101至步骤102、图9中的方法步骤901-902。The embodiment of the present application also provides a computer program product, the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, the computer program includes program instructions, and when the program instructions are stored without When the human store executes, the unmanned store is made to execute the above-mentioned shopping guide method or interactive method, for example, execute the method steps 101 to 102 in FIG. 5 and the method steps 901-902 in FIG. 9 described above.
通过以上的实施方式的描述,本领域普通技术人员可以清楚地了解到各实施方式可借助软件加通用硬件平台的方式来实现,当然也可以通过硬件。本领域普通技术人员可以理解实现上述实施例方法中的全部或部分流程是可以通过计算机程序来指令相关的硬件来完成,上述的程序可存储于一计算机可读取存储介质中,该程序在执行时,可包括如上述各方法的实施例的流程。其中,上述的存储介质可为磁碟、光盘、只读存储记忆体(Read-Only Memory,ROM)或随机存储记忆体(RandomAccessMemory,RAM)等。Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a general hardware platform, and of course also by hardware. Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above-mentioned embodiments can be completed by instructing related hardware through computer programs. The above-mentioned programs can be stored in a computer-readable storage medium. , may include the flow of the embodiments of the above-mentioned methods. Wherein, the above-mentioned storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM), etc.
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;在本申请的思路下,以上实施例或者不同实施例中的技术特征之间也可以进行组合,步骤可以以任意顺序实现,并存在如上 所述的本申请的不同方面的许多其它变化,为了简明,它们没有在细节中提供;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, but not to limit them; under the thinking of the present application, the above embodiments or technical features in different embodiments can also be combined, The steps can be performed in any order, and there are many other variations of the different aspects of the application as described above, which have not been presented in detail for the sake of brevity; although the application has been described in detail with reference to the preceding examples, those of ordinary skill in the art The skilled person should understand that: it is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the implementation of the present application. The scope of technical solutions.

Claims (11)

  1. 一种无人商店交互方法,应用于无人商店,其特征在于,所述无人商店设置有投影装置和功能键盘器,所述方法包括:An unmanned store interaction method applied to unmanned stores, characterized in that the unmanned store is provided with a projection device and a functional keyboard, and the method includes:
    投影出第一信息,所述第一信息包括第一商品信息和按键信息,所述按键信息用于指示所述功能键盘器上的功能按键;Projecting first information, the first information includes first product information and key information, the key information is used to indicate the function keys on the function keyboard;
    响应于用户对所述功能按键的按压操作,投影出第二信息;projecting second information in response to the user pressing the function key;
    其中,所述第二信息包括所述第一信息的说明信息。Wherein, the second information includes description information of the first information.
  2. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method according to claim 1, further comprising:
    响应于用户对所述功能按键的按压操作,投影出第三信息,所述第三信息包括第二商品信息;In response to the user's pressing operation on the function button, third information is projected, and the third information includes the second commodity information;
    所述第二商品信息和所述第一商品信息属于不同的商品。The second commodity information and the first commodity information belong to different commodities.
  3. 根据权利要求1或2所述的方法,其特征在于,所述说明信息包括商品内容的动画演示。The method according to claim 1 or 2, characterized in that the description information includes animation demonstration of commodity content.
  4. 根据权利要求3所述的方法,其特征在于,所述动画演示包括安装演示、拆卸演示、商品演示、商品变形演示、商品零部件演示中的至少一种。The method according to claim 3, wherein the animation demonstration includes at least one of installation demonstration, disassembly demonstration, commodity demonstration, commodity deformation demonstration, and commodity component demonstration.
  5. 根据权利要求3所述的方法,其特征在于,所述无人商店还包括语音装置,所述方法还包括:The method according to claim 3, wherein the unmanned store also includes a voice device, and the method also includes:
    在投影的第二信息包括动画演示时,通过语音装置播放说明语音。When the projected second information includes an animation demonstration, an explanatory voice is played through the voice device.
  6. 根据权利要求1或2所述的方法,其特征在于,所述方法还包括:The method according to claim 1 or 2, characterized in that the method further comprises:
    投影出虚拟导购员;Project a virtual shopping guide;
    配合所述虚拟导购员的动作,发出所述兴趣商品的语音介绍。Cooperating with the actions of the virtual shopping guide, a voice introduction of the commodity of interest is issued.
  7. 根据权利要求1所述的方法,其特征在于,所述功能键盘器还包括启动按键,所述投影出第一信息,包括:The method according to claim 1, wherein the functional keyboard further includes a start button, and the projected first information includes:
    响应于用户按压所述启动按键的操作,投影出第一信息。The first information is projected in response to the user's operation of pressing the start button.
  8. 一种无人商店,其特征在于,包括:An unmanned store is characterized in that it includes:
    投影装置,所述投影装置用于投射虚拟影像;a projection device, the projection device is used for projecting a virtual image;
    功能键盘器,所述功能键盘器包括至少一个功能按键;A functional keyboard, the functional keyboard includes at least one function key;
    控制系统;Control System;
    所述控制系统包括:The control system includes:
    至少一个处理器,所述至少一个处理器分别与所述投影装置和功能键盘器连接;以及At least one processor, the at least one processor is respectively connected with the projection device and the functional keyboard; and
    存储器,所述存储器与所述至少一个处理器通信连接,所述存储器存储有可被所述至少一个处理器执行的指令,所述指令被所述至少一个处理器执行,以使所述至少一个处理器能够执行权利要求1-7任一项所述的方法。memory, the memory is connected in communication with the at least one processor, the memory stores instructions executable by the at least one processor, the instructions are executed by the at least one processor, so that the at least one The processor is capable of executing the method of any one of claims 1-7.
  9. 根据权利要求8所述的无人商店,其特征在于,所述无人商店还包括:The unmanned store according to claim 8, wherein the unmanned store also includes:
    语音装置,所述语音装置与所述处理器连接,用于语音识别和输出语音。A speech device, the speech device is connected with the processor, and is used for speech recognition and output speech.
  10. 一种可读存储介质,其特征在于,所述可读存储介质上存储程序或指令,所述程序或指令被处理器执行时实现如权利要求1-7任一项所述的方法。A readable storage medium, wherein a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the method according to any one of claims 1-7 is implemented.
  11. 一种计算机程序产品,其特征在于,所述计算机程序产品包括存储在非易失性计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被处理器执行时,使所述处理器执行权利要求1-6任一项所述的方法。A computer program product, characterized in that the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, the computer program includes program instructions, and when the program instructions are executed by a processor , causing the processor to execute the method according to any one of claims 1-6.
PCT/CN2021/136491 2021-09-09 2021-12-08 Self-service store interaction method, and self-service store and storage medium WO2023035442A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202111055963.8 2021-09-09
CN202111055963.8A CN113902466A (en) 2021-09-09 2021-09-09 Unmanned store interaction method, unmanned store and storage medium

Publications (1)

Publication Number Publication Date
WO2023035442A1 true WO2023035442A1 (en) 2023-03-16

Family

ID=79028066

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/136491 WO2023035442A1 (en) 2021-09-09 2021-12-08 Self-service store interaction method, and self-service store and storage medium

Country Status (2)

Country Link
CN (1) CN113902466A (en)
WO (1) WO2023035442A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6070149A (en) * 1998-07-02 2000-05-30 Activepoint Ltd. Virtual sales personnel
CN102411749A (en) * 2011-08-24 2012-04-11 厦门市鼎朔信息技术有限公司 Virtual guiding system based on positioning information and network display terminal
CN109224442A (en) * 2018-09-03 2019-01-18 腾讯科技(深圳)有限公司 Data processing method, device and the storage medium of virtual scene
CN110021062A (en) * 2018-01-08 2019-07-16 佛山市顺德区美的电热电器制造有限公司 A kind of acquisition methods and terminal, storage medium of product feature

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6070149A (en) * 1998-07-02 2000-05-30 Activepoint Ltd. Virtual sales personnel
CN102411749A (en) * 2011-08-24 2012-04-11 厦门市鼎朔信息技术有限公司 Virtual guiding system based on positioning information and network display terminal
CN110021062A (en) * 2018-01-08 2019-07-16 佛山市顺德区美的电热电器制造有限公司 A kind of acquisition methods and terminal, storage medium of product feature
CN109224442A (en) * 2018-09-03 2019-01-18 腾讯科技(深圳)有限公司 Data processing method, device and the storage medium of virtual scene

Also Published As

Publication number Publication date
CN113902466A (en) 2022-01-07

Similar Documents

Publication Publication Date Title
US20200099960A1 (en) Video Stream Based Live Stream Interaction Method And Corresponding Device
US11165837B2 (en) Viewing a virtual reality environment on a user device by joining the user device to an augmented reality session
US9348411B2 (en) Object display with visual verisimilitude
EP3696648A1 (en) Interaction method and device
US11190848B2 (en) Video distribution system distributing video that includes message from viewing user
CN108038726A (en) Article display method and device
WO2020151430A1 (en) Air imaging system and implementation method therefor
CN210181908U (en) Sand table for real estate exhibition
CN104656597A (en) Central control system for remotely controlling exhibition hall
WO2023035442A1 (en) Self-service store interaction method, and self-service store and storage medium
US20230368464A1 (en) Information processing system, information processing method, and information processing program
WO2023035441A1 (en) Unmanned store shopping guidance method, unmanned store, and storage medium
TWM559476U (en) System device with virtual reality and mixed reality house purchase experience
WO2021145878A1 (en) Mobile application platform projected on a secondary display with intelligent gesture interactions
JP2020017981A (en) Moving image distribution system distributing moving image including message from viewer user
CN112269553B (en) Display system, display method and computing device
US11449451B2 (en) Information processing device, information processing method, and recording medium
JPH1020757A (en) Remote cooperating lesson system
US20130217487A1 (en) Character image projection methods and systems
TW201917676A (en) System device with virtual reality and mixed reality house purchase experiences capable of providing a user with virtual reality or mixed reality house viewing by mixing reality, augmented reality, enhanced virtualizing and virtual reality
JP2020103685A (en) Moving image distribution system, moving image distribution method, and moving image distribution program
TW202008092A (en) Panoramic live broadcast navigation robot enabling people without actual participation to have a first-person full-view experience and to interact through messages
US11821571B2 (en) Playback control method, apparatus system, electronic device and storage medium
CN108989874B (en) Intelligent display with projection function, implementation method thereof and intelligent television
US20010017633A1 (en) Method and a computer program for responding a user command in an information processing apparatus and an information processing apparatus

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21956611

Country of ref document: EP

Kind code of ref document: A1