WO2018121283A1 - 服务提供方法及装置、移动服务设备及存储介质 - Google Patents

服务提供方法及装置、移动服务设备及存储介质 Download PDF

Info

Publication number
WO2018121283A1
WO2018121283A1 PCT/CN2017/116221 CN2017116221W WO2018121283A1 WO 2018121283 A1 WO2018121283 A1 WO 2018121283A1 CN 2017116221 W CN2017116221 W CN 2017116221W WO 2018121283 A1 WO2018121283 A1 WO 2018121283A1
Authority
WO
WIPO (PCT)
Prior art keywords
service
mobile
mobile service
target user
location
Prior art date
Application number
PCT/CN2017/116221
Other languages
English (en)
French (fr)
Inventor
陆见微
Original Assignee
纳恩博(北京)科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 纳恩博(北京)科技有限公司 filed Critical 纳恩博(北京)科技有限公司
Publication of WO2018121283A1 publication Critical patent/WO2018121283A1/zh

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/30Semantic analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0631Item recommendations
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F40/00Handling natural language data
    • G06F40/20Natural language analysis
    • G06F40/279Recognition of textual entities
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/38Payment protocols; Details thereof
    • G06Q20/382Payment protocols; Details thereof insuring higher security of transaction
    • G06Q20/3821Electronic credentials
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/38Payment protocols; Details thereof
    • G06Q20/40Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q20/00Payment architectures, schemes or protocols
    • G06Q20/38Payment protocols; Details thereof
    • G06Q20/40Authorisation, e.g. identification of payer or payee, verification of customer or shop credentials; Review and approval of payers, e.g. check credit lines or negative lists
    • G06Q20/401Transaction verification
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0639Item locations

Definitions

  • the present invention relates to the field of information technology, and in particular, to a service providing method and apparatus, a mobile service device, and a storage medium.
  • the embodiments of the present invention are directed to providing a service providing method and apparatus, a mobile service device, and a storage medium, so as to better utilize the resource effective usage rate of the electronic device and improve the intelligence of the device.
  • a first aspect of the embodiments of the present invention provides a service providing method, which is applied to a mobile service device, where the mobile service device is provided with a driving device, and the driving device is configured to provide a driving force for moving the mobile service device,
  • the mobile service device is further provided with an image capture device having at least two different service modes of operation, the method comprising:
  • a second aspect of the embodiments of the present invention provides a service providing apparatus, which is applied to a mobile service device, where the mobile service device is provided with a driving device, and the driving device is configured to provide a driving force for moving the mobile service device,
  • the mobile service device is further provided with an image capture device having at least two different service modes of operation, the device comprising:
  • An acquisition unit configured to acquire and acquire a first image based on the image collection device
  • An identification unit configured to identify the first image and determine a target user that needs to provide a mobile service
  • a mobile unit configured to move to a second location according to the first location where the target user is located, where the second location is within a first distance range of the first location;
  • a determining unit configured to obtain service demand information and determine a service working mode that matches the service demand information
  • An execution unit configured to enter the determined service working mode, and provide the target user with the service operation in the service working mode that is entered.
  • a third aspect of the embodiments of the present invention provides a computer storage medium storing computer executable code, which can be provided by the foregoing method after the computer executable code is executed.
  • An embodiment of the present invention provides a mobile service device, including: a mobile device, configured to move the mobile service device;
  • a driving device connected to the mobile device and configured to provide a driving force for moving to the mobile device
  • An image capture device configured to acquire an image
  • the processing device comprising at least one processor, coupled to the image capture device, the drive device, and the drive device, is configured to implement the service providing method of the foregoing solution by executing computer executable code.
  • the mobile service device can identify the target user by itself, and obtain the service demand information of the target user, and enter the service that matches the service demand information.
  • the working mode in the service working mode, provides a service operation required by the user.
  • the mobile device moves to a second location within a first preset range from the first location of the target user, so that the target user is conveniently served near the user, thereby better utilizing the hardware and software of the mobile service device. Resources improve the effective utilization of resources while improving the intelligence and user satisfaction of the mobile service devices.
  • FIG. 1 is a schematic flowchart of a first service providing method according to an embodiment of the present invention
  • FIG. 2 is a schematic flowchart of a second service providing method according to an embodiment of the present invention.
  • FIG. 3 is a schematic flowchart of a third service providing method according to an embodiment of the present invention.
  • FIG. 4 is a schematic structural diagram of a service providing apparatus according to an embodiment of the present disclosure.
  • FIG. 5 is a schematic flowchart diagram of a fourth service providing method according to an embodiment of the present invention.
  • the embodiment provides a service providing method, which is applied to a mobile service device, where the mobile service device is provided with a driving device, and the driving device is configured to provide a driving force for moving the mobile service device.
  • the mobile service device further includes an image capture device, the shifting The mobile service device has at least two different service modes of operation, the method comprising:
  • Step S110 acquiring and acquiring a first image based on the image collection device
  • Step S120 Identify the first image, and determine a target user that needs to provide a mobile service
  • Step S130 moving to a second location according to the first location where the target user is located, where the second location is within a first distance range of the first location;
  • Step S140 Obtain service demand information, and determine a service working mode that matches the service demand information
  • Step S150 Enter the determined service working mode, and provide the target user with the service operation in the service working mode that is entered.
  • the embodiment provides a service providing method, and the main body providing the service is the mobile service device.
  • the mobile service device here can be a mobile robot.
  • the mobile robot may be a ground mobile robot or a low altitude flying robot.
  • the mobile service device includes a mobile device, and the mobile device can include a mobile chassis on which are mounted wheels and/or tracks or the like that can cause the mobile service device to move.
  • the mobile device may also include a flight device such as a propeller that is capable of providing flight movement of the device.
  • the driving device is coupled to the mobile device to provide a driving force to the mobile device.
  • the drive device may include an electric drive device or a hydraulic drive device or a pneumatic drive device or the like.
  • An image capture device is also provided on the mobile service device, and the image capture device herein may include various types of cameras or cameras and the like.
  • the image acquisition device may be a three-dimensional 3D image acquisition device; the 3D image acquisition device is capable of acquiring a 3D image, and can provide a 3D visual effect for the mobile service device.
  • the 3D image device in the embodiment not only includes graphic data, but also provides positioning data for image acquisition.
  • the mobile service device can work in different service working modes, and the service operations provided in different service working modes are at least partially different.
  • each of the service operations provided by the service working mode may include an information service; the information service here may include The local and/or remote database is queried based on the user's query request, and the query result is output.
  • the service operations provided by each of the service working modes may further include a loading service; the loading service may carry items purchased and/or carried by the target user, or may be seat services provided for a specific group of people.
  • the mobile service device acquires the first image by using the image acquisition device in step S110.
  • the first image may be a plurality of discrete still images, or may be an image frame in the collected video stream.
  • the step S110 may include: the mobile service device is located at a preset position, and acquires a first image in a predetermined direction.
  • the mobile service device is a mobile service device working in a shopping mall, a hospital or an activity club, and the mobile service device may be located at an entrance of a work area where the mobile service device provides services, such as a shopping mall, a hospital, or an event club.
  • the first image is taken towards the entrance.
  • the first image may be an image acquired when the user moves to a predetermined location at the entrance.
  • the first image may also be a first image acquired by the mobile service device at any location within the working area.
  • the target user who needs to provide the mobile service is determined by the image recognition technology in step S120.
  • the mobile service device can identify the person by distinguishing the object and the human body through human body recognition; secondly, the human body can be further identified to identify the target user.
  • an image of two people is included in the first image, and it is possible to identify which target users who need to provide the mobile service according to the wear of the user by image recognition.
  • the mall includes consumers and mall staff.
  • the store staff may wear work clothes or wearer work permits to identify the target users who need to provide mobile services through the identification of the wear of different people in the image.
  • the step S120 may further include: parsing the first image, extracting a viewpoint movement trajectory of the candidate user in the image according to the first image; and determining that the candidate user is when the viewpoint movement trajectory satisfies a preset condition
  • the target user When a user enters a mall, hospital, or event club, if they don't know where they are going, they may have a gaze or look in the work area. In this embodiment, the candidate user's view in the plurality of first images may be adopted. Point movement trajectory can be used to find these gaze users as the target user.
  • the step S120 may further include: parsing the first image, determining whether a user in the first image has made a predetermined action to greet the mobile service device, and if yes, determining that the corresponding user is the target user .
  • the step S120 may further include: parsing the first image, determining whether the user of the first image carries a preset object, and if the candidate user carries the preset object, the candidate user may be considered as the target user.
  • the mobile service device is a device applied to a hospital, and it is found that a candidate user has a preset object that supports walking by using a crutches or the like through image collection, and the user is considered to be a target that needs to provide a seat service or a care service. user.
  • the target user can be determined by wearing recognition of different people in the first image, motion recognition, and/or motion path recognition of a specific part, body shape recognition, and the like.
  • step S130 after the mobile service device determines the target user, the mobile service device will move from its current location to a second location closer to the target user, after moving to the second location.
  • the distance between the mobile target device and the target user is not greater than a maximum value of the preset first distance range, that is, within the first distance range.
  • the mobile service device is conveniently provided with the mobile service to the target user.
  • the first location is a location where the target user is located.
  • the service demand information will be obtained in step S140, where the service demand information can be obtained by analyzing the first image or by interacting with the information of the target user.
  • the target user provides required service demand information to the mobile service device through a human-machine interaction interface on the mobile service device.
  • the target user inputs an acquisition instruction thereto through the voice collection and recognition device of the mobile service device.
  • the target user sends a control instruction to the mobile service device by using a physical control or a virtual control on the mobile service device, for example, when the distance between the mobile service device and the target user is located in the first After a distance range, the mobile service device is used with a mobile phone, tablet or wearable device that the user carries with him or the like.
  • the user terminal establishes a connection, and pushes a control interface of the mobile service device to the user terminal through the connection, where the control interface can collect user instructions, and the mobile service device can obtain the service demand information by using the mobile terminal.
  • the mobile service device is also equipped with a special control device.
  • the mobile service device prompts the user to remove the control device from the mobile service device, and the mobile service device can pass The control device receives user input to obtain the service demand information.
  • a service working mode that can satisfy the user's needs ie, satisfy the service demand information
  • step S150 the mobile service device will enter the currently determined service working mode, and provide corresponding service operations for the user in the service working mode.
  • the corresponding indoor navigation service may be provided by the mobile service device.
  • the service providing method in this embodiment is a mobile service providing method.
  • the services provided by the device are usually in a fixed location, or can only be carried by the user itself, and can be obtained in the mobile.
  • the service solves the problem that the user in the prior art cannot obtain the corresponding service in the motion.
  • the mobile service device can provide a service required by the user on the move.
  • the mobile service device has different service working modes, and works according to the actual service demand of the user, works in the corresponding service working mode, provides the mobile service required by the user, improves the intelligence of the device, and better uses the device.
  • the software and hardware resources of mobile service devices have improved service quality and user satisfaction.
  • the step S130 may include:
  • the mobile service device can collect user voices, and can perform semantic extraction on the user's natural, and through semantic analysis and extraction, determine the services that the target user may need, thereby obtaining the service demand information. After the mobile service device moves to the target user, the user only needs to provide the target demand information to the mobile user device by using the voice, and the user does not need to perform corresponding manual operations, thereby simplifying the user operation and improving the intelligence of the mobile service device.
  • the semantic analysis may include local semantic analysis of the mobile service device, and/or the mobile service device submits the collected voice to the network side, and is remotely performed by the network server on the network side. Semantic analysis.
  • the service working mode may include multiple categories, and two optional categories are provided below.
  • the service work mode includes a companion work mode, which may be a specific companion work service.
  • the step S150 may include:
  • Step S151 Enter the companion working mode, and collect the second image of the target user by using the image collecting device;
  • Step S152 determining a moving path of the target user according to the second image
  • Step S153 acquiring roadblock information that blocks the mobile service device on the moving path
  • Step S154 planning a following parameter of the mobile service device according to the mobile characteristic of the mobile service device and the roadblock information, where the following parameter includes a following path;
  • Step S155 providing a companion service in the companion working mode based on the following parameter movement, specifically, for example, using the following parameter to move, maintaining a distance from the target user within a second distance range, and providing The companion service in the companion work mode.
  • the mobile service device continues to perform image collection on the target user, for example, acquiring images by using the 3D image collection device to acquire 3D visual information of the mobile service device.
  • the mobile service device can obtain The user's current movement track.
  • the mobile service device is a companion service provided in the companion work mode, and then the mobile service device generally follows the target user or behind the target user. Therefore, the step S151 may include: opening the front image capturing device of the mobile user equipment, collecting the back image and/or the side body image of the target user, and of course, in the specific implementation, not limited to collecting the back image. Image and / or sideways images.
  • the mobile user equipment in order to avoid obstructing the movement of the target user, the mobile user equipment usually follows or is beside the target user, unless the specific situation, the mobile service device does not move to the target user. front.
  • the moving path of the target user can be obtained by parsing the second image in step S152.
  • step S153 by analyzing at least one of the second image, or by at least one of radar positioning, ultrasonic positioning, infrared sensing, etc., it is determined whether there is a roadblock on the moving path of the user movement that causes the mobile service device to fail, thereby obtaining Roadblock information.
  • a follow path suitable for the mobile service device itself is planned according to the mobile service device's own mobile characteristics and the roadblock information.
  • the mobility characteristics herein may include the mobility capabilities of the mobile device as well as morphological parameters. For example, some channels may be able to pass by the user, but the mobile service device may not be able to pass due to the large size, then the mobile service device needs to bypass tracking at this time. For example, in some steeply steep locations, the target user may easily pass, and the visual mobile service device does not have the ability to climb up. At this time, the mobile service device also needs to perform a bypass. Then, at this time, the mobile The following path that the service device plans for itself may be somewhat different from the mobile user's moving path. After completing the determination of the following path, the mobile service device will move in accordance with the following path to provide the companion service.
  • the morphological parameter may be a shape parameter and/or a size parameter that characterizes the shape of the mobile service device.
  • the shape parameters for example, the outer shape of the mobile service device form a cube, a cuboid, an ellipsoid, and the like.
  • the size parameter may include: a width of the mobile service device on different coordinate axes in three-dimensional coordinates, for example, length, width, and height of the mobile service device.
  • the mobility capability parameter may include parameters such as a maximum speed, a maximum acceleration, and a maximum creepage angle of the mobile service device.
  • the following parameter may include a movement control parameter in addition to the following path.
  • the mobile service device can include a variety of mobility capabilities, and the mobile service device may need to select a corresponding mobility capability to move on different following paths.
  • the user currently enters the escalator. If the mobile service device works in the companion work mode, the mobile service device also needs to enter the escalator. After entering the escalator, the mobile service device needs to adopt the braking parameter to connect itself with the escalator. The escalator ground is locked to avoid slipping.
  • the braking parameter here is one of the following parameters.
  • the length of the cross section of the mobile service device in the first dimension is greater than the length in the second dimension.
  • the mobile service device can provide a load location, which can be a carry-on item or a purchased item that carries the user.
  • the loading position can also be a seat for a particular person, such as a child, an elderly person, and/or a disabled person.
  • the mobile service device provides a loading position, and the product selected by the user during the shopping can be placed in the loading position.
  • the companion service provided by the mobile service device includes an automatic shopping cart. Service.
  • the method may further include providing a child entertainment service when detecting that the child seat is not empty. Detecting whether the child seat is unloaded can be determined by weight detection and image detection of the child seat.
  • the children's entertainment service may include playing audio games such as children's music, fairy tales, video services such as playing cartoons, and chain chat services for voice chat, reducing The crying of children during their parents' shopping.
  • the second distance range in step S150 may be equal to the first distance range, or may be slightly smaller than the first preset distance or slightly larger than the first preset distance.
  • the second category is a first category:
  • the service work mode includes a boot work mode in which a boot service can be provided to direct the target user to a target location that the user wants to go.
  • the step S140 may include: the determined service working mode that matches the service demand information is a guiding working mode.
  • the step S150 may include:
  • the guiding service may be a guide service that guides the target user to reach the target location.
  • the mobile service device first determines the target location, and then uses the map data or route data stored in the mobile service device in advance to plan the boot parameters.
  • the boot parameters here include at least the boot path.
  • the guidance parameters may also include the aforementioned mobility control parameters.
  • the mobility control parameters herein can control the mobility mode or mobility capability or mobile speed used by the mobile service device.
  • the mobile service device moves according to the boot path, and during the move, the mobile service device guides the user to follow the move to the target location.
  • the mobile service device can output during the movement according to the guiding path Guide the voice prompt to prompt the user to select the path at the forked intersection.
  • the mobile service device will turn on the image capturing device, collect the image of the target user, and adjust its own mobile control parameters, such as the moving speed, according to the moving condition of the target user.
  • the mobile service device when the mobile service device is in the booting mode, it may move in front of the target user. In order to reduce the phenomenon of the target user losing, the mobile service device turns on the rear image capturing device to collect the target user. The image ensures that the distance between the target user and the mobile service device remains within a preset distance range, for example, can remain within the first distance range.
  • the service working mode of the foregoing mobile service device is integrated into at least two categories, namely, the companion working mode and the mobile working mode.
  • the guiding path may be a one-time planned overall path.
  • the mobile service device plans the current location to reach the target location at one time according to the current location where the user is currently located and the target location that the target user desires to go.
  • the overall path is then moved based on the overall path when the guiding service is subsequently provided.
  • the guiding path can be adjusted according to the congestion situation on the path to avoid the congested road segment.
  • the following path may be scheduled, and the following path is a path that the mobile service device moves according to the motion of the target user, with a predetermined duration as a planning period, combined with the current location and target of the mobile service device.
  • the user's location is planned to follow the path.
  • the target user's moving direction or moving path is also predicted according to the target user's moving parameter. Therefore, when planning the following path, the method further includes: according to the current location of the mobile service device. The current position of the target user and the current movement parameters are planned to follow the path.
  • the following path planning is performed based on the current movement parameter of the target user, which can facilitate the mobile service device to adjust its own movement parameters in time, for example, one or more of the moving direction, the moving acceleration, and the moving speed, thereby reducing the phenomenon of falling and losing to provide more good service.
  • the third category is a first category:
  • the service working mode further includes: querying a working mode.
  • the mobile service providing device When the user arrives in a new environment, he may get lost, etc., and he does not know who to ask questions. After the mobile service providing device recognizes the target user, it moves to the second location based on the first location where the current target user is located.
  • the two locations may be geographic locations or spatial locations at which the target user can operate the mobile service device.
  • the step S140 may include:
  • Output service prompt information for example, output service prompt voice
  • the service prompt response information generated based on the service prompt information is collected. If the service prompt response information is directed to the query work service, the step S150 includes: entering the query work mode, and providing a query to the target user. service.
  • the mobile service device after entering the query working mode, is connected to a predetermined database or a predetermined device.
  • the mobile service device is located in a specific indoor area. Generally, the mobile device only needs to connect to a local area network of a specific indoor area.
  • the target user may need to connect to the Internet.
  • Querying data in this embodiment, the mobile service device can be connected to an external gateway, obtain data from the Internet through an external gateway to provide a comprehensive query service, or can be connected to a database that can provide a specific query service.
  • a mobile service device is applied to a hospital, and the current target user wants to query his own case, and the mobile service device needs to be connected to the case database, and the case has been reported.
  • the mobile service device When the mobile service device works in the query working mode, if the target user's query service ends, the mobile service device may move to the initial location to be in a standby state to facilitate providing services for other users.
  • the initial location may be an area that the target user often appears without disturbing the location of the user's activity.
  • the companion work mode can be subdivided into the following types;
  • Carrying companion mode follow the target user shift using 3D vision device and roadblock positioning device Move, accompany the target user to make a purchase, carry the goods purchased by the user, reduce the shopping load of the target user, carry the goods by the mobile service device, and provide the anti-theft service.
  • the anti-theft service may be: the target user may put an item into the loading position provided by the mobile service device, and after the item is placed, if the cover of the loading position needs to be opened, the verification may be gesture verification, fingerprint verification. Or voice password verification or password verification to prevent items in the load location from being lost or replaced.
  • a child or a user with limited mobility can be placed in a seat (eg, a child seat) of the mobile service device while following the target user moving within the mall.
  • a seat eg, a child seat
  • Such a mobile service device can carry drinking water or establish an emergency connection with a health care room in a work area, and in the event of an accident, the mobile service device can communicate its location information to the health care room through the emergency connection. Thereby it is convenient for the caregiver to get medical services in the first time.
  • the unexpected situation can be determined by monitoring the physical condition information of the person on the seat.
  • the mobile service device is provided with a heartbeat detecting device, and the heartbeat detecting device can detect the heartbeat number of the person on the seat.
  • the emergency connection is used to send an alarm notification to a predetermined device of the medical care room, and the current location is located through the global positioning system or the map data carried by the GPS, and the location is sent to the predetermined location.
  • Equipment to facilitate access to medical care for those who are being cared for.
  • the guiding work mode can also be subdivided into the following types:
  • the mobile service device may obtain an explicit target location or other information of the target location from the user input of the target user, and the target user only knows the path of how to reach the target location. Then the mobile service device only needs to be based on The current location and target location can be planned. For example, the mobile service device acquires the clear shopping information of the user through voice interaction, and then plans a guide video according to the placement position of the purchased product specified by the target user, and leads the user to the target location.
  • the mobile service device may plan the boot parameters according to the recommendation information of the local or remote database, and guide the target user to move and provide corresponding Guided service. For example, in a shopping mall, if the user does not have a clear shopping target, the mobile service device may obtain user identity information and/or historical service information through face recognition or the like, and then according to the user identity information and/or historical service information, Targeted users are directed to where they are likely to purchase.
  • the historical service information herein may include information such as a user's historical purchase record.
  • the mobile service device specifically accesses the big data system of the shopping mall through the network, obtains a user portrait, combines real-time business information, performs shopping recommendation and shopping mall guiding function, and leads the user to the ideal merchant purchase or entertainment of the system calculation, on the mobile
  • the mobile service device can open the voice service device, interact with the user through voice, confirm the user's intention and problem, and increase service satisfaction.
  • the boot path will be planned according to a preset policy, for example, adopting a path shortest strategy, a minimum flow policy, and/or a sightseeing strategy.
  • the method may further include: selecting the preset policy according to whether the guiding working mode is a passive guiding mode or an automatic guiding mode. For example, if the current boot working mode is the passive boot mode, and the user is more anxious through image acquisition, the shortest path of the path can be selected, and the boot path is planned.
  • the current guiding work mode is the automatic guiding mode, and the user may not be in a hurry to purchase at present, and may purchase the guiding route by using the sightseeing strategy.
  • the sightseeing strategy is a planning rule for causing the planned guiding path to pass at least N recommended locations provided by the shopping mall, the N Is an integer not less than 1.
  • the minimum flow policy may be a planning rule that circumvents the planned guiding path from the crowded road segment.
  • determining the preset planning policy may include: outputting a planning policy that the mobile service device can provide, receiving a user indication, and determining the preset planning policy according to the user indication.
  • the method further includes:
  • Step S310 Obtain a to-be-paid list of the target user
  • Step S320 Send the to-be-paid list to the user terminal of the target user;
  • Step S330 Receive payment information sent by the user terminal based on the to-be-paid list
  • Step S340 request payment from the target account according to the payment information.
  • the mobile service device further obtains a to-be-paid request of the target user, where the to-be-paid list may be a shopping list, and may also be a medical list or a to-be-paid list of the mobile service, and the total is generated by the target user.
  • the mobile service device may scan the products purchased by the user, query the database code of the store, obtain the price of each item, and form a shopping list.
  • the working area of the mobile service device is a hospital, and the mobile service device can generate the medical list by entering medical information of the hospital system by a doctor.
  • the mobile service device may provide a mobile service list according to a service type and/or a service time provided by the mobile service device, and a problem such as whether a loss occurs during the service process.
  • the payment list is sent to the user terminal of the target user.
  • the mobile service device is affixed with or displayed with the identifier of the mobile service device or the identifier of the to-be-paid list, and the user can scan the identifier from the mobile service device or the mobile service device by using a user terminal such as a mobile phone.
  • the connected server receives the to-be-paid list.
  • the identification may be a barcode; the barcode may comprise a two-dimensional code.
  • the tag may also include a sequence of character strings, and the like.
  • the user terminal After receiving the to-be-paid list, the user terminal outputs the to-be-paid list by using an output manner such as display or voice, and the user terminal also collects user operations, determines whether to pay, which parts to pay, and the payment account and/or payment.
  • the password or the like, in short, the payment information will be generated according to the user operation.
  • the mobile service device receives the payment information, and requests payment from the target account according to the payment information.
  • the target account here may be a bank account, a network payment account, and/or a storage account of a work area of a mobile service device such as a mall or a hospital, requesting payment.
  • the payment amount, the account accepting the payment, and the payment information are transmitted to the corresponding target account. In this case, the target account will pay the payment amount requested to be paid to the account accepting the payment by the verification of the payment information.
  • the method further includes:
  • the payment voucher may be an electronic voucher, and the electronic voucher may be sent to the user terminal; the payment voucher may also be a paper voucher, the mobile The service device prints a paper voucher.
  • the method may further include:
  • the mobile service device After confirming the payment, the mobile service device degaussing the paid product, and avoiding the electromagnetic signal written on the commodity triggering the alarm of the shopping mall when the commodity that has not been demagnetized is passed through the mall.
  • the method further includes:
  • the mobile service device may further receive a query request input by the target user, where the query request may be a query request input by voice, control operation, or the like.
  • the mobile service device queries the predetermined database, where the predetermined database may be a database of the working area of the mobile service device, or may be a network database, and obtain a corresponding query result.
  • the mobile service device may obtain the query result.
  • the query result is directly output or directly provides a service corresponding to the query result.
  • the target user may suddenly want to know the advance of the outside, and ask the mobile service device for the weather by voice.
  • the mobile service device may pass the Query the web server, get the current weather conditions, and finally output the queried weather by voice.
  • the mobile service device may ask for information related to the item or service, such as price, purchase discount, shelf life, and the like, and the mobile service device receives the same.
  • query the relevant information of the corresponding item or service output the query result, or directly direct the target user to the consultation office that can provide such service or product information.
  • this embodiment provides a service providing apparatus, which is applied to a mobile service device, where the mobile service device is provided with a driving device, and the driving device is configured to provide a driving force for moving the mobile service device.
  • the mobile service device is further provided with an image collection device, and the mobile service device has at least two different service working modes, and the device includes:
  • the collecting unit 110 is configured to acquire and acquire the first image based on the image collecting device;
  • the identifying unit 120 is configured to identify the first image, and determine a target user that needs to provide a mobile service
  • the mobile unit 130 is configured to move to the second location according to the first location where the target user is located, where the second location is within a first distance range of the first location;
  • a determining unit 140 configured to obtain service requirement information, and determine a service working mode that matches the service demand information
  • the executing unit 150 is configured to enter the determined service working mode, and provide the target user with the service operation in the service working mode that is entered.
  • the service providing apparatus in the present embodiment is an information processing apparatus applied to the mobile service device.
  • the collection unit 110, the identification unit 120, the determination unit 140, and the execution unit 150 may each correspond to a processor or processing circuit in the mobile service device.
  • the processor can be a central processing unit, a microprocessor, a digital signal processor, an application processor, or a programmable array or the like.
  • the processing circuit can be an application specific integrated circuit.
  • the processor or processing circuit can implement the functions of the above various units by executing a predetermined code or program.
  • the acquisition unit 110 can be a controller or processor or processing circuit coupled to the image acquisition device.
  • the mobile unit 130 can be coupled to a mobile device and/or a drive device of the mobile service device for controlling movement of the mobile service device.
  • the mobile service device can automatically move and identify the target user, and move to the vicinity of the target user, obtain the corresponding service operation mode by obtaining the service demand information, and provide corresponding service operations, which is convenient.
  • the service is obtained in time, the intelligence of the device is improved, and the software and hardware resources of the mobile service device are better used.
  • the determining unit 140 is configured to collect the voice of the target user, perform semantic analysis on the collected voice, extract and obtain corresponding service requirement information, and query the preset according to the service requirement information.
  • the service working mode obtains a service working mode that matches the service demand information.
  • the service providing device acquires the service demand information through voice interaction, so that the user can control the mobile service device to provide a service by voice, which has the characteristics of simple operation.
  • the determined service work that matches the service demand information The mode is a companion working mode
  • the executing unit 150 is configured to enter the companion working mode, collect the second image of the target user by using the image collecting device, and determine the moving path of the target user according to the second image.
  • the second image of the target user is obtained through image acquisition, and the following parameters are planned based on the confirmation of the second image and the roadblock information.
  • the moving time of the mobile service device leaving the target user exceeds a specified distance does not exceed a predetermined time in the moving process, so as to achieve the effect of tracking at any time, during the tracking movement, the foregoing may be provided.
  • the determined service working mode that matches the service demand information is a guiding working mode
  • the executing unit 150 is specifically configured to enter the guiding working mode, and determine that the target user desires to go to a target location; according to the target location and the current location of the mobile service device, planning a boot parameter of the mobile service device moving from the current location to the target location, the boot parameter including at least guiding a path; moving to the target location in accordance with the boot parameter and directing the target user to follow the mobile service device to the target location.
  • the mobile service device operates in an illuminating mode, and the guiding parameters are planned according to a target location that the user wants to go, and the target user is guided to move to the target location.
  • the apparatus further includes:
  • An obtaining unit configured to obtain a to-be-paid list of the target user
  • a first sending unit configured to send the to-be-paid list to a user terminal of the target user
  • a first receiving unit configured to receive payment information sent by the user terminal based on the to-be-paid list
  • a requesting unit configured to request payment from the target account according to the payment information.
  • the obtaining unit may correspond to a human-computer interaction interface or an image capturing device or a communication interface. For example, a list of services or products that the user wants to purchase is obtained based on user input through a human-computer interaction interface, and then the information to be inquired is generated by information such as the price of the goods or services.
  • the first sending unit and the first receiving unit may both correspond to a communication interface, and the communication interface may perform information interaction with other devices through a direct link or the Internet, for example, the user terminal.
  • the to-be-paid list is transmitted to the user terminal of the target user, and the payment information is received from the user terminal.
  • the request unit may also correspond to a communication interface, and may send a payment request to a service device that operates and/or manages the target account, thereby implementing a function of requesting payment.
  • the apparatus further includes:
  • a second receiving unit configured to receive an information query request
  • a querying unit configured to query a predetermined database according to the query request, and obtain a query result that is adapted to the query request;
  • the executing unit 150 is further configured to output the query result or provide a corresponding service operation according to the query result.
  • the apparatus further includes a second receiving unit, and the second receiving unit generally opens in real time when providing the companion service or the guiding service, so as to receive the information query request at any time.
  • the query unit may correspond to a processor and a communication interface, and the processor sends the query request to the predetermined database by using the communication interface in a predetermined information format, thereby receiving a query result returned by the predetermined database.
  • the execution unit 150 may include a voice output interface capable of querying a result; the execution unit 150 may also display the query result corresponding to a display screen.
  • the execution unit 150 can control a processor to perform a corresponding service operation on the processor.
  • the embodiment of the present invention provides a computer storage medium, where the computer storage medium stores computer executable code, and after the computer executable code is executed, the service providing method provided by the foregoing one or more technical solutions can be implemented, for example, The service providing method as shown in FIGS. 1, 2, and 3 can be performed.
  • the computer storage medium may be various types of computer storage media, such as a storage medium such as a random storage medium, a flash memory, a read-only storage medium, a mobile hard disk, or the like, optionally a non-transitory storage medium.
  • a storage medium such as a random storage medium, a flash memory, a read-only storage medium, a mobile hard disk, or the like, optionally a non-transitory storage medium.
  • the embodiment provides a mobile service device, including: a mobile device configured to move the mobile service device; the mobile device can be a mobile chassis, a flight component (eg, a rotor flight component, a fixed wing flight component);
  • a flight component eg, a rotor flight component, a fixed wing flight component
  • a driving device coupled to the mobile device, configured to provide a driving force for moving to the mobile device;
  • the driving device may include: one or more electric driving devices, a fuel driving device, a gas driving device, etc.;
  • the driving device may include: one or more electric motors, etc., and in total, may provide energy required for movement of the moving device in multiple directions, such as front, rear, left, right, up and down;
  • An image capture device configured to acquire an image; the image capture device includes: one or more cameras, the cameras may be distributed at different locations, for example, may be distributed on the first surface and the second surface of the mobile service device, the first surface And the second surface is opposite to each other, if the first surface faces the forward direction of the mobile service device, the second surface faces away from the forward direction of the mobile service device; if the second surface faces the forward direction of the mobile service device, the first surface Back to the direction of the mobile service device.
  • the processing device comprising at least one processor, coupled to the image capture device, the drive device, and the drive device, is configured to implement the service providing method provided by one or more of the foregoing technical solutions by executing computer executable code.
  • the processor may include: a central processing unit, a microprocessor, a digital signal processor, an application processor, a programmable array or an application specific integrated circuit, etc., which may be executed by a computer program, a software application, or a functional component of an operating system.
  • a central processing unit a microprocessor, a digital signal processor, an application processor, a programmable array or an application specific integrated circuit, etc., which may be executed by a computer program, a software application, or a functional component of an operating system.
  • a mobile service device can be a robot.
  • the robot can provide the following functions:
  • the robot includes a sports chassis that can move freely inside the mall.
  • the sports chassis has a certain carrying capacity and can store goods purchased by the user or carry young children.
  • the robot provides voice input and output interactive functions, behind which is a 3D vision system for speech recognition/semantic recognition and artificial intelligence (AI).
  • the 3D vision system includes a variety of sensor devices such as a camera, a laser radar, an ultrasonic wave, and an infrared sensor.
  • the robot has an instant positioning function that enables instant positioning of itself.
  • the robot can utilize the Instant Location and Map Construction (SLAM) system or other auxiliary indoor positioning system to locate its location.
  • the auxiliary indoor positioning system may include one or more of a WiFi positioning system, a Bluetooth positioning system, a carrierless communication technology (uwb) positioning system, and a visible light positioning system. It is an aid to the positioning function in the 3D vision system, speeding up the positioning speed and accuracy of the 3D vision system.
  • the robot has image recognition, can recognize objects/human body/faces, and performs functions such as moving follow-up based on image recognition capabilities.
  • the robot has communication function, and can interact with the predetermined database such as the shopping mall big data system, and can query the following data: real-time information of the merchant (product information, discount information), real-time data of the mall (user traffic, map data, sudden Information on the situation), user portrait information (information based on the user's age, gender, occupation, income, family, past purchase records, etc.)
  • the robot When the user enters the mall, the robot actively discovers the user through 3D visual human body recognition, and moves the autonomously. Move to the user, voice and user communication, ask if you need to provide services and what services you need.
  • the service 1 may include: following the user, accompanying the user to make a purchase, carrying the goods purchased by the user, reducing the burden on the user, and the robot carrying the item has a basic anti-lost function.
  • the service 2 may include: for a child with a child, the child may be placed in the child seat of the robot while the parent is moving within the mall. Voice chat, play songs and other stories can be provided according to the age of the child.
  • the service 3 may include: obtaining clear shopping information of the user according to the voice interaction, and guiding the user to the target location through autonomous navigation.
  • the service 4 may include: if the user does not have a clear target, then the identity of the user may be confirmed by face recognition or other identification methods, and the big data system of the mall is accessed through the network to obtain User portrait, combined with real-time merchant information, conducts shopping recommendation and shopping mall guidance function (3D visual autonomous navigation + indoor positioning function + barrier), leading users to the ideal merchant purchase or entertainment of system computing, the user can pass the voice during the process Interact with the robot to confirm the user's intentions and problems and increase service satisfaction.
  • shopping recommendation and shopping mall guidance function (3D visual autonomous navigation + indoor positioning function + barrier
  • the present example provides a service providing system including a mobile service device and a cloud server.
  • the mobile service device collects voice input, sends the collected voice data to the cloud server, performs voice/semantic analysis by the cloud server, obtains a result according to the analysis, queries a corresponding business logic, generates a control instruction according to the service logic, and
  • the control command is sent to the control module of the mobile service device.
  • the control module herein can include various controllers.
  • the control module controls the movement of the sports chassis according to the control parameters, controls the display of the display screen, and the voice output of the voice system.
  • the bearer structure of the mobile service device is located at the bottom of the motion Above the disc, a loading position can be provided.
  • the loading position here can be the item loading position or the seat of a specific person.
  • the mobile service device is equipped with a camera, ultrasound, lidar or infrared sensor to form a 3D vision system.
  • the local visual algorithm performs local analysis, and the local analysis result and/or the collected visual information are sent to the cloud server, and the cloud server further processes the cloud visual algorithm, and then
  • the cloud server combines the business logic, the operation result obtained by using the visual algorithm, and various information extracted from the information system to obtain the aforementioned control parameters.
  • the information system includes big data, user portraits, and store/business information.
  • the big data may include information such as various map data as well as user history purchase data.
  • the user portrait may include user feature data.
  • the user feature data may include user age, user gender, and user behavior preferences.
  • the mobile service device may move according to the output result of the local visual algorithm, using the guiding route or the tracking route planned by the map system or the navigation positioning. During the movement process, the mobile service device also performs its own indoor positioning in combination with the indoor positioning system.
  • the mobile service system may also include human/face/object recognition.
  • the disclosed apparatus and method may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner such as: multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored or not executed.
  • the coupling, or direct coupling, or communication connection of the components shown or discussed may be indirect coupling or communication connection through some interfaces, devices or units, and may be electrical, mechanical or other forms. of.
  • the units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one
  • the place may also be distributed to multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in each embodiment of the present invention may be integrated into one processing module, or each unit may be separately used as one unit, or two or more units may be integrated into one unit; the above integration
  • the unit can be implemented in the form of hardware or in the form of hardware plus software functional units.
  • the foregoing program may be stored in a computer readable storage medium, and the program is executed when executed.
  • the foregoing storage device includes the following steps: the foregoing storage medium includes: a mobile storage device, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
  • ROM read-only memory
  • RAM random access memory
  • magnetic disk or an optical disk.
  • optical disk A medium that can store program code.
  • the mobile service device automatically identifies the target user that needs the service through image collection, automatically moves to the target user, and enters the corresponding service working mode by determining the service demand information to provide the target user with the required service.
  • Service operation so that users do not need to manually find equipment that can provide services or help, improve equipment intelligence and user experience satisfaction, have positive industrial effects, and achieve simple and industrially strong features.

Abstract

一种服务提供方法及移动服务设备和计算机存储介质,该方法应用于移动服务设备中,移动服务设备具备驱动装置,驱动装置用于为移动服务设备提供移动的驱动力,移动服务设备还具备图像采集装置,移动服务设备具有至少两种不同的服务工作模式。该方法包括:基于所述图像采集装置采集获取第一图像(S110);识别所述第一图像,确定需要提供移动服务的目标用户(S120);根据所述目标用户所在的第一位置移动到第二位置,所述第二位置位于所述第一位置的第一距离范围内(S130);获得服务需求信息,并确定与所述服务需求信息相匹配的服务工作模式(S140);进入确定的所述服务工作模式,并为所述目标用户提供进入的所述服务工作模式下的服务操作(S150)。

Description

服务提供方法及装置、移动服务设备及存储介质
相关申请的交叉引用
本申请基于申请号为201611219961.7、申请日为2016年12月26日的中国专利申请提出,并要求该中国专利申请的优先权,该中国专利申请的全部内容在此引入本申请作为参考。
技术领域
本发明涉及信息技术领域,尤其涉及一种服务提供方法及装置、移动服务设备及存储介质。
背景技术
在某些特定场合下,通常人们可能需要工具或设备提供各种支撑服务,但是可能存在的问题是,工具或设备没有在身边。用户需要首先找到对应的工具或设备,显然存在着设备的智能性低,工具和设备的软硬件资源的使用率低的问题。
发明内容
有鉴于此,本发明实施例期望提供一种服务提供方法及装置、移动服务设备及存储介质,以更好的使用电子设备的资源有效使用率,提升设备的智能性。
本发明的技术方案是这样实现的:
本发明实施例第一方面提供一种服务提供方法,应用于移动服务设备中,所述移动服务设备具备驱动装置,所述驱动装置用于为所述移动服务设备提供移动的驱动力,所述移动服务设备还具备图像采集装置,所述移动服务设备具有至少两种不同的服务工作模式,所述方法包括:
基于所述图像采集装置采集获取第一图像;
识别所述第一图像,确定需要提供移动服务的目标用户;
根据所述目标用户所在的第一位置移动到第二位置,其中,所述第二位置位于所述第一位置的第一距离范围内;
获得服务需求信息,并确定与所述服务需求信息相匹配的服务工作模式;
进入确定的所述服务工作模式,并为所述目标用户提供进入的所述服务工作模式下的服务操作。
本发明实施例第二方面提供一种服务提供装置,应用于移动服务设备中,所述移动服务设备具备驱动装置,所述驱动装置用于为所述移动服务设备提供移动的驱动力,所述移动服务设备还具备图像采集装置,所述移动服务设备具有至少两种不同的服务工作模式,所述装置包括:
采集单元,配置为基于所述图像采集装置采集获取第一图像;
识别单元,配置为识别所述第一图像,确定需要提供移动服务的目标用户;
移动单元,配置为根据所述目标用户所在的第一位置移动到第二位置,其中,所述第二位置位于所述第一位置的第一距离范围内;
确定单元,配置为获得服务需求信息,并确定与所述服务需求信息相匹配的服务工作模式;
执行单元,配置为进入确定的所述服务工作模式,并为所述目标用户提供进入的所述服务工作模式下的服务操作。
本发明实施例第三方面提供一种计算机存储介质,所述计算机存储介质存储有计算机可执行代码,所述计算机可执行代码被执行后,能够前述方案提供的服务提供方法。
本发明实施例提供一种移动服务设备,包括:移动装置,配置为移动所述移动服务设备;
驱动装置,与所述移动装置连接,配置为向所述移动装置提供移动的驱动力;
图像采集装置,配置为采集图像;
处理装置,包括至少一个处理器,与所述图像采集装置、驱动装置及所述驱动装置连接,配置为通过执行计算机可执行代码,实现前述方案的服务提供方法。
本发明实施例提供的服务提供方法及装置、移动服务设备及存储介质,移动服务设备可以自行识别目标用户,并会获取目标用户的服务需求信息,进入到与所述服务需求信息相匹配的服务工作模式,在所述服务工作模式下,提供用户所需的服务操作。所述移动设备会移动到与目标用户第一位置距离在第一预设范围内的第二位置,这样的话,方便就近为目标用户提供服务,从而更好的利用所述移动服务设备的软硬件资源,提升资源的有效利用率,与此同时提升所述移动服务设备的智能性及用户使用满意度。
附图说明
图1为本发明实施例提供的第一种服务提供方法的流程示意图;
图2为本发明实施例提供的第二种服务提供方法的流程示意图;
图3为本发明实施例提供的第三种服务提供方法的流程示意图;
图4为本发明实施例提供的一种服务提供装置的结构示意图;
图5为本发明实施例提供的第四种服务提供方法的流程示意图。
具体实施方式
以下结合说明书附图及具体实施例对本发明的技术方案做进一步的详细阐述。
如图1所示,本实施例提供一种服务提供方法,应用于移动服务设备中,所述移动服务设备具备驱动装置,所述驱动装置用于为所述移动服务设备提供移动的驱动力,所述移动服务设备还具备图像采集装置,所述移 动服务设备具有至少两种不同的服务工作模式,所述方法包括:
步骤S110:基于所述图像采集装置采集获取第一图像;
步骤S120:识别所述第一图像,确定需要提供移动服务的目标用户;
步骤S130:根据所述目标用户所在的第一位置移动到第二位置,其中,所述第二位置位于所述第一位置的第一距离范围内;
步骤S140:获得服务需求信息,并确定与所述服务需求信息相匹配的服务工作模式;
步骤S150:进入确定的所述服务工作模式,并为所述目标用户提供进入的所述服务工作模式下的服务操作。
本实施例提供一种服务提供方法,提供所述服务的主体为所述移动服务设备。这里的移动服务设备可以成为移动机器人。所述移动机器人可为地面移动机器人或低空飞行机器人。所述移动服务设备包括移动装置,所述移动装置可包括移动底盘,所述移动底盘上安装有可以使得所述移动服务设备移动的轮子和/或履带等。所述移动装置还可包括螺旋桨等能够提供设备飞行移动的飞行装置。所述驱动装置与所述移动装置连接,可为所述移动装置提供驱动力。所述驱动装置可包括电动驱动装置或液压驱动装置或气压驱动装置等。
在所述移动服务设备上还设置有图像采集装置,这里的图像采集装置可包括各种类型的摄像头或相机等。在本实施例中所述图像采集装置可为三维3D图像采集装置;所述3D图像采集装置能够采集3D图像,能够为所述移动服务设备提供3D视觉效果。本实施例中所述3D图像装置不仅包括图形数据,还可以提供图像采集的定位数据。
在本实施例中所述移动服务设备可以工作在不同的服务工作模式,在不同的服务工作模式下提供的服务操作至少部分不同。当然每一种所述服务工作模式提供的服务操作,均可包括信息服务;这里的信息服务可包括 基于用户的查询请求,查询本地和/或远程数据库,输出查询结果。每一种所述服务工作模式提供的服务操作,还可包括装载服务;所述装载服务可以承载目标用户购买和/或携带的物品,也可以是为特定人群提供的座椅服务。
在本实施例中所述移动服务装置在步骤S110中,将利用所述图像采集装置采集获取第一图像。在本实施例中所述第一图像可为多个离散的静态图像,也可以是采集的视频流中的图像帧。所述步骤S110可包括:所述移动服务设备位于预设位置,朝预定方向采集第一图像。例如,所述移动服务设备是工作在商场、医院或活动会所的移动服务设备,则所述移动服务设备可位于商场、医院或活动会所等所述移动服务设备提供服务的工作区域的入口处,朝入口方向采集第一图像。所述第一图像可为用户移动到所述入口处的预定位置时采集的图像。当然,所述第一图像也可以为所述移动服务设备在所述工作区域内任意位置采集的第一图像。
在步骤S120中通过图像识别技术,确定需要提供移动服务的目标用户。首先所述移动服务设备可以通过人体识别,区分物体和人体,从而识别出人;其次,还可以对人体进行进一步的设别,识别出所述目标用户。例如,在第一图像中包括两个人的图像,可以通过图像识别,根据用户的穿着识别出哪些是需要提供移动服务的目标用户。例如,在商场包括消费者和商场工作人员。商场工作人员可能穿着工作服或佩带者工作证,通过图像中不同人的穿戴的识别,确定出需要提供移动服务的目标用户。
所述步骤S120还可包括:解析所述第一图像,根据所述第一图像提取出图像中候选用户的视点移动轨迹;当所述视点移动轨迹满足预设条件时,确定所述候选用户为所述目标用户。当一个用户进入商场、医院或活动会所时,若不知道自己所要去的位置则可能会出现目光游离的现象或在工作区域内搜寻的目光。在本实施例中可以通过多幅第一图像中候选用户的视 点移动轨迹,可以将这些目光游离的用户查找出来,作为所述目标用户。
所述步骤S120还可包括:解析所述第一图像,确定第一图像中的用户是否做出了招呼所述移动服务设备的预定动作,若有,则可确定对应的用户为所述目标用户。
所述步骤S120还可包括:解析所述第一图像,确定所述第一图像的用户是否携带了预设物体,若候选用户携带了预设物体,则可认为该候选用户为目标用户。例如,所述移动服务设备为应用于医院的设备,通过图像采集发现某一个候选用户有使用拐杖等支撑其行走的预设物体,则认为该用户可为需要提供座椅服务或看护服务的目标用户。
总之,在步骤S120中可以通过第一图像中不同人的穿着识别、动作识别和/或特定部位的运动轨迹识别、人体形态识别等,确定出所述目标用户。
在步骤S130中,所述移动服务设备一旦确定了目标用户之后,所述移动服务设备将会从其自身当前所在的位置,移动到与目标用户较近的第二位置,移动到第二位置之后,所述移动目标设备与所述目标用户之间的距离不大于预设的第一距离范围的最大值,即位于所述第一距离范围内。这样的话,方便所述移动服务设备向所述目标用户提供移动服务。在本实施例中所述第一位置为目标用户所在的位置。
在步骤S140中将获得服务需求信息,这里的服务需求信息可以通过分析所述第一图像获得,也可以通过与所述目标用户的信息交互获得。例如,所述目标用户通过所述移动服务设备上的人机交互接口,向移动服务设备提供所需服务需求信息。例如,目标用户通过所述移动服务设备的语音采集识别装置,向其输入采集指令。再例如,所述目标用户通过所述移动服务设备上的实体控件或虚拟控件向所述移动服务设备发送控件指令,再比如,当所述移动服务设备与目标用户之间的距离位于所述第一距离范围之后,所述移动服务设备会与用户随身携带的手机、平板或可穿戴设备等用 户终端建立连接,并通过该连接向用户终端推送所述移动服务设备的操控界面,所述操控界面可以采集用户指令,所述移动服务设备可以通过移动终端获取所述服务需求信息。当然,所述移动服务设备还配备有专门的控制装置,当所述移动服务设备移动到目标用户身边时,移动服务设备提示用户从移动服务设备上取走控制装置,所述移动服务设备可以通过所述控制装置接收用户输入,从而获得所述服务需求信息。在步骤S140中将直接根据所述服务需求信息,确定出可以满足用户需求(即满足所述服务需求信息)的服务工作模式。
在步骤S150中,所述移动服务设备将进入当前确定的服务工作模式,并在该服务工作模式下为用户提供相应的服务操作。
例如,在医院,就医者可能需要挂号,需要去到对应的门诊室,但是不知道挂号位置以及门诊室的具体位置,则此时,可以由所述移动服务设备提供相应的室内导航服务。
本实施例的服务提供方法,是一种移动中的服务提供方法,在现有技术中通常设备提供的服务都是在固定的位置,或仅能是由用户自身携带设备,才可以获得移动中的服务,从而解决了现有技术中用户在运动中无法获得对应服务的问题。在本实施例中所述移动服务设备可以在移动中提供用户所需的服务。且所述移动服务设备具有不同的服务工作模式,会根据用户的实际服务需求,工作在相应的服务工作模式,为用户提供其所需的移动服务,提升了设备的智能性,更好的使用了移动服务设备的软硬件资源,提升了服务品质和用户满意度。
在一些实施例中,所述步骤S130可包括:
采集所述目标用户的语音,对采集所得语音进行语义分析,提取获得相应的服务需求信息,并根据所述服务需求信息查询预设的服务工作模式,获得与所述服务需求信息匹配的服务工作模式。
在本实施例中所述移动服务设备可以采集用户语音,可以对用户的自然进行语义提取,通过语义分析和提取,确定出目标用户可能需要的服务,从而获得所述服务需求信息。当移动服务设备移动到目标用户身边之后,用户仅需通过语音就可以向移动用户设备提供目标需求信息,用户不用进行对应的手动操作等,简化了用户操作,提升了移动服务设备的智能性。
在本实施例中所述语义分析可包括所述移动服务设备的本地语义分析,和/或,所述移动服务设备将所述采集的语音提交给网络侧,并由网络侧的网络服务器进行远程的语义分析。
所述服务工作模式可包括多类,以下提供两种可选类别。
第一类:
所述服务工作模式包括陪伴工作模式,所述陪伴工作模式可特定的陪伴工作服务。当在步骤S140中确定的服务工作模式为所述陪伴工作模式时,如图2所示,所述步骤S150可包括:
步骤S151:进入所述陪伴工作模式,利用所述图像采集装置采集所述目标用户的第二图像;
步骤S152:根据第二图像确定所述目标用户的移动路径;
步骤S153:获取所述移动路径上阻碍所述移动服务设备的路障信息;
步骤S154:根据所述移动服务设备的移动特性及所述路障信息,规划所述移动服务设备的跟随参数,其中,所述跟随参数包括跟随路径;
步骤S155:基于所述跟随参数移动,提供所述陪伴工作模式下的陪伴服务,具体如,利用所述跟随参数移动,保持与所述目标用户之间的距离位于第二距离范围内,并提供所述陪伴工作模式下的陪伴服务。
在本实施例中所述移动服务设备,会继续对所述目标用户进行图像采集,例如,利用所述3D图像采集装置采集图像,获取所述移动服务设备的3D视觉信息。通过所述第二图像的采集,则所述移动服务设备可以获得 用户当前的移动轨迹。在本实施例中所述移动服务设备是工作在陪伴工作模式,提供的陪伴服务,则此时所述移动服务设备一般跟在所述目标用户的身后或者身旁。故在所述步骤S151中可包括:开启所述移动用户设备的前置图像采集装置,采集所述目标用户的背影图像和/或侧身图像,当然在具体实现时,不局限于采集所述背影图像和/或侧身图像。在具体实现时,为了避免妨碍所述目标用户的移动,所述移动用户设备通常跟在所述目标用户身后或身旁,除非特定情况,所述移动服务设备不会移动到所述目标用户的前面。
在步骤S152中可以通过解析所述第二图像,获得目标用户的移动路径。
在步骤S153中,将通过解析第二图像、或通过雷达定位、超声波定位、红外感应等至少其中之一,确定用户移动的移动路径上是否有造成所述移动服务设备不能通过的路障,从而获得路障信息。
在步骤S154中,将根据移动服务设备自身的移动特性,及路障信息,规划出适宜于所述移动服务设备的自身的跟随路径。这里的移动特性可包括所述移动设备的移动能力以及形态参数。例如,有些通道可能用户能够过去,但是移动服务设备可能由于体积较大就不能够通过,则此时所述移动服务设备就需要绕道跟踪。例如,有些坡度较陡的位置,目标用户可能很容易就通过了,可视移动服务设备确没有能力攀爬上去,此时,所述移动服务设备也需要进行绕道,那么此时,所述移动服务设备为自身规划的跟随路径可能就与移动用户的移动路径有些区别。在完成跟随路径的确定之后,所述移动服务设备将按照跟随路径进行移动,以提供所述陪伴服务。
所述形态参数,可为表征移动服务设备外形的外形参数和/或尺寸参数。所述外形参数,例如,移动服务设备的外形成立方体、长方体、椭圆球体等。所述尺寸参数可包括:该移动服务设备在三维立体坐标中不同坐标轴上的宽度,例如,移动服务设备的长、宽及高等。
所述移动能力参数,可包括:所述移动服务设备的最大速度、最大加速度以及最大爬破角度等参数。
所述跟随参数除了所述跟随路径,还可包括移动控制参数。例如,所述移动服务设备可包括多种移动能力,在不同的跟随路径上,所述移动服务设备可能需要选择对应的移动能力才能进行移动。例如,用户当前进入到手扶梯,若移动服务设备工作在陪伴工作模式,所述移动服务设备也需要进入到手扶梯,进入手扶梯之后,所述移动服务设备需要采用制动参数,将自身与手扶梯的扶梯地面进行锁定,以免滑动。显然这里的制动参数即为所述跟随参数的一种。
再比如,所述移动服务设备的横截面在第一维度上的长度大于在第二维度上的长度。当前目标用户通过一个窄道,通过3D视觉分析或雷达或声波定位之后,移动服务设备确定是一个窄道,在移动时,若以第一维度横穿,则移动服务设备会被卡住,若以第二维度横穿,则可以顺利通过,则此时,所述移动服务设备规划的跟随路径可以与所述目标用户的移动路径一致,但是移动控制参数会控制所述移动设备在通过所述窄道时,调整移动服务设备自身的姿态,采用以第一维度穿过所述窄道。
在陪伴服务中,所述移动服务设备可以提供装载位,所述装载位可以为承载用户的随身物品或购买的商品。所述装载位还可以是可供儿童、老人和/或伤残人士等特定人士的座椅。例如,在商场,所述移动服务设备上提供装载位,则用户在购物中挑选的商品,可以放到该装载位内,则此时,所述移动服务设备提供的陪伴服务中包括自动购物车的服务。若所述装载位包括儿童座椅,所述方法还可包括:当检测到所述儿童座椅未空载时,提供儿童娱乐服务。检测儿童座椅是否空载可以通过重量检测,以及对所述儿童座椅的图像检测来确定。所述儿童娱乐服务可包括播放儿童音乐、童话等音频服务、播放卡通等视频服务以及语音聊天的链聊天服务,减少 儿童在父母购物过程中的哭闹现象。
步骤S150中的第二距离范围可等于所述第一距离范围,也可以略小于所述第一预设距离或略大于所述第一预设距离。
第二类:
所述服务工作模式包括引导工作模式,在所述移动服务模式下可以提供引导服务,将目标用户引导到用户想要去的目标位置。
所述步骤S140可包括:所述确定的与所述服务需求信息相匹配的服务工作模式为引导工作模式。
所述步骤S150可包括:
进入所述引导工作模式,确定所述目标用户期望前往的目标位置;
根据所述目标位置以及所述移动服务设备当前所处位置,规划所述移动服务设备从所述当前所处位置移动到所述目标位置的引导参数,所述引导参数至少包括引导路径;
按照所述引导参数移动到所述目标位置,并引导所述目标用户跟随所述移动服务设备前往所述目标位置。
在本实施例中所述引导服务可为引导目标用户达到目标位置的导游服务。
在本实施例中所述移动服务设备首先会确定目标位置,再利用预先存储在所述移动服务设备内部的地图数据或路线数据等,规划出引导参数。这里的引导参数至少包括引导路径。所述引导参数还可包括前述的移动控制参数。这里的移动控制参数可以控制移动服务设备所采用的移动方式或移动能力或移动速度等。
当确定出所述引导参数之后,所述移动服务设备会按照所述引导路径进行移动,在移动的过程中,所述移动服务设备会引导用户跟随其移动到目标位置。例如,移动服务设备在按照所述引导路径移动过程中,可输出 引导语音提示,提示用户在分叉路口的路径选择。当然,在引导的过程中,所述移动服务设备将开启图像采集装置,采集目标用户的图像,根据所述目标用户的移动快慢等移动状况,调整自身的移动控制参数,例如,移动速度等。
在一些实施例中,当移动服务设备由于处于引导工作模式,可能会在目标用户的前面移动,为了减少目标用户跟丢的现象,所述移动服务设备会开启后置图像采集装置,采集目标用户的图像,确保所述目标用户与移动服务设备之间的距离保持在预设距离范围内,例如,可保持在所述第一距离范围内。
综合上述所述移动服务设备的服务工作模式至少包括两大类,分别是所述陪伴工作模式和所述移动工作模式。
在一些实施例中,所述引导路径可是一次性规划出的整体路径,例如,移动服务设备根据自身当前所在的当前位置,以及目标用户期望前往的目标位置,一次性规划出当前位置达到目标位置的整体路径,然后后续提供引导服务时,基于该整体路径进行移动,在移动的过程中,可以根据路径上的拥堵情况等,调整引导路径,以避开拥堵路段。
在另一些实施例中,所述跟随路径可是分周期规划的,跟随路径为移动服务设备根据目标用户的运动而运动的路径,以预定时长为一个规划周期,结合移动服务设备的当前位置及目标用户的所在位置规划出跟随路径,在一些实施例中还会根据目标用户的移动参数,预测目标用户的移动方向或移动路径,故在规划跟随路径时,还包括:根据移动服务设备的当前位置、目标用户的当前位置和当前移动参数,规划出跟随路径。基于目标用户的当前移动参数进行跟随路径的规划,可以方便移动服务设备及时调整自身的移动参数,例如,移动方向、移动加速度及移动速度中的一个或多个,减少跟丢现象,以提供更好的服务。
第三类:
所述服务工作模式,还包括:查询工作模式。
当用户到达一个新环境之后,可能会迷路等,同时也不知道向谁提问,移动服务提供设备识别出目标用户之后,会基于当前目标用户所在的第一位置,移动到第二位置,该第二位置可为目标用户能够操作所述移动服务设备的地理位置或空间位置。
所述步骤S140可包括:
输出服务提示信息,例如,输出服务提示语音;
采集基于所述服务提示信息产生的服务提示应答信息,若所述服务提示应答信息指向所述查询工作服务之后,所述步骤S150包括:进入所述查询工作模式,并向所述目标用户提供查询服务。
在本实施例中,进入所述查询工作模式之后,所述移动服务设备连接到预定数据库或预定设备。例如,移动服务设备是位于特定室内区域的,通常情况下,所述移动设备仅需连接到特定室内区域的局域网即可,若当前服务工作模式为查询工作模式,则目标用户可能需要连接到互联网查询数据,在本实施例中,所述移动服务设备可以连接到外接网关,通过外接网关从互联网获取数据,以提供全面的查询服务,也可以连接到可以提供特定查询服务的数据库。例如,移动服务设备应用于医院,当前目标用户想查询自己的病例,在移动服务设备需要连接到病例数据库,已反馈病例。
当所述移动服务设备工作在查询工作模式时,若目标用户的查询服务结束之后,所述移动服务设备可以移动到初始位置,以处于待用状态,以方便为其他用户提供服务。该初始位置可为目标用户经常出现的区域,且不干扰用户活动的位置。所述陪伴工作模式有可细分为以下几种;
第一种:
承载陪伴模式,:利用3D视觉装置及路障定位装置等跟随目标用户移 动,陪伴目标用户进行购物,承载用户购买的商品,减轻目标用户的购物负担,移动服务设备承载物品,并且提供防盗服务。所述防盗服务可为:目标用户可以向移动服务设备提供的装载位内放入物品,在放入物品之后,若需要打开装载位的盖子需要进行验证,所述验证可为手势验证、指纹验证或语音口令验证或密码验证,从而防止装载位内的物品丢失或被替换。
第二种:
看护陪伴模式:
对于有小孩或行动不便的目标用户,可以将小孩或行动不便的用户安置在移动服务设备的座椅(例如,儿童座椅)中,同时跟随目标用户在商场内移动。在移动过程中对小孩或行动不便的人士提供看护服务。这种移动服务设备可携带饮用水或与工作区域的医疗保健室建立有紧急连接,一旦出现意外时,所述移动服务设备可以通过所述紧急连接,可将自身的位置信息告知医疗保健室,从而方便被看护者在第一时间得到医疗服务。
这里判断意外情况,可通过监控座椅上的人的身体状况信息来确定,例如,所述移动服务设备上设置有心跳检测装置,可以通过心跳检测装置检测做座椅上的人的心跳数,当出现心跳异常时,利用所述紧急连接向医疗保健室的预定设备发送告警通知,并通过全球定位系统或自身携带的地图数据,定位出自身当前的位置,向自身的位置发送给所述预定设备,方便被看护的人士获得医疗救治。
所述引导工作模式也可细分为以下几种:
第一种:
被动引导工作模式:
在被动引导工作模式下,所述移动服务设备会从目标用户的用户输入获得明确的目标位置或定位所述目标位置的其他信息,目标用户仅是不知道具体如何达到所述目标位置的路径,则所述移动服务设备,仅需要根据 当前所在位置和目标位置,规划出所述引导参数即可。例如,所述移动服务设备通过语音交互,获取用户的明确购物信息,再根据目标用户指定购买的商品的摆放位置,规划出引导录像,并带领用户到目标位置。
第二种:
自动引导工作模式:
当所述移动服务设备没有获得目标用户明确至少的目标位置或目标位置的确定信息时,所述移动服务设备会根据本地或远程数据库的推荐信息,规划出引导参数,引导目标用户移动并提供相应的引导服务。例如,在商场,如果用户没有明确的购物目标,则移动服务设备可以通过人脸识别等识别方式,获取用户身份信息和/或历史服务信息,再根据用户身份信息和/或历史服务信息,有针对性将目标用户引导至其可能购买的商品位置所在处。这里的历史服务信息可包括用户的历史购买记录等信息。所述移动服务设备,具体可通过网络访问商场的大数据系统,获取用户画像,结合实时的商户信息,进行购物推荐和商场导引功能,带领用户去系统计算的理想商户购买或娱乐,在移动过程中所述移动服务设备可以开启语音服务装置,与用户通过语音交互,确认用户的意图和问题,增加服务的满意度。
当所述移动服务设备工作在引导工作模式下时,将会根据预设策略规划所述引导路径,例如,采用路径最短策略、人流最少策略和/或观光策略等。在根据所述预设策略进行引导路径的规划之前,所述方法还可包括:根据所述引导工作模式是被动引导模式还是自动引导模式,选择所述预设策略。例如,当前的引导工作模式为被动引导模式,且通过图像采集发现用户比较着急,则可以选择路径最短路径,规划所述引导路径。例如,当前引导工作模式为自动引导模式,可能用户当前并不着急购物,可能是看到想买的就买,则可以采用所述观光策略规划引导路径。所述观光策略为使规划的引导路径至少经过商场提供的N个推荐位置的规划规则,所述N 为不小于1的整数。所述人流最少策略可为使规划的引导路径避开人流拥堵路段的规划规则。当然在一些实施例中,确定所述预设规划策略,可包括:输出所述移动服务设备可提供的规划策略,接收用户指示,根据用户指示确定所述预设规划策略。
在一些实施例中,如图3所示,所述方法还包括:
步骤S310:获取所述目标用户的待支付清单;
步骤S320:将所述待支付清单发送给目标用户的用户终端;
步骤S330:接收所述用户终端基于所述待支付清单发送的支付信息;
步骤S340:根据所述支付信息向目标账户请求支付。
在本实施例中所述移动服务设备还会获取目标用户的待支付请求,这里的待支付清单可为购物清单,还可为医疗清单或移动服务的待支付清单,总之为目标用户产生的各种需要支付的列表或单子。
针对于所述购物清单,所述移动服务设备可以扫描用户购买的商品,查询商场的数据库码,获得每一件商品的价格,形成购物清单。再比如,所述移动服务设备的工作区域为医院,所述移动服务设备可以通过医生输入到医院系统的就诊信息,生成所述医疗清单。再比如,所述移动服务设备提供的服务为有偿服务,则所述移动服务设备可以根据自身提供的服务类型和/或服务时间,以及服务过程中是否产生赔损等问题,提供移动服务清单。
在本实施例中当所述移动服务设备获取了待支付清单之后,会将所述支付清单发送给目标用户的用户终端。例如,所述移动服务设备上贴有或显示有移动服务设备的标识或所述待支付清单的标识,用户可以利用手机等用户终端通过扫描所述标识,从移动服务设备或所述移动服务设备连接的服务器接收到所述待支付清单。所述标识可为条形码;所述条形码可包括二维码。所述标签还可包括字符串组成的序列等。
用户终端在接收到所述待支付清单之后,采用显示或语音等输出方式,输出所述待支付清单,用户终端还会采集用户操作,确定是否支付,支付哪些部分,以及支付账户和/或支付密码等,总之,将根据所述用户操作产生支付信息,此时,所述移动服务设备会接收到所述支付信息,根据所述支付信息,向目标账户请求支付。这里的目标账户可为银行账户、网络支付账户和/会商场或医院等移动服务设备的工作区域的存储账户,请求支付。请求支付时向对应的目标账户发送支付金额、接受支付的账户以及支付信息。这样的话,所述目标账户通过支付信息的验证,将向所述接受支付的账户,支付请求支付的所述支付金额。
这样的话,在商场、医院或会所等地方,用户可以不用到柜台等待支付,减少了支付所需的排队操作和/或排队时间,提升了支付效率和用户使用满意度。
在一些实施例中,所述方法还包括:
当所述移动服务设备确认支付完毕之后,形成支付凭证;所述支付凭证可为电子凭证,将所述电子凭证发送给所述用户终端;所述支付凭证还可为纸质凭证,所述移动服务设备打印纸质凭证。
在另外一些实施例中,所述方法还可包括:
所述移动服务设备在确认支付完毕之后,对已支付商品进行消磁处理,避免未进行消磁处理的商品经过商场出口时,由写在商品上的电磁信号触发商场的报警。
在另一些实施例中,所述方法还包括:
接收信息查询请求;
根据所述查询请求查询预定数据库,获得与所述查询请求相适配的查询结果;
输出所述查询结果或根据所述查询结果提供对应地服务操作。
在本实施例中所述移动服务设备还可以接收目标用户输入的查询请求,这里的查询请求,可以是以语音、控件操作等方式输入的查询请求。移动服务设备接收到所述查询请求之后,会查询预定数据库,这里的预定数据库可为移动服务设备的工作区域的数据库,也可以是网络数据库,获得对应的查询结果,在获得查询结果之后,可以直接输出所述查询结果或直接提供与查询结果相对应的服务。
例如,移动服务设备在提供引导服务或陪伴服务的过程中,目标用户可能突然想知道外面的提前,通过语音向移动服务设备询问天气,则所述移动服务设备接收到这种询问之后,可以通过查询网络服务器,获得当前的天气状况,并最终通过语音的方式输出查询的天气。再比如,用户在看到一个自己感兴趣的商品或服务时,可能会询问与该物品或服务相关的信息,比如价格、购买优惠、保质期等各种信息,所述移动服务设备接收到这种查询请求之后,查询对应物品或服务的相关信息,输出查询结果,或直接将所述目标用户引导到可以提供这种服务或商品资讯的咨询处。
如图4所示,本实施例提一种服务提供装置,应用于移动服务设备中,所述移动服务设备具备驱动装置,所述驱动装置用于为所述移动服务设备提供移动的驱动力,所述移动服务设备还具备图像采集装置,所述移动服务设备具有至少两种不同的服务工作模式,所述装置包括:
采集单元110,配置为基于所述图像采集装置采集获取第一图像;
识别单元120,配置为识别所述第一图像,确定需要提供移动服务的目标用户;
移动单元130,配置为根据所述目标用户所在的第一位置移动到第二位置,其中,所述第二位置位于所述第一位置的第一距离范围内;
确定单元140,用于获得服务需求信息,并确定与所述服务需求信息相匹配的服务工作模式;
执行单元150,配置为进入确定的所述服务工作模式,并为所述目标用户提供进入的所述服务工作模式下的服务操作。
在本实施例中所述服务提供装置为应用于所述移动服务设备中的信息处理装置。
所述采集单元110、识别单元120、确定单元140及所述执行单元150都可对应于所述移动服务设备中的处理器或处理电路。所述处理器可为中央处理器、微处理器、数字信号处理器、应用处理器或可编程阵列等。所述处理电路可为专用集成电路。所述处理器或处理电路,可通过预定代码或程序的执行,实现上述各个单元的功能。
所述采集单元110可为与所述图像采集装置连接的控制器或处理器或处理电路。
所述移动单元130可与所述移动服务设备的移动装置和/或驱动装置连接,用于控制所述移动服务设备的移动。
在本实施例中所述移动服务设备,可以自动移动识别目标用户,并移动到目标用户的附近,通过服务需求信息的获取,并进入到相应的服务工作模式,提供相应的服务操作,具有方便用户所需要服务时,及时获得服务,提高了设备的智能性,更好的使用了移动服务设备的软硬件资源。
在一些实施例中,所述确定单元140,具体用于采集所述目标用户的语音,对采集所得语音进行语义分析,提取获得相应的服务需求信息,并根据所述服务需求信息查询预设的服务工作模式,获得与所述服务需求信息匹配的服务工作模式。
在本实施例中所述服务提供装置,通过语音交互获取所述服务需求信息,这样用户可以通过语音控制所述移动服务设备提供服务,具有操作简便的特点。
在一些实施例中,所述确定的与所述服务需求信息相匹配的服务工作 模式为陪伴工作模式,所述执行单元150,具体用于进入所述陪伴工作模式,利用所述图像采集装置采集所述目标用户的第二图像;根据第二图像确定所述目标用户的移动路径;获取所述移动路径上阻碍所述移动服务设备的路障信息;根据所述移动服务设备的移动特性及所述路障信息,规划所述移动服务设备的跟随参数,其中,所述跟随参数至少包括跟随路径;基于所述跟随参数移动,提供所述陪伴工作模式下的陪伴服务。
在本实施例中所述执行单元150,在移动服务设备工作在陪伴工作模式时,会通过图像采集获得目标用户的第二图像,再基于第二图像及路障信息的确认,规划出跟随参数,基于跟随参数根据目标用户移动,在移动过程中,所述移动服务设备离开所述目标用户距离超过指定距离的时长不超过预定时间,以达到随时跟踪的效果,在跟踪移动过程中,可以提供前述的信息服务和/或装载服务等。
在有些实施例中,所述确定的与所述服务需求信息相匹配的服务工作模式为引导工作模式,所述执行单元150,具体用于进入所述引导工作模式,确定所述目标用户期望前往的目标位置;根据所述目标位置以及所述移动服务设备当前所处位置,规划所述移动服务设备从所述当前所处位置移动到所述目标位置的引导参数,所述引导参数至少包括引导路径;按照所述引导参数移动到所述目标位置,并引导所述目标用户跟随所述移动服务设备前往所述目标位置。
在本实施例中所述移动服务设备,工作在引动工作模式,将根据用户想要去的目标位置,规划所述引导参数,引导目标用户移动到所述目标位置。
在另一些实施例中,所述装置还包括:
获取单元,配置为获取所述目标用户的待支付清单;
第一发送单元,配置为将所述待支付清单发送给目标用户的用户终端;
第一接收单元,配置为接收所述用户终端基于所述待支付清单发送的支付信息;
请求单元,配置为根据所述支付信息向目标账户请求支付。
所述获取单元可对应于人机交互接口或图像采集装置或通信接口。例如,通过人机交互接口基于用户输入,获得用户想要购买的服务或商品的列表,再通过商品或服务的价格等信息查询,生成所述待支付清单。所述第一发送单元和所述第一接收单元,都可对应于通信接口,该通信接口可以通过直连链路或互联网与其他设备进行信息交互,例如,所述用户终端。将所述待支付清单发送给目标用户的用户终端,并从用户终端接收所述支付信息。所述请求单元同样可对应于通信接口,可以向运营和/或管理所述目标账户的服务设备,发送支付请求,从而实现请求支付的功能。
在另一些实施例中,所述装置还包括:
第二接收单元,配置为接收信息查询请求;
查询单元,配置为根据所述查询请求查询预定数据库,获得与所述查询请求相适配的查询结果;
所述执行单元150,还配置为输出所述查询结果或根据所述查询结果提供对应地服务操作。
在本实施例中所述装置还包括第二接收单元,所述第二接收单元一般在提供陪伴服务或引导服务时,实时开启,以便随时接收信息查询请求。所述查询单元可对应于处理器及通信接口,所述处理器将所述查询请求以预定信息格式,利用所述通信接口发送给所述预定数据库,从而接收所述预定数据库返回的查询结果。
所述执行单元150可包括语音输出接口,能够查询结果;所述执行单元150还可对应于显示屏,显示所述查询结果。所述执行单元150可对处理器,控制所述移动服务设备执行对应的服务操作。
本发明实施例提供一种计算机存储介质,所述计算机存储介质存储有计算机可执行代码,所述计算机可执行代码被执行后,能够实现前述一个或多个技术方案提供的服务提供方法,例如,可以执行如图1、图2及图3所示的服务提供方法。
所述计算机存储介质可为各种类型的计算机存储介质,例如,随机存储介质、闪存、只读存储介质、移动硬盘等存储介质,可选为非瞬间存储介质。
本实施例提供一种移动服务设备,包括:移动装置,配置为移动所述移动服务设备;该移动装置可为移动底盘、飞行组件(例如,旋翼飞行组件,固定翼飞行组件);
驱动装置,与所述移动装置连接,配置为向所述移动装置提供移动的驱动力;所述驱动装置可包括:一个或多个电驱动装置、燃油驱动装置、燃气驱动装置等;所述电驱动装置可包括:一个或多个电动机等,总之可以提供移动装置前后左右上下等多个方向上的移动所需的能量;
图像采集装置,配置为采集图像;该图像采集装置包括:一个或多个摄像头,这些摄像头可以分布在不同的位置,例如,可以分布在移动服务设备的第一表面和第二表面,第一表面和第二表面互为相反面,若第一表面朝向移动服务设备的前进方向,则第二表面背向移动服务设备的前进方向;若第二表面朝向移动服务设备的前进方向,则第一表面背向移动服务设备的前进方向。
处理装置,包括至少一个处理器,与所述图像采集装置、驱动装置及所述驱动装置连接,配置为通过执行计算机可执行代码,实现前述一个或多个技术方案提供的服务提供方法。
所述处理器,可包括:中央处理器、微处理器、数字信号处理器、应用处理器、可编程阵列或专用集成电路等,可以通过计算机程序、软件应用或操作系统的功能组件的执行,可以实现前述一个或多个技术方案提供 的服务提供方法。
以下结合上述实施例提供几个具体的示例:
示例一:
本示例中提供一种移动服务设备,该移动服务设备可以成为机器人。该机器人可以提供以下功能:
1)机器人包括运动底盘,可以在商场内部自由移动。该运动底盘具有一定的承载能力,可以保存运输用户购买的商品或携带幼童。
2)机器人提供语音输入输出交互功能,背后是语音识别/语义识别及人工智能(AI)的3D视觉系统。所述3D视觉系统包括摄像头、激光雷达、超声波、红外传感器等多种传感器设备。
3)机器人具有即时定位功能,能够对自身进行即时定位。所述机器人可以利用即时定位与地图构建(SLAM)系统或其他辅助的室内定位系统,可以对自身所在的位置进行定位。所述辅助的室内定位系统可包括:WiFi定位系统、蓝牙定位系统、无载波通信技术(uwb)定位系统、可见光定位系统中的一种或几种。是对3D视觉系统中定位功能的辅助,加快3D视觉系统的定位速度及准确性。
4)机器人具有图像识别,能够对物体/人体/人脸识别,并基于图像识别能力进行移动跟随等功能。
5)机器人具有通信功能,能够与商场大数据系统等预定数据库进行数据交互,可以查询到下列数据:商户的实时信息(商品信息、打折信息)、商场的实时数据(用户流量、地图数据、突发情况信息)、用户画像信息(根据用户的年龄、性别、职业、收入、家庭、过往购买记录等汇总而成的信息)
以下提供所述机器人的具体使用场景和步骤:
用户进入商场,机器人通过3D视觉的人体识别主动发现用户,自主移 动到用户面前,语音和用户沟通,询问是否需要提供服务及需要何种服务。以下为机器人可提供的服务种类:
服务1(购物陪伴),所述服务1可包括:跟随用户,陪伴用户进行购物,承载用户购买的商品,减轻用户的负担,机器人承载物品具有基础的防丢功能。
服务2(儿童陪伴),所述服务2可包括:对于有小孩的用户,可以将小孩安置在机器人的儿童座椅中,同时跟随家长在商场内移动。可以根据儿童的年龄提供语音聊天、播放儿歌故事等功能。
服务3(被动购物引导),所述服务3可包括:根据语音交互,获取用户的明确购物信息,通过自主导航带领用户到目标地点。
服务4(自动购物引导),所述服务4可包括:如果用户没有明确的目标,这时可以通过人脸识别或其它身份识别方法,确认用户的身份,通过网络访问商场的大数据系统,获取用户画像,结合实时的商户信息,进行购物推荐和商场导引功能(3D视觉的自主导航+室内定位功能+壁障),带领用户去系统计算的理想商户购买或娱乐,过程中用户可以通过语音与机器人进行交互,确认用户的意图和问题,增加服务的满意度。
示例二:
如图5所示,本示例提供一种服务提供系统,包括移动服务设备和云端服务器。
所述移动服务设备采集语音输入,将采集的语音数据发送给云端服务器,由云端服务器进行语音/语义分析,根据分析得到结果,查询对应的业务逻辑,根据所述业务逻辑生成控制指令,将所述控制指令发送给所述移动服务设备的控制模块。这里的控制模块可包括各种控制器。所述控制模块,根据所述控制参数控制运动底盘的移动,控制显示屏幕的显示以及语音系统的语音输出等操作。所述移动服务设备的承载结构位于所述运动底 盘之上,可以提供装载位。这里的装载位可以是物品装载位,也可以是特定人士的座椅。
所述移动服务设备配备有摄像头、超声波、激光雷达或红外传感器,形成了3D视觉系统。所述3D视觉系统采集到视觉信息之后,将通过本地视觉算法进行本地分析,将本地分析的结果和/或采集的视觉信息,发送给他云端服务器,云端服务器利用云端视觉算法进行进一步处理,随后云端服务器,会结合业务逻辑、将利用视觉算法得到的运算结果,以及从信息系统提取的各种信息,得到前述控制参数。所述信息系统中包括大数据、用户画像以及商场/商户信息。所述大数据可包括各种地图数据以及用户历史购买数据等信息。所述用户画像可包括用户特征数据。所述用户特征数据可包括用户年纪、用户性别、用户行为偏好。
所述移动服务设备可以根据本地视觉算法的输出结果,利用地图系统或导航定位规划出的引导路线或跟踪路线进行移动。在移动过程中,所述移动服务设备还会结合室内定位系统,进行自身的室内定位。所述移动服务系统还可包括人体/人脸/物体识别。
在本申请所提供的几个实施例中,应该理解到,所揭露的设备和方法,可以通过其它的方式实现。以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,如:多个单元或组件可以结合,或可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的各组成部分相互之间的耦合、或直接耦合、或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性的、机械的或其它形式的。
上述作为分离部件说明的单元可以是、或也可以不是物理上分开的,作为单元显示的部件可以是、或也可以不是物理单元,即可以位于一个 地方,也可以分布到多个网络单元上;可以根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。
另外,在本发明各实施例中的各功能单元可以全部集成在一个处理模块中,也可以是各单元分别单独作为一个单元,也可以两个或两个以上单元集成在一个单元中;上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。
本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于一计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:移动存储设备、只读存储器(ROM,Read-Only Memory)、随机存取存储器(RAM,Random Access Memory)、磁碟或者光盘等各种可以存储程序代码的介质。
以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。因此,本发明的保护范围应以所述权利要求的保护范围为准
工业实用性
本发明实施例中移动服务设备会通过图像采集自动识别出需要服务的目标用户,自动移动到目标用户的跟前,通过服务需求信息的确定,进入到对应的服务工作模式,为目标用户提供其所需的服务操作,这样用户无需人工去找可提供服务或帮助的设备,提高了设备的智能性及用户的体验满意度,具有积极的工业效果,且实现简单具有工业实现性强的特点。

Claims (14)

  1. 一种服务提供方法,应用于移动服务设备中,所述移动服务设备具备驱动装置,所述驱动装置用于为所述移动服务设备提供移动的驱动力,所述移动服务设备还具备图像采集装置,所述移动服务设备具有至少两种不同的服务工作模式,所述方法包括:
    基于所述图像采集装置采集、获取第一图像;
    识别所述第一图像,确定需要提供移动服务的目标用户;
    根据所述目标用户所在的第一位置移动到第二位置,其中,所述第二位置位于所述第一位置的第一距离范围内;
    获得服务需求信息,并确定与所述服务需求信息相匹配的服务工作模式;
    进入确定的所述服务工作模式,并为所述目标用户提供进入的所述服务工作模式下的服务操作。
  2. 根据权利要求1所述的方法,其中,所述获得服务需求信息,并确定与所述服务需求信息匹配的服务工作模式,包括:
    采集所述目标用户的语音,
    对采集所得语音进行语义分析,
    提取获得相应的服务需求信息,
    根据所述服务需求信息查询预设的服务工作模式,获得与所述服务需求信息匹配的服务工作模式。
  3. 根据权利要求2所述的方法,其中,所述确定的与所述服务需求信息相匹配的服务工作模式为陪伴工作模式,
    所述进入服务工作模式,并为所述目标用户提供相应工作模式下的服务操作,包括:
    进入所述陪伴工作模式,利用所述图像采集装置采集所述目标用户的 第二图像;
    根据第二图像确定所述目标用户的移动路径;
    获取所述移动路径上阻碍所述移动服务设备的路障信息;
    根据所述移动服务设备的移动特性及所述路障信息,规划所述移动服务设备的跟随参数,其中,所述跟随参数至少包括跟随路径;
    基于所述跟随参数移动,提供所述陪伴工作模式下的陪伴服务。
  4. 根据权利要求2所述的方法,其中,所述确定的与所述服务需求信息相匹配的服务工作模式为引导工作模式,
    所述进入服务工作模式,并为所述目标用户提供相应工作模式下的服务操作,包括:
    进入所述引导工作模式,确定所述目标用户期望前往的目标位置;
    根据所述目标位置以及所述移动服务设备当前所处位置,规划所述移动服务设备从所述当前所处位置移动到所述目标位置的引导参数,所述引导参数至少包括引导路径;
    按照所述引导参数移动到所述目标位置,并引导所述目标用户跟随所述移动服务设备前往所述目标位置。
  5. 根据权利要求1所述的方法,其中,所述方法还包括:
    获取所述目标用户的待支付清单;
    将所述待支付清单发送给目标用户的用户终端;
    接收所述用户终端基于所述待支付清单发送的支付信息;
    根据所述支付信息向目标账户请求支付。
  6. 根据权利要求1所述的方法,其中,所述方法还包括:
    接收信息查询请求;
    根据所述查询请求查询预定数据库,获得与所述查询请求相适配的查询结果;输出所述查询结果或根据所述查询结果提供对应地服务操作。
  7. 一种服务提供装置,应用于移动服务设备中,所述移动服务设备具备驱动装置,所述驱动装置用于为所述移动服务设备提供移动的驱动力,所述移动服务设备还具备图像采集装置,所述移动服务设备具有至少两种不同的服务工作模式,所述装置包括:
    采集单元,配置为基于所述图像采集装置采集获取第一图像;
    识别单元,配置为识别所述第一图像,确定需要提供移动服务的目标用户;
    移动单元,配置为根据所述目标用户所在的第一位置移动到第二位置,其中,所述第二位置位于所述第一位置的第一距离范围内;
    确定单元,配置为获得服务需求信息,并确定与所述服务需求信息相匹配的服务工作模式;
    执行单元,配置为进入确定的所述服务工作模式,并为所述目标用户提供进入的所述服务工作模式下的服务操作。
  8. 根据权利要求7所述的装置,其中,
    所述确定单元,配置为采集所述目标用户的语音,对采集所得语音进行语义分析,提取获得相应的服务需求信息,并根据所述服务需求信息查询预设的服务工作模式,获得与所述服务需求信息匹配的服务工作模式。
  9. 根据权利要求8所述的装置,其中,所述确定的与所述服务需求信息相匹配的服务工作模式为陪伴工作模式,
    所述执行单元,配置为进入所述陪伴工作模式,利用所述图像采集装置采集所述目标用户的第二图像;根据第二图像确定所述目标用户的移动路径;获取所述移动路径上阻碍所述移动服务设备的路障信息;根据所述移动服务设备的移动特性及所述路障信息,规划所述移动服务设备的跟随参数,其中,所述跟随参数至少包括跟随路径;基于所述跟随参数移动,提供所述陪伴工作模式下的陪伴服务。
  10. 根据权利要求8所述的装置,其中,所述确定的与所述服务需求信息相匹配的服务工作模式为引导工作模式,
    所述执行单元,配置为进入所述引导工作模式,确定所述目标用户期望前往的目标位置;根据所述目标位置以及所述移动服务设备当前所处位置,规划所述移动服务设备从所述当前所处位置移动到所述目标位置的引导参数,所述引导参数至少包括引导路径;按照所述引导参数移动到所述目标位置,并引导所述目标用户跟随所述移动服务设备前往所述目标位置。
  11. 根据权利要求7所述的装置,其中,所述装置还包括:
    获取单元,配置为获取所述目标用户的待支付清单;
    第一发送单元,配置为将所述待支付清单发送给目标用户的用户终端;
    第一接收单元,配置为接收所述用户终端基于所述待支付清单发送的支付信息;
    请求单元,配置为根据所述支付信息向目标账户请求支付。
  12. 根据权利要求7所述的装置,其中,所述装置还包括:
    第二接收单元,配置为接收信息查询请求;
    查询单元,配置为根据所述查询请求查询预定数据库,获得与所述查询请求相适配的查询结果;
    所述执行单元,还配置为输出所述查询结果或根据所述查询结果提供对应地服务操作。
  13. 一种计算机存储介质,所述计算机存储介质存储有计算机可执行代码,所述计算机可执行代码被执行后,能够实现权利要求1至6任一项提供的服务提供方法。
  14. 一种移动服务设备,包括:移动装置,配置为移动所述移动服务设备;
    驱动装置,与所述移动装置连接,配置为向所述移动装置提供移动的驱动力;
    图像采集装置,配置为采集图像;
    处理装置,包括至少一个处理器,与所述图像采集装置、驱动装置及所述驱动装置连接,配置为通过执行计算机可执行代码,实现权利要求1至6任一项提供的服务提供方法。
PCT/CN2017/116221 2016-12-26 2017-12-14 服务提供方法及装置、移动服务设备及存储介质 WO2018121283A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201611219961.7 2016-12-26
CN201611219961.7A CN108242007B (zh) 2016-12-26 2016-12-26 服务提供方法及装置

Publications (1)

Publication Number Publication Date
WO2018121283A1 true WO2018121283A1 (zh) 2018-07-05

Family

ID=62702113

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2017/116221 WO2018121283A1 (zh) 2016-12-26 2017-12-14 服务提供方法及装置、移动服务设备及存储介质

Country Status (2)

Country Link
CN (1) CN108242007B (zh)
WO (1) WO2018121283A1 (zh)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110111136A (zh) * 2019-04-12 2019-08-09 平安科技(深圳)有限公司 视频数据处理方法、装置、计算机设备和存储介质
CN110865644A (zh) * 2019-11-27 2020-03-06 中国银行股份有限公司 机器人移动方法及装置
CN112233349A (zh) * 2020-09-08 2021-01-15 福建升腾资讯有限公司 一种智能刷脸终端语音报警方法、系统、设备和介质
CN113805512A (zh) * 2021-09-16 2021-12-17 上海擎朗智能科技有限公司 穿戴设备的控制方法、装置及存储介质

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108969858B (zh) * 2018-08-08 2021-04-06 贵州中医药大学 一种全自动送氧机器人上氧方法及系统
CN110109479A (zh) * 2019-04-24 2019-08-09 北京百度网讯科技有限公司 导航处理方法、装置、智能机器人及计算机可读存储介质
CN110058609A (zh) * 2019-04-29 2019-07-26 北京金山云网络技术有限公司 一种雨伞共享系统和方法
CN110766717B (zh) * 2019-09-02 2022-06-24 广东天波信息技术股份有限公司 一种基于图像识别的跟随服务方法及装置
CN113129047A (zh) * 2019-12-31 2021-07-16 上海依图信息技术有限公司 自动扶梯机器人的广告投放方法及装置
CN113126520A (zh) * 2019-12-31 2021-07-16 上海依图信息技术有限公司 自动扶梯安全机器人的控制方法及自动扶梯安全机器人
CN111309230B (zh) * 2020-02-19 2021-12-17 北京声智科技有限公司 信息展示方法、装置、电子设备及计算机可读存储介质
CN112104962B (zh) * 2020-10-30 2021-03-23 北京声智科技有限公司 一种基于图像识别的跟随式机器人扩声方法及扩声系统
CN112783177A (zh) * 2021-01-28 2021-05-11 谈斯聪 一种室内外移动机器人、车体两用装置、管理系统及方法

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080025387A1 (en) * 2006-07-26 2008-01-31 Eul Gyoon Lim Intelligent moving robot based network communication capable of outputting/transmitting images selectively according to moving of photographed object
CN204462847U (zh) * 2014-12-28 2015-07-08 青岛通产软件科技有限公司 一种多功能酒店服务机器人
CN105701447A (zh) * 2015-12-30 2016-06-22 上海智臻智能网络科技股份有限公司 迎宾机器人
CN105798916A (zh) * 2016-03-31 2016-07-27 深圳市金乐智能健康科技有限公司 一种智能护理机器人控制方法及系统
CN106095115A (zh) * 2016-06-30 2016-11-09 北京智能管家科技有限公司 一种应用程序调度处理方法及装置

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3553373B2 (ja) * 1998-06-05 2004-08-11 財団法人鉄道総合技術研究所 局所的行動予測に基づく視覚障害者用誘導案内システム
JP4247041B2 (ja) * 2003-04-01 2009-04-02 本田技研工業株式会社 顔識別システム
JP2005135093A (ja) * 2003-10-29 2005-05-26 Fujitsu Ltd 電子決済支援システムおよび電子決済支援装置
JP4379616B2 (ja) * 2005-03-01 2009-12-09 株式会社国際電気通信基礎技術研究所 モーションキャプチャデータ補正装置、マルチモーダルコーパス作成システム、画像合成装置、及びコンピュータプログラム
JP2010049415A (ja) * 2008-08-20 2010-03-04 Sony Corp 商品販売システム
CN101866215B (zh) * 2010-04-20 2013-10-16 复旦大学 在视频监控中采用视线跟踪的人机交互装置和方法
CN102456194A (zh) * 2010-10-27 2012-05-16 中国移动通信集团公司 一种远程支付的方法、系统、终端和服务器
CN102289556A (zh) * 2011-05-13 2011-12-21 郑正耀 一种超市购物助手机器人
CN102393739B (zh) * 2011-05-27 2014-12-03 严海蓉 智能手推车及其应用方法
JP2016177393A (ja) * 2015-03-19 2016-10-06 カシオ計算機株式会社 情報処理装置、顔認識方法、及びプログラム
CN104820943A (zh) * 2015-03-27 2015-08-05 嘉兴市德宝威微电子有限公司 购物机器人
CN204890818U (zh) * 2015-06-02 2015-12-23 陈琨 输液调速参考器
CN105116994B (zh) * 2015-07-07 2019-05-31 百度在线网络技术(北京)有限公司 基于人工智能的智能机器人追踪方法和追踪装置
CN105744057B (zh) * 2016-01-21 2019-02-22 平安科技(深圳)有限公司 一种智能语音对话交互方法和装置
CN105867433A (zh) * 2016-03-31 2016-08-17 纳恩博(北京)科技有限公司 一种移动控制方法、移动电子设备及移动控制系统
CN105955267A (zh) * 2016-05-11 2016-09-21 上海慧流云计算科技有限公司 一种移动控制方法及系统
CN105929827B (zh) * 2016-05-20 2020-03-10 北京地平线机器人技术研发有限公司 移动机器人及其定位方法
CN106095099B (zh) * 2016-06-12 2018-11-02 南京邮电大学 一种用户行为动作检测识别方法
CN106157471A (zh) * 2016-06-17 2016-11-23 广州信聚丰信息科技有限公司 智能门店用消费者行为可引导化导购及快速结算系统
CN106210511A (zh) * 2016-06-30 2016-12-07 纳恩博(北京)科技有限公司 一种定位用户的方法和装置

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20080025387A1 (en) * 2006-07-26 2008-01-31 Eul Gyoon Lim Intelligent moving robot based network communication capable of outputting/transmitting images selectively according to moving of photographed object
CN204462847U (zh) * 2014-12-28 2015-07-08 青岛通产软件科技有限公司 一种多功能酒店服务机器人
CN105701447A (zh) * 2015-12-30 2016-06-22 上海智臻智能网络科技股份有限公司 迎宾机器人
CN105798916A (zh) * 2016-03-31 2016-07-27 深圳市金乐智能健康科技有限公司 一种智能护理机器人控制方法及系统
CN106095115A (zh) * 2016-06-30 2016-11-09 北京智能管家科技有限公司 一种应用程序调度处理方法及装置

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110111136A (zh) * 2019-04-12 2019-08-09 平安科技(深圳)有限公司 视频数据处理方法、装置、计算机设备和存储介质
CN110111136B (zh) * 2019-04-12 2023-04-18 平安科技(深圳)有限公司 视频数据处理方法、装置、计算机设备和存储介质
CN110865644A (zh) * 2019-11-27 2020-03-06 中国银行股份有限公司 机器人移动方法及装置
CN112233349A (zh) * 2020-09-08 2021-01-15 福建升腾资讯有限公司 一种智能刷脸终端语音报警方法、系统、设备和介质
CN113805512A (zh) * 2021-09-16 2021-12-17 上海擎朗智能科技有限公司 穿戴设备的控制方法、装置及存储介质
CN113805512B (zh) * 2021-09-16 2023-08-15 上海擎朗智能科技有限公司 穿戴设备的控制方法、装置及存储介质

Also Published As

Publication number Publication date
CN108242007B (zh) 2022-01-25
CN108242007A (zh) 2018-07-03

Similar Documents

Publication Publication Date Title
WO2018121283A1 (zh) 服务提供方法及装置、移动服务设备及存储介质
US9796093B2 (en) Customer service robot and related systems and methods
US10311400B2 (en) Intelligent service robot and related systems and methods
US10088846B2 (en) System and method for intended passenger detection
US9355368B2 (en) Computer-based method and system for providing active and automatic personal assistance using a robotic device/platform
US10024667B2 (en) Wearable earpiece for providing social and environmental awareness
Lin et al. Deep learning based wearable assistive system for visually impaired people
US10024678B2 (en) Wearable clip for providing social and environmental awareness
US10024679B2 (en) Smart necklace with stereo vision and onboard processing
US9922236B2 (en) Wearable eyeglasses for providing social and environmental awareness
US11341355B2 (en) Robot and method of controlling the same
US20160025499A1 (en) Intelligent mobility aid device and method of navigating and providing assistance to a user thereof
US10248856B2 (en) Smart necklace with stereo vision and onboard processing
US10902263B1 (en) Image processing system for object identification
CN109703607A (zh) 一种智能行李车
EP4350296A1 (en) Inconvenience for passenger pickups and drop offs for autonomous vehicles
EP3549045A1 (en) Intelligent service robot and related systems and methods
JP7180613B2 (ja) 情報処理装置および情報処理方法
JP2017007033A (ja) ロボット
KR20180040907A (ko) 공항 로봇
KR102599784B1 (ko) 공항 로봇
KR20180074404A (ko) 공항용 로봇 및 그의 동작 방법
US11766779B2 (en) Mobile robot for recognizing queue and operating method of mobile robot
Raj et al. Ocularone: Exploring drones-based assistive technologies for the visually impaired
CN210757755U (zh) 慈善募捐机器人

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17889453

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17889453

Country of ref document: EP

Kind code of ref document: A1