WO2021213457A1 - 数据处理方法、系统、空间及设备 - Google Patents
数据处理方法、系统、空间及设备 Download PDFInfo
- Publication number
- WO2021213457A1 WO2021213457A1 PCT/CN2021/088872 CN2021088872W WO2021213457A1 WO 2021213457 A1 WO2021213457 A1 WO 2021213457A1 CN 2021088872 W CN2021088872 W CN 2021088872W WO 2021213457 A1 WO2021213457 A1 WO 2021213457A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- target object
- user
- display
- space
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
- G06Q30/0643—Graphical representation of items or shoppers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/02—Marketing; Price estimation or determination; Fundraising
- G06Q30/0282—Rating or review of business operators or products
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0623—Item investigation
Definitions
- This application relates to the field of computer technology, in particular to a data processing method, system, space and equipment.
- this application is proposed to provide a data processing method, system, space and equipment that solves the above-mentioned problems or at least partially solves the above-mentioned problems.
- a data processing method includes:
- the interface elements corresponding to at least part of the at least one user are displayed in the image.
- a data processing method includes:
- the relevant information of the at least one user is fed back to the client, so as to display the interface elements corresponding to at least part of the at least one user in the image displayed by the client.
- a data processing method includes:
- the display content in the image is determined.
- a data processing system in another embodiment, includes:
- the displayed content is sent to at least one client that displays the image, so that the received client displays the displayed content in the displayed image.
- a data processing system includes:
- the client is used to display an image of a space; obtain relevant information of at least one user viewing the image on the network side; and display at least part of the at least one user in the image according to the relevant information of the at least one user User interface elements corresponding;
- the server is used to receive the data request sent by the client for an image; obtain the relevant information of at least one user viewing the image; and feed back the relevant information of the at least one user to the client, so that the client
- the image displayed on the terminal displays interface elements corresponding to at least some of the at least one user.
- a data processing system includes:
- Client used to display an image of a space
- the server is used to obtain data information of at least one target object in the image; determine the display content in the image according to the data information; send the display content to at least one client that displays the image, so that The received client displays the display content in the displayed image;
- the client is also used to receive the display content fed back by the server, and display the display content in the image.
- This space includes:
- the first collection device is arranged in the space and is used to collect first data information related to at least one target object; send the first data information to the server; so that the server can, according to the first data, Determine the display content that needs to be displayed in the image corresponding to the space;
- the second collection device is set in the space and is used to collect three-dimensional panoramic data of the space, and send the three-dimensional panoramic data to the server; so that the server generates the three-dimensional panoramic data according to the three-dimensional panoramic data. And obtain relevant information of at least one user viewing the image, and feed the relevant information of the at least one user to at least one client.
- a client device in another embodiment, includes: a memory, a processor, and a display, where:
- the memory is used to store programs
- the processor is coupled with the memory, and is configured to execute the program stored in the memory for:
- the interface elements corresponding to at least part of the at least one user are displayed in the image.
- a server device in another embodiment of the present application, includes: a memory and a processor, among which,
- the memory is used to store programs
- the processor is coupled with the memory, and is configured to execute the program stored in the memory for:
- the relevant information of the at least one user is fed back to the client, so as to display the interface elements corresponding to at least part of the at least one user in the image displayed by the client.
- a client device in another embodiment, includes: a memory, a processor, and a display, where:
- the memory is used to store programs
- the processor is coupled with the memory, and is configured to execute the program stored in the memory for:
- the display content in the image is determined.
- the technical solutions provided by the embodiments of the present application can obtain real-time related information of at least one user viewing the image on the network side while displaying an image of a space, so as to determine the at least one user based on the related information of the at least one user.
- the interface elements displayed in the image corresponding to at least some users of a user facilitate interaction between users (such as consumers) and improve user satisfaction.
- the determined data information of at least one target object in the image can also be obtained, and the display content of the image will be determined based on the data information, so as to facilitate the display of the display content in the image.
- By displaying it is convenient for users (such as merchants) to view the data information changes of the target object in real time, and make adjustments to the target object in time.
- FIG. 1 is a schematic flowchart of a data processing method provided by an embodiment of this application
- Figure 2a is a partial image provided by an embodiment of this application.
- Figure 2b is a schematic diagram of a spatial location provided by an embodiment of the application.
- FIG. 3 is a schematic diagram of image content display in an image provided by an embodiment of the application.
- FIG. 5a is a schematic flowchart of a data processing method provided by another embodiment of this application.
- FIG. 5b is a schematic diagram of a specific implementation principle of the data processing method provided by an embodiment of the application in a specific application scenario
- FIG. 5c is a schematic diagram of a specific flow of the data processing method provided by an embodiment of the application in an application scenario
- FIG. 6 is a schematic flowchart of a data processing system provided by an embodiment of this application.
- FIG. 7 is a structural block diagram of a data processing system provided by an embodiment of this application.
- FIG. 8 is a structural block diagram of a data processing system provided by another embodiment of this application.
- FIG. 9 is a structural block diagram of a space provided by an embodiment of the application.
- FIG. 10 is a structural block diagram of a data processing device provided by an embodiment of this application.
- FIG. 11 is a structural block diagram of a data processing device provided by another embodiment of this application.
- FIG. 12 is a structural block diagram of a data processing device provided by another embodiment of this application.
- FIG. 13 is a structural block diagram of a device provided by an embodiment of this application.
- each embodiment of the present application is to generate corresponding images for fusing online and offline data of a space to display the interaction online in real time; wherein, the offline data of the space includes radar data and image data, which can be It is collected in real time using specific hardware equipment, for example, radar camera fusion equipment.
- the offline data of the space includes radar data and image data, which can be It is collected in real time using specific hardware equipment, for example, radar camera fusion equipment.
- Fig. 1 shows a schematic flowchart of a data processing method provided by an embodiment of the present application.
- the execution subject of this method may be a client, and the client may be any terminal device such as a mobile phone, a tablet computer, or a smart wearable device (such as a virtual reality device), which is not specifically limited in the embodiment of the present application.
- the method includes:
- the interface elements corresponding to at least part of the at least one user in the image According to the relevant information of the at least one user, display the interface elements corresponding to at least part of the at least one user in the image.
- the image can be obtained based on image data and radar data in the space; wherein, the image data can be collected by an image sensor (such as a panoramic camera), and the radar data can be obtained by radar, such as lidar, etc. Scan and measure the same space area.
- the three-dimensional information of a space ie radar data or point cloud data
- the surface texture information of the space that is, the panoramic picture (or image data) is collected by the image sensor
- the point cloud data By performing data fusion processing on the panoramic picture, the picture information after the fusion of the two can be obtained, that is, a panoramic picture containing three-dimensional information, which may also be referred to as a three-dimensional panoramic picture for short.
- the image in this embodiment may be a three-dimensional panoramic image, or a three-dimensional scene image generated based on the three-dimensional information of the space.
- the image is consistent with the corresponding position and size of the space in reality, and the image is intuitive and contains a wealth of information. It can be published to the user-side and/or merchant-side client for display for users and/or merchants to browse Check.
- the image can also be a two-dimensional photo of the space, or a video image of the space, and so on.
- the server communicating with the user-side client can obtain the relevant information of these users, so as to display the relevant information on the image middle.
- a feasible solution for the aforementioned 102 "obtain information about at least one user who viewed the image on the network side" is: obtain at least one client that displays the image on the network side; and obtain information related to the at least one client Information about at least one associated user.
- the server may obtain at least one client that displays the image on the network side according to the client IP address, and then obtain the relevant information of the at least one user according to the association relationship between the user and the at least one client;
- the server can be a common server, a cloud or a virtual server, etc., which is not specifically limited in the embodiment of the present application;
- the client has an APP application or related website that displays the image function.
- the space corresponding to the image is a three-dimensional panoramic view of a certain shopping mall scene, it can be displayed in an online store of the shopping mall.
- the online store may be a shopping APP owned by the shopping mall.
- It can also be a store set up on an e-commerce platform, or the store’s official website on the Internet, etc.
- One of the possible implementations of 103 “displaying the interface elements corresponding to at least part of the at least one user in the image according to the relevant information of the at least one user” is: acquiring the image displayed on the interface The first spatial position corresponding to the partial image; according to the relevant information of the at least one user, a target user whose spatial position is within the target area is acquired from the at least one user; wherein the target area is determined by the first spatial position OK; In the partial image, the interface element corresponding to the target user is displayed.
- the image of the space can be displayed on the display interface. It is only a partial image; the user can use touch, mouse, etc. to perform corresponding operations on the interface to display other hidden partial images of the image in the interface. The user can browse through the entire image of the space through continuous operations.
- the user may only be interested in the image content (such as a display) in a certain partial image in the image.
- the partial image will be displayed on the client interface;
- the corresponding first spatial position can be obtained based on the partial image, and the target user whose spatial position is within the target area among the at least one user can be determined according to the obtained relevant information of the at least one user, where the target area is determined by The first spatial location is determined. For example, taking the first spatial position as the center and a radius of m meters (for example, 2 meters, 5 meters, etc., which are not specifically limited in this embodiment), or a rule centered on the first spatial position (such as square) or irregularly shaped areas, etc.
- the interface element corresponding to the target user is displayed in the partial image.
- the interface element corresponding to the target user displayed on the partial image 100' may include at least one of the following: user Avatar, user nickname, user input content (such as evaluation of a certain product).
- the content input by the user may be the content about the shopping mood published by the user when shopping, for example, referring to Figure 2b, the user b has purchased a product in the partial image 100 and published the evaluation content of the product. "The quality of this computer is so real, it doesn't freeze at all.".
- the related information includes at least one of the following: a user identification, a user avatar, user input information, and a second spatial location of the user.
- the above “displaying the interface element corresponding to the first user in the image according to the relevant information of the first user among the at least one user” may specifically include:
- the first user may be an online user who has APP software or a website that displays the image on the client to view the image; the second spatial location is when the first user is viewing the image
- the aforementioned "determining the interface display position based on the second spatial position of the first user" may specifically include: determining the position information of the second spatial position relative to the first spatial position; Information, determine the location of the interface display.
- the interface element corresponding to at least one of the user identification, user avatar, and user input information of the first user may be displayed at the interface display position.
- the user ID is the login ID of the current user who has the APP application or website displaying the image on the client by logging in, and will be used to uniquely identify the user identity in the account system of the APP application or website displaying the image .
- the login identifier may be obtained by the user through registration in an APP application or website, or an identifier that belongs to another application and can be used to log in to the APP application or website, or may be an instant messaging tool The identifiers that can be used to log in to the APP or website will not be listed here.
- the method provided in this embodiment may further include the following steps:
- the spatial structure model diagram may be a top view 11 of the spatial structure of the space, or may be a three-dimensional scene diagram 12 of the space.
- the user can click on the "3D scene" control in Figure 2a to switch to the three-dimensional scene graph that displays the space. Displaying the graphic elements representing the first spatial position where the user is currently located in the spatial structure model can enable the user to understand the spatial position of the current partial image corresponding to the overall spatial structure model in the process of browsing the image , Can guide the user's subsequent browsing direction.
- the method provided in this embodiment may further include at least one of the following:
- the image content 13 (computer) in a partial image 100 in the image shown in FIG. 2a
- the image content 13 associated with the image content 13 is displayed on the client interface
- the first display content such as price, brand model, etc.
- Part of the information related to the image content can be displayed in the first display content, and the user can enter the detailed interface corresponding to the image content by operating the operable elements in the first display content.
- the image content is a computer in the partial image 100
- the client sends the user's request information to the server
- the server responds to the user's request Operation
- part of the information of the computer 13 that is, the first display content 200
- This part of the information includes part of the introduction and price of the computer 13.
- the third display content associated with the image may be the product associated with the product quantity display module and related information of the product.
- the number of commodities contained in the partial scene displayed in the commodity quantity display module 14 is 3, and the commodities associated with the commodity quantity display module are wine cabinets, gauze curtains, and goblet
- the user clicks on the The product quantity display module 14 will display the third display content 400 on the interface.
- the third display content 400 specifically displays the relevant information of the product, that is, the wine cabinet, the gauze curtain, and the goblet.
- the user can also purchase goods through the third display content 400.
- the method provided in this embodiment may further include the following steps:
- the image content may be a system default content.
- the image content when the image corresponds to a shopping mall monitoring scene, the image content may be a target person or a display item in a store; in a home monitoring scene, the image content may be a target person.
- the recognition of the image content in the image can be completed by using existing image recognition technology, for example, machine learning technology (such as deep learning technology) can be used to complete the recognition of the image content to obtain the recognition result.
- machine learning technology such as deep learning technology
- the partial image 100 is input into the pre-trained deep learning network model, and according to the output result of the deep learning network model,
- the content contained in the partial image 100 is determined, such as the target person, the display item, and so on.
- the existing technologies please refer to the existing technologies, which will not be repeated here.
- An achievable solution of 105b "determine at least one target object based on the recognition result" is: in response to a user's operation on a target image content in the image, the recognition result corresponding to the target image content is taken as the target object .
- the recognition result corresponding to the target image content that is, a computer, can be used as the target object.
- the above 105c "obtain the data information of the at least one target object" may include at least one of the following:
- A1. Acquire first data information related to the at least one target object by deploying at least one first collection device in the space;
- A2 Obtain the second data information related to the at least one target object from a local or a server.
- the first collection device can be a camera, such as a panoramic camera;
- the target object can be any form of object, such as people, animals, display items, etc.; using the first collection device (such as a panoramic camera) )
- the dynamic information of people and/or animals and the image information of the displayed items can be collected.
- the target object is a person
- the second data information related to the at least one target object obtained from the local or server side such as the user's historical purchase products, user preferences , The user's more personalized information, etc.
- the target object is an item
- the second data information related to the at least one target object obtained from the local or the server is the inventory quantity of the item, recent sales, etc. .
- the content shown in the above embodiments can be displayed on the client side corresponding to the merchant side and the user side at the same time.
- the server can determine the display content in the image based on the data information corresponding to the target object, and store the display content It is only sent to the merchant-side client for display on the merchant-side client.
- the display content in the image based on the data information of the people or the displayed items in the space.
- step 105d determine the display content in the image according to the data information.
- recognizing the behavior of the at least one target object is essentially extracting effective motion features from the image sequence, and then analyzing these features to determine the category of the behavior. Based on the data information corresponding to the at least one target object obtained based on the above-mentioned related content 105a to 105b, the characteristics that characterize the motion of the target object can be determined, and the motion behavior characteristics of the target object are compared with the existing behavior category through the classifier. By comparison, the classification result of the target object's behavior can be obtained.
- the detailed behavior recognition of the target object can refer to the existing technology, for example, the machine learning technology, which will not be repeated here.
- the above 105d1 “determine the display content in the image based on the result of behavior recognition” may specifically include:
- the display content is displayed in association with the image content corresponding to the target object in the image.
- the server can generate display content related to the computer and send it to the merchant-side client interface for display, which is convenient for the merchant offline, that is, in the physical store Provide services to the target object, such as introducing the computer to the target user, promotional activities, etc.; you can also understand the popularity of each product in the store through these displayed contents, and then make targeted promotional activities.
- step 105d determine the display content in the image according to the data information.
- the data information determine at least one parameter among the number of displays of the target object in the space, the number of inventory, and the amount of out of the warehouse within a preset time period;
- the display content is displayed in association with the image content corresponding to the target object in the image.
- the target object is the computer 13, when the server recognizes the content in the partial image 100, it determines a target object (that is, the computer 13) according to the recognition result. Later, data information related to the computer 13 can be obtained from the corresponding database, and the data information can include the number of displays of the computer in the space, the number of stocks in the database, and the number of stocks in the database within a preset period of time.
- the merchant-side client uses a preset position in the image for associated display, which is convenient for merchants to query data information related to the target object in real time, and adjust the target object based on this data information. For example: when it is found that the number of the target object displayed in the space is small, the merchant will be reminded to replenish; when the total inventory of the target object in the database is detected to be insufficient, the merchant can be reminded to carry out the purchase process; The merchant can determine the popularity of the commodity by referring to the amount of the target object's out of stock within the preset time period.
- the relevant information of at least one user viewing the image on the network side is obtained in real time, so as to determine the at least one user based on the relevant information of the at least one user
- the interface elements shown in the image corresponding to at least some users in the user interface facilitate interaction between users and improve user satisfaction.
- FIG. 4 shows a schematic flowchart of a data processing method provided by another embodiment of the present application.
- the execution subject of this method may be a server, and the server may be a common server, a cloud or a virtual server, etc., which is not specifically limited in the embodiment of the present application.
- the method includes:
- the method provided in this embodiment may further include the following steps:
- the second acquisition device includes a radar and a camera, where the radar may be a lidar, and the camera may be a panoramic camera.
- the second collection device can be used to collect the first collection data of a spatial area, that is, radar data and image data; and then send the collected first collection data to the communication connection with the second collection device
- the server can reconstruct an image according to the first collected data to update the previous image. In this way, when the user sends a request through the client to display the image corresponding to the space, the server can send the updated image to the client.
- the method provided in this embodiment may further include the following steps:
- the above-mentioned 205c "acquiring data information of the at least one target object" may include at least one of the following: acquiring first data information related to the at least one target object by deploying at least one first collection device in the space ; Obtain the second data information related to the at least one target object from the local or the server.
- the target object is a person in the space.
- the above “determine the display content in the image according to the data information” may specifically include:
- the above 205d2 "determine the display content in the image based on the behavior recognition result" may specifically include: determining the intent information of the target object according to the behavior recognition result; based on the intent information, generating for display in The content displayed in the image.
- the target object is an item displayed in the space.
- the above “determine the display content in the image according to the data information” may specifically include:
- the data information determine at least one parameter among the number of displays of the target object in the space, the number of inventory, and the amount of out of the warehouse within a preset time period;
- display content for display in the image is generated.
- the technical solution provided in this embodiment obtains related information of at least one user viewing the image based on a data request sent by a received client for an image, and feeds back the related information of the at least one user to the client , So as to display the interface elements corresponding to at least part of the at least one user in the image displayed by the client. Based on this, it is easy to realize mutual interaction between users, improve user experience, and thereby improve user satisfaction.
- Fig. 5a shows a schematic flowchart of a data processing method provided by another embodiment of the present application.
- the execution subject of this method may be a client, such as a merchant-side client; the client may be any terminal device such as a mobile phone, a tablet computer, or a smart wearable device, which is not specifically limited in the embodiment of the present application.
- the method includes:
- the above 302 "determine at least one target object in the image” may specifically include:
- the above 3022 "determine at least one target object according to the recognition result” may specifically include: in response to a user's operation on a target image content in the image, taking the recognition result corresponding to the target image content as the target object.
- the above 303 "Acquire the data information of the at least one target object” may specifically include at least one of the following: acquiring first data related to the at least one target object through at least one first collection device arranged in the space Information; Obtain the second data information related to the at least one target object from a local or a server.
- the target object is a person in the space.
- the above “determining the display content in the image based on the data information” may specifically include: recognizing the behavior of the at least one target object based on the data information; determining the behavior of the at least one target object based on the data information; The content displayed in the image.
- determining the display content in the image according to the behavior recognition result may specifically include: determining the intention information of the target object according to the behavior recognition result; generating information for display in the target object based on the intention information The display content in the image; the display content is displayed in association with the image content corresponding to the target object in the image.
- the above “determining the display content in the image based on the data information” may specifically include: determining the display quantity and inventory quantity of the target object in the space according to the data information; The display quantity and the inventory quantity are used to generate display content for display in the image; and the display content is displayed in association with the image content corresponding to the target object in the image.
- the technical solution provided by this embodiment while displaying an image of a space, acquires the determined data information of at least one target object in the image, and will determine the display in the image based on the data information. Content, so that the display content can be displayed in the image, so that users (such as merchants) can view the data information changes of the target object in real time, and make adjustments to the target object in time.
- the data processing method provided in the above embodiments can be summarized as the process shown in FIG. 5b. That is, the image sensor 504 (such as a panoramic camera) and the radar 503 perform data collection on the same spatial area 001.
- the image collected by the image sensor 504 and the radar data collected by the radar 503 are sent to the server 502 for data fusion processing, and an image of the spatial area, such as a three-dimensional panoramic image, can be obtained.
- the image is sent to the client 501 so that it can be displayed on the interface of the client 501 for the user to browse and view; at the same time, when the user is browsing the image, the server can also obtain other information on the network side.
- the relevant information of the user is sent to the client to display the relevant information in the image displayed by the client.
- the server can also identify the target object in the image, obtain data information of the target object according to the recognition result, and send the data information to the client 501. Display on an image interface displayed by the client.
- the three-dimensional reconstruction of the space is completed online to obtain the corresponding image and the image is sent to the corresponding client on the merchant side and/or the user side for display, and at the same time
- the merchant-side client it can enable the merchant to adjust product information in real time based on online and offline real-time synchronization data, while for the user-side client, it can enable the user to purchase products based on real-time visits.
- the image of the physical store is displayed on the client, the interface element corresponding to at least one user browsing the image on the network side, and one or some commodities correspond to
- the display content such as inventory, sales, etc.
- the technical solution provided in this embodiment can also be applied to a virtual decoration scene.
- businesses can use mobile data collection equipment to collect three-dimensional data from the user’s home to build a three-dimensional model image of the user’s home based on the three-dimensional spatial data of the space provided by the user; Solution, rendering a virtual decoration image of the user's home, such as a three-dimensional panoramic image.
- the user can view the virtual decoration image through the corresponding client, and can click on any product in the virtual decoration image, such as curtains, dining table, bookcase, etc., to view the detailed information of the product (such as price, product brand, material, etc.) .
- other users on the network side can also view the user's virtual decoration image through the corresponding client, and the network side user uploads an evaluation of the virtual decoration image or one or more commodities in the image.
- These evaluation information can be displayed on the virtual decoration image, so that the user can decide whether to use the plan in the virtual decoration image for decoration based on the evaluation of the network side user; for the business that provides the virtual decoration plan, it can be based on the online user’s
- the evaluation understands the preferences of most users in order to adjust the subsequent decoration plan formulation.
- FIG. 6 shows a schematic flowchart of a data processing method provided by an embodiment of the present application.
- the execution subject of the method provided in this embodiment may be a server, such as a server, a virtual server deployed on a server cluster, or a cloud computing center.
- the data processing method includes:
- the target object may be a person in the space or an item displayed in the space.
- the “acquiring data information of at least one target object in an image” may include at least one of the following:
- the target object is a person in the space; correspondingly, the above-mentioned 402 "determine the display content in the image according to the data information" may specifically include: According to the data information, the behavior of the at least one target object is recognized; and the display content in the image is determined according to the behavior recognition result.
- the above "determine the display content in the image according to the result of behavior recognition” may specifically include:
- the display content is displayed in association with the image content corresponding to the target object in the image.
- the target object is an item displayed in the space; correspondingly, the above 402 "determine the display content in the image according to the data information" may specifically include : Determine the display quantity and inventory quantity of the target object in the space according to the data information; generate the display content for display in the image according to the display quantity and the inventory quantity; The display content is displayed in association with the image content corresponding to the target object in the image.
- the technical solution provided by this embodiment sends the displayed content in the image determined based on the data information of at least one target object in the image to at least one client that displays the image, so as to facilitate the received
- the client displays the displayed content in the displayed image, which can facilitate the user (such as a merchant) to view the changes in the data information of the target object in real time, and make adjustments to the target object in time.
- FIG. 7 shows a structural block diagram of a data processing system provided by an embodiment of the present application.
- the data processing system includes:
- the client 501 is configured to display an image of a space; obtain relevant information of at least one user who views the image on the network side; according to the relevant information of the at least one user, display in the image at least one of the at least one user Interface elements corresponding to some users;
- the server 502 is configured to receive a data request sent by the client for an image; obtain relevant information of at least one user viewing the image; and feed back the relevant information of the at least one user to the client, so that the The image displayed by the client displays interface elements corresponding to at least some of the at least one user.
- system provided in this embodiment may further include:
- the second collection device 5031 is configured to collect three-dimensional panoramic data of the space, and send the three-dimensional panoramic data to the server;
- the server 502 is configured to generate the image based on the three-dimensional panoramic data.
- system provided in this embodiment may further include:
- the first collection device 5041 is configured to collect first data information related to at least one target object; send the first data information to the server;
- the server 502 is used to determine the display content in the image according to the first data information and the second data information; wherein, the second data information is that the server is from the local or network side Information related to at least one target object acquired by the device.
- the technical solution provided in this embodiment obtains related information of at least one user viewing the image based on a data request sent by a received client for an image, and feeds back the related information of the at least one user to the client , So as to display the interface elements corresponding to at least part of the at least one user in the image displayed by the client. Based on this, it is easy to realize mutual interaction between users, improve user experience, and thereby improve user satisfaction.
- Fig. 8 shows a structural block diagram of a data processing system provided by another embodiment of the present application. As shown in Figure 8, the data processing system includes:
- the client 501 is used to display an image of a space
- the server 502 is configured to obtain data information of at least one target object in the image; determine the display content in the image according to the data information; send the display content to at least one client that displays the image;
- the client 501 is also used to receive the display content fed back by the server 502, and display the display content in the image.
- the determined data information of at least one target object in the image is acquired through the server, and the determined data information will be determined based on the data information.
- the displayed content of is sent to the client for display in the image displayed by the client, so that it is convenient for users (such as merchants) to view the data information changes of the target object in real time, and make adjustments to the target object in time.
- Fig. 9 shows a structural block diagram of a space provided by an embodiment of the present application. As shown in Figure 9, the space includes:
- the first collection device 5041 is set in the space, and is used to collect first data information related to at least one target object; send the first data information to the server; so that the server can use the first data To determine the display content to be displayed in the image corresponding to the space;
- the second collection device 5031 is arranged in the space, and is used to collect three-dimensional panoramic data of the space, and send the three-dimensional panoramic data to the server; so that the server generates all the data according to the three-dimensional panoramic data. And obtain the relevant information of at least one user viewing the image, and feed back the relevant information of the at least one user to at least one client.
- the technical solution provided by this embodiment can realize real-time collection of the spatial data by arranging the first collection device and the first collection device in the space; timely sending the collected data information to the server can be effectively realized Image update processing.
- the technical solutions provided by the embodiments of the present application can be applied to a variety of application scenarios, such as indoor monitoring of homes, shopping malls, museums, etc., and outdoor monitoring of tourist attractions, streets, and the like.
- the foregoing embodiments are correspondingly described in combination with a shopping mall space scene.
- the technical solutions provided in the embodiments of the present application will be described below in combination with home application scenarios.
- Fig. 10 shows a structural block diagram of a data processing device provided by an embodiment of the present application.
- the data processing device includes: a display module 801, an acquisition module 802, and a display module 803; among them,
- the display module 801 is used to display an image of a space
- the obtaining module 802 is configured to obtain relevant information of at least one user who views the image on the network side;
- the display module 803 is configured to display interface elements corresponding to at least part of the at least one user in the image according to the relevant information of the at least one user.
- the relevant information of at least one user viewing the image on the network side is obtained in real time, so as to determine the at least one user based on the relevant information of the at least one user
- the interface elements shown in the image corresponding to at least some users in the user interface facilitate interaction between users and improve user satisfaction.
- the obtaining module 802 is specifically configured to:
- the display module 803 is specifically used for:
- the interface element corresponding to the target user is displayed.
- the related information includes at least one of the following: user identification, user avatar, user input information, and user's second spatial location.
- the display module 803 is further specifically configured to: determine the interface display position according to the second spatial position of the first user; at the interface display position, display the user identification of the first user, the user Interface element corresponding to at least one of the avatar and user input information.
- the display module 803 is further configured to: determine the orientation information of the second spatial position relative to the first spatial position; and determine the interface display position according to the orientation information.
- the display module 803 is further specifically configured to: display the spatial structure model diagram corresponding to the image; map the first spatial position to the spatial structure model diagram to obtain the corresponding mark position; Describe the position of the mark, and display the map element.
- the data processing device provided in this embodiment further includes: a response module 804, which is configured to display information associated with the image content in response to a user's operation on an image content in the image The first display content; or/and in response to the user's operation on the operable interface elements displayed on the interface where the image is located, display the second display content associated with the image.
- a response module 804 which is configured to display information associated with the image content in response to a user's operation on an image content in the image The first display content; or/and in response to the user's operation on the operable interface elements displayed on the interface where the image is located, display the second display content associated with the image.
- the data processing device provided in this embodiment further includes: an identification module 805, and the identification module 805 is specifically configured to: identify the image content in the image to obtain an identification result; according to the identification result, determine at least one Target object; acquiring data information of the at least one target object; determining the display content in the image according to the data information.
- the recognition module 805 is further specifically configured to respond to a user's operation on a target image content in the image, and use the recognition result corresponding to the target image content as a target object.
- the identification module 805 is further specifically configured to: obtain the first data information related to the at least one target object through at least one first collection device arranged in the space; Second data information related to at least one target object.
- the target object is a person in the space.
- the recognition module 804 is further specifically configured to: recognize the behavior of the at least one target object based on the data information; and determine the display content in the image according to the behavior recognition result.
- the recognition module 805 is further specifically configured to: determine the intention information of the target object according to the behavior recognition result; and generate display content for display in the image based on the intention information.
- the display module 801 is further configured to display the display content in association with the image content corresponding to the target object in the image.
- the target object is an item in the space.
- the identification module 804 is further specifically configured to determine at least one of the number of displays of the target object in the space, the number of inventory, and the amount of out of the library within a preset time period according to the data information. Parameters; according to the determined at least one parameter, generating display content for display in the image;
- the display content is displayed in association with the image content corresponding to the target object in the image.
- FIG. 11 shows a structural block diagram of a data processing device provided by another embodiment of the present application.
- the data processing device includes: a receiving module 901, an acquiring module 902, and a feedback module 903; among them,
- the receiving module 901 is configured to receive a data request sent by the client for an image
- the obtaining module 902 is configured to obtain relevant information of at least one user who views the image;
- the feedback module 903 is configured to feed back relevant information of the at least one user to the client, so as to display the interface elements corresponding to at least part of the at least one user in the image displayed by the client .
- the technical solution provided in this embodiment obtains related information of at least one user viewing the image based on a data request sent by a received client for an image, and feeds back the related information of the at least one user to the client , So as to display the interface elements corresponding to at least part of the at least one user in the image displayed by the client. Based on this, it is easy to realize mutual interaction between users, improve user experience, and thereby improve user satisfaction.
- the data processing device provided in this embodiment further includes an update module 904, and the update module 904 is specifically configured to:
- the image is updated to send the updated image to the client when the client requests to display the image corresponding to the space.
- the data processing device provided in this embodiment further includes an identification module 905, and the identification module 905 is specifically configured to:
- At least one target object is determined
- the display content is sent to at least one client that displays the image, so that the display content is displayed in the image displayed on the interface of the client.
- the obtaining module 902 is also specifically configured to:
- the target object is a person in the space.
- the recognition module 905 is further specifically configured to: recognize the behavior of the target object based on the data information; and determine the display content in the image according to the behavior recognition result.
- the recognition module 905 is further specifically configured to: determine the intent information of the target object according to the behavior recognition result; and generate display content for display in the image based on the intent information.
- the target object is an item in the space.
- the identification module 905 is further specifically configured to: determine at least one of the number of displays, the number of inventory, and the amount of stock out of the warehouse within a preset time period of the target object in the space according to the data information Parameters; according to the determined at least one parameter, generating display content for display in the image.
- Fig. 12 shows a structural block diagram of a data processing device provided by another embodiment of the present application.
- the data processing device includes: a display module 1001, a determination module 1002, and an acquisition module 1003; wherein,
- the display module 1001 is used to display an image of a space
- the determining module 1002 is configured to determine at least one target object in the image
- the acquiring module 1003 is configured to acquire data information of the at least one target object
- the determining module 1002 is further configured to determine the display content in the image according to the data information.
- the technical solution provided by this embodiment while displaying an image of a space, acquires the determined data information of at least one target object in the image, and will determine the display in the image based on the data information. Content, so that the display content can be displayed in the image, so that users (such as merchants) can view the data information changes of the target object in real time, and make adjustments to the target object in time.
- the determining module 1002 is specifically configured to: recognize the image content in the image to obtain a recognition result; and determine the at least one target object according to the recognition result.
- the determining module 1002 is further specifically configured to: in response to a user's operation on a target image content in the image, take the recognition result corresponding to the target image content as the target object.
- the acquisition module 1003 is specifically configured to: acquire first data information related to the at least one target object by deploying at least one first acquisition device in the space; or/and acquire and The second data information related to the at least one target object.
- the target object is a person in the space.
- the determining module 1002 is further specifically configured to: recognize the behavior of the at least one target object based on the data information; and determine the display content in the image according to the behavior recognition result.
- the determining module 1002 is further specifically configured to: determine the intent information of the target object according to the behavior recognition result; generate display content for display in the image based on the intent information; The display content is displayed in association with the image content corresponding to the target object in the image.
- the target object is an item in the space.
- the determining module 1002 is further specifically configured to: determine the display quantity and inventory quantity of the target object in the space according to the data information; and generate the data according to the display quantity and the inventory quantity.
- the display content displayed in the image the display content is displayed in association with the image content corresponding to the target object in the image.
- FIG. 13 shows a schematic structural diagram of a client device provided by an embodiment of the present application.
- the client device includes: a memory 1101, a processor 1102, and a display 1103.
- the memory 1101 may be configured to store other various data to support operations on the sensor. Examples of such data include instructions for any application or method operating on the sensor.
- the memory 1101 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable and Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.
- SRAM static random access memory
- EEPROM electrically erasable programmable read-only memory
- EPROM erasable and Programmable Read Only Memory
- PROM Programmable Read Only Memory
- ROM Read Only Memory
- Magnetic Memory Flash Memory
- Magnetic Disk Magnetic Disk or Opti
- the processor 1102 is coupled with the memory 1101, and is configured to execute the program stored in the memory 1101 for:
- the interface elements corresponding to at least part of the at least one user are displayed in the image.
- processor 1102 executes the program in the memory 1101, in addition to the above functions, it may also implement other functions. For details, please refer to the descriptions of the previous embodiments.
- the client device further includes: a communication component 1104, a power supply component 1105 and other components. Only part of the components are schematically shown in FIG. 13, which does not mean that the sensor only includes the components shown in FIG. 13.
- the service device includes: a memory 1101 and a processor 1102.
- the memory 1101 may be configured to store other various data to support operations on the sensor. Examples of such data include instructions for any application or method operating on the sensor.
- the memory 1101 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable and Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.
- SRAM static random access memory
- EEPROM electrically erasable programmable read-only memory
- EPROM erasable and Programmable Read Only Memory
- PROM Programmable Read Only Memory
- ROM Read Only Memory
- Magnetic Memory Flash Memory
- Magnetic Disk Magnetic Disk or Optical Disk.
- the processor 1102 is coupled with the memory 1101, and is configured to execute the program stored in the memory 1101 for:
- the relevant information of the at least one user is fed back to the client, so as to display the interface elements corresponding to at least part of the at least one user in the image displayed by the client.
- processor 1102 executes the program in the memory 1101, in addition to the above functions, it may also implement other functions. For details, please refer to the descriptions of the previous embodiments.
- the client device further includes: a communication component 1104, a power supply component 1105 and other components. Only part of the components are schematically shown in FIG. 13, which does not mean that the sensor only includes the components shown in FIG. 13.
- An embodiment of the present application further provides another client device, and the structure of the client device is similar to the above-mentioned FIG. 13.
- the client device includes: a memory 1101, a processor 1102, and a display 1103.
- the memory 1101 may be configured to store other various data to support operations on the sensor. Examples of such data include instructions for any application or method operating on the sensor.
- the memory 1101 can be implemented by any type of volatile or non-volatile storage device or their combination, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable and Programmable Read Only Memory (EPROM), Programmable Read Only Memory (PROM), Read Only Memory (ROM), Magnetic Memory, Flash Memory, Magnetic Disk or Optical Disk.
- SRAM static random access memory
- EEPROM electrically erasable programmable read-only memory
- EPROM erasable and Programmable Read Only Memory
- PROM Programmable Read Only Memory
- ROM Read Only Memory
- Magnetic Memory Flash Memory
- the processor 1102 is coupled with the memory 1101, and is configured to execute the program stored in the memory 1101 for:
- the display content in the image is determined.
- processor 1102 executes the program in the memory 1101, in addition to the above functions, it may also implement other functions. For details, please refer to the descriptions of the previous embodiments.
- the client device further includes: a communication component 1104, a power supply component 1105 and other components. Only part of the components are schematically shown in FIG. 13, which does not mean that the sensor only includes the components shown in FIG. 13.
- an embodiment of the present application also provides a computer-readable storage medium storing a computer program, which can realize the steps or functions of the data processing method provided by the foregoing embodiments when the computer program is executed by a computer.
- the device embodiments described above are merely illustrative.
- the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in One place, or it can be distributed to multiple network units.
- Some or all of the modules can be selected according to actual needs to achieve the objectives of the solutions of the embodiments. Those of ordinary skill in the art can understand and implement it without creative work.
- each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be realized by hardware.
- the above technical solution essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM/RAM, magnetic A disc, an optical disc, etc., include several instructions to make a computer device (which may be a personal computer, a server, or a network device, etc.) execute the methods described in each embodiment or some parts of the embodiment.
Landscapes
- Business, Economics & Management (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Strategic Management (AREA)
- Development Economics (AREA)
- Engineering & Computer Science (AREA)
- Economics (AREA)
- Marketing (AREA)
- Physics & Mathematics (AREA)
- General Business, Economics & Management (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Entrepreneurship & Innovation (AREA)
- Game Theory and Decision Science (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
一种数据处理方法、系统、空间及设备。其中,所述方法包括:显示一空间的图像(101);获取网络侧查看所述图像的至少一个用户的相关信息(102);根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素(103)。采用所述方法可以有效实现线上线下融合,提升用户体验。
Description
本申请要求2020年04月22日递交的申请号为202010323311.7、发明名称为“数据处理方法、系统、空间及设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及计算机技术领域,尤其涉及一种数据处理方法、系统、空间及设备。
近年来,伴随移动互联网行业的迅猛发展,线上线下融合(OMO,即Online-Merge-Offline)孕育而生,并被应用于很多行业领域,例如,商场行业领域、道路监控领域。以商场应用系统为例,在该系统中多展示出商场内所包含的商品的二维信息,且在该系统中用户之间的相互交互多为基于评论区的用户评论信息,用户体验感不够。
发明内容
鉴于上述问题,提出了本申请以提供一种解决上述问题或至少部分地解决上述问题的一种数据处理方法、系统、空间及设备。
于是,在本申请的一个实施例中,提供了一种数据处理方法。该方法,包括:
显示一空间的图像;
获取网络侧查看所述图像的至少一个用户的相关信息;
根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
在本申请的另一个实施例中,提供了一种数据处理方法。该方法包括:
接收客户端针对一图像发送的数据请求;
获取查看所述图像的至少一个用户的相关信息;
将所述至少一个用户的相关信息反馈至所述客户端,以在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
在本申请的又一个实施例中,提供了一种数据处理方法。该方法包括:
显示一空间的图像;
确定所述图像中的至少一个目标对象;
获取所述至少一个目标对象的数据信息;
根据所述数据信息,确定在所述图像中的显示内容。
在本申请的另一实施例中,提供了一种数据处理系统。该数据处理系统,包括:
获取图像中至少一个目标对象的数据信息;
根据所述数据信息,确定在所述图像中的显示内容;
将所述显示内容发送至显示所述图像的至少一个客户端,以便接收到的客户端在显示的图像中展示所述显示内容。
在本申请的又一个实施例中,提供了一种数据处理系统。该数据处理系统,包括:
客户端,用于显示一空间的图像;获取网络侧查看所述图像的至少一个用户的相关信息;根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素;
服务端,用于接收客户端针对一图像发送的数据请求;获取查看所述图像的至少一个用户的相关信息;将所述至少一个用户的相关信息反馈至所述客户端,以在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
在本申请的又一个实施例中,提供了一种数据处理系统。该数据处理系统,包括:
客户端,用于显示一空间的图像;
服务端,用于获取图像中至少一个目标对象的数据信息;根据所述数据信息,确定在所述图像中的显示内容;将所述显示内容发送至显示所述图像的至少一个客户端,以便接收到的客户端在显示的图像中展示所述显示内容;
所述客户端,还用于接收所述服务端反馈的显示内容,在所述图像中展示所述显示内容。
在本申请的另一实施例中,提供了一种空间。该空间,包括:
第一采集设备,设置在所述空间内,用于采集至少一个目标对象相关的第一数据信息;将所述第一数据信息发送至服务端;以便所述服务端根据所述第一数据,确定需在所述空间对应的图像中显示的显示内容;
第二采集设备,设置在所述空间内,用于采集所述空间的三维全景数据,将所述三维全景数据发送至所述服务端;以便所述服务端根据所述三维全景数据生成所述空间的图像,并获取查看所述图像的至少一个用户的相关信息,将所述至少一个用户的相关信息反馈至至少一个客户端。
在本申请的另一实施例中,提供了一种客户端设备。该客户端设备,包括:存储器、处理器以及显示器,其中,
所述存储器,用于存储程序;
所述处理器,与所述存储器耦合,用于执行所述存储器中存储的所述程序,以用于:
通过所述显示器显示一空间的图像;
获取网络侧查看所述图像的至少一个用户的相关信息;
根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
在本申请的另一实施例中,提供了一种服务端设备。该服务端设备,包括:存储器和处理器,其中,
所述存储器,用于存储程序;
所述处理器,与所述存储器耦合,用于执行所述存储器中存储的所述程序,以用于:
接收客户端针对一图像发送的数据请求;
获取查看所述图像的至少一个用户的相关信息;
将所述至少一个用户的相关信息反馈至所述客户端,以在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
在本申请的另一实施例中,提供了一种客户端设备。该客户端设备,包括:存储器、处理器以及显示器,其中,
所述存储器,用于存储程序;
所述处理器,与所述存储器耦合,用于执行所述存储器中存储的所述程序,以用于:
通过所述显示器显示一空间的图像;
确定所述图像中的至少一个目标对象;
获取所述至少一个目标对象的数据信息;
根据所述数据信息,确定在所述图像中的显示内容。
本申请实施例提供的技术方案,在显示一空间的图像的同时,可以实时获取网络侧查看所述图像的至少一个用户的相关信息,以基于所述至少一个用户的相关信息来确定所述至少一个用户中至少部分用户对应的在所述图像中所展示的界面元素,便于用户(如消费者)之间的交互,提高用户满意度。此外,还可以获取所确定的所述图像中的至少一个目标对象的数据信息,且将基于所述数据信息来确定在所述图像的显示内容,以便于将所述显示内容在所述图像中进行显示,这样可以方便用户(如商家)实时查看所述目标对象的数据信息变化,及时对所述目标对象作出调整。
为了更清楚地说明本申请实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要利用的附图作一简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。
图1为本申请一实施例提供的数据处理方法的流程示意图;
图2a为本申请实施例提供的一局部的图像;
图2b为本申请实施例提供的一空间位置示意图;
图3为本申请实施例提供的图像中的图像内容显示的示意图;
图4为本申请另一实施例提供的数据处理方法的流程示意图;
图5a为本申请又一实施例提供的数据处理方法的流程示意图;
图5b为本申请实施例提供的数据处理方法在具体应用场景下的具体实现原理性示意图;
图5c为本申请实施例提供的数据处理方法在一应用场景下的具体流程示意图;
图6为本申请一实施例提供的数据处理系统的流程示意图;
图7为本申请一实施例提供的数据处理系统的结构框图;
图8为本申请另一实施例提供的数据处理系统的结构框图;
图9为本申请实施例提供的一空间的结构框图;
图10为本申请一实施例提供的数据处理装置的结构框图;
图11为本申请另一实施例提供的数据处理装置的结构框图;
图12为本申请另一实施例提供的数据处理装置的结构框图;
图13为本申请一实施例提供的一设备的结构框图。
为了使本技术领域的人员更好地理解本申请方案,下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述。
在本申请的说明书、权利要求书及上述附图中描述的一些流程中,包含了按照特定顺序出现的多个操作,这些操作可以不按照其在本文中出现的顺序来执行或并行执行。操作的序号如101、102等,仅仅是用于区分各个不同的操作,序号本身不代表任何的执行顺序。另外,这些流程可以包括更多或更少的操作,并且这些操作可以按顺序执行或并行执行。需要说明的是,本文中的“第一”、“第二”等描述,是用于区分不同的消息、设备、模块等,不代表先后顺序,也不限定“第一”和“第二”是不同的类型;而本文中术语“或/和”,仅仅是一种描述关联对象的关联关系,表示可以存在三种关系,例如:A或/和B,表示可以单独存在A,同时存在A和B,单独存在B这三种情况;本文中字符“/”,一般表示前后关联对象是一种“或”关系。此外,下述的各实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。
本申请各实施例提供的技术方案是为融合一空间线上线下数据生成对应的图像,以在线上实时展示交互;其中,所述空间的线下数据包含了雷达数据和图像数据,其可以是利用具体的硬件设备实时采集而来,例如,雷达相机融合设备。通过所述图像可以完成家庭、商场等室内监控操作,同时在商场应用情景下,还可以实现用户的实时交互,提升用户购物满意度。
图1示出了本申请一实施例提供的数据处理方法的流程示意图。该方法的执行主体可以是一客户端,所述客户端可以为手机、平板电脑、智能穿戴设备(如虚拟现实设备) 等任意终端设备,本申请实施例对此不作具体限定。如图1所示,该方法包括:
101、显示一空间的图像;
102、获取网络侧查看所述图像的至少一个用户的相关信息;
103、根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
上述101中,所述图像可以基于所述空间的图像数据以及雷达数据得到;其中,所述图像数据可由图像传感器(如全景相机)采集得到,所述雷达数据可由雷达,如激光雷达等,对同一空间区域进行扫描测量得到。具体地:通过雷达扫描获取一空间的三维信息(即雷达数据或点云数据),同时利用图像传感器采集该空间的表面纹理信息,即全景图片(或图像数据);对所述点云数据及所述全景图片进行数据融合处理,便可以得到两者融合后的图片信息,即包含三维信息的全景图片,也可简称为三维全景图。本实施例中的所述图像可以是三维全景图,也可以是基于所述空间的三维信息生成的三维场景图。所述图像与现实中该空间对应的位置、尺寸一致,且图片直观、含有丰富的信息量,可将其发布至用户侧和/或商户侧客户端进行展示,以供用户和/或商户浏览查看。当然,所述图像也可以是该空间的二维的照片,还可以是空间的视频图像等等。
当某些用户通过客户端应用对所述图像进行点击查看、浏览等操作时,与用户侧客户端通信连接的服务端可以获取这些用户的相关信息,以便将所述相关信息展示于所述图像中。基于此,上述102“获取网络侧查看所述图像的至少一个用户的相关信息”的一种可实现方案为:获取网络侧展示所述图像的至少一个客户端;获取与所述至少一个客户端关联的至少一个用户的相关信息。具体实施时:所述服务端可以根据客户端IP地址获取到网络侧展示所述图像的至少一个客户端,进而根据用户与所述至少一个客户端的关联关系来得到至少一个用户的相关信息;其中,所述服务端可以是常用服务器、云端或虚拟服务器等,本申请实施例对此不作具体限定;所述客户端具有展示所述图像功能的APP应用或相关网址。举例而言,若所述图像对应的一空间为某一商场场景的三维全景图,可以在该商场的线上店铺进行展示,此时所述线上店铺可以是该商场自家所具有的购物APP,也可以是电商平台上所设有的店铺,也可以是该店铺在互联网上的官方网址等等。
上述103“根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素”的一种可实现方案为:获取所述图像在界面上展示的局部图像对应的第一空间位置;根据所述至少一个用户的相关信息,从所述至少一个用户中获取空间位置在目标区域内的目标用户;其中,所述目标区域由所述第一空间位置确定;在所述局部图像中,展示所述目标用户对应的界面元素。
这里需要说明的是:对于一些较为大的空间,比如,分为很多间或区域,或分为多层的空间来说,空间的图像,特别是三维全景图,在显示器界面上能显示出的可能只是 局部图像;用户可采用触摸、鼠标等方式在界面上进行相应操作,以在界面中显示出图像的被隐藏的其他局部图像。用户可通过不断的操作,浏览完所述空间的整个图像。
比如,用户可能只对所述图像中的某一局部图像中图像内容(如展示品)感兴趣,当用户对该局部图像进行点击浏览时,在客户端界面上将会展示出该局部图像;此时可基于局部图像获取到对应的第一空间位置,并根据得到的所述至少一个用户的相关信息来确定所述至少一个用户中空间位置在目标区域内的目标用户,其中,目标区域由第一空间位置来确定。例如,以所述第一空间位置为圆心,半径在m米(如,2米、5米等,本实施例对此不作具体限定)的区域,或者以第一空间位置为中心的一个规则(如正方形)或不规则形状的区域,等等。将所述目标用户对应的界面元素在所述局部图像中进行展示。例如,在图2b所示的显示有某店铺对应的图像中的一局部图像100’的界面,在该局部图像100’上显示的目标用户对应的界面元素可以包括如下中的至少一种:用户头像、用户昵称、用户输入的内容(如对某一商品的评价)。其中,用户输入的内容可以为用户购物时所发表的关于购物心情的内容,如:参见图2b,用户b购买了所述局部图像100中的一件商品,并发表了对该商品的评价内容“这款电脑的质量真实太好了,用起来一点也不卡顿......”。对于未发表评价的其他用户,如用户c1、用户c2等,可以只在局部图像中显示各自的头像。以此种方式,不但可以实现目标用户之间的相互交流,提高用户购买满意度,还可以使商家能够直观的了解到各商品的受欢迎程度,及时对商品做出调整。
上述103中,所述相关信息包含如下中的至少一种:用户标识、用户头像、用户输入信息、用户的第二空间位置。相应的,上述“根据所述至少一个用户中第一用户的相关信息,在所述图像中展示所述第一用户对应的界面元素”,可具体包括:
1031、根据所述第一用户的第二空间位置,确定界面显示位置;
1032、在所述界面显示位置处,显示所述第一用户的用户标识、用户头像、用户输入信息中至少一项对应的界面元素。
上述1031中,所述第一用户可以为登录客户端上具有展示所述图像的APP软件或网址等查看图像的线上用户;所述第二空间位置则为所述第一用户在浏览所述空间图像时其界面上展示的局部图像所对应的空间位置。相应地,上述“根据所述第一用户的第二空间位置,确定界面显示位置”,可具体包括:确定所述第二空间位置相对于所述第一空间位置的方位信息;根据所述方位信息,确定界面显示位置。
上述1032’中,在确定界面显示位置之后,可以在所述界面显示位置处显示所述第一用户的用户标识、用户头像、用户输入信息中至少一项对应的界面元素。其中,所述用户标识即为当前用户通过登录客户端上具有展示所述图像的APP应用或网址的登录标识,将在展示所示图像的APP应用或网址的账号体系中用来唯一标识用户身份。例如,所述登录标识可以是用户在一APP应用或网址中通过注册所得到的,也可以是属于另一 应用并且可用于进行该APP应用或网址登录的标识,还可以是某一即时通信工具且可用于该APP应用或网址登录的标识,在此不再一一进行列举。
进一步的,本实施例提供的所述方法还可包括如下步骤:
显示所述图像对应的空间结构模型图;
将所述第一空间位置,映射到所述空间结构模型图中得到对应的标记位置;
在所述标记位置,显示图元素。
具体地,参见图2a,所述空间结构模型图可以为所述空间的空间结构的俯视图11,也可以是所述空间的三维场景图12。用户可点击图2a中的“3D场景”控件,便可切换至显示所述空间的三维场景图。在所述空间结构模型中显示表征用户当前所在第一空间位置的图元素,可以使用户在浏览图像的过程中,了解到当前浏览到的局部图像对应在总体的空间结构模型图中的空间位置,可指引用户后续的浏览方向。
进一步的,本实施例提供的所述方法还可包括如下中的至少一项:
104a、响应于用户针对所述图像中一图像内容的操作,显示与所述图像内容关联的第一展示内容;
104b、响应于用户针对所述图像所在界面上显示的可操作界面元素的操作,显示与所述图像关联的第二展示内容。
举一实施例,继续参见图2a,若用户对图2a中所示图像中的一局部图像100中的图像内容13(电脑)进行操作,在客户端界面上显示与所述图像内容13关联的第一展示内容,如价格、品牌型号等等。在所述第一展示内容中可以展示与图像内容相关的部分信息,且用户通过对所述第一展示内容中的可操作元素进行操作,可以进入该图像内容对应的详情界面。例如,参见图3,若所述图像内容为局部图像100中的电脑,在用户触发对电脑图元的操作时,客户端将用户的请求信息发送至服务端,所述服务端响应用户的请求操作,将会在界面上展示出所述电脑13的部分信息(即第一展示内容200),该部分信息包含了该电脑13的部分介绍及价格,接着用户通过点击“查看详细”模块21,便可以进入该电脑购买界面300;或者,若用户对所述局部图像100的可操作元素,如在所述局部图像100中所包含的商品数量展示模块14,的点击操作,则在界面上显示与所述图像关联的第三展示内容(如展示界面400所展示的内容),所述第三展示内容可以为与所述商品数量展示模块关联的商品以及所述商品的相关信息。例如,当在所述商品数量展示模块14中显示的局部场景中所包含的商品数量为3,且与商品数量展示模块关联的商品为酒柜、纱帘以及高脚杯时,用户点击所述商品数量展示模块14,在界面上将会显示出所述第三展示内容400,在所述第三展示内容400中具体展示出了商品,即酒柜、纱帘以及高脚杯的相关信息,此外用户还可以通过所述第三展示内容400进行商品选购。
进一步的,本实施例提供的所述方法还可包括如下步骤:
105a、对图像中的图像内容进行识别,得到识别结果;
105b、根据识别结果,确定至少一个目标对象;
105c、获取所述至少一个目标对象的数据信息;
105d、根据所述数据信息,确定在所述图像中的显示内容。
上述105a中,所述图像内容可以是一个系统默认内容。例如,在所述图像对应的是商场监控场景下,所述图像内容可以是目标人员、商店内的陈列物品;在家庭监控场景下,所述图像内容可以是目标人员。而对图像中的图像内容的识别,则可以采用现有图像识别技术完成,例如:可以采用机器学习技术(如深度学习技术)完成图像内容的识别,以得到识别结果。具体地,如图2a示出的一商场对应的图像中的局部图像100,将该局部图像100输入到预先训练好的深度学习网络模型中,根据所述深度学习网络模型的输出结果,即可确定该局部图像100中所包含的内容,如目标人员、陈列物品等等。关于如何利用其它现有图像识别技术完成图像内容的识别,可参见已存在的技术,在此不再赘述。
上述105b“根据识别结果,确定至少一个目标对象”的一种可实现方案为:响应于用户在所述图像中针对一目标图像内容的操作,将所述目标图像内容对应的识别结果作为目标对象。例如,继续参见图2a,当用户对所述局部图像100中的目标图像内容13进行点击操作时,可以将目标图像内容对应的识别结果,即电脑,作为目标对象。
上述105c“获取所述至少一个目标对象的数据信息”,可包括如下中的至少一种:
A1、通过布设在空间内至少一个第一采集设备,获取与所述至少一个目标对象相关的第一数据信息;
A2、从本地或服务端获取与所述至少一个目标对象相关的第二数据信息。
上述A1中,所述第一采集设备可以为摄像头,比如全景相机;所述目标对象可以是任何形式的对象,如人、动物、陈列物品等等;利用所述第一采集设备(如全景相机)可以采集到人和/或动物的动态信息及陈列物品的图像信息。
上述A2中,例如:在商场监控场景下,若所述目标对象为人,从本地或服务端所获取的与所述至少一个目标对象相关的第二数据信息,如用户的历史购买产品、用户喜好、用户比较个性的信息等等;若所述目标对象为物品,从本地或服务端所获取的与所述至少一个目标对象相关的第二数据信息则为物品的库存数量、近期售卖情况等等。
这里需要说明的是:以上各实施例所示的内容,均可在商家侧以及用户侧所对应的客户端同时进行显示。而当所述目标对象为所述空间内的人或所述空间内的陈列物品时,服务端基于所述目标对象对应的数据信息可确定在所述图像中的显示内容,并将该显示内容仅发送至商家侧客户端以便在所述商户侧客户端进行显示。下面将详细阐述如何基于所述空间内的人或陈列物品的数据信息来确定在所述图像中的显示内容。
在一种可实现的技术方案中,若所述目标对象为在所述空间内的人。相应地,上述 步骤105d“根据所述数据信息,确定在所述图像中的显示内容”,可具体包括:
105d1、基于所述数据信息,对所述至少一个目标对象的行为进行识别;
105d2、根据行为识别结果,确定在所述图像中的显示内容。
上述105d1,对所述至少一个目标对象的行为进行识别实质上就是从图像序列中提取有效的运动特征,再对这些特征进行分析从而确定出该行为所属类别。基于上述105a至105b相关内容所得出的所述至少一个目标对象对应的数据信息,可以确定出表征所述目标对象运动的特征,通过分类器将所述目标对象运动行为特征与已有的行为类别作比较,便可得出目标对象行为的分类结果。详尽的所述目标对象的行为识别可参见已有技术,例如,机器学习技术,在此不再进行赘述。
上述105d1“据行为识别结果,确定在所述图像中的显示内容”,可具体包括:
根据所述行为识别结果,确定所述目标对象的意图信息;
基于所述意图信息,生成用于显示在所述图像中的显示内容;
将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
例如,若所述目标对象的意图信息为购买一电脑,此时服务端可以生成与该电脑相关的显示内容并将其发送至商家侧客户端界面进行显示,这样便于商家在线下即实体店铺内对该目标对象提供服务,如上前为该目标用户介绍该款电脑,促销活动等;还可通过这些显示内容了解店内各商品的受欢迎程度,进而可做出针对性的促销活动。
在另一种可实现的技术方案中,若所述目标对象为在所述空间内陈列的物品。相应地,上述步骤105d“根据所述数据信息,确定在所述图像中的显示内容”,可具体包括:
根据所述数据信息,确定所述目标对象在所述空间内的陈列数、库存数、预设时段内的出库量中的至少一项参数;
根据确定出的所述至少一项参数,生成用于显示在所述图像中的显示内容;
将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
举一具体实施例,继续参见图2a所述,若所述目标对象为电脑13,服务端在对局部图像100中的内容进行识别时,根据所述识别结果确定一目标对象(即电脑13)后,可以从对应的数据库中获取与所述电脑13相关的数据信息,该所述数据信息可以包含所述电脑在所述空间内的陈列数量、在数据库中的库存数量以及在预设时段内的出库量等等,将所述陈列数量、在数据库中的库存数量以及在预设时段内的出库量等等作为显示内容并将该显示内容发送至商户侧客户端,以在所述商户侧客户端以在所述图像中的预设位置进行关联显示,便于商家实时查询与所述目标对象相关的数据信息,基于此数据信息来对目标对象进行调整。如:在发现所述目标对象在空间内的陈列数量较少时,将提醒商家进行补货;在检测到所述目标对象在数据库总的库存数量不足时,可以提醒商家进行进货处理;根据所述目标对象的预设时段内的出库量,商家可以判定出商品的受欢迎程度。
本实施例提供的技术方案,在显示一空间的图像的同时,实时获取网络侧查看所述图像的至少一个用户的相关信息,以基于所述至少一个用户的相关信息来确定所述至少一个用户中至少部分用户对应的在所述图像中所展示的界面元素,便于用户之间的相互交互,提高用户满意度。
图4示出了本申请另一实施例提供的数据处理方法的流程示意图。该方法的执行主体可以是服务端,所述服务端可以是常用服务器、云端或虚拟服务器等,本申请实施例对此不作具体限定。如图4所示,该方法包括:
201、接收客户端针对一图像发送的数据请求;
202、获取查看所述图像的至少一个用户的相关信息;
203、将所述至少一个用户的相关信息反馈至所述客户端,以在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
上述步骤201至203的具体实现可参见上述各实施例中相应内容,在此不再赘述。
进一步的,本实施例提供的所述方法,还可包括如下步骤:
204a、接收布设在空间内的第二采集设备发送的第一采集数据;
204b、根据所述第一采集数据,更新所述图像,以在客户端请求显示所述空间对应的图像时,将更新后的所述图像发送至所述客户端。
具体实施时,所述第二采集设备包括雷达和相机,其中,所述雷达可以为激光雷达,所述相机可以为全景相机。利用所述第二采集设备便可以采集得到一空间区的第一采集数据,即雷达数据和图像数据;进而将采集到的所述第一采集数据发送至与所述第二采集设备通信连接的服务端,所述服务端根据所述第一采集数据便可重新构建一图像,以用来更新前一图像。这样当用户通过客户端发送请求显示所述空间对应的图像时,服务端便可将更新后的所述图像发送至所述客户端。
进一步的,本实施例提供的所述方法,还可包括如下步骤:
205a、对所述图像中的图像内容进行识别,得到识别结果;
205b、根据识别结果,确定至少一个目标对象;
205c、获取所述至少一个目标对象的数据信息;
205d、根据所述数据信息,确定在所述图像中的显示内容;
205e、将所述显示内容发送至展示有所述图像的至少一个客户端,以便在所述客户端界面上显示的图像中,展示所述显示内容。
上述205c“获取所述至少一个目标对象的数据信息”,可包括如下中的至少一种:通过布设在空间内至少一个第一采集设备,获取与所述至少一个目标对象相关的第一数据信息;从本地或服务端获取与所述至少一个目标对象相关的第二数据信息。
上述中,所述目标对象为在所述空间内的人。相应地,上述“根据所述数据信息,确定在所述图像中的显示内容”,可具体包括:
205d1、基于所述数据信息,对所述目标对象的行为进行识别;
205d2、根据行为识别结果,确定在所述图像中的显示内容。
上述205d2“根据行为识别结果,确定在所述图像中的显示内容”,可具体包括:根据所述行为识别结果,确定所述目标对象的意图信息;基于所述意图信息,生成用于显示在所述图像中的显示内容。
上述中,所述目标对象为在所述空间内陈列的物品。相应地,上述“根据所述数据信息,确定在所述图像中的显示内容”,可具体包括:
根据所述数据信息,确定所述目标对象在所述空间内的陈列数、库存数、预设时段内的出库量中的至少一项参数;
根据确定出的所述至少一项参数,生成用于显示在所述图像中的显示内容。
本实施例提供的技术方案,基于所接收客户端针对一图像发送的数据请求来获取查看所述图像的至少一个用户的相关信息,并将所述至少一个用户的相关信息反馈至所述客户端,以便于在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。基于此,易实现用户之间的相互交互,提升用户体验感,进而提高用户满意度。
这里需要说明的是:本申请实施例提供的所述数据处理方法中各步骤未尽详述的内容可参见上述各实施例中的相应内容,此处不再赘述。此外,本申请实施例提供的所述方法中除了上述各步骤以外,还可包括上述各实施例中其他部分或全部步骤,具体可参见上述各实施例相应内容,在此不再赘述。
图5a示出了本申请另一实施例提供的数据处理方法的流程示意图。该方法的执行主体可以是一客户端,如商家侧客户端;所述客户端可以为手机、平板电脑、智能穿戴设备等任意终端设备,本申请实施例对此不作具体限定。如图5a所示,该方法包括:
301、显示一空间的图像;
302、确定所述图像中的至少一个目标对象;
303、获取所述至少一个目标对象的数据信息;
304、根据所述数据信息,确定在所述图像中的显示内容。
上述302“确定所述图像中的至少一个目标对象”,可具体包括:
3021、对图像中的图像内容进行识别,得到识别结果;
3022、根据识别结果,确定所述至少一个目标对象。
上述3022“根据所述识别结果,确定至少一个目标对象”,可具体包括:响应于用户在所述图像中针对一目标图像内容的操作,将所述目标图像内容对应的识别结果作为目标对象。
上述303“获取所述至少一个目标对象的数据信息”,可具体包括如下中的至少一种:通过布设在空间内至少一个第一采集设备,获取与所述至少一个目标对象相关的第 一数据信息;从本地或服务端获取与所述至少一个目标对象相关的第二数据信息。
上述中,所述目标对象为在所述空间内的人。相应地,上述“根据所述数据信息,确定在所述图像中的显示内容”,可具体包括:基于所述数据信息,对所述至少一个目标对象的行为进行识别;根据行为识别结果,确定在所述图像中的显示内容。
上述“根据行为识别结果,确定在所述图像中的显示内容”,可具体包括:根据所述行为识别结果,确定所述目标对象的意图信息;基于所述意图信息,生成用于显示在所述图像中的显示内容;将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
上述中,若所述目标对象为在所述空间内陈列的物品。相应地,上述“根据所述数据信息,确定在所述图像中的显示内容”,可具体包括:根据所述数据信息,确定所述目标对象在所述空间内的陈列数量及库存数量;根据所述陈列数量及所述库存数量,生成用于显示在所述图像中的显示内容;将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
本实施例提供的技术方案,在显示一空间的图像的同时,并获取所确定的所述图像中的至少一个目标对象的数据信息,且将基于所述数据信息来确定在所述图像的显示内容,以便于将所述显示内容在所述图像中进行显示,这样可以方便用户(如商家)实时查看所述目标对象的数据信息变化,及时对所述目标对象作出调整。
这里需要说明的是:本申请实施例提供的所述数据处理方法中各步骤未尽详述的内容可参见上述各实施例中的相应内容,此处不再赘述。此外,本申请实施例提供的所述方法中除了上述各步骤以外,还可包括上述各实施例中其他部分或全部步骤,具体可参见上述各实施例相应内容,在此不再赘述。
综上所述,以上实施例提供的所述数据处理方法可总结为图5b所示的过程。即,图像传感器504(如全景相机)与雷达503对同一空间区域001进行数据采集。将所述图像传感器504采集到的图像及雷达503采集到的雷达数据发送至服务端502进行数据融合处理,可得到该空间区域的图像,如三维全景图。将所述图像发送至客户端501,以便在所述客户端501的界面上进行显示,供用户进行浏览查看;同时当用户在浏览所述图像时,所述服务端还可以获取到网络侧其他用户的相关信息并将所述相关信息发送至客户端,以展示在所述客户端显示的图像中。另外,基于所述图像传感器504采集的图像,所述服务端还可以对图像内的目标对象进行识别并根据识别结果获取所述目标对象的数据信息,将所述数据信息发送至所述客户端501,以在所述客户端显示的图像界面上进行展示。
参见图5c所示,基于图5b得到的在客户端显示的图像的技术方案可简述为如下过程:
通过基于一空间(比如商场)的图像信息和雷达数据,在线上完成该空间的三维重 建得到与其对应的图像并将所述图像发送至商家侧和/或用户侧对应的客户端进行显示,同时还可以实时获取浏览该图像进行购物的线上用户的相关信息以及图像中目标对象(如商场空间内的人、陈列物品等等)的数据信息,并在所述图像中进行展示,以实现线上线下的融合。对于商家侧客户端的来说,可以使商家能够基于线上线下实时同步的数据及时调整商品信息,而对于用户侧客户端的用户来说,则可以使用户根据实时访问量来购买商品。
进一步的,以上述实施例中提及的空间为实体店铺为例,在客户端上显示有该实体店铺的图像、网络侧浏览该图像的至少一个用户对应的界面元素、某一个或一些商品对应的显示内容(如库存量、销售量等)、店铺内用户的偏好等等内容之外,还可将实体店铺中的线下商品促销活动信息、线下店铺内客户人数等等线下的更多的信息,转换到线上,即显示在图像中;使得实体店铺对应的线上和线下信息融合,方便用户选购商品,商家可随时了解线上和线下的商品信息进而做出更加合理的决策。
另外,除店铺场景外,本实施例提供的技术方案还可应用在虚拟装修场景。例如,商家可针对用户提供的空间的三维空间数据,或使用移动数据采集设备到用户家中采集三维空间数据,构建用户家的三维模型图像;然后基于三维模型图像及针对用户实际需求制定的虚拟装修方案,渲染出用户家的虚拟装修图像,比如三维全景图。用户可通过相应客户端查看该虚拟装修图像,并能通过点击虚拟装修图像中的任一商品,如窗帘、餐桌、书柜等,查看该商品的详细信息(如价格、产品品牌、材质等等)。在用户允许的情况下,网络侧其他用户也可通过相应客户端查看到该用户的虚拟装修图像,网络侧用户上传对该虚拟装修图像或图像中某一个或多个商品的评价。这些评价信息可展示在虚拟装修图像上,这样用户可基于网络侧用户的评价来决定是否采用该虚拟装修图像中的方案进行装修;对于提供虚拟装修方案的商家来说,可基于线上用户的评价了解大多数用户的偏好,以便于调整后续装修方案的制定。
图6示出了本申请一实施例提供的数据处理方法的流程示意图。本实施例提供的所述方法的执行主体可以是服务端,如服务器、部署在服务器集群上的虚拟服务器或云计算中心等。如图6所述,该数据处理方法包括:
401、获取图像中至少一个目标对象的数据信息;
402、根据所述数据信息,确定在所述图像中的显示内容;
403、将所述显示内容发送至显示所述图像的至少一个客户端,以便接收到的客户端在显示的图像中展示所述显示内容。
上述401中,所述目标对象可以为所述空间内的人或所述空间内陈列的物品,基于此,上述“获取图像中至少一个目标对象的数据信息”可包括如下中的至少一种:
通过布设在空间内至少一个第一采集设备,获取与所述至少一个目标对象相关的第一数据信息;
从本地或服务端获取与所述至少一个目标对象相关的第二数据信息。
在一种可实现的方案中,所述目标对象为所述空间内的人;相应地,上述402“根据所述数据信息,确定在所述图像中的显示内容”,可具体包括:基于所述数据信息,对所述至少一个目标对象的行为进行识别;根据行为识别结果,确定在所述图像中的显示内容。
上述“根据行为识别结果,确定在所述图像中的显示内容”,可具体包括:
根据所述行为识别结果,确定所述目标对象的意图信息;
基于所述意图信息,生成用于显示在所述图像中的显示内容;
将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
在另一种可实现的方案中,所述目标对象为在所述空间内陈列的物品;相应地,上述402“根据所述数据信息,确定在所述图像中的显示内容”,可具体包括:根据所述数据信息,确定所述目标对象在所述空间内的陈列数量及库存数量;根据所述陈列数量及所述库存数量,生成用于显示在所述图像中的显示内容;将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
本实施例提供的技术方案,将基于所述图像中至少一个目标对象的数据信息所确定出的在所述图像中的显示内容发送至显示所述图像的至少一个客户端,以便于接收到的客户端在显示的图像中展示所述显示内容,这可方便用户(如商家)实时查看所述目标对象的数据信息变化,及时对所述目标对象作出调整。
这里需要说明的是:本申请实施例提供的所述数据处理系统中各步骤未尽详述的内容可参见上述各实施例中的相应内容,此处不再赘述。此外,本申请实施例提供的所述数据处理系统中除了上述各步骤以外,还可包括上述各实施例中其他部分或全部步骤,具体可参见上述各实施例相应内容,在此不再赘述。
上述各方法实施例提供的技术方案可基于如下硬件系统实现。具体的,图7示出了本申请一实施例提供的数据处理系统的结构框图。如图7所述,该数据处理系统包括:
客户端501,用于显示一空间的图像;获取网络侧查看所述图像的至少一个用户的相关信息;根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素;
服务端502,用于接收客户端针对一图像发送的数据请求;获取查看所述图像的至少一个用户的相关信息;将所述至少一个用户的相关信息反馈至所述客户端,以在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
进一步的,本实施例提供的所述系统,还可包括:
第二采集设备5031,用于采集所述空间的三维全景数据,将所述三维全景数据发送至所述服务端;
相应地,所述服务端502用于基于所述三维全景数据,生成所述图像。
进一步的,本实施例提供的所述系统,还可包括:
第一采集设备5041,用于采集至少一个目标对象相关的第一数据信息;将所述第一数据信息发送至服务端;
相应地,所述服务端502用于根据所述第一数据信息及第二数据信息,确定在所述图像像中的显示内容;其中,第二数据信息是所述服务端从本地或网络侧设备获取到的与至少一个目标对象相关的信息。
本实施例提供的技术方案,基于所接收客户端针对一图像发送的数据请求来获取查看所述图像的至少一个用户的相关信息,并将所述至少一个用户的相关信息反馈至所述客户端,以便于在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。基于此,易实现用户之间的相互交互,提升用户体验感,进而提高用户满意度。
这里需要说明的是:本申请实施例提供的所述数据处理系统中各步骤未尽详述的内容可参见上述各实施例中的相应内容,此处不再赘述。此外,本申请实施例提供的所述数据处理系统中除了上述各步骤以外,还可包括上述各实施例中其他部分或全部步骤,具体可参见上述各实施例相应内容,在此不再赘述。
图8示出了本申请另一实施例提供的数据处理系统的结构框图。如图8所述,该数据处理系统包括:
客户端501,用于显示一空间的图像;
服务端502,用于获取图像中至少一个目标对象的数据信息;根据所述数据信息,确定在所述图像中的显示内容;将所述显示内容发送至显示所述图像的至少一个客户端;
所述客户端501,还用于接收所述服务端502反馈的显示内容,在所述图像中展示所述显示内容。
本实施例提供的技术方案,在客户端界面上显示一空间的图像的同时,通过服务端获取所确定的所述图像中的至少一个目标对象的数据信息,且将基于所述数据信息所确定的显示内容发送至客户端以便于在所述客户端所显示的图像中进行显示,这样可以方便用户(如商家)实时查看所述目标对象的数据信息变化,及时对所述目标对象作出调整。
这里需要说明的是:本申请实施例提供的所述数据处理系统中各步骤未尽详述的内容可参见上述各实施例中的相应内容,此处不再赘述。此外,本申请实施例提供的所述数据处理系统中除了上述各步骤以外,还可包括上述各实施例中其他部分或全部步骤,具体可参见上述各实施例相应内容,在此不再赘述。
图9示出了本申请一实施例提供的一空间的结构框图。如图9所述,该空间包括:
第一采集设备5041,设置在所述空间内,用于采集至少一个目标对象相关的第一数据信息;将所述第一数据信息发送至服务端;以便所述服务端根据所述第一数据,确定 需在所述空间对应的图像中显示的显示内容;
第二采集设备5031,设置在所述空间内,用于采集所述空间的三维全景数据,将所述三维全景数据发送至所述服务端;以便所述服务端根据所述三维全景数据生成所述空间的图像,并获取查看所述图像的至少一个用户的相关信息,将所述至少一个用户的相关信息反馈至至少一个客户端。
本实施例提供的技术方案,通过在所述空间中布设第一采集设备和第一采集设备,可以实现所述空间数据的实时采集;及时将所采集到的数据信息发送至服务端可以有效实现图像的跟新处理。
这里需要说明的是:本申请实施例提供的所述空间中各步骤未尽详述的内容可参见上述各实施例中的相应内容,此处不再赘述。此外,本申请实施例提供的所述空间中除了上述各步骤以外,还可包括上述各实施例中其他部分或全部步骤,具体可参见上述各实施例相应内容,在此不再赘述。
本申请各实施例提供的技术方案可以应用到多种应用场景,比如对家庭、商场、博物馆等室内监控以及旅游景区、街道等室外的监控。上述各实施例结合了商场空间场景进行了相应的描述。下面在结合家庭应用场景对本申请实施例提供的技术方案进行说明。通过布设在家庭周围内的摄像头及雷达(即第一采集设备和第二采集设备),可以采集到家庭各个角落的图像数据及雷达数据;融合所述图像数据和所述雷达数据可以得到一图像,将所述图像显示在家庭各个成员对应的客户端,可以方便用户随时随地的监控家庭内发生的相关状况。
图10示出了本申请一实施例提供的数据处理装置的结构框图。如图10所示,该数据处理装置包括:显示模块801、获取模块802以及展示模块803;其中,
所述显示模块801,用于显示一空间的图像;
所述获取模块802,用于获取网络侧查看所述图像的至少一个用户的相关信息;
所述展示模块803,用于根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
本实施例提供的技术方案,在显示一空间的图像的同时,实时获取网络侧查看所述图像的至少一个用户的相关信息,以基于所述至少一个用户的相关信息来确定所述至少一个用户中至少部分用户对应的在所述图像中所展示的界面元素,便于用户之间的相互交互,提高用户满意度。
进一步地,所述获取模块802,具体用于:
获取网络侧展示所述图像的至少一个客户端;
获取与所述至少一个客户端关联的至少一个用户的相关信息。
进一步地,所述展示模块803,具体用于:
获取所述图像在界面上展示的局部图像对应的第一空间位置;
根据所述至少一个用户的相关信息,从所述至少一个用户中获取空间位置在目标区域内的目标用户;其中,所述目标区域由所述第一空间位置确定;
在所述局部图像中,展示所述目标用户对应的界面元素。
上述中,所述相关信息包含如下中的至少一种:用户标识、用户头像、用户输入信息、用户的第二空间位置。相应地,所述展示模块803,还具体用于:根据所述第一用户的第二空间位置,确定界面显示位置;在所述界面显示位置处,显示所述第一用户的用户标识、用户头像、用户输入信息中至少一项对应的界面元素。
进一步地,所述展示模块803,还用于:确定所述第二空间位置相对于所述第一空间位置的方位信息;根据所述方位信息,确定界面显示位置。
进一步地,所述展示模块803,还具体用于:显示所述图像对应的空间结构模型图;将所述第一空间位置,映射到所述空间结构模型图中得到对应的标记位置;在所述标记位置,显示图元素。
进一步地,本实施例提供的所述数据处理装置还包括:响应模块804,所述响应模块804,用于响应于用户针对所述图像中一图像内容的操作,显示与所述图像内容关联的第一展示内容;或/和响应于用户针对所述图像所在界面上显示的可操作界面元素的操作,显示与所述图像关联的第二展示内容。
进一步地,本实施例提供的所述数据处理装置还包括:识别模块805,所述识别模块805,具体用于:对图像中的图像内容进行识别,得到识别结果;根据识别结果,确定至少一个目标对象;获取所述至少一个目标对象的数据信息;根据所述数据信息,确定在所述图像中的显示内容。
进一步地,所述识别模块805,还具体用于响应于用户在所述图像中针对一目标图像内容的操作,将所述目标图像内容对应的识别结果作为目标对象。
进一步地,所述识别模块805,还具体用于:通过布设在空间内至少一个第一采集设备,获取与所述至少一个目标对象相关的第一数据信息;从本地或服务端获取与所述至少一个目标对象相关的第二数据信息。
上述中所述目标对象为在所述空间内的人。相应地,所述识别模块804,还具体用于:基于所述数据信息,对所述至少一个目标对象的行为进行识别;根据行为识别结果,确定在所述图像中的显示内容。
进一步地,所述识别模块805,还具体用于:根据所述行为识别结果,确定所述目标对象的意图信息;基于所述意图信息,生成用于显示在所述图像中的显示内容。相应的,所述显示模块801还用于将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
上述中所述目标对象为在所述空间内的物品。相应地,所述识别模块804,还具体用于:根据所述数据信息,确定所述目标对象在所述空间内的陈列数、库存数、预设时 段内的出库量中的至少一项参数;根据确定出的所述至少一项参数,生成用于显示在所述图像中的显示内容;
将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
这里需要说明的是:本实施例提供的数据处理装置可实现上述图1示出的数据处理方法实施例中描述的技术方案,上述各模块或单元具体实现的原理可参见上述图1示出的数据处理方法实施例中的相应内容,此处不再赘述。
图11示出了本申请另一实施例提供的数据处理装置的结构框图。如图11所示,该数据处理装置包括:接收模块901、获取模块902以及反馈模块903;其中,
所述接收模块901,用于接收客户端针对一图像发送的数据请求;
所述获取模块902,用于获取查看所述图像的至少一个用户的相关信息;
所述反馈模块903,用于将所述至少一个用户的相关信息反馈至所述客户端,以在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
本实施例提供的技术方案,基于所接收客户端针对一图像发送的数据请求来获取查看所述图像的至少一个用户的相关信息,并将所述至少一个用户的相关信息反馈至所述客户端,以便于在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。基于此,易实现用户之间的相互交互,提升用户体验感,进而提高用户满意度。
进一步地,本实施例提供的所述数据处理装置,还包括更新模块904,所述更新模块904,具体用于:
接收布设在空间内的第二采集设备发送的第一采集数据;
根据所述第一采集数据,更新所述图像,以在客户端请求显示所述空间对应的图像时,将更新后的所述图像发送至所述客户端。
进一步地,本实施例提供的所述数据处理装置,还包括识别模块905,所述识别模块905,具体用于:
对所述图像中的图像内容进行识别,得到识别结果;
根据识别结果,确定至少一个目标对象;
获取所述至少一个目标对象的数据信息;
根据所述数据信息,确定在所述图像中的显示内容;
将所述显示内容发送至展示有所述图像的至少一个客户端,以便在所述客户端界面上显示的图像中,展示所述显示内容。
进一步地,所述获取模块902,还具体用于:
通过布设在空间内至少一个第一采集设备,获取与所述至少一个目标对象相关的第一数据信息;
从本地或服务端获取与所述至少一个目标对象相关的第二数据信息。
上述中所述目标对象为在所述空间内的人。相应地,所述识别模块905,还具体用于:基于所述数据信息,对所述目标对象的行为进行识别;根据行为识别结果,确定在所述图像中的显示内容。
进一步地,所述识别模块905,还具体用于:根据所述行为识别结果,确定所述目标对象的意图信息;基于所述意图信息,生成用于显示在所述图像中的显示内容。
上述中所述目标对象为在所述空间内的物品。相应地,所述识别模块905,还具体用于:根据所述数据信息,确定所述目标对象在所述空间内的陈列数、库存数、预设时段内的出库量中的至少一项参数;根据确定出的所述至少一项参数,生成用于显示在所述图像中的显示内容。
这里需要说明的是:本实施例提供的数据处理装置可实现上述图4示出的数据处理方法实施例中描述的技术方案,上述各模块或单元具体实现的原理可参见上述图4示出的数据处理方法实施例中的相应内容,此处不再赘述。
图12示出了本申请另一实施例提供的数据处理装置的结构框图。如图12所示,该数据处理装置包括:显示模块1001、确定模块1002、获取模块1003;其中,
所述显示模块1001,用于显示一空间的图像;
所述确定模块1002,用于确定所述图像中的至少一个目标对象;
所述获取模块1003,用于获取所述至少一个目标对象的数据信息;
所述确定模块1002,还用于根据所述数据信息,确定在所述图像中的显示内容。
本实施例提供的技术方案,在显示一空间的图像的同时,并获取所确定的所述图像中的至少一个目标对象的数据信息,且将基于所述数据信息来确定在所述图像的显示内容,以便于将所述显示内容在所述图像中进行显示,这样可以方便用户(如商家)实时查看所述目标对象的数据信息变化,及时对所述目标对象作出调整。
进一步地,所述确定模块1002,具体用于:对图像中的图像内容进行识别,得到识别结果;根据识别结果,确定所述至少一个目标对象。
进一步地,所述确定模块1002,还具体用于:响应于用户在所述图像中针对一目标图像内容的操作,将所述目标图像内容对应的识别结果作为目标对象。
进一步地,所述获取模块1003,具体用于:通过布设在空间内至少一个第一采集设备,获取与所述至少一个目标对象相关的第一数据信息;或/和从本地或服务端获取与所述至少一个目标对象相关的第二数据信息。
上述中所述目标对象为在所述空间内的人。相应地,所述确定模块1002,还具体用于:基于所述数据信息,对所述至少一个目标对象的行为进行识别;根据行为识别结果,确定在所述图像中的显示内容。
进一步地,所述确定模块1002,还具体用于:根据所述行为识别结果,确定所述目标对象的意图信息;基于所述意图信息,生成用于显示在所述图像中的显示内容;将所 述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
上述中所述目标对象为在所述空间内的物品。相应地,所述确定模块1002,还具体用于:根据所述数据信息,确定所述目标对象在所述空间内的陈列数量及库存数量;根据所述陈列数量及所述库存数量,生成用于显示在所述图像中的显示内容;将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
这里需要说明的是:本实施例提供的数据处理装置可实现上述图5a示出的数据处理方法实施例中描述的技术方案,上述各模块或单元具体实现的原理可参见上述图5a示出的数据处理方法实施例中的相应内容,此处不再赘述。
图13示出了本申请一实施例提供一个客户端设备的结构示意图。如图13所示,所述客户端设备包括:存储器1101、处理器1102以及显示器1103。存储器1101可被配置为存储其它各种数据以支持在传感器上的操作。这些数据的示例包括用于在传感器上操作的任何应用程序或方法的指令。存储器1101可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。
所述处理器1102,与所述存储器1101耦合,用于执行所述存储器1101中存储的所述程序,以用于:
通过显示器1103显示一空间的图像;
获取网络侧查看所述图像的至少一个用户的相关信息;
根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
其中,处理器1102在执行存储器1101中的程序时,除了上面的功能之外,还可实现其它功能,具体可参见前面各实施例的描述。
进一步,如图13所示,客户端设备还包括:通信组件1104、电源组件1105等其它组件。图13中仅示意性给出部分组件,并不意味着传感器只包括图13所示组件。
本申请一实施例还提供一个服务端设备,该服务端设备的结构同上述图13类似。具体的,所述服务设备包括:存储器1101以及处理器1102。存储器1101可被配置为存储其它各种数据以支持在传感器上的操作。这些数据的示例包括用于在传感器上操作的任何应用程序或方法的指令。存储器1101可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。
所述处理器1102,与所述存储器1101耦合,用于执行所述存储器1101中存储的所述程序,以用于:
接收客户端针对一图像发送的数据请求;
获取查看所述图像的至少一个用户的相关信息;
将所述至少一个用户的相关信息反馈至所述客户端,以在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
其中,处理器1102在执行存储器1101中的程序时,除了上面的功能之外,还可实现其它功能,具体可参见前面各实施例的描述。
进一步,如图13所示,客户端设备还包括:通信组件1104、电源组件1105等其它组件。图13中仅示意性给出部分组件,并不意味着传感器只包括图13所示组件。
本申请一实施例还提供另一个客户端设备,该客户端设备的结构同上述图13类似。具体的,所述客户端设备包括:存储器1101、处理器1102以及显示器1103。存储器1101可被配置为存储其它各种数据以支持在传感器上的操作。这些数据的示例包括用于在传感器上操作的任何应用程序或方法的指令。存储器1101可以由任何类型的易失性或非易失性存储设备或者它们的组合实现,如静态随机存取存储器(SRAM),电可擦除可编程只读存储器(EEPROM),可擦除可编程只读存储器(EPROM),可编程只读存储器(PROM),只读存储器(ROM),磁存储器,快闪存储器,磁盘或光盘。
所述处理器1102,与所述存储器1101耦合,用于执行所述存储器1101中存储的所述程序,以用于:
通过显示器1103显示一空间的图像;
确定所述图像中的至少一个目标对象;
获取所述至少一个目标对象的数据信息;
根据所述数据信息,确定在所述图像中的显示内容。
其中,处理器1102在执行存储器1101中的程序时,除了上面的功能之外,还可实现其它功能,具体可参见前面各实施例的描述。
进一步,如图13所示,客户端设备还包括:通信组件1104、电源组件1105等其它组件。图13中仅示意性给出部分组件,并不意味着传感器只包括图13所示组件。
相应地,本申请实施例还提供一种存储有计算机程序的计算机可读存储介质,所述计算机程序被计算机执行时能够实现上述各实施例提供的数据处理方法步骤或功能。
以上所描述的装置实施例仅仅是示意性的,其中所述作为分离部件说明的单元可以是或者也可以不是物理上分开的,作为单元显示的部件可以是或者也可以不是物理单元,即可以位于一个地方,或者也可以分布到多个网络单元上。可以根据实际的需要选择其中的部分或者全部模块来实现本实施例方案的目的。本领域普通技术人员在不付出创造性的劳动的情况下,即可以理解并实施。
通过以上的实施例的描述,本领域的技术人员可以清楚地了解到各实施例可借助软件加必需的通用硬件平台的方式来实现,当然也可以通过硬件。基于这样的理解,上述 技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在计算机可读存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行各个实施例或者实施例的某些部分所述的方法。
最后应说明的是:以上实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。
Claims (42)
- 一种数据处理方法,其特征在于,包括:显示一空间的图像;获取网络侧查看所述图像的至少一个用户的相关信息;根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
- 根据权利要求1所述的方法,其特征在于,获取网络侧查看所述图像的至少一个用户的相关信息,包括:获取网络侧展示所述图像的至少一个客户端;获取与所述至少一个客户端关联的至少一个用户的相关信息。
- 根据权利要求1所述的方法,其特征在于,根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素,包括:获取所述图像在界面上展示的局部图像对应的第一空间位置;根据所述至少一个用户的相关信息,从所述至少一个用户中获取空间位置在目标区域内的目标用户;其中,所述目标区域由所述第一空间位置确定;在所述局部图像中,展示所述目标用户对应的界面元素。
- 根据权利要求3所述的方法,其特征在于,相关信息包含如下中的至少一种:用户标识、用户头像、用户输入信息、用户的第二空间位置。
- 根据权利要求4所述的方法,其特征在于,根据所述至少一个用户中第一用户的相关信息,在所述图像中展示所述第一用户对应的界面元素,包括:根据所述第一用户的第二空间位置,确定界面显示位置;在所述界面显示位置处,显示所述第一用户的用户标识、用户头像、用户输入信息中至少一项对应的界面元素。
- 根据权利要求5所述的方法,其特征在于,根据所述第一用户的第二空间位置,确定界面显示位置,包括:确定所述第二空间位置相对于所述第一空间位置的方位信息;根据所述方位信息,确定界面显示位置。
- 根据权利要求3所述的方法,其特征在于,还包括:显示所述空间的空间结构模型图;将所述第一空间位置,映射到所述空间结构模型图中得到对应的标记位置;在所述标记位置,显示图元素。
- 根据权利要求1至3中任一项所述的方法,其特征在于,还包括如下中的至少一项:响应于用户针对所述图像中一图像内容的操作,显示与所述图像内容关联的第一展示内容;响应于用户针对所述图像所在界面上显示的可操作界面元素的操作,显示与所述图像关联的第二展示内容。
- 根据权利要求1至3中任一项所述的方法,其特征在于,还包括:对图像中的图像内容进行识别,得到识别结果;根据识别结果,确定至少一个目标对象;获取所述至少一个目标对象的数据信息;根据所述数据信息,确定在所述图像中的显示内容。
- 根据权利要求9所述的方法,其特征在于,根据所述识别结果,确定至少一个目标对象,包括:响应于用户在所述图像中针对一目标图像内容的操作,将所述目标图像内容对应的识别结果作为目标对象。
- 根据权利要求9所述的方法,其特征在于,获取针对所述空间内至少一个目标对象的数据信息,包括如下中的至少一种:通过布设在空间内至少一个第一采集设备,获取与所述至少一个目标对象相关的第一数据信息;从本地或服务端获取与所述至少一个目标对象相关的第二数据信息。
- 根据权利要求9所述的方法,其特征在于,目标对象为在所述空间内的人;以及根据所述数据信息,确定在所述图像中的显示内容,包括:基于所述数据信息,对所述至少一个目标对象的行为进行识别;根据行为识别结果,确定在所述图像中的显示内容。
- 根据权利要求11所述的方法,其特征在于,根据行为识别结果,确定在所述图像中的显示内容,包括:根据所述行为识别结果,确定所述目标对象的意图信息;基于所述意图信息,生成用于显示在所述图像中的显示内容;将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
- 根据权利要求9所述的方法,其特征在于,目标对象为在所述空间内陈列的物品;以及根据所述数据信息,确定在所述图像中的显示内容,包括:根据所述数据信息,确定所述目标对象在所述空间内的陈列数、库存数、预设时段内的出库量中的至少一项参数;根据确定出的所述至少一项参数,生成用于显示在所述图像中的显示内容;将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
- 根据权利要求1所述的方法,其特征在于,所述图像是基于所述空间的三维全景数据生成;所述三维全景数据由设置在所述空间内的采集设备采集。
- 一种数据处理方法,其特征在于,包括:接收客户端针对一图像发送的数据请求;获取查看所述图像的至少一个用户的相关信息;将所述至少一个用户的相关信息反馈至所述客户端,以在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
- 根据权利要求16所述的方法,其特征在于,还包括:接收布设在空间内的第二采集设备发送的第一采集数据;根据所述第一采集数据,更新所述图像,以在客户端请求显示所述空间对应的图像时,将更新后的所述图像发送至所述客户端。
- 根据权利要求17所述的方法,其特征在于,还包括:对所述图像中的图像内容进行识别,得到识别结果;根据识别结果,确定至少一个目标对象;获取所述至少一个目标对象的数据信息;根据所述数据信息,确定在所述图像中的显示内容;将所述显示内容发送至展示有所述图像的至少一个客户端,以便在所述客户端界面上显示的图像中,展示所述显示内容。
- 根据权利要求18所述的方法,其特征在于,获取所述至少一个目标对象的数据信息,包括如下中的至少一种:通过布设在空间内至少一个第一采集设备,获取与所述至少一个目标对象相关的第一数据信息;从本地或服务端获取与所述至少一个目标对象相关的第二数据信息。
- 根据权利要求18所述的方法,其特征在于,目标对象为在所述空间内的人;以及根据所述数据信息,确定在所述图像中的显示内容,包括:基于所述数据信息,对所述目标对象的行为进行识别;根据行为识别结果,确定在所述图像中的显示内容。
- 根据权利要求20所述的方法,其特征在于,根据行为识别结果,确定在所述图像中的显示内容,包括:根据所述行为识别结果,确定所述目标对象的意图信息;基于所述意图信息,生成用于显示在所述图像中的显示内容。
- 根据权利要求18所述的方法,其特征在于,目标对象为在所述空间内陈列的物品;以及根据所述数据信息,确定在所述图像中的显示内容,包括:根据所述数据信息,确定所述目标对象在所述空间内的陈列数、库存数、预设时段内的出库量中的至少一项参数;根据确定出的所述至少一项参数,生成用于显示在所述图像中的显示内容。
- 一种数据处理方法,其特征在于,包括:显示一空间的图像;确定所述图像中的至少一个目标对象;获取所述至少一个目标对象的数据信息;根据所述数据信息,确定在所述图像中的显示内容。
- 根据权利要求23所述的方法,其特征在于,确定所述图像中的至少一个目标对象,包括:对图像中的图像内容进行识别,得到识别结果;根据识别结果,确定所述至少一个目标对象。
- 根据权利要求24所述的方法,其特征在于,根据所述识别结果,确定至少一个目标对象,包括:响应于用户在所述图像中针对一目标图像内容的操作,将所述目标图像内容对应的识别结果作为目标对象。
- 根据权利要求23所述的方法,其特征在于,获取所述至少一个目标对象的数据信息,包括如下中的至少一种:通过布设在空间内至少一个第一采集设备,获取与所述至少一个目标对象相关的第一数据信息;从本地或服务端获取与所述至少一个目标对象相关的第二数据信息。
- 根据权利要求23所述的方法,其特征在于,目标对象为在所述空间内的人;以及根据所述数据信息,确定在所述图像中的显示内容,包括:基于所述数据信息,对所述至少一个目标对象的行为进行识别;根据行为识别结果,确定在所述图像中的显示内容。
- 根据权利要求27所述的方法,其特征在于,根据行为识别结果,确定在所述图像中的显示内容,包括:根据所述行为识别结果,确定所述目标对象的意图信息;基于所述意图信息,生成用于显示在所述图像中的显示内容;将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
- 根据权利要求23所述的方法,其特征在于,目标对象为在所述空间内陈列的物品;以及根据所述数据信息,确定在所述图像中的显示内容,包括:根据所述数据信息,确定所述目标对象在所述空间内的陈列数量及库存数量;根据所述陈列数量及所述库存数量,生成用于显示在所述图像中的显示内容;将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
- 一种数据处理系统,其特征在于,包括:获取图像中至少一个目标对象的数据信息;根据所述数据信息,确定在所述图像中的显示内容;将所述显示内容发送至显示所述图像的至少一个客户端,以便接收到的客户端在显示的图像中展示所述显示内容。
- 根据权利要求30所述的系统,其特征在于,获取图像中至少一个目标对象的数据信息,包括如下中的至少一种:通过布设在空间内至少一个第一采集设备,获取与所述至少一个目标对象相关的第一数据信息;从本地或服务端获取与所述至少一个目标对象相关的第二数据信息。
- 根据权利要求30所述的系统,其特征在于,目标对象为空间内的人;以及,根据所述数据信息,确定在所述图像中的显示内容,包括:基于所述数据信息,对所述至少一个目标对象的行为进行识别;根据行为识别结果,确定在所述图像中的显示内容。
- 根据权利要求32所述的系统,其特征在于,根据行为识别结果,确定在所述图像中的显示内容,包括:根据所述行为识别结果,确定所述目标对象的意图信息;基于所述意图信息,生成用于显示在所述图像中的显示内容;将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
- 根据权利要求30所述的系统,其特征在于,目标对象为在空间内陈列的物品;以及,根据所述数据信息,确定在所述图像中的显示内容,包括:根据所述数据信息,确定所述目标对象在所述空间内的陈列数量及库存数量;根据所述陈列数量及所述库存数量,生成用于显示在所述图像中的显示内容;将所述显示内容与所述图像中所述目标对象对应的图像内容关联显示。
- 一种数据处理系统,其特征在于,包括:客户端,用于显示一空间的图像;获取网络侧查看所述图像的至少一个用户的相关信息;根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素;服务端,用于接收客户端针对一图像发送的数据请求;获取查看所述图像的至少一个用户的相关信息;将所述至少一个用户的相关信息反馈至所述客户端。
- 根据权利要求35所述的系统,其特征在于,还包括:第二采集设备,用于采集所述空间的三维全景数据,将所述三维全景数据发送至所述服务端;所述服务端,用于基于所述三维全景数据,生成所述图像。
- 根据权利要求35所述的系统,其特征在于,还包括:第一采集设备,用于采集至少一个目标对象相关的第一数据信息;将所述第一数据信息发送至服务端;所述服务端,用于根据所述第一数据信息及第二数据信息,确定在所述图像中的显示内容;其中,第二数据信息是所述服务端从本地或网络侧设备获取到的与至少一个目标对象相关的信息。
- 一种数据处理系统,其特征在于,包括:客户端,用于显示一空间的图像;服务端,用于获取图像中至少一个目标对象的数据信息;根据所述数据信息,确定在所述图像中的显示内容;将所述显示内容发送至显示所述图像的至少一个客户端;所述客户端,还用于接收所述服务端反馈的显示内容,在所述图像中展示所述显示内容。
- 一种空间,其特征在于,包括:第一采集设备,设置在所述空间内,用于采集至少一个目标对象相关的第一数据信息;将所述第一数据信息发送至服务端;以便所述服务端根据所述第一数据,确定需在所述空间对应的图像中显示的显示内容;第二采集设备,设置在所述空间内,用于采集所述空间的三维全景数据,将所述三维全景数据发送至所述服务端;以便所述服务端根据所述三维全景数据生成所述空间的图像,并获取查看所述图像的至少一个用户的相关信息,将所述至少一个用户的相关信息反馈至至少一个客户端。
- 一种客户端设备,其特征在于,包括:存储器、处理器以及显示器,其中,所述存储器,用于存储程序;所述处理器,与所述存储器耦合,用于执行所述存储器中存储的所述程序,以用于:通过所述显示器显示一空间的图像;获取网络侧查看所述图像的至少一个用户的相关信息;根据所述至少一个用户的相关信息,在所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
- 一种服务端设备,其特征在于,包括:存储器和处理器,其中,所述存储器,用于存储程序;所述处理器,与所述存储器耦合,用于执行所述存储器中存储的所述程序,以用于:接收客户端针对一图像发送的数据请求;获取查看所述图像的至少一个用户的相关信息;将所述至少一个用户的相关信息反馈至所述客户端,以在所述客户端显示的所述图像中展示所述至少一个用户中至少部分用户对应的界面元素。
- 一种客户端设备,其特征在于,包括:存储器、处理器以及显示器,其中,所述存储器,用于存储程序;所述处理器,与所述存储器耦合,用于执行所述存储器中存储的所述程序,以用于:通过所述显示器显示一空间的图像;确定所述图像中的至少一个目标对象;获取所述至少一个目标对象的数据信息;根据所述数据信息,确定在所述图像中的显示内容。
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010323311.7A CN113538083B (zh) | 2020-04-22 | 2020-04-22 | 数据处理方法、系统、线下店铺空间及设备 |
CN202010323311.7 | 2020-04-22 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021213457A1 true WO2021213457A1 (zh) | 2021-10-28 |
Family
ID=78124019
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2021/088872 WO2021213457A1 (zh) | 2020-04-22 | 2021-04-22 | 数据处理方法、系统、空间及设备 |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN113538083B (zh) |
WO (1) | WO2021213457A1 (zh) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111523972A (zh) * | 2020-04-22 | 2020-08-11 | 陈议尊 | 一种现货仓货线上线下同步营销方法及系统 |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104063796A (zh) * | 2013-03-19 | 2014-09-24 | 腾讯科技(深圳)有限公司 | 对象信息展示方法、系统及装置 |
CN107247510A (zh) * | 2017-04-27 | 2017-10-13 | 成都理想境界科技有限公司 | 一种基于增强现实的社交方法、终端、服务器和系统 |
CN107370801A (zh) * | 2017-07-07 | 2017-11-21 | 天脉聚源(北京)科技有限公司 | 一种头像显示方法及装置 |
US20190318076A1 (en) * | 2016-10-19 | 2019-10-17 | Jong Yoon Chun | Augmented reality object providing method and server using image authentication |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20170142086A (ko) * | 2016-06-16 | 2017-12-27 | 주식회사 에이치투앤컴퍼니 | 가상 현실 영상 및 증강 현실 컨텐츠를 결합한 상호작용 중첩현실 시스템 및 그 제공 방법 |
CN106713840B (zh) * | 2016-06-28 | 2018-09-04 | 腾讯科技(深圳)有限公司 | 虚拟信息显示方法及装置 |
CN108932051B (zh) * | 2017-05-24 | 2022-12-16 | 腾讯科技(北京)有限公司 | 增强现实图像处理方法、装置及存储介质 |
CN109963163A (zh) * | 2017-12-26 | 2019-07-02 | 阿里巴巴集团控股有限公司 | 网络视频直播方法、装置及电子设备 |
JP6378850B1 (ja) * | 2018-03-22 | 2018-08-22 | 株式会社ドワンゴ | サーバおよびプログラム |
CN109087172A (zh) * | 2018-08-08 | 2018-12-25 | 百度在线网络技术(北京)有限公司 | 商品识别处理方法及装置 |
CN110852770B (zh) * | 2018-08-21 | 2023-05-26 | 阿里巴巴集团控股有限公司 | 数据处理方法、装置、计算设备及显示设备 |
CN110866796A (zh) * | 2018-08-28 | 2020-03-06 | 阿里巴巴集团控股有限公司 | 信息显示、信息获取方法、系统及设备 |
CN111008859B (zh) * | 2019-11-11 | 2024-04-09 | 北京迈格威科技有限公司 | 虚拟店铺中信息呈现方法、装置、电子设备及存储介质 |
-
2020
- 2020-04-22 CN CN202010323311.7A patent/CN113538083B/zh active Active
-
2021
- 2021-04-22 WO PCT/CN2021/088872 patent/WO2021213457A1/zh active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104063796A (zh) * | 2013-03-19 | 2014-09-24 | 腾讯科技(深圳)有限公司 | 对象信息展示方法、系统及装置 |
US20190318076A1 (en) * | 2016-10-19 | 2019-10-17 | Jong Yoon Chun | Augmented reality object providing method and server using image authentication |
CN107247510A (zh) * | 2017-04-27 | 2017-10-13 | 成都理想境界科技有限公司 | 一种基于增强现实的社交方法、终端、服务器和系统 |
CN107370801A (zh) * | 2017-07-07 | 2017-11-21 | 天脉聚源(北京)科技有限公司 | 一种头像显示方法及装置 |
Also Published As
Publication number | Publication date |
---|---|
CN113538083B (zh) | 2023-02-03 |
CN113538083A (zh) | 2021-10-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11403829B2 (en) | Object preview in a mixed reality environment | |
US10559019B1 (en) | System for centralized E-commerce overhaul | |
CN107239725B (zh) | 一种信息展示方法、装置及系统 | |
CN106779940B (zh) | 一种展示商品的确认方法及装置 | |
GB2555524A (en) | Product recommendations based on augmented reality viewpoints | |
US9818224B1 (en) | Augmented reality images based on color and depth information | |
CN107122380A (zh) | 增强实时视图的计算机实施方法和计算机系统 | |
WO2015191461A1 (en) | Recommendations utilizing visual image analysis | |
US11392996B2 (en) | Systems and methods for creating a navigable path between pages of a network platform based on linking database entries of the network platform | |
US12020311B2 (en) | Systems and methods for product visualization using a single-page application | |
TW201533588A (zh) | 提供掃碼結果資訊的方法及裝置 | |
CN109213310B (zh) | 信息互动设备、数据对象信息处理方法及装置 | |
US10692103B2 (en) | Systems and methods for hashtag embedding based on user generated content for creating user specific loyalty identifiers | |
US20210142394A1 (en) | Virtual shopping software system and method | |
WO2012075589A1 (en) | Method and system for virtual shopping | |
US12033190B2 (en) | System and method for content recognition and data categorization | |
WO2021213457A1 (zh) | 数据处理方法、系统、空间及设备 | |
WO2019192455A1 (zh) | 门店系统、物品搭配方法、装置及电子设备 | |
Fernandes et al. | A review on potential technological advances for fashion retail: smart fitting rooms, augmented and virtual realities | |
KR101657588B1 (ko) | 웹을 이용한 상품 이미지 기반 상품 거래 정보 제공 시스템 및 방법 | |
JP6438878B2 (ja) | 広告情報提供システム | |
US20190272585A1 (en) | Virtual shopping software system and method | |
KR101657583B1 (ko) | 모바일 애플리케이션을 이용한 상품 이미지의 해시 태그 추출 시스템 및 방법 | |
US20170270599A1 (en) | Retail website user interface, systems, and methods for displaying trending looks | |
KR101657589B1 (ko) | 모바일 애플리케이션을 이용한 상품 이미지 기반 상품 거래 정보 제공 시스템 및 방법 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21793064 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 21793064 Country of ref document: EP Kind code of ref document: A1 |