CN113570441B - Article display method and device based on virtual back projection - Google Patents
Article display method and device based on virtual back projection Download PDFInfo
- Publication number
- CN113570441B CN113570441B CN202111125904.3A CN202111125904A CN113570441B CN 113570441 B CN113570441 B CN 113570441B CN 202111125904 A CN202111125904 A CN 202111125904A CN 113570441 B CN113570441 B CN 113570441B
- Authority
- CN
- China
- Prior art keywords
- image
- article
- environment
- distance
- projection
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q30/00—Commerce
- G06Q30/06—Buying, selling or leasing transactions
- G06Q30/0601—Electronic shopping [e-shopping]
- G06Q30/0641—Shopping interfaces
- G06Q30/0643—Graphical representation of items or shoppers
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/95—Retrieval from the web
- G06F16/958—Organisation or management of web site content, e.g. publishing, maintaining pages or automatic linking
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Business, Economics & Management (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Accounting & Taxation (AREA)
- Finance (AREA)
- Databases & Information Systems (AREA)
- Physics & Mathematics (AREA)
- Economics (AREA)
- General Business, Economics & Management (AREA)
- Strategic Management (AREA)
- Marketing (AREA)
- Development Economics (AREA)
- Data Mining & Analysis (AREA)
- General Engineering & Computer Science (AREA)
- Processing Or Creating Images (AREA)
Abstract
The application discloses an article display method and device based on virtual back projection, which are used for acquiring an environment image sent by a client; performing foreground and background splitting processing to split a foreground image and a background image; performing projection processing on a foreground image in a first area in a real space to form a first image; performing projection processing on the background image in a second area in the real space to form a second image; determining a first distance of the item placement area from the foreground image; determining a second distance between the article placement area and the background image; carrying out image acquisition processing on the first image, the article to be displayed and the second image to obtain a display picture; and sending the display picture to the client side, thereby finishing the display of the article based on the virtual back projection, improving the display effect of the article and saving the time and energy of the user.
Description
Technical Field
The present application relates to the field of computers, and in particular, to a method and an apparatus for displaying an article based on virtual back projection, a computer device, and a storage medium.
Background
Due to the rapid growth of the internet, long-range communications, including long-range item displays, have been implemented, which may be applied to online item displays for viewing and selection by users. However, in the existing online article display method, for example, the display of the article in the online shopping mall generally takes a picture or a video of the article to be displayed to generate a corresponding picture or video, and although the characteristics of the article can be displayed to a certain extent, the user wants to know the display effect of the article in the user's environment. The article display method in the prior art has poor effect, and wastes time and energy of both parties.
Disclosure of Invention
The application provides an article display method based on virtual back projection, which comprises the following steps:
s1, the server acquires the environment image sent by the client; wherein the environment image is marked with an article placement area;
s2, the server splits the foreground and the background of the environment image according to a preset image splitting method to split the foreground image and the background image;
s3, the server performs projection processing on the foreground image in a first area in the real space by a first projection method through a preset first projection device to form a first image; wherein, the real space is provided with an article to be displayed, and the first area is positioned in front of the article to be displayed; in the projection process of the first projection method, the part of the adopted film which is not projected with colors is transparent, and the part of the projected colors is non-transparent;
s4, the server performs projection processing of the background image in a second area in the real space by a second projection method through a preset second projection device to form a second image; wherein the second area is located behind the item to be displayed;
s5, the server determines a first distance between the article placement area and the foreground image according to the article placement area in the environment image and the foreground image; determining a second distance between the article placement area and the background image according to the article placement area in the environment image and the background image;
s6, the server adopts a preset image collector in front of the first area to collect and process the first image, the article to be displayed and the second image to obtain a display picture;
s7, the server determines whether the distance between the article to be displayed and the first image in the display picture is equal to the first distance, and determines whether the distance between the article to be displayed and the second image in the display picture is equal to the second distance;
s8, if the distance between the article to be displayed and the first image is equal to the first distance in the display picture, and the distance between the article to be displayed and the second image is equal to the second distance in the display picture, sending the display picture to the client, and accordingly completing the article display based on virtual back projection.
Further, the server acquires an environment image sent by the client; before step S1, in which the environment image is marked with an item placement area, the method includes:
s001, starting a preset visible light flash lamp by a client to irradiate a preset environment, and carrying out image acquisition processing on the preset environment by adopting a preset visible light camera to obtain a first environment image; the preset environment comprises an article placing area, a first boundary line drawn by a first material and a second boundary line drawn by a second material, wherein the first boundary line is positioned in front of the article placing area, and the second boundary line is positioned behind the article placing area; the first material is capable of converting ultraviolet light into visible light of a first color, and the second material is capable of converting ultraviolet light into visible light of a second color;
s002, the client starts a preset ultraviolet flash lamp to irradiate the preset environment, and a preset visible light camera is adopted to perform image acquisition processing on the preset environment to obtain a second environment image;
s003, generating an image sending instruction by the client to indicate that the first environment image and the second environment image are sent to a server;
the step S2, in which the server performs foreground and background splitting processing on the environment image according to a preset image splitting method to split a foreground image and a background image, includes:
s201, the server splits a foreground image from the second environment image according to a first boundary line in a first color in the second environment image;
s202, the server splits the background image from the second environment image according to a second boundary line in a second color in the second environment image.
Further, the server determines a first distance between an article placement area in the environment image and the foreground image according to the article placement area and the foreground image; step S5, determining a second distance between the article placement area and the background image based on the article placement area in the environment image and the background image, includes:
s501, recording the distance between the article placement area in the second environment image and the first boundary line in the first color as a first distance by the server;
s502, the server marks the distance between the article placement area in the second environment image and the second boundary line in the second color as a second distance.
Further, the first projection method is water mist projection or transparent film projection; the first projection takes water mist or a transparent film as a projection curtain;
when the first projection takes water mist as a projection curtain, a plurality of water mist spraying holes are arranged above a first area in a real space, and the water mist spraying holes are not positioned on the same straight line.
Further, dress the article to be shown on the show robot, the bodily form parameter of show robot is adjustable, the server is in the place ahead in first region adopts preset image collector, to first image, article to be shown and the second image carry out image acquisition and handle to before step S6 of obtaining the show picture, include:
s51, the server acquires the body shape parameters of the client sent by the client;
s52, the server sends the body shape parameters and body shape modification instructions of the client to the display robot to request the display robot to modify the body shape parameters to be the same as the body shape parameters of the client;
s53, the server generates an image acquisition instruction to instruct image acquisition processing on the first image, the article to be displayed and the second image.
The application provides an article display device based on virtual back projection includes:
the environment image acquisition unit is used for indicating the server to acquire the environment image sent by the client; wherein the environment image is marked with an article placement area;
the image splitting unit is used for indicating the server to split the foreground and background of the environment image according to a preset image splitting method so as to split the foreground image and the background image;
the first projection unit is used for indicating the server to perform projection processing on a foreground image in a first area in a real space by a first projection method through a preset first projection device so as to form a first image; wherein, the real space is provided with an article to be displayed, and the first area is positioned in front of the article to be displayed; in the projection process of the first projection method, the part of the adopted film which is not projected with colors is transparent, and the part of the projected colors is non-transparent;
the second projection unit is used for indicating the server to perform projection processing on the background image in a second area in the real space by a second projection method through a preset second projection device so as to form a second image; wherein the second area is located behind the item to be displayed;
a first distance determining unit, configured to instruct a server to determine a first distance between an article placement area in the environment image and the foreground image based on the article placement area and the foreground image; determining a second distance between the article placement area and the background image according to the article placement area in the environment image and the background image;
the display picture acquisition unit is used for indicating the server to be in front of the first area, and adopting a preset image collector to carry out image acquisition processing on the first image, the article to be displayed and the second image so as to obtain a display picture;
a first distance determining unit, configured to instruct a server to determine whether a distance between the article to be displayed and the first image in the display picture is equal to the first distance, and determine whether a distance between the article to be displayed and the second image in the display picture is equal to the second distance;
and the display picture sending unit is used for indicating that if the distance between the article to be displayed and the first image is equal to the first distance in the display picture, and the distance between the article to be displayed and the second image is equal to the second distance in the display picture, the display picture is sent to the client, so that the article display based on the virtual back projection is completed.
The present application provides a computer device comprising a memory storing a computer program and a processor implementing the steps of any of the above methods when the processor executes the computer program.
The present application provides a computer-readable storage medium having stored thereon a computer program which, when being executed by a processor, carries out the steps of the method of any of the above.
The article display method and device based on the virtual back projection, the computer equipment and the storage medium acquire the environment image sent by the client; performing foreground and background splitting processing to split a foreground image and a background image; performing projection processing on a foreground image in a first area in a real space to form a first image; performing projection processing on the background image in a second area in the real space to form a second image; determining a first distance of the item placement area from the foreground image; determining a second distance between the article placement area and the background image; carrying out image acquisition processing on the first image, the article to be displayed and the second image to obtain a display picture; and sending the display picture to the client side, thereby finishing the display of the article based on the virtual back projection, improving the display effect of the article and saving the time and energy of the user.
Drawings
Fig. 1 is a schematic flowchart of an article displaying method based on virtual back projection according to an embodiment of the present application;
FIG. 2 is a block diagram of a virtual back projection based article display device according to an embodiment of the present application;
fig. 3 is a block diagram illustrating a structure of a computer device according to an embodiment of the present application.
The implementation, functional features and advantages of the objectives of the present application will be further explained with reference to the accompanying drawings.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
Referring to fig. 1, an embodiment of the present application provides an article display method based on virtual back projection, including the following steps:
s1, the server acquires the environment image sent by the client; wherein the environment image is marked with an article placement area;
s2, the server splits the foreground and the background of the environment image according to a preset image splitting method to split the foreground image and the background image;
s3, the server performs projection processing on the foreground image in a first area in the real space by a first projection method through a preset first projection device to form a first image; wherein, the real space is provided with an article to be displayed, and the first area is positioned in front of the article to be displayed; in the projection process of the first projection method, the part of the adopted film which is not projected with colors is transparent, and the part of the projected colors is non-transparent;
s4, the server performs projection processing of the background image in a second area in the real space by a second projection method through a preset second projection device to form a second image; wherein the second area is located behind the item to be displayed;
s5, the server determines a first distance between the article placement area and the foreground image according to the article placement area in the environment image and the foreground image; determining a second distance between the article placement area and the background image according to the article placement area in the environment image and the background image;
s6, the server adopts a preset image collector in front of the first area to collect and process the first image, the article to be displayed and the second image to obtain a display picture;
s7, the server determines whether the distance between the article to be displayed and the first image in the display picture is equal to the first distance, and determines whether the distance between the article to be displayed and the second image in the display picture is equal to the second distance;
s8, if the distance between the article to be displayed and the first image is equal to the first distance in the display picture, and the distance between the article to be displayed and the second image is equal to the second distance in the display picture, sending the display picture to the client, and accordingly completing the article display based on virtual back projection.
The execution terminal of the application is a server, for example, a server of an online shopping mall. The client may be any feasible terminal, such as a PC terminal, a mobile terminal, and the like. The method and the device can be applied to any feasible scene, and are preferably applied to the scene of commodity display during online shopping. The virtual back projection is named for a conventional projection technology, in which an image of an article a is collected and projected to a position B (for example, on a screen of a certain terminal or on a certain projection wall), and this way cannot effectively display the article, because the article is integrated with the environment and cannot be divided, so that a viewer cannot know specific attributes of the article in other environments, such as size difference, color difference, and the like. The virtual back projection of the present application can do this, specifically, the present application projects the environment of the viewer to the article to be displayed (this is the origin of the back projection), and then collects the image, so that the viewer can obtain the specific condition of the article to be displayed in the specific environment.
The article to be displayed can be any feasible article, preferably furniture, in particular large furniture. For traditional large-scale furniture purchase custom, large-scale furniture generally all need go to the shop purchase of going off the line (and still can not necessarily solve the problem that whether the furniture of selecting in the shop of going off the line matches with the environment at home), adopt the scheme of this application, can confirm the matching problem of large-scale furniture and environment at home, saved the selection link of shop of going off the line, improved overall efficiency. In addition, the article to be displayed may also be a wearing article, such as a garment or the like.
As described in the above steps S1-S4, the server obtains the environment image sent by the client; wherein the environment image is marked with an article placement area; the server carries out foreground and background splitting processing on the environment image according to a preset image splitting method so as to split a foreground image and a background image; the server performs projection processing on a foreground image in a first area in a real space by a preset first projection device by adopting a first projection method to form a first image; wherein, the real space is provided with an article to be displayed, and the first area is positioned in front of the article to be displayed; in the projection process of the first projection method, the part of the adopted film which is not projected with colors is transparent, and the part of the projected colors is non-transparent; the server performs projection processing on the background image in a second area in the real space by a preset second projection device by adopting a second projection method to form a second image; wherein the second region is located behind the item to be displayed.
The environment image sent by the client may be an environment image shot by the user in advance (that is, an image shot in a real space), an environment image generated by the user through a drawing tool or a three-dimensional construction tool, or an environment image shot by the user at that time at home. For example, if the article to be displayed is an article such as a wardrobe or a washing machine, the environment image is a corresponding environment image in home, and the region intended to be placed can be marked, that is, the environment image is marked with the article placement region.
And the server performs foreground and background splitting processing on the environment image according to a preset image splitting method so as to split a foreground image and a background image. The foreground image refers to an image in front of the object placement area, and the background image refers to an image behind the object placement area. The specific image splitting method may adopt any feasible method, for example, acquiring shooting parameters (including depth of field) when the image is shot, and determining which parts in the environmental image are foreground and which parts are background based on the shooting parameters.
The first image is projected by the first projection device, and the purpose of the projection device is to realize virtual back projection of the first part. The first projection method is a transparent projection method, that is, in the projection process of the first projection method, the part of the adopted film screen without projected colors is transparent, while the part of the projected colors is non-transparent, and only through the arrangement, the subsequent object to be displayed and the background image can be acquired during the subsequent image acquisition. The first projection method may employ any feasible method, for example, the first projection method is water mist projection or transparent film projection. Furthermore, the first projection is prepared by using water mist or a transparent film as a projection curtain; when the first projection is prepared by using water mist as a projection curtain, a plurality of water mist spraying holes are arranged above a first area in real space (for example, on a ceiling), and the plurality of water mist spraying holes are not in the same straight line. Therefore, the projection effect of the foreground image is more stereoscopic, and the final article display effect is better.
The first image projected by the first projection method of the present application can be regarded as an aerial projection, that is, it has a certain transparency characteristic, which is a precondition for the implementation of the present application.
The server performs projection processing on the background image in a second area in the real space by a preset second projection device by adopting a second projection method to form a second image; wherein the second region is located behind the item to be displayed. At this time, the second projection method may be the same as or different from the first projection method, and preferably, the second projection method may be different from the first projection method. That is, the second projection method may adopt a conventional projection method, using a solid curtain as a projection wall, which is lower in cost than the water mist projection method and the like, and the second projection method does not require transparency.
Further, the server acquires an environment image sent by the client; before step S1, in which the environment image is marked with an item placement area, the method includes:
s001, starting a preset visible light flash lamp by a client to irradiate a preset environment, and carrying out image acquisition processing on the preset environment by adopting a preset visible light camera to obtain a first environment image; the preset environment comprises an article placing area, a first boundary line drawn by a first material and a second boundary line drawn by a second material, wherein the first boundary line is positioned in front of the article placing area, and the second boundary line is positioned behind the article placing area; the first material is capable of converting ultraviolet light into visible light of a first color, and the second material is capable of converting ultraviolet light into visible light of a second color;
s002, the client starts a preset ultraviolet flash lamp to irradiate the preset environment, and a preset visible light camera is adopted to perform image acquisition processing on the preset environment to obtain a second environment image;
s003, generating an image sending instruction by the client to indicate that the first environment image and the second environment image are sent to a server;
the step S2, in which the server performs foreground and background splitting processing on the environment image according to a preset image splitting method to split a foreground image and a background image, includes:
s201, the server splits a foreground image from the second environment image according to a first boundary line in a first color in the second environment image;
s202, the server splits the background image from the second environment image according to a second boundary line in a second color in the second environment image.
Therefore, the separation of the foreground image and the background image is more accurate and quicker. The first material and the second material may be any feasible material, such as an ultraviolet-to-visible light material (e.g., a rare earth-based material, such as rare earth-doped calcium titanate, which can convert ultraviolet light into yellow light by controlling the doping amount and the type of the doped rare earth element) or a light conversion resin (e.g., a maleic anhydride copolymer-based resin, which can convert ultraviolet light into blue light), and the material has a specific energy band structure, and electrons of the material can emit visible light photons under an ultraviolet light environment. The specific principle is as follows: the uv-to-visible material has a specific energy gap (difference between energy levels) and is matched to uv light, so that electrons of the uv-to-visible material can absorb energy of a uv photon in a ground state to transit to an excited state (higher energy level), and can jump down to emit visible light due to instability of electrons of the excited state (because the difference between two energy levels of the transition is matched to visible light, and the transition is from a high energy level to a low energy level, but not necessarily a direct transition to the ground state, and thus can emit visible light). In addition, ultraviolet lamps are also used as common tools by some households due to their germicidal properties. In addition, the execution main part at this time is a client.
By presetting the first boundary line and the second boundary line, the foreground and the background can be accurately divided. In this case, the first environment image used as the base image is used for image comparison without showing two boundaries, and the second environment image is a division image showing two boundaries having different colors. Therefore, when the server performs the specific foreground and background splitting processing, the image splitting can be performed quickly only by detecting two continuous boundary lines of the first color and the second color.
As described in the above steps S5-S8, the server determines a first distance between the item placement area and the foreground image based on the item placement area in the environment image and the foreground image; determining a second distance between the article placement area and the background image according to the article placement area in the environment image and the background image; the server is arranged in front of the first area, and a preset image collector is adopted to collect and process the first image, the article to be displayed and the second image so as to obtain a display picture; the server judges whether the distance between the article to be displayed and the first image is equal to the first distance in the display picture and judges whether the distance between the article to be displayed and the second image is equal to the second distance in the display picture; if the distance between the article to be displayed and the first image is equal to the first distance in the display picture, and the distance between the article to be displayed and the second image is equal to the second distance in the display picture, the display picture is sent to the client, so that the article display based on the virtual back projection is completed.
The foreground image is in front of the object placing area, so that a certain distance exists between the foreground image and the object placing area in fact, and the distance can be reflected in the environment image; similarly, a second distance between the article placement area and the background image can be reflected in the environment image. Therefore, a first distance between the article placement area and the foreground image is determined; determining a second distance between the article placement area and the background image. The method and the device aim to enable the subsequent display pictures to be matched with the real environment corresponding to the environment image as much as possible, and because the scene in the environment image cannot be really restored, the projection position needs to be debugged more accurately, so that the reality of the display pictures is improved.
Further, the server determines a first distance between an article placement area in the environment image and the foreground image according to the article placement area and the foreground image; step S5, determining a second distance between the article placement area and the background image based on the article placement area in the environment image and the background image, includes:
s501, recording the distance between the article placement area in the second environment image and the first boundary line in the first color as a first distance by the server;
s502, the server marks the distance between the article placement area in the second environment image and the second boundary line in the second color as a second distance.
Since the boundary line is present, the distance between the article placement area and the foreground area is easily defined, and therefore, when the determination process of the first distance and the second distance is performed, it is only necessary to determine the distance between the article placement area and the first boundary line in the first color and to determine the distance between the article placement area and the second boundary line in the second color. Thereby increasing the processing speed.
And the server is arranged in front of the first area, and a preset image collector is adopted to collect and process the first image, the article to be displayed and the second image so as to obtain a display picture. The display picture obtained at this time includes the first image, the article to be displayed and the second image. The first image is used for replacing foreground scenery of the user environment, and the second image is used for replacing background scenery of the user environment, so that the scenery in the user environment does not need to be really restored, and the effect similar to the effect of placing the object to be displayed to the user environment and then shooting can be achieved.
In addition, in order to improve the projected authenticity, the method adopts the judgment in the display picture, treat the display article and whether the distance between the first images is equal to the first distance, and judge in the display picture, treat the display article and whether the distance between the second images is equal to the second distance, so as to ensure that the projection is the same as or similar to the environmental image as far as possible, and thus the user can obtain better experience.
If the distance between the article to be displayed and the first image is equal to the first distance in the display picture and the distance between the article to be displayed and the second image is equal to the second distance in the display picture, the display picture is sent to the client side, so that article display based on virtual back projection is completed.
Further, dress the article to be shown on the show robot, the bodily form parameter of show robot is adjustable, the server is in the place ahead in first region adopts preset image collector, to first image, article to be shown and the second image carry out image acquisition and handle to before step S6 of obtaining the show picture, include:
s51, the server acquires the body shape parameters of the client sent by the client;
s52, the server sends the body shape parameters and body shape modification instructions of the client to the display robot to request the display robot to modify the body shape parameters to be the same as the body shape parameters of the client;
s53, the server generates an image acquisition instruction to instruct image acquisition processing on the first image, the article to be displayed and the second image.
The article to be displayed in this case is, for example, a skirt, a jacket, or the like. Through the modification to the bodily form parameter of show robot for not only the matching degree of waiting to demonstrate article and environment can show, but also can show the matching degree of waiting to demonstrate article to user self, thereby the user of being convenient for selects suitable own article.
In addition, the article display method can be used for displaying a plurality of terminals, and virtual back projection article display aiming at different user requirements can be realized only by changing the projection images.
According to the article display method based on the virtual back projection, the environment image sent by the client side is obtained; performing foreground and background splitting processing to split a foreground image and a background image; performing projection processing on a foreground image in a first area in a real space to form a first image; performing projection processing on the background image in a second area in the real space to form a second image; determining a first distance of the item placement area from the foreground image; determining a second distance between the article placement area and the background image; carrying out image acquisition processing on the first image, the article to be displayed and the second image to obtain a display picture; and sending the display picture to the client side, thereby finishing the display of the article based on the virtual back projection, improving the display effect of the article and saving the time and energy of the user.
Referring to fig. 2, an embodiment of the present application provides an article display apparatus based on virtual back projection, including:
an environment image acquiring unit 10, configured to instruct a server to acquire an environment image sent by a client; wherein the environment image is marked with an article placement area;
the image splitting unit 20 is configured to instruct the server to perform foreground and background splitting processing on the environment image according to a preset image splitting method, so as to split a foreground image and a background image;
the first projection unit 30 is configured to instruct the server to perform projection processing on a foreground image in a first area in a real space by using a first projection method through a preset first projection device to form a first image; wherein, the real space is provided with an article to be displayed, and the first area is positioned in front of the article to be displayed; in the projection process of the first projection method, the part of the adopted film which is not projected with colors is transparent, and the part of the projected colors is non-transparent;
the second projection unit 40 is configured to instruct the server to perform projection processing on the background image in a second area in the real space by using a second projection method through a preset second projection device to form a second image; wherein the second area is located behind the item to be displayed;
a first distance determining unit 50, configured to instruct a server to determine a first distance between an article placement area in the environment image and the foreground image according to the article placement area and the foreground image; determining a second distance between the article placement area and the background image according to the article placement area in the environment image and the background image;
a display picture obtaining unit 60, configured to instruct a server to perform image acquisition processing on the first image, the article to be displayed, and the second image by using a preset image acquisition device in front of the first area, so as to obtain a display picture;
a first distance determining unit 70, configured to instruct a server to determine whether a distance between the article to be displayed and the first image in the display picture is equal to the first distance, and determine whether a distance between the article to be displayed and the second image in the display picture is equal to the second distance;
a display picture sending unit 80, configured to indicate that, if, in the display picture, the distance between the to-be-displayed item and the first image is equal to the first distance, and, in the display picture, the distance between the to-be-displayed item and the second image is equal to the second distance, the display picture is sent to the client, so as to complete the virtual back projection-based item display.
The operations performed by the units are respectively corresponding to the steps of the method for displaying an article based on virtual back projection in the foregoing embodiment one by one, and are not described herein again.
The article display device based on the virtual back projection obtains an environment image sent by a client; performing foreground and background splitting processing to split a foreground image and a background image; performing projection processing on a foreground image in a first area in a real space to form a first image; performing projection processing on the background image in a second area in the real space to form a second image; determining a first distance of the item placement area from the foreground image; determining a second distance between the article placement area and the background image; carrying out image acquisition processing on the first image, the article to be displayed and the second image to obtain a display picture; and sending the display picture to the client side, thereby finishing the display of the article based on the virtual back projection, improving the display effect of the article and saving the time and energy of the user.
Referring to fig. 3, an embodiment of the present invention further provides a computer device, where the computer device may be a server, and an internal structure of the computer device may be as shown in the figure. The computer device includes a processor, a memory, a network interface, and a database connected by a system bus. Wherein the computer designed processor is used to provide computational and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used for storing data used by the virtual back projection based item display method. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement a virtual backprojection-based item presentation method. The computer equipment also comprises a display screen and an input device which are respectively used for displaying the human-computer interaction interface and receiving the input instruction.
The processor executes the method for displaying an article based on virtual back projection, wherein the steps included in the method correspond to the steps of executing the method for displaying an article based on virtual back projection in the foregoing embodiment one to one, and are not described herein again.
It will be understood by those skilled in the art that the structures shown in the drawings are only block diagrams of some of the structures associated with the embodiments of the present application and do not constitute a limitation on the computer apparatus to which the embodiments of the present application may be applied.
The computer equipment acquires an environment image sent by a client; performing foreground and background splitting processing to split a foreground image and a background image; performing projection processing on a foreground image in a first area in a real space to form a first image; performing projection processing on the background image in a second area in the real space to form a second image; determining a first distance of the item placement area from the foreground image; determining a second distance between the article placement area and the background image; carrying out image acquisition processing on the first image, the article to be displayed and the second image to obtain a display picture; and sending the display picture to the client side, thereby finishing the display of the article based on the virtual back projection, improving the display effect of the article and saving the time and energy of the user.
An embodiment of the present application further provides a computer-readable storage medium, where a computer program is stored thereon, and when the computer program is executed by a processor, the method for displaying an article based on virtual back projection is implemented, where steps included in the method correspond to steps of executing the method for displaying an article based on virtual back projection in the foregoing embodiment one to one, and are not described herein again.
The computer-readable storage medium of the application acquires an environment image sent by a client; performing foreground and background splitting processing to split a foreground image and a background image; performing projection processing on a foreground image in a first area in a real space to form a first image; performing projection processing on the background image in a second area in the real space to form a second image; determining a first distance of the item placement area from the foreground image; determining a second distance between the article placement area and the background image; carrying out image acquisition processing on the first image, the article to be displayed and the second image to obtain a display picture; and sending the display picture to the client side, thereby finishing the display of the article based on the virtual back projection, improving the display effect of the article and saving the time and energy of the user.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by hardware associated with a computer program or instructions, the computer program can be stored in a non-volatile computer-readable storage medium, and the computer program can include the processes of the embodiments of the methods described above when executed. Any reference to memory, storage, database, or other medium provided herein and used in the examples may include non-volatile and/or volatile memory. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), double-rate SDRAM (SSRSDRAM), Enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and bus dynamic RAM (RDRAM).
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, apparatus, article, or method that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, apparatus, article, or method. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, apparatus, article, or method that includes the element.
The above description is only a preferred embodiment of the present application, and not intended to limit the scope of the present application, and all modifications of equivalent structures and equivalent processes, which are made by the contents of the specification and the drawings of the present application, or which are directly or indirectly applied to other related technical fields, are also included in the scope of the present application.
Claims (7)
1. An article display method based on virtual back projection is characterized by comprising the following steps:
s1, the server acquires the environment image sent by the client; wherein the environment image is marked with an article placement area;
s2, the server splits the foreground and the background of the environment image according to a preset image splitting method to split the foreground image and the background image;
s3, the server performs projection processing on the foreground image in a first area in the real space by a first projection method through a preset first projection device to form a first image; wherein, the real space is provided with an article to be displayed, and the first area is positioned in front of the article to be displayed; in the projection process of the first projection method, the part of the adopted film which is not projected with colors is transparent, and the part of the projected colors is non-transparent;
s4, the server performs projection processing of the background image in a second area in the real space by a second projection method through a preset second projection device to form a second image; wherein the second area is located behind the item to be displayed;
s5, the server determines a first distance between the article placement area and the foreground image according to the article placement area in the environment image and the foreground image; determining a second distance between the article placement area and the background image according to the article placement area in the environment image and the background image;
s6, the server adopts a preset image collector in front of the first area to collect and process the first image, the article to be displayed and the second image to obtain a display picture;
s7, the server determines whether the distance between the article to be displayed and the first image in the display picture is equal to the first distance, and determines whether the distance between the article to be displayed and the second image in the display picture is equal to the second distance;
s8, if the distance between the article to be displayed and the first image in the display picture is equal to the first distance, and the distance between the article to be displayed and the second image in the display picture is equal to the second distance, sending the display picture to the client, thereby completing the article display based on the virtual back projection;
the server acquires an environment image sent by a client; before step S1, in which the environment image is marked with an item placement area, the method includes:
s001, starting a preset visible light flash lamp by a client to irradiate a preset environment, and carrying out image acquisition processing on the preset environment by adopting a preset visible light camera to obtain a first environment image; the preset environment comprises an article placing area, a first boundary line drawn by a first material and a second boundary line drawn by a second material, wherein the first boundary line is positioned in front of the article placing area, and the second boundary line is positioned behind the article placing area; the first material is capable of converting ultraviolet light into visible light of a first color, and the second material is capable of converting ultraviolet light into visible light of a second color;
s002, the client starts a preset ultraviolet flash lamp to irradiate the preset environment, and a preset visible light camera is adopted to perform image acquisition processing on the preset environment to obtain a second environment image;
s003, generating an image sending instruction by the client to indicate that the first environment image and the second environment image are sent to a server;
the step S2, in which the server performs foreground and background splitting processing on the environment image according to a preset image splitting method to split a foreground image and a background image, includes:
s201, the server splits a foreground image from the second environment image according to a first boundary line in a first color in the second environment image;
s202, the server splits the background image from the second environment image according to a second boundary line in a second color in the second environment image.
2. The virtual back projection-based item display method of claim 1, wherein the server determines a first distance between an item placement area in the environment image and the foreground image based on the item placement area and the foreground image; step S5, determining a second distance between the article placement area and the background image based on the article placement area in the environment image and the background image, includes:
s501, recording the distance between the article placement area in the second environment image and the first boundary line in the first color as a first distance by the server;
s502, the server marks the distance between the article placement area in the second environment image and the second boundary line in the second color as a second distance.
3. The virtual-backprojection-based item display method of claim 1, wherein the first projection method is water mist projection or transparent film projection; the first projection device takes water mist or a transparent film as a projection curtain;
when the first projection device takes water mist as a projection curtain, a plurality of water mist injection holes are arranged above a first area in a real space, and the water mist injection holes are not positioned on the same straight line.
4. The method for displaying an article based on virtual back projection according to claim 1, wherein the article to be displayed is worn on a display robot, the body shape parameters of the display robot are adjustable, and the step S6 of performing image acquisition processing on the first image, the article to be displayed and the second image by using a preset image acquisition device in front of the first area by the server to obtain a display picture includes:
s51, the server acquires the body shape parameters of the client sent by the client;
s52, the server sends the body shape parameters and body shape modification instructions of the client to the display robot to request the display robot to modify the body shape parameters to be the same as the body shape parameters of the client;
s53, the server generates an image acquisition instruction to instruct image acquisition processing on the first image, the article to be displayed and the second image.
5. An article display device based on virtual back projection, comprising:
the environment image acquisition unit is used for indicating the server to acquire the environment image sent by the client; wherein the environment image is marked with an article placement area;
the image splitting unit is used for indicating the server to split the foreground and background of the environment image according to a preset image splitting method so as to split the foreground image and the background image;
the first projection unit is used for indicating the server to perform projection processing on a foreground image in a first area in a real space by a first projection method through a preset first projection device so as to form a first image; wherein, the real space is provided with an article to be displayed, and the first area is positioned in front of the article to be displayed; in the projection process of the first projection method, the part of the adopted film which is not projected with colors is transparent, and the part of the projected colors is non-transparent;
the second projection unit is used for indicating the server to perform projection processing on the background image in a second area in the real space by a second projection method through a preset second projection device so as to form a second image; wherein the second area is located behind the item to be displayed;
a first distance determining unit, configured to instruct a server to determine a first distance between an article placement area in the environment image and the foreground image based on the article placement area and the foreground image; determining a second distance between the article placement area and the background image according to the article placement area in the environment image and the background image;
the display picture acquisition unit is used for indicating the server to be in front of the first area, and adopting a preset image collector to carry out image acquisition processing on the first image, the article to be displayed and the second image so as to obtain a display picture;
a first distance determining unit, configured to instruct a server to determine whether a distance between the article to be displayed and the first image in the display picture is equal to the first distance, and determine whether a distance between the article to be displayed and the second image in the display picture is equal to the second distance;
a display picture sending unit, configured to indicate that, if, in the display picture, a distance between the to-be-displayed item and the first image is equal to the first distance, and if, in the display picture, a distance between the to-be-displayed item and the second image is equal to the second distance, the display picture is sent to the client, so as to complete an item display based on virtual back projection;
the server acquires an environment image sent by a client; wherein, before the environment image marks the article placement area, the method comprises the following steps:
the method comprises the steps that a client starts a preset visible light flash lamp to irradiate a preset environment, and a preset visible light camera is adopted to conduct image acquisition processing on the preset environment to obtain a first environment image; the preset environment comprises an article placing area, a first boundary line drawn by a first material and a second boundary line drawn by a second material, wherein the first boundary line is positioned in front of the article placing area, and the second boundary line is positioned behind the article placing area; the first material is capable of converting ultraviolet light into visible light of a first color, and the second material is capable of converting ultraviolet light into visible light of a second color;
the client starts a preset ultraviolet flash lamp to irradiate a preset environment, and adopts a preset visible light camera to perform image acquisition processing on the preset environment so as to obtain a second environment image;
the client generates an image sending instruction to instruct to send the first environment image and the second environment image to a server;
the server performs foreground and background splitting processing on the environment image according to a preset image splitting method to split a foreground image and a background image, and the method comprises the following steps:
the server splits a foreground image from the second environment image according to a first boundary line in a first color in the second environment image;
and the server splits the background image from the second environment image according to a second boundary line in a second color in the second environment image.
6. A computer device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the steps of the method of any one of claims 1 to 4 when executing the computer program.
7. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111125904.3A CN113570441B (en) | 2021-09-26 | 2021-09-26 | Article display method and device based on virtual back projection |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111125904.3A CN113570441B (en) | 2021-09-26 | 2021-09-26 | Article display method and device based on virtual back projection |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113570441A CN113570441A (en) | 2021-10-29 |
| CN113570441B true CN113570441B (en) | 2022-02-01 |
Family
ID=78174466
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111125904.3A Active CN113570441B (en) | 2021-09-26 | 2021-09-26 | Article display method and device based on virtual back projection |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113570441B (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104700352A (en) * | 2013-12-09 | 2015-06-10 | Cjcgv株式会社 | Method for generating images for multi-projection theater and image management apparatus using the same |
| CN108364209A (en) * | 2018-02-01 | 2018-08-03 | 北京京东金融科技控股有限公司 | Methods of exhibiting, device, medium and the electronic equipment of merchandise news |
| CN109521879A (en) * | 2018-11-19 | 2019-03-26 | 网易（杭州）网络有限公司 | Interactive projection control method, device, storage medium and electronic equipment |
| CN111275731A (en) * | 2020-01-10 | 2020-06-12 | 杭州师范大学 | Projection type real object interactive desktop system and method for middle school experiment |
| CN111882408A (en) * | 2020-09-27 | 2020-11-03 | 北京达佳互联信息技术有限公司 | Virtual trial method and device, electronic equipment and storage equipment |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8884984B2 (en) * | 2010-10-15 | 2014-11-11 | Microsoft Corporation | Fusing virtual content into real content |
| CN104464389A (en) * | 2013-09-15 | 2015-03-25 | 南京大五教育科技有限公司 | Virtual teaching system based on augmented reality |
| CN105184808B (en) * | 2015-10-13 | 2018-09-07 | 中国科学院计算技术研究所 | Scape automatic division method before and after a kind of light field image |
| CN107862563A (en) * | 2017-09-16 | 2018-03-30 | 深圳市赛亿科技开发有限公司 | Virtual shopping method and system |
| CN110392251B (en) * | 2018-04-18 | 2021-07-16 | 广景视睿科技（深圳）有限公司 | Dynamic projection method and system based on virtual reality |
-
2021
- 2021-09-26 CN CN202111125904.3A patent/CN113570441B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104700352A (en) * | 2013-12-09 | 2015-06-10 | Cjcgv株式会社 | Method for generating images for multi-projection theater and image management apparatus using the same |
| CN108364209A (en) * | 2018-02-01 | 2018-08-03 | 北京京东金融科技控股有限公司 | Methods of exhibiting, device, medium and the electronic equipment of merchandise news |
| CN109521879A (en) * | 2018-11-19 | 2019-03-26 | 网易（杭州）网络有限公司 | Interactive projection control method, device, storage medium and electronic equipment |
| CN111275731A (en) * | 2020-01-10 | 2020-06-12 | 杭州师范大学 | Projection type real object interactive desktop system and method for middle school experiment |
| CN111882408A (en) * | 2020-09-27 | 2020-11-03 | 北京达佳互联信息技术有限公司 | Virtual trial method and device, electronic equipment and storage equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113570441A (en) | 2021-10-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111832745B (en) | Data augmentation method and device and electronic equipment | |
| US20190311544A1 (en) | Image processing for augmented reality | |
| CN103795998B (en) | Image processing method and image processing equipment | |
| US20150109339A1 (en) | Method and apparatus for implementing augmented reality | |
| US20140257532A1 (en) | Apparatus for constructing device information for control of smart appliances and method thereof | |
| CN104899920A (en) | Image processing method, image processing device and electronic device | |
| CN108572772A (en) | Image content rendering method and device | |
| KR20150012299A (en) | Image processing method and apparatus | |
| CN110880139B (en) | Commodity display method, commodity display device, terminal, server and storage medium | |
| CN114882167B (en) | Shoe logo design method and device based on association elements | |
| CN102917158A (en) | Dynamic color replacing device and method as well as cellphone | |
| US20120113109A1 (en) | Method and apparatus for searching for image data | |
| CN113570441B (en) | Article display method and device based on virtual back projection | |
| US11579746B2 (en) | Dynamic image capturing apparatus and method using arbitrary viewpoint image generation technology | |
| CN114494659A (en) | Image display method and device, AR head-mounted equipment and storage medium | |
| US11043019B2 (en) | Method of displaying a wide-format augmented reality object | |
| CN103731657A (en) | Hole filling processing method of hole-containing image processed by DIBR (Depth Image Based Rendering) algorithm | |
| JP2020014075A (en) | Image projection system, image projection method, and program | |
| KR102161437B1 (en) | Apparatus for sharing contents using spatial map of augmented reality and method thereof | |
| CN110660136A (en) | Virtual house decoration method based on VR equipment, VR equipment and storage medium | |
| CN106055108B (en) | Virtual touch screen control method and system | |
| CN114442888A (en) | Object determination method and device and electronic equipment | |
| CN107580157A (en) | Image processing apparatus, image processing method and program | |
| US10225655B1 (en) | Stereo user interface elements placed in 3D space for virtual reality applications in head mounted displays | |
| KR20160056132A (en) | Image conversion apparatus and image conversion method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20230728 Address after: Room 12407, 24th Floor, Building 1, China Railway Construction Ruiyuan, No. 6, North Section of Gaoxin 6th Road, Yanta District, Xi'an City, Shaanxi Province, 710000 Patentee after: Xi'an Hemu Fangsheng Technology Co.,Ltd. Address before: 510000 rooms 1401-1419, 1501-1519, No. 48, wanhuiyi Road, Nancun Town, Panyu District, Guangzhou City, Guangdong Province Patentee before: Guangzhou new AODA cloud Technology Co.,Ltd. |
|
| TR01 | Transfer of patent right |