CN115063564B - Method, device and medium for displaying object label in two-dimensional display image - Google Patents

Method, device and medium for displaying object label in two-dimensional display image Download PDF

Info

Publication number
CN115063564B
CN115063564B CN202210820670.2A CN202210820670A CN115063564B CN 115063564 B CN115063564 B CN 115063564B CN 202210820670 A CN202210820670 A CN 202210820670A CN 115063564 B CN115063564 B CN 115063564B
Authority
CN
China
Prior art keywords
display
label
item
determining
overlap
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210820670.2A
Other languages
Chinese (zh)
Other versions
CN115063564A (en
Inventor
李阳
李蕊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
You Can See Beijing Technology Co ltd AS
Original Assignee
You Can See Beijing Technology Co ltd AS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by You Can See Beijing Technology Co ltd AS filed Critical You Can See Beijing Technology Co ltd AS
Priority to CN202210820670.2A priority Critical patent/CN115063564B/en
Publication of CN115063564A publication Critical patent/CN115063564A/en
Application granted granted Critical
Publication of CN115063564B publication Critical patent/CN115063564B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/003Navigation within 3D models or images

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)

Abstract

The disclosure provides a method, a device and a medium for displaying an article label in a two-dimensional display image, and relates to the technical field of computers, wherein the method comprises the following steps: determining position information and article label information of display candidate articles in a two-dimensional display image according to the three-dimensional model, performing label overlapping judgment processing on the display candidate articles to determine display target articles with non-overlapping article labels, and performing display processing on the display target articles in the two-dimensional display image; when the number of the articles is large, the overlapping condition among the labels of the articles can be avoided, the completeness of the display of the labels of the articles can be ensured, the calculation complexity is low, and the efficiency is high; the article display effect is improved, and the experience of the user is effectively improved.

Description

Method, device and medium for displaying object label in two-dimensional display image
Technical Field
The disclosure relates to the field of computer technology, and in particular, to a method and a device for displaying an article label in a two-dimensional display image, an electronic device, and a storage medium.
Background
VR (Virtual Reality) panoramic technology is an emerging technology, and because VR panoramic technology can be 720 degrees no dead angle, three-dimensional space scene is presented for the user, and immersion type visual experience is brought for the user, the user can see the simulation fitment scheme in room selection room through VR, can realize house fitment effect simulation etc. in VR scene. In the VR house watching process, a user can confirm the displayed observation image based on the position information and the visual angle information by confirming the position information and the visual angle information of the virtual observation point in the VR model, and can see articles in the observation image, including articles such as furniture, refrigerators, mirrors, televisions and the like. In order to show the information of the articles, a line segment is vertically mapped in the observed image by taking the center point of the articles as the origin of coordinates and the ground as the horizontal plane, and a label describing the information of the articles is added at the tail end of the line segment. Because the number of the objects appearing in the same observation image is large, the labels of the objects can be overlapped, the visual effect for the user is poor, and the experience of the user is not high.
Disclosure of Invention
The present disclosure has been made in order to solve the above technical problems. The embodiment of the disclosure provides a method and a device for displaying an article label in a two-dimensional display image, electronic equipment and a storage medium.
According to a first aspect of embodiments of the present disclosure, there is provided an article tag display method for use in a two-dimensional display image, including: acquiring a two-dimensional display image corresponding to a user observation visual angle based on the three-dimensional model; determining position information of a display candidate object in the two-dimensional display image according to the three-dimensional model; determining item tag information corresponding to the display candidate item; performing label overlapping judgment processing on the display candidate object based on the position information and the object label information to determine a display target object with non-overlapping object labels; and displaying the display target object in the two-dimensional display image according to the object label information corresponding to the display target object.
Optionally, the location information includes: an abscissa and an ordinate corresponding to the article; the article tag information includes: label width and label line height; the label overlap judging process for the display candidate item based on the position information and the item label information, for determining a display target item with non-overlapping item labels, includes: performing a first overlap determination process between the display candidate items based on the abscissa and the tag width; performing a second overlap determination process between the display candidate items based on the ordinate and the tag line height; and determining the display target object according to the results of the first overlapping judgment processing and the second overlapping judgment processing.
Optionally, performing the first overlap determination process and performing the second overlap determination process includes: selecting one display candidate item as the display target item according to an item selection strategy, generating a first set, and constructing a second set corresponding to the rest display candidate items; sequentially selecting one display candidate item from the second set according to the item selection strategy, and sequentially carrying out first overlapping judgment processing by using the abscissa and the label width of the display candidate item and the abscissa and the label width of each display target item in the second set; and, using the ordinate and the tag line height of the display candidate item and the ordinate and the tag line height of each display target item in the second set in order, performing a second overlap determination process.
Optionally, the determining the display target object according to the results of the first overlap determination process and the second overlap determination process includes: if the results of the first overlap judging process and the second overlap judging process are that no overlap occurs, setting the display candidate item as a display target item and adding the display candidate item to a first set; the displaying the display target object in the two-dimensional display image according to the object label information corresponding to the display target object comprises the following steps: and acquiring the label width and the label line height of each display target object in the first set, and performing display processing on each display target object in the first set in the two-dimensional display image.
Optionally, the performing the first overlap determination processing using the abscissa and the tag width of the display candidate item and the abscissa and the tag width of each display target item in the second set sequentially includes: calculating a first coordinate difference of two abscissas corresponding to the display candidate item and the display target item; determining a first overlap threshold based on an average of two label widths corresponding to the display candidate item and the display target item; and if the first coordinate difference value is larger than the first overlap threshold value, determining that the result of the first overlap judgment processing is that no overlap occurs.
Optionally, the performing the second overlapping determining process by using the ordinate and the label line height of the display candidate item and the ordinate and the label line height of each display target item in the second set sequentially includes: calculating a second coordinate difference of two vertical coordinates corresponding to the display candidate object and the display target object; determining a second overlap threshold based on an average of two label line heights corresponding to the display candidate item and the display target item; and if the second coordinate difference value is larger than the second overlapping threshold value, determining that the result of the second overlapping judgment processing is that no overlapping occurs.
Optionally, the determining, according to the three-dimensional model, the position information of the display candidate item in the two-dimensional display image includes: acquiring three-dimensional coordinates of the label mark points of the display candidate object in the three-dimensional model; and determining the abscissa and the ordinate of the label mark point in the two-dimensional display image based on the three-dimensional coordinates.
Optionally, the determining item tag information corresponding to the display candidate item includes: determining the label width based on label content corresponding to the display candidate item, wherein if the label width is greater than a preset width threshold, the label width is set as the width threshold; determining the height of the tag line according to the type of the display equipment and based on the distance between the display candidate object and a preset height reference plane; wherein the tag line height is directly proportional to the distance.
Optionally, the three-dimensional model includes: a three-dimensional model corresponding to the house; the article comprises: an item placed within the house.
According to a second aspect of embodiments of the present disclosure, there is provided an article tag display comprising: the display image determining module is used for acquiring a two-dimensional display image corresponding to the user observation visual angle based on the three-dimensional model; a position information determining module for determining position information of a display candidate item in the two-dimensional display image according to the three-dimensional model; a tag information determining module for determining item tag information corresponding to the display candidate item; the label overlapping judging module is used for carrying out label overlapping judging processing on the display candidate articles based on the position information and the article label information and determining display target articles with non-overlapping article labels; and the label display processing module is used for displaying the display target object in the two-dimensional display image according to the object label information corresponding to the display target object.
Optionally, the location information includes: an abscissa and an ordinate corresponding to the article; the article tag information includes: label width and label line height; the label overlap judging module includes: a judging unit configured to perform a first overlap judging process between the display candidate items based on the abscissa and the tag width; performing a second overlap determination process between the display candidate items based on the ordinate and the tag line height; and the determining unit is used for determining the display target object according to the results of the first overlapping judgment processing and the second overlapping judgment processing.
Optionally, the judging unit is configured to select, according to an item selection policy, one display candidate item as the display target item and generate a first set, and construct a second set corresponding to the remaining display candidate items; sequentially selecting one display candidate item from the second set according to the item selection strategy, and sequentially carrying out first overlapping judgment processing by using the abscissa and the label width of the display candidate item and the abscissa and the label width of each display target item in the second set; and, using the ordinate and the tag line height of the display candidate item and the ordinate and the tag line height of each display target item in the second set in order, performing a second overlap determination process.
Optionally, the determining unit is configured to set the display candidate item as the display target item and add the display candidate item to the first set if the results of the first overlap determination process and the second overlap determination process are both that no overlap occurs; the label display processing module is used for acquiring the label width and the label line height of each display target object in the first set, and performing display processing on each display target object in the first set in the two-dimensional display image.
Optionally, the judging unit is specifically configured to calculate a first coordinate difference value of two abscissas corresponding to the display candidate item and the display target item; determining a first overlap threshold based on an average of two label widths corresponding to the display candidate item and the display target item; and if the first coordinate difference value is larger than the first overlap threshold value, determining that the result of the first overlap judgment processing is that no overlap occurs.
Optionally, the judging unit is specifically configured to calculate a second coordinate difference value of two ordinate coordinates corresponding to the display candidate item and the display target item; determining a second overlap threshold based on an average of two label line heights corresponding to the display candidate item and the display target item; and if the second coordinate difference value is larger than the second overlapping threshold value, determining that the result of the second overlapping judgment processing is that no overlapping occurs.
Optionally, the position information determining module is configured to obtain three-dimensional coordinates of a tag label point of the display candidate object in the three-dimensional model; and determining the abscissa and the ordinate of the label mark point in the two-dimensional display image based on the three-dimensional coordinates.
Optionally, the tag information determining module is configured to determine the tag width based on tag content corresponding to the display candidate item, where if the tag width is greater than a preset width threshold, the tag width is set to the width threshold; determining the height of the tag line according to the type of the display equipment and based on the distance between the display candidate object and a preset height reference plane; wherein the tag line height is directly proportional to the distance.
Optionally, the three-dimensional model includes: a three-dimensional model corresponding to the house; the article comprises: an item placed within the house.
According to a third aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium storing a computer program for executing the above-described method.
According to a fourth aspect of embodiments of the present disclosure, there is provided an electronic device comprising: a processor; a memory for storing the processor-executable instructions; the processor is used for executing the method.
Based on the method, the device, the electronic equipment and the storage medium for displaying the object tag in the two-dimensional display image provided by the embodiment of the disclosure, determining the position information and the object tag information of the display candidate object in the two-dimensional display image according to the three-dimensional model, performing tag overlapping judgment processing on the display candidate object to determine a display target object with non-overlapping object tag, and performing display processing on the display target object in the two-dimensional display image; when the number of the articles is large, the overlapping condition among the labels of a plurality of articles can be avoided, the completeness of the display of the articles can be ensured, the calculation complexity is low, and the efficiency is high; the article display effect is improved, and the experience of the user is effectively improved.
The technical scheme of the present disclosure is described in further detail below through the accompanying drawings and examples.
Drawings
The above and other objects, features and advantages of the present disclosure will become more apparent by describing embodiments thereof in more detail with reference to the accompanying drawings. The accompanying drawings are included to provide a further understanding of embodiments of the disclosure and are incorporated in and constitute a part of this specification, illustrate embodiments of the disclosure and together with the description serve to explain the disclosure, not to limit the disclosure. In the drawings, like reference numerals generally refer to like parts or steps.
FIG. 1 is a flow chart of one embodiment of a method of the present disclosure for displaying an item label in a two-dimensional display image;
FIG. 2 is a flow chart of a label overlap determination process in one embodiment of a method for displaying an item label in a two-dimensional display image of the present disclosure;
FIG. 3 is a schematic diagram of label overlap determination in one embodiment of a method for displaying an item label in a two-dimensional display image of the present disclosure;
FIGS. 4A-4D are schematic diagrams of an item tag display;
FIG. 5 is a schematic structural view of one embodiment of an article tag display of the present disclosure;
FIG. 6 is a schematic diagram of a label overlap determination module in one embodiment of an article label display device of the present disclosure;
Fig. 7 is a block diagram of one embodiment of an electronic device of the present disclosure.
Detailed Description
Example embodiments according to the present disclosure will be described in detail below with reference to the accompanying drawings. It should be apparent that the described embodiments are only some of the embodiments of the present disclosure and not all of the embodiments of the present disclosure, and that the present disclosure is not limited by the example embodiments described herein.
It should be noted that: the relative arrangement of the components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present disclosure unless it is specifically stated otherwise.
It will be appreciated by those of skill in the art that the terms "first," "second," etc. in embodiments of the present disclosure are used merely to distinguish between different steps, devices or modules, etc., and do not represent any particular technical meaning nor necessarily logical order between them.
It should also be understood that in embodiments of the present disclosure, "plurality" may refer to two or more, and "at least one" may refer to one, two or more.
It should also be appreciated that any component, data, or structure referred to in the presently disclosed embodiments may be generally understood as one or more without explicit limitation or the contrary in the context.
In addition, the term "and/or" in this disclosure is merely an association relationship describing an association object, and indicates that three relationships may exist, such as a and/or B, and may indicate: a exists alone, A and B exist together, and B exists alone. In addition, the character "/" in the present disclosure generally indicates that the front and rear association objects are an or relationship.
It should also be understood that the description of the various embodiments of the present disclosure emphasizes the differences between the various embodiments, and that the same or similar features may be referred to each other, and for brevity, will not be described in detail.
Meanwhile, it should be understood that the sizes of the respective parts shown in the drawings are not drawn in actual scale for convenience of description.
The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the disclosure, its application, or uses.
Techniques, methods, and apparatus known to one of ordinary skill in the relevant art may not be discussed in detail, but are intended to be part of the specification where appropriate.
It should be noted that: like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further discussion thereof is necessary in subsequent figures.
Embodiments of the present disclosure are applicable to electronic devices such as terminal devices, computer systems, servers, etc., which are operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known terminal devices, computing systems, environments, and/or configurations that may be suitable for use with the terminal device, computer system, or server, include, but are not limited to: personal computer systems, server computer systems, thin clients, thick clients, hand-held or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, minicomputer systems, mainframe computer systems, distributed cloud computing environments that include any of the above systems, and the like.
Electronic devices such as terminal devices, computer systems, servers, etc. may be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules may include routines, programs, objects, components, logic, data structures, etc., that perform particular tasks or implement particular abstract data types. The computer system/server may be implemented in a distributed cloud computing environment. In a distributed cloud computing environment, tasks may be performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules may be located in both local and remote computing system storage media including memory storage devices.
Summary of the application
In the process of realizing the present disclosure, the inventor finds that, in the observed images of different view angles of the VR model, a line segment is vertically mapped with the center point of the article as the origin of coordinates and the ground as the horizontal plane, a label describing the article information is added at the end of the line segment, and the article information is displayed by the label. Because the number of the objects appearing in the same observation image is large, the labels of the objects can be overlapped, and the experience of the user is not high.
According to the article tag display method for the two-dimensional display image, position information and article tag information of display candidate articles in the two-dimensional display image are determined according to the three-dimensional model, tag overlapping judgment processing is carried out on the display candidate articles, display target articles with non-overlapping article tags are determined, and display processing is carried out on the display target articles in the two-dimensional display image; when the number of the articles is large, the overlapping condition among the labels of a plurality of articles can be avoided, the completeness of the display of the articles can be ensured, the calculation complexity is low, and the efficiency is high; the article display effect is improved, and the experience of the user is effectively improved.
Exemplary method
FIG. 1 is a flowchart of one embodiment of a method of the present disclosure for displaying an item label in a two-dimensional display image, the method shown in FIG. 1 comprising the steps of: S101-S105. The steps are described separately below.
S101, acquiring a two-dimensional display image corresponding to a user observation visual angle based on the three-dimensional model.
In one embodiment, the three-dimensional model comprises a three-dimensional model corresponding to a house or the like, the item comprises an item placed within the house, the item comprises furniture, appliances, or the like. Three-dimensional point clouds for furniture, houses and the like are collected, modeling is conducted based on the three-dimensional point clouds, and a three-dimensional model is generated. In the process that the user looks at the room based on the three-dimensional model by VR, the existing method can be adopted to determine the position information of the virtual observation point in the three-dimensional model and the observation view angle of the user, and the two-dimensional display image to be displayed, namely the observation image, is determined based on the position information and the observation view angle of the user.
S102, determining the position information of the display candidate object in the two-dimensional display image according to the three-dimensional model.
In one embodiment, the display candidate item is an item displayed in a two-dimensional display image, including furniture, appliances, and the like. The three-dimensional coordinates of the label marking points of the display candidate object in the three-dimensional model are obtained, the label marking points can be points arranged on the surface of the object, namely label display starting points, and the label marking points can be geometric center points and the like on the surface of the object. And determining the abscissa and the ordinate of the label mark point in the two-dimensional display image based on the three-dimensional coordinates of the display candidate object.
For example, three-dimensional position coordinates of the display candidate item in the three-dimensional model are obtained, and three-dimensional coordinates modelPosition of the upper surface geometric center position of the display candidate item in the three-dimensional model are calculated in combination with the size data of the display candidate item. And converting the three-dimensional coordinates modelPosition into two-dimensional screen coordinates to obtain the position information of the label marking point (label display starting point) on the screen, wherein the position information comprises an abscissa, an ordinate and the like corresponding to the display candidate object.
S103, determining item label information corresponding to the display candidate item. The article label information includes information such as label width and label line height.
And S104, performing label overlapping judgment processing on the display candidate articles based on the position information and the article label information so as to determine the display target articles with non-overlapping article labels.
S105, according to the item label information corresponding to the display target item, display processing is carried out on the display target item in the two-dimensional display image.
In one embodiment, the tag overlap determination process for the display candidate item may use a variety of methods. Fig. 2 is a flowchart of a tag overlap determination process in one embodiment of a method for displaying an article tag in a two-dimensional display image of the present disclosure, the method shown in fig. 2 including the steps of: S201-S203. The steps are described separately below.
S201, a first overlap determination process is performed between display candidate items based on the abscissa and the label width.
S202, based on the ordinate and the label line height, second overlapping judgment processing is performed between display candidate items.
S203, determining the display target object according to the results of the first overlapping judgment processing and the second overlapping judgment processing.
In one embodiment, according to an item selection policy, one display candidate item is selected as a display target item and a first set is generated, and a second set corresponding to the remaining display candidate items is constructed. Sequentially selecting one display candidate item from the second set according to an item selection strategy, and sequentially using the abscissa and the label width of the display candidate item and the abscissa and the label width of each display target item in the second set to perform first overlap judgment processing; and, using the ordinate and the tag line height of the display candidate item and the ordinate and the tag line height of each display target item in the second set in order, performing a second overlap determination process. If the results of the first overlap determination process and the second overlap determination process are both that no overlap has occurred, this display candidate item is set as the display target item and added to the first set.
For example, during a VR house-seeing process by a user based on a three-dimensional model, position information and view angle information of a virtual viewpoint in the three-dimensional model are determined, and a corresponding two-dimensional display image is generated. The display candidate items in the two-dimensional display image include item a, item B, item C, and item D. The article selection policy may be various, for example, a selection order is set for the types of articles, and articles a, B, D, and C are sequentially selected according to the selection order.
Selecting an item A as a display target item and generating a first set T1, wherein the items in the first set T1 comprise the item A, and constructing a second set T2 corresponding to the rest display candidate items, and the display candidate items in the second set T2 comprise an item B, an item D and an item C.
Sequentially selecting an article B, an article D and an article C from the second set T2. For example, selecting an article B, and performing a first overlap determination process using the abscissa and the tag width of the article B and the abscissa and the tag width of the article a in the first set T1 in order; and, a second overlap determination process is performed using the ordinate and the tag line height of the article B and the ordinate and the tag line height of the article a in the second set in this order. If the results of both the first overlap determination process and the second overlap determination process are that no overlap has occurred, the item B is set as the display target item and added in the first set T1.
Selecting an article D, and sequentially carrying out first overlap judgment processing by using the abscissa and the label width of the article D and the abscissa and the label width of an article A and an article B in a first set T1; and, a second overlap determination process is performed using the ordinate of the article D and the label line height, and the ordinate of the article a and the article B and the label line height in this order in the second set. If the results of both the first overlap determination process and the second overlap determination process are that no overlap has occurred, the item D is set as the display target item and added in the first set T1.
Selecting an article C, and sequentially carrying out first overlap judgment processing by using the abscissa and the label width of the article C and the abscissa and the label width of the article A, the article B and the article D in the first set T1; and, a second overlap determination process is performed using the ordinate of the article C and the label line height, and the ordinate of the articles a, B, and D in the second set and the label line height in order. If the results of the first overlap determination process and the second overlap determination process are not all that no overlap occurs, the article C is set to not display a label.
In one embodiment, a plurality of methods may be used to perform the first overlap determination process. And calculating a first coordinate difference value of two abscissas corresponding to the display candidate item and the display target item, determining a first overlap threshold value based on an average value of two label widths corresponding to the display candidate item and the display target item, and if the first coordinate difference value is larger than the first overlap threshold value, determining that the result of the first overlap judgment processing is that no overlap occurs.
As shown in fig. 3, the heights of the label lines are h_line, the heights of the label contents are h, the geometric center positions of the upper surfaces of the display target articles are P1 and P3 respectively, and the geometric center positions of the upper surfaces of the display candidate articles are P2. Calculating a first coordinate difference value of two abscissas x2 and x1 corresponding to the display candidate item and the display target item, calculating a first average value of two label widths W2 and W1 corresponding to the display candidate item and the display target item as a first overlap threshold value, and if the first coordinate difference value is satisfied to be greater than the first overlap threshold value, that is, the following equation 1-1 is satisfied, then no overlap occurs:
When the formula 1-1 is satisfied, it is determined that the result of the first overlap determination process is that no overlap occurs.
In one embodiment, a tag width is determined based on tag content corresponding to a display candidate item, and if the tag width is greater than a preset width threshold, the tag width is set to the width threshold. For example, if the width of the tag is determined based on the number of words of the tag content, the greater the width of the tag. Setting a width threshold of the label, and if the label width is larger than the width threshold, setting the label width as the width threshold, and reducing the number of words of the label content or reducing the words of the label content for display.
And determining the height of the label line according to the type of the display equipment and based on the distance between the display candidate object and the preset height reference surface, wherein the height of the label line is in direct proportion to the distance. For example, the display device type may be a cell phone, tablet, desktop, etc. The reference level of the height may be set as the floor of the room. The label wire height is set as follows:
L=ax+b(1-2);
Where L is the tag line height, a and b are coefficients, and x is the distance between the object and a preset height reference plane (room floor surface).
And respectively setting a maximum distance L1 and a minimum distance L2 between the display candidate object and a preset height reference surface (room floor surface) aiming at display equipment such as a mobile phone, a tablet personal computer and a desktop computer, and substituting L1 and L2 into a formula (1-2) to obtain values of a and b. And setting display coefficients corresponding to the mobile phone, the tablet personal computer, the desktop computer and the like, and taking the product of the display coefficients and the label line height obtained based on the formula (1-2) as the final determined label line height.
Aiming at three equipment scenes of a mobile phone, a tablet and a computer, according to a strategy that the lower the starting point position of a label is, the higher the length is, the shortest value and the longest value of the label are respectively set based on display equipment, the length value of an actual label is in direct proportion to the length between a label identification point and a floor, the label can be displayed outside a model as far as possible under the condition of approaching a head-up view angle, and the definition of the label is ensured.
In one embodiment, the second overlap determination process may be performed in a variety of ways. And calculating a second coordinate difference value of two vertical coordinates corresponding to the display candidate object and the display target object, determining a second overlapping threshold value based on an average value of two label line heights corresponding to the display candidate object and the display target object, and determining that the result of the second overlapping judgment processing is that no overlapping occurs if the second coordinate difference value is larger than the second overlapping threshold value.
As shown in fig. 3, a second coordinate difference value of two ordinate y2 and y1 corresponding to the display candidate item and the display target item is calculated, a second average value of two label line heights h_line1, h_line2 corresponding to the display candidate item and the display target item is calculated as a second overlap threshold value, and if the second coordinate difference value is greater than the second overlap threshold value, that is, the following formula 1-3 is satisfied, no overlap occurs:
When the formulas 1 to 3 are satisfied, it is determined that the result of the second overlap determination process is that no overlap occurs.
In one embodiment, the display processing of the display target object in the two-dimensional display image may employ a variety of methods. For example, the tag width and the tag line height of each display target item in the first set are acquired, and display processing is performed on each display target item in the first set in the two-dimensional display image. As shown in fig. 4A-4D, under different viewing angles, the user can see label displays of different articles, so that the completeness of the article display is ensured, and the experience effect is improved.
Exemplary apparatus
In one embodiment, as shown in fig. 5, the present disclosure provides an article tag display comprising: a display image determination module 501, a position information determination module 502, a tag information determination module 503, a tag overlap judgment module 504, and a tag display processing module 505. The display image determination module 501 acquires a two-dimensional display image corresponding to a user viewing angle based on the three-dimensional model. The position information determination module 502 determines position information of the display candidate item in the two-dimensional display image according to the three-dimensional model.
The tag information determination module 503 determines item tag information corresponding to a display candidate item. The tag overlap determination module 504 performs tag overlap determination processing on the display candidate item based on the position information and the item tag information to determine a display target item for which the item tag does not overlap. The tag display processing module 505 performs display processing on the display target item in the two-dimensional display image according to item tag information corresponding to the display target item.
In one embodiment, the location information determination module 502 obtains three-dimensional coordinates of the tag label points of the display candidate item in the three-dimensional model, and determines the abscissa and the ordinate of the tag label points in the two-dimensional display image based on the three-dimensional coordinates. The tag information determination module 503 determines a tag width based on tag content corresponding to the display candidate item, wherein if the tag width is greater than a preset width threshold, the tag width is set as the width threshold. The tag information determining module 503 determines a tag line height according to the type of the display device and based on a distance between the display candidate item and a preset height reference plane; wherein the tag line height is directly proportional to the distance.
In one embodiment, the location information includes an abscissa and an ordinate corresponding to the item, and the item tag information includes a tag width and a tag line height. As shown in fig. 6, the tag overlap determination module 504 includes a determination unit 5041 and a determination unit 5042. The judging unit 5041 performs a first overlap judging process between display candidate items based on the abscissa and the tag width, and performs a second overlap judging process between display candidate items based on the ordinate and the tag line height. The determining unit 5042 determines the display target article according to the results of the first overlap determination process and the second overlap determination process.
The judging unit 5041 selects one display candidate item as a display target item according to the item selection policy and generates a first set, and constructs a second set corresponding to the remaining display candidate items. The judging unit 5041 sequentially selects one display candidate item from the second set according to the item selection policy, and performs a first overlap judgment process using the abscissa and the label width of the display candidate item and the abscissa and the label width of each display target item in the second set sequentially; the determination unit 5041 uses the ordinate and the label line height of the display candidate item and the ordinate and the label line height of each display target item in the second set in order to perform the second overlap determination process.
If the results of the first overlap determination process and the second overlap determination process are both that no overlap has occurred, the determination unit 5042 sets this display candidate item as the display target item and adds it in the first set. The tag display processing module 505 obtains the tag width and the tag line height of each display target item in the first set, and performs display processing on each display target item in the first set in the two-dimensional display image.
In one embodiment, the determination unit 5041 calculates a first coordinate difference of two abscissas corresponding to the display candidate item and the display target item. The judging unit 5041 determines a first overlap threshold based on an average value of two label widths corresponding to the display candidate item and the display target item. If the first coordinate difference value is greater than the first overlap threshold value, the judgment unit 5041 determines that the result of the first overlap judgment process is that no overlap occurs.
The judging unit 5041 calculates a second coordinate difference of two ordinate coordinates corresponding to the display candidate item and the display target item. The judging unit 5041 determines a second overlap threshold based on an average value of two tag line heights corresponding to the display candidate item and the display target item. If the second coordinate difference value is greater than the second overlap threshold value, the judgment unit 5041 determines that the result of the second overlap judgment processing is that no overlap occurs.
Fig. 7 is a block diagram of one embodiment of an electronic device of the present disclosure, as shown in fig. 7, the electronic device 71 including one or more processors 711 and memory 712.
The processor 711 may be a Central Processing Unit (CPU) or other form of processing unit having data processing and/or instruction execution capabilities, and may control other components in the electronic device 71 to perform desired functions.
Memory 712 may include one or more computer program products that may include various forms of computer-readable storage media, such as volatile memory and/or nonvolatile memory. Volatile memory, for example, may include: random Access Memory (RAM) and/or cache, etc. Non-volatile memory, for example, may include: read Only Memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on a computer readable storage medium and the processor 711 may execute the program instructions to implement the article label presentation method for use in two-dimensional display images and/or other desired functions of the various embodiments of the present disclosure above. Various contents such as an input signal, a signal component, a noise component, and the like may also be stored in the computer-readable storage medium.
In one example, the electronic device 71 may further include: input devices 713, output devices 714, and the like, interconnected by a bus system and/or other forms of connection mechanisms (not shown). In addition, the input device 713 may also include, for example, a keyboard, a mouse, and the like. The output device 714 can output various information to the outside. The output device 714 may include, for example, a display, speakers, a printer, and a communication network and remote output devices connected thereto, etc.
Of course, only some of the components of the electronic device 71 relevant to the present disclosure are shown in fig. 7 for simplicity, components such as buses, input/output interfaces, and the like being omitted. In addition, the electronic device 71 may include any other suitable components depending on the particular application.
In addition to the methods and apparatus described above, embodiments of the present disclosure may also be a computer program product comprising computer program instructions which, when executed by a processor, cause the processor to perform the steps in an item label presentation method for use in two-dimensional display images according to various embodiments of the present disclosure described in the "exemplary methods" section of this specification.
The computer program product may write program code for performing the operations of embodiments of the present disclosure in any combination of one or more programming languages, including an object oriented programming language such as Java, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, as a stand-alone software package, partly on the user's computing device, partly on a remote computing device, or entirely on the remote computing device or server.
Furthermore, embodiments of the present disclosure may also be a computer-readable storage medium, having stored thereon computer program instructions, which when executed by a processor, cause the processor to perform the steps in an item label presentation method for use in two-dimensional display images according to various embodiments of the present disclosure described in the above "exemplary methods" section of the present disclosure.
The computer readable storage medium may employ any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may include, for example, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or a combination of any of the foregoing. More specific examples (a non-exhaustive list) of the readable storage medium may include the following: an electrical connection having one or more wires, a portable disk, a hard disk, random Access Memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
The basic principles of the present disclosure have been described above in connection with specific embodiments, but it should be noted that the advantages, benefits, effects, etc. mentioned in the present disclosure are merely examples and not limiting, and these advantages, benefits, effects, etc. are not to be considered as necessarily possessed by the various embodiments of the present disclosure. Furthermore, the specific details disclosed herein are for purposes of illustration and understanding only, and are not intended to be limiting, since the disclosure is not necessarily limited to practice with the specific details described.
In the method, the device, the electronic equipment and the storage medium for displaying the object tag in the two-dimensional display image, the position information and the object tag information of the display candidate object in the two-dimensional display image are determined according to the three-dimensional model, the display candidate object is subjected to tag overlapping judgment processing, so as to determine the display target object with non-overlapping object tag, and the display target object is subjected to display processing in the two-dimensional display image; when the number of the articles is large, the overlapping condition among the labels of a plurality of articles can be avoided, the completeness of the display of the articles can be ensured, the calculation complexity is low, and the efficiency is high; the article display effect is improved, and the experience of the user is effectively improved.
In this specification, each embodiment is described in a progressive manner, and each embodiment is mainly described in a different manner from other embodiments, so that the same or similar parts between the embodiments are mutually referred to. For system embodiments, the description is relatively simple as it essentially corresponds to method embodiments, and reference should be made to the description of method embodiments for relevant points.
The block diagrams of the devices, apparatuses, devices, systems referred to in this disclosure are merely illustrative examples and are not intended to require or imply that the connections, arrangements, configurations must be made in the manner shown in the block diagrams. As will be appreciated by one of skill in the art, the devices, apparatus, devices, and systems may be connected, arranged, configured in any manner. Words such as "including," "comprising," "having," and the like are words of openness and mean "including but not limited to," and are used interchangeably therewith. The terms "or" and "as used herein refer to and are used interchangeably with the term" and/or "unless the context clearly indicates otherwise. The term "such as" as used herein refers to, and is used interchangeably with, the phrase "such as, but not limited to.
The methods and apparatus of the present disclosure may be implemented in a number of ways. For example, the methods and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, firmware. The above-described sequence of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the sequence specifically described above unless specifically stated otherwise. Furthermore, in some embodiments, the present disclosure may also be implemented as programs recorded in a recording medium, the programs including machine-readable instructions for implementing the methods according to the present disclosure. Thus, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.
It is also noted that in the apparatus, devices and methods of the present disclosure, components or steps may be disassembled and/or assembled. Such decomposition and/or recombination should be considered equivalent to the present disclosure.
The previous description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects, and the like, will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit embodiments of the disclosure to the form disclosed herein. Although a number of example aspects and embodiments have been discussed above, those of skill in the art will recognize certain variations, modifications, changes, additions, and sub-combinations thereof.

Claims (7)

1. A method for displaying an item tag in a two-dimensional display image, comprising:
Acquiring a two-dimensional display image corresponding to a user observation visual angle based on the three-dimensional model; wherein the three-dimensional model comprises a three-dimensional model corresponding to a house;
Determining position information of a display candidate object in the two-dimensional display image according to the three-dimensional model; wherein the display candidate items comprise furniture and electric appliances;
determining item tag information corresponding to the display candidate item;
Wherein the article tag information comprises a tag width and a tag line height; determining the label width based on label content corresponding to the display candidate item, and setting the label width as a width threshold value if the label width is larger than the preset width threshold value; determining the height of the tag line according to the type of the display equipment and based on the distance between the display candidate object and a preset height reference plane; the tag line height is proportional to the distance;
Performing label overlapping judgment processing on the display candidate object based on the position information and the object label information to determine a display target object with non-overlapping object labels;
Wherein the location information includes: an abscissa and an ordinate corresponding to the article; the first overlap determination process includes: calculating a first coordinate difference of two abscissas corresponding to the display candidate item and the display target item; determining a first overlap threshold based on an average of two label widths corresponding to the display candidate item and the display target item; if the first coordinate difference value is larger than the first overlap threshold value, determining that the result of the first overlap judgment processing is that no overlap occurs;
The second overlap determination process includes: calculating a second coordinate difference of two vertical coordinates corresponding to the display candidate object and the display target object; determining a second overlap threshold based on an average of two label line heights corresponding to the display candidate item and the display target item; if the second coordinate difference value is larger than the second overlapping threshold value, determining that the result of the second overlapping judgment processing is that overlapping does not occur;
and displaying the display target object in the two-dimensional display image according to the object label information corresponding to the display target object.
2. The method of claim 1, wherein determining that the item tags do not overlap the display target item comprises:
And determining the display target object according to the results of the first overlapping judgment processing and the second overlapping judgment processing.
3. The method of claim 2, comprising:
Selecting one display candidate item as the display target item according to an item selection strategy, generating a first set, and constructing a second set corresponding to the rest display candidate items;
Sequentially selecting one display candidate item from the second set according to the item selection strategy, and sequentially carrying out first overlapping judgment processing by using the abscissa and the label width of the display candidate item and the abscissa and the label width of each display target item in the second set; and, using the ordinate and the tag line height of the display candidate item and the ordinate and the tag line height of each display target item in the second set in order, performing a second overlap determination process.
4. The method of claim 3, wherein the determining the display target item according to the results of the first overlap determination process and the second overlap determination process comprises:
If the results of the first overlap determination process and the second overlap determination process are that no overlap occurs, setting the display candidate item as a display target item and adding the display candidate item to the first set;
The displaying the display target object in the two-dimensional display image according to the object label information corresponding to the display target object comprises the following steps:
and acquiring the label width and the label line height of each display target object in the first set, and performing display processing on each display target object in the first set in the two-dimensional display image.
5. The method of claim 2, the determining location information of display candidates in the two-dimensional display image from the three-dimensional model comprising:
Acquiring three-dimensional coordinates of the label mark points of the display candidate object in the three-dimensional model;
and determining the abscissa and the ordinate of the label mark point in the two-dimensional display image based on the three-dimensional coordinates.
6. An article label display device comprising:
the display image determining module is used for acquiring a two-dimensional display image corresponding to the user observation visual angle based on the three-dimensional model; wherein the three-dimensional model comprises a three-dimensional model corresponding to a house;
a position information determining module for determining position information of a display candidate item in the two-dimensional display image according to the three-dimensional model; wherein the display candidate items comprise furniture and electric appliances;
a tag information determining module for determining item tag information corresponding to the display candidate item;
Wherein the article tag information comprises a tag width and a tag line height; the label information determining module is used for determining the label width based on label content corresponding to the display candidate object, and if the label width is larger than a preset width threshold value, setting the label width as the width threshold value; determining the height of the tag line according to the type of the display equipment and based on the distance between the display candidate object and a preset height reference plane; the tag line height is proportional to the distance;
the label overlapping judging module is used for carrying out label overlapping judging processing on the display candidate articles based on the position information and the article label information and determining display target articles with non-overlapping article labels;
wherein, the label overlap judging module includes:
A judging unit for calculating a first coordinate difference value of two abscissas corresponding to the display candidate item and the display target item; determining a first overlap threshold based on an average of two label widths corresponding to the display candidate item and the display target item; if the first coordinate difference value is larger than the first overlap threshold value, determining that the result of the first overlap judgment processing is that no overlap occurs; calculating a second coordinate difference of two vertical coordinates corresponding to the display candidate object and the display target object; determining a second overlap threshold based on an average of two label line heights corresponding to the display candidate item and the display target item; if the second coordinate difference value is larger than the second overlapping threshold value, determining that the result of second overlapping judgment processing is that overlapping does not occur;
and the label display processing module is used for displaying the display target object in the two-dimensional display image according to the object label information corresponding to the display target object.
7. A computer readable storage medium storing a computer program for performing the method of any one of the preceding claims 1-5.
CN202210820670.2A 2022-07-13 2022-07-13 Method, device and medium for displaying object label in two-dimensional display image Active CN115063564B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210820670.2A CN115063564B (en) 2022-07-13 2022-07-13 Method, device and medium for displaying object label in two-dimensional display image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210820670.2A CN115063564B (en) 2022-07-13 2022-07-13 Method, device and medium for displaying object label in two-dimensional display image

Publications (2)

Publication Number Publication Date
CN115063564A CN115063564A (en) 2022-09-16
CN115063564B true CN115063564B (en) 2024-04-30

Family

ID=83206765

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210820670.2A Active CN115063564B (en) 2022-07-13 2022-07-13 Method, device and medium for displaying object label in two-dimensional display image

Country Status (1)

Country Link
CN (1) CN115063564B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116185959B (en) * 2023-04-28 2023-06-30 公安部信息通信中心 Superimposed tag recognition and processing system

Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107851241A (en) * 2015-06-04 2018-03-27 泰科消防及安全有限公司 System and method for the positioning object in facility
CN110519774A (en) * 2018-05-21 2019-11-29 中国移动通信集团广东有限公司 Base station surveying method, system and equipment based on VR technology
CN111178191A (en) * 2019-11-11 2020-05-19 贝壳技术有限公司 Information playing method and device, computer readable storage medium and electronic equipment
CN112037341A (en) * 2020-08-26 2020-12-04 北京掌中飞天科技股份有限公司 Method and device for processing VR panorama interaction function based on Web front end
CN112070074A (en) * 2020-11-12 2020-12-11 中电科新型智慧城市研究院有限公司 Object detection method and device, terminal equipment and storage medium
CN112085795A (en) * 2019-12-31 2020-12-15 Oppo广东移动通信有限公司 Article positioning method, device, equipment and storage medium
CN113190150A (en) * 2021-04-20 2021-07-30 北京百度网讯科技有限公司 Display method, device and storage medium of covering
CN113361511A (en) * 2020-03-05 2021-09-07 顺丰科技有限公司 Method, device and equipment for establishing correction model and computer readable storage medium
CN113553368A (en) * 2020-04-26 2021-10-26 腾讯科技(深圳)有限公司 Tag information processing method and device of multilayer pie chart and terminal
CN113610993A (en) * 2021-08-05 2021-11-05 南京师范大学 3D map building object annotation method based on candidate label evaluation
CN114612569A (en) * 2022-02-23 2022-06-10 广州华端科技有限公司 Method and device for processing marker overlapping in geometric calibration
CN114694136A (en) * 2022-03-29 2022-07-01 北京字跳网络技术有限公司 Article display method, device, equipment and medium

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10127722B2 (en) * 2015-06-30 2018-11-13 Matterport, Inc. Mobile capture visualization incorporating three-dimensional and two-dimensional imagery

Patent Citations (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107851241A (en) * 2015-06-04 2018-03-27 泰科消防及安全有限公司 System and method for the positioning object in facility
CN110519774A (en) * 2018-05-21 2019-11-29 中国移动通信集团广东有限公司 Base station surveying method, system and equipment based on VR technology
CN111178191A (en) * 2019-11-11 2020-05-19 贝壳技术有限公司 Information playing method and device, computer readable storage medium and electronic equipment
CN112085795A (en) * 2019-12-31 2020-12-15 Oppo广东移动通信有限公司 Article positioning method, device, equipment and storage medium
CN113361511A (en) * 2020-03-05 2021-09-07 顺丰科技有限公司 Method, device and equipment for establishing correction model and computer readable storage medium
CN113553368A (en) * 2020-04-26 2021-10-26 腾讯科技(深圳)有限公司 Tag information processing method and device of multilayer pie chart and terminal
CN112037341A (en) * 2020-08-26 2020-12-04 北京掌中飞天科技股份有限公司 Method and device for processing VR panorama interaction function based on Web front end
CN112070074A (en) * 2020-11-12 2020-12-11 中电科新型智慧城市研究院有限公司 Object detection method and device, terminal equipment and storage medium
CN113190150A (en) * 2021-04-20 2021-07-30 北京百度网讯科技有限公司 Display method, device and storage medium of covering
CN113610993A (en) * 2021-08-05 2021-11-05 南京师范大学 3D map building object annotation method based on candidate label evaluation
CN114612569A (en) * 2022-02-23 2022-06-10 广州华端科技有限公司 Method and device for processing marker overlapping in geometric calibration
CN114694136A (en) * 2022-03-29 2022-07-01 北京字跳网络技术有限公司 Article display method, device, equipment and medium

Also Published As

Publication number Publication date
CN115063564A (en) 2022-09-16

Similar Documents

Publication Publication Date Title
CN112907755B (en) Model display method and device in three-dimensional house model
CN114827711B (en) Image information display method and device
CN115063564B (en) Method, device and medium for displaying object label in two-dimensional display image
CN113077548A (en) Collision detection method, device, equipment and storage medium for object
CN112529097B (en) Sample image generation method and device and electronic equipment
WO2023202349A1 (en) Interactive presentation method and apparatus for three-dimensional label, and device, medium and program product
CN108597034B (en) Method and apparatus for generating information
CN113870439A (en) Method, apparatus, device and storage medium for processing image
CN115578486A (en) Image generation method and device, electronic equipment and storage medium
CN113689508B (en) Point cloud labeling method and device, storage medium and electronic equipment
CN114758075A (en) Method, apparatus and storage medium for generating three-dimensional label
CN112950759B (en) Three-dimensional house model construction method and device based on house panoramic image
CN111562845B (en) Method, device and equipment for realizing three-dimensional space scene interaction
CN115512046B (en) Panorama display method and device for points outside model, equipment and medium
WO2023103980A1 (en) Three-dimensional path presentation method and apparatus, and readable storage medium and electronic device
CN109697722A (en) For generating the method and device of three components
CN115619989B (en) Fusion effect diagram generation method and device, electronic equipment and storage medium
CN115880464A (en) Method for generating online house-watching video data, electronic equipment and storage medium
CN113763113A (en) Article display method and device
CN116228949B (en) Three-dimensional model processing method, device and storage medium
CN114820908B (en) Virtual image generation method and device, electronic equipment and storage medium
CN117635886A (en) Content display method, device and computer readable storage medium
CN116594531A (en) Object display method, device, electronic equipment and storage medium
CN117635792A (en) Rendering method and device, electronic equipment and storage medium
CN115965446A (en) Method and device for determining article display video and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant