CN112560642A

CN112560642A - Display method and device and electronic equipment

Info

Publication number: CN112560642A
Application number: CN202011443668.5A
Authority: CN
Inventors: 向永航
Original assignee: Vivo Mobile Communication Hangzhou Co Ltd
Current assignee: Vivo Mobile Communication Hangzhou Co Ltd
Priority date: 2020-12-08
Filing date: 2020-12-08
Publication date: 2021-03-26

Abstract

The application discloses a display method, a display device and electronic equipment, and belongs to the technical field of communication. The problem that when a user views the content with a large amount of digital information, the operation process of obtaining the statistical information is complicated and time-consuming can be solved. The method comprises the following steps: identifying a target image, and acquiring target data meeting preset conditions in the target image, wherein the target image is an image acquired by a first camera in electronic equipment; generating a target chart corresponding to the target data according to the target data; the target graph is displayed. The method can be applied to a scene in which the generated AR chart is viewed through the electronic device.

Description

Display method and device and electronic equipment

Technical Field

The embodiment of the application relates to the technical field of communication, in particular to a display method and device and electronic equipment.

Background

In daily life, in a case where a user views content having a large amount of digital information, generally, since the content includes a large amount of digital information, it may cause inconvenience in viewing for the user.

For example, when a user views a score or a price menu, if the user needs to obtain statistical information such as a maximum value, a minimum value or an arithmetic mean value of data in the score or the price menu, the user often needs to search for the maximum value and the minimum value from all the data and use a calculation tool to perform statistical calculation to obtain the mean value of the data, which may cause a cumbersome and time-consuming operation process of obtaining the statistical information when viewing content with a large amount of digital information.

Disclosure of Invention

The embodiment of the application aims to provide a display method, a display device and electronic equipment, and can solve the problems that when a user views content with a large amount of digital information, the operation process of obtaining statistical information is complicated and time-consuming.

In order to solve the technical problem, the present application is implemented as follows:

in a first aspect, an embodiment of the present application provides a display method, where the method includes: identifying a target image, and acquiring target data meeting preset conditions in the target image, wherein the target image is an image acquired by a first camera in electronic equipment; generating a target chart corresponding to the target data according to the target data; the target graph is displayed.

In a second aspect, an embodiment of the present application provides a display device, including: the device comprises an acquisition module, a processing module and a display module. The acquisition module is used for identifying a target image and acquiring target data meeting preset conditions in the target image, wherein the target image is an image acquired by a first camera in the electronic equipment; the processing module is used for generating a target chart corresponding to the target data according to the target data; and the display module is used for displaying the target graph.

In a third aspect, embodiments of the present application provide an electronic device, which includes a processor, a memory, and a program or instructions stored on the memory and executable on the processor, where the program or instructions, when executed by the processor, implement the steps of the method according to the first aspect.

In a fourth aspect, embodiments of the present application provide a readable storage medium on which a program or instructions are stored, which when executed by a processor, implement the steps of the method according to the first aspect.

In a fifth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, and the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the method according to the first aspect.

In the embodiment of the application, the electronic device can identify a target image, and acquire target data meeting preset conditions in the target image, wherein the target image is an image acquired by a first camera in the electronic device; and generating a target chart corresponding to the target data according to the target data, and displaying the target chart. By the method, the electronic device (for example, the AR device) can directly generate the acquired target data into a chart and display the chart in the preset area of the chart. For example, the user may see an augmented displayed image including the target chart through the AR device, and the augmented displayed image of the target chart may be displayed on the target image. Therefore, the user can quickly and intuitively check the target data through the target chart, so that the use of the user is facilitated, and the use experience of the user is prompted.

Drawings

Fig. 1 is a schematic diagram of a display method according to an embodiment of the present disclosure;

fig. 2 is a schematic diagram of an AR device displaying a target chart according to an embodiment of the present disclosure;

fig. 3 is a second schematic diagram of a display method according to an embodiment of the present application;

fig. 4 is a second schematic diagram of an AR device displaying a target chart according to an embodiment of the present application;

fig. 5 is a third schematic diagram of a display method according to an embodiment of the present application;

fig. 6 is a schematic structural diagram of a display device according to an embodiment of the present disclosure;

fig. 7 is a second schematic structural diagram of a display device according to an embodiment of the present application;

fig. 8 is a hardware diagram of an AR device according to an embodiment of the present disclosure;

fig. 9 is a second hardware schematic diagram of an AR device according to an embodiment of the present application.

Detailed Description

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.

The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used is interchangeable under appropriate circumstances such that the embodiments of the application are capable of operation in sequences other than those illustrated or described herein. The objects distinguished by "first", "second", and the like are usually a class, and the number of the objects is not limited, and for example, the first object may be one or a plurality of objects. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.

The display method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.

The method provided by the embodiment of the application can be applied to any one of the following scenes.

Scenario 1, a scenario in which a user views a transcript, menu, or water note using an AR device (e.g., wearing AR glasses).

Scene 2, a scene in which a user views the composition and content of a certain good using an AR device (e.g., wearing AR glasses).

Scenario 3, a scenario in which a user using an AR device (e.g., wearing AR glasses) compares the prices or component contents of at least two items.

As shown in fig. 1, an embodiment of the present application provides a display method, which may be applied to a display device, and the method may include steps 101 to 103 described below.

Step 101, a display device identifies a target image and acquires target data meeting preset conditions in the target image.

The target image is an image acquired by a first camera in the electronic equipment.

It should be noted that Augmented Reality (AR) is a technology that skillfully integrates virtual information with the real world, and a variety of technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, sensing and the like are widely applied, and virtual information such as characters, images, three-dimensional models, music, videos and the like generated by a computer is applied to the real world after being simulated, and the two kinds of information complement each other, thereby realizing the "enhancement" of the real world. The principle is that on the basis of scientific technologies such as computers, simulation processing is carried out on entity information which is difficult to experience in the space range of the real world originally, virtual information content is effectively applied in the real world in an overlapping mode, and the virtual information content can be sensed by human senses in the process, so that the sense experience beyond reality is achieved. After the real environment and the virtual object are overlapped, the real environment and the virtual object can exist in the same picture and space at the same time.

In the embodiment of the present application, the display device is the entire electronic device or one display device in the electronic device. The electronic device may specifically be an AR device, or an electronic device composed of a plurality of modules (including modules capable of implementing AR functions). That is, the display device is an AR device or a combination of electronic devices capable of realizing an AR function. For convenience of description, the following embodiments specifically describe the technical solutions of the present application by directly using the AR apparatus and the display device, and do not limit the present application.

Further, an AR device is a device intended to cooperate with the implementation and use of AR technology. Specifically, the AR device may be a mobile AR device or a non-mobile AR device. For example, the mobile AR device may be an AR-enabled cell phone, an AR-enabled tablet, an in-vehicle AR device, a wearable device (e.g., AR glasses, etc.). The AR glasses are novel glasses with augmented reality functions, and most of AR glasses have the functions of photographing, displaying, video call, file processing, game entertainment and the like. The AR glasses may be on the basis of displaying a real-world scene, while displaying a wearable AR device of a virtual scene. It should be noted that the following embodiments exemplarily illustrate an AR device as AR glasses.

Optionally, in this embodiment of the application, the first camera is a camera facing the user sight direction in the AR device. Specifically, if the AR device is an AR glasses, the first camera may be a camera mounted on the AR glasses along a normal of the glasses lens and facing a direction of a user's sight. For example, a camera mounted in front of the AR eyeglass frame. The determination may be specifically performed according to actual use requirements, and the embodiment of the present application is not specifically limited.

Optionally, in this embodiment of the application, the AR device may identify an image acquired by the first camera, and acquire the target data in the target image when it is identified that the target image meets the preset condition.

Optionally, in an embodiment of the present application, the preset condition includes at least one of the following: the data type is a preset data type, and the user is watching data in an area with the watching time in the image being larger than or equal to a target threshold value.

Specifically, the data type is a preset data type, which means that when the AR device recognizes that the data in the target image is the preset data type, the AR device acquires the data in the target image. Wherein the preset data type may be at least one of the following: price data type, achievement data type, sales data type, ingredient content data type, and the like. The determination may be specifically performed according to actual use requirements, and the embodiment of the present application is not specifically limited.

Specifically, the data in the area where the gaze time of the user in the image is greater than or equal to the target threshold refers to that when the AR device detects that the gaze time of the human eye in an area in the target image is greater than or equal to the target threshold, the AR device acquires the data in the area. The method can be realized by the following steps a to c:

and a, the display device acquires a target human eye image through the second camera.

The target human eye image is a human eye image collected by a second camera in the AR equipment, and the second camera and the first camera are different cameras.

Optionally, in this embodiment of the application, the second camera is used to collect images of human eyes when the user observes the target image, that is, the second camera is a camera that is arranged on the AR device and faces human eyes. For example, a camera mounted on a frame of the AR device and facing in the direction of the eyes of the person.

And b, determining the gazing time and the gazing area by the display device according to the target human eye image.

The gazing area is an area where a focus of the user sight line is projected in the target image, and the gazing time is a dwell time of the focus of the user sight line in the gazing area.

Optionally, in this embodiment of the application, the line of sight of the user may be determined by the pupil coordinates and the line of sight direction vector. The pupil coordinates can be determined by identifying the eye positions in the target eye image through a human eye algorithm. The vector of the sight line direction can be determined according to the flare position in the target human eye image. It should be noted that, the above determination method may refer to the detailed description in the related art, and is not repeated herein.

And c, the display device acquires data in the gazing area of which the gazing time of the user in the target image is greater than or equal to the target threshold value.

Optionally, in this embodiment of the application, the target threshold may be preset or manually set by a user.

For example, assuming that the target threshold is 3 seconds, when the user wears the AR glasses to view a picture of the nutritional component list including milk, if the AR glasses detect that the stay time of the line of sight of the user in the area where the nutritional component list is located is greater than or equal to 3 seconds, the AR glasses acquire data of the area where the nutritional component list is located, that is, data of specific nutritional components in the list.

Step 102, the display device generates a target graph corresponding to the target data according to the target data.

Optionally, in this embodiment of the application, the AR device may generate a target graph according to a specific data type of the target data. That is, the style of the target chart is determined by the data type of the target data. Specifically, when the data type of the target data is a price data type, a performance data type, or a sales data type, a bar graph or a line graph may be generated, that is, the style of the target graph is: a bar graph style or a line graph style. In the case that the data type of the target data is a component content data type, a pie chart or a sector chart may be generated, that is, the style of the target chart is: pie chart style or pie chart style. The determination may be specifically performed according to actual use requirements, and the embodiment of the present application is not specifically limited.

Optionally, in this embodiment of the application, when the data type of the target data is a price data type, a performance data type, or a sales data type, the AR device may determine, according to the quantity of the target data, to generate the target graph as a histogram or a line graph. Specifically, if the number of the target data is less than or equal to the first threshold, the AR device may generate a target graph of a histogram according to the target data; if the number of the target data is greater than the first threshold, the AR device may generate a target graph of the line graph from the target data. Therefore, the user can set the size of the first threshold according to the actual use requirement, so that the size of the generated target chart is determined, and the display is convenient.

And 103, displaying the target graph by the display device.

Optionally, in this embodiment of the application, the device for displaying the target icon may be a screen of the electronic device, a preset screen area of the AR device, or the like. The determination may be specifically performed according to actual use requirements, and the embodiment of the present application is not specifically limited.

Alternatively, the step 103 may be specifically realized by the following step 103A.

Step 103A, the display device displays the target chart in a preset screen area of the AR equipment.

Optionally, in this embodiment of the application, the preset screen area may be at least one of the following: lenses for AR glasses, vehicle windshields, screens for AR cell phones, etc. The determination may be specifically performed according to actual use conditions of different AR devices, and the embodiment of the present application is not particularly limited. It should be noted that the following embodiments of the present application exemplify lenses of AR glasses as a preset screen area.

In the embodiment of the present application, the image that the user finally sees is an augmented reality image in which a target diagram is displayed on a target image.

It should be noted that, a manner in which the AR device displays content (e.g., a target graph) in a preset screen area of the AR device has certain differences according to differences of the AR device, and reference may be specifically made to related technologies, which is not described in detail in this embodiment of the application. The following embodiments take the AR device as the AR glasses, and the preset screen area as the lens of the AR glasses.

Specifically, the AR glasses may project a chart to a coupling-in area of a displayable lens through an optical engine installed in the AR glasses and couple projected light into a glass substrate of the lens. The light is then transmitted by the principle of total reflection to the outcoupling area in front of the AR spectacle lens, so that the display of an AR image of a target diagram, for example a bar chart, a line chart or a pie chart, in the lens is achieved.

Illustratively, fig. 2 is one of the schematic diagrams of the AR device displaying the target graph. As shown in fig. 2 (a), the drinking water sheet 001 is a target image obtained by the AR glasses, and the drinking water sheet 001 includes: the class of wine and data corresponding to the price (which data is of the price data type), and the service phone 136XXXX 1689. The AR device may acquire preset types of price data of mineral water 2 yuan, milk tea 5 yuan, coffee 5 yuan, beer 7 yuan, etc. as target data, and generate the target data into a target chart to be displayed on the lenses of the AR glasses (i.e., display the target chart in a preset screen area, not shown in the drawings). The user sees an image as shown in (b) of fig. 2 using the AR glasses, in which the target chart 002 is augmented reality on the water note.

According to the display method provided by the embodiment of the application, the electronic equipment can identify a target image, and acquire target data meeting preset conditions in the target image, wherein the target image is an image acquired by a first camera in the electronic equipment; and generating a target chart corresponding to the target data according to the target data, and displaying the target chart. By the method, the electronic device (for example, the AR device) can directly generate the acquired target data into a chart and display the chart in the preset area of the chart. For example, the user may see an augmented displayed image including the target chart through the AR device, and the augmented displayed image of the target chart may be displayed on the target image. Therefore, the user can quickly and intuitively check the target data through the target chart, so that the use of the user is facilitated, and the use experience of the user is prompted.

Optionally, with reference to fig. 1, as shown in fig. 3, the target data includes M data items, the target graph includes M graph symbols, each graph symbol is used to indicate a value of one data item, and M is a positive integer greater than or equal to 2. Before the step 103A, after the step 102, the display method provided in the embodiment of the present application further includes the following steps 104 and 105, and accordingly, the step 103A may be specifically implemented by the following step 103A.

104, the display device determines the position of each data item in the M data items in the target image to obtain M first positions;

optionally, in this embodiment of the application, each chart symbol is used to indicate a numerical value of one data item. Specifically, the target chart symbol may be a column in the histogram, and the height of the column indicates the value of the corresponding data item; the target chart symbol may also have an inflection point represented in each of the figures, the coordinate value (abscissa value or ordinate value) of the inflection point being used to indicate the numerical value of the corresponding data item; the target chart symbol may also be each sector region in a pie chart or pie chart, the area of the sector being used to indicate the value of the corresponding data item.

Optionally, in this embodiment of the application, the AR device may determine, according to a position of one data item of the M data items in the target image, a first position in any one of the following manners: in mode 1, the AR device determines the location of a data item in the target image as a first location. Mode 2, the AR device determines a target position next to a position of one data item in the target image as one first position. Wherein the target position is a position which satisfies a target preset condition with a position of one data item in the target image. The target preset condition may be any one of: the device is translated for a preset distance along a preset direction, overturned along a preset axis, rotated for a preset angle along a preset rotation center, and the like. For example, the target position may be a position where the position of one data item in the target image is moved 5 mm to the right, or the target position may be a position where the position of one data item in the target image is flipped along a preset axis, or the target position may be a position where the position of one data item in the target image is rotated 30 degrees counterclockwise along a preset rotation center. The manner of determining the first position may be determined according to actual use requirements, and the embodiment of the present application is not particularly limited. It should be noted that the AR device may repeatedly perform M times according to the above-mentioned mode 1 or mode 2 to determine M first positions.

And 105, the display device determines M second positions in a preset screen area according to the M first positions.

And each second position is a mapping position of the first position in the preset screen area.

Optionally, in this embodiment of the application, the electronic device may determine M first positions according to a mapping relationship of a display of the target image in the AR device, and respectively correspond to M second positions in the preset screen area. Wherein each second position is a mapping position of the first position in a preset screen area of the AR device. Specifically, different scaling methods and mapping manners are used according to different AR devices, and the embodiments of the present application are not limited specifically, and the following embodiments take AR glasses as an example for illustration.

For example, assume that the target image is a wine order that includes a plurality of wines and their corresponding prices, such as: 2 yuan mineral water; coffee 5 yuan; beer 7 yuan, etc. The AR glasses can acquire the alcohol water list through the first camera: 2-membered, 5-membered, and 7-membered display positions (i.e., three first positions), and then, the AR glasses determine 2-membered, 5-membered, and 7-membered positions (i.e., three second positions) in a projection area (i.e., a preset screen area) of the AR glasses lens, respectively, according to the relative position of the wine glass in the glasses lens.

And 103a, the display device displays M chart symbols at M second positions.

Wherein each second position displays a corresponding one of the chart symbols.

Optionally, in this embodiment of the application, each of the second positions displays a corresponding chart symbol. It is meant that each chart symbol displayed at a second location corresponds to a data item at a first location corresponding to that second location. Illustratively, assuming that the target image is a water sheet including beer 7 yuan (i.e., a first location), a bar graph (i.e., a chart symbol) displayed next to "beer 7 yuan" (i.e., a second location) seen in the lenses of the AR glasses when the user uses the AR glasses has a height of 7 mm (i.e., the data indicated by the chart symbol is the data at the first location).

It should be noted that, in this embodiment of the application, the AR device displays M chart symbols at M second positions, respectively, and further displays the target chart.

Optionally, the target graph in the embodiment of the present application may display data for generating the target graph. For example, when the target graph is a bar graph or a line graph, corresponding data may be displayed at a cylinder or an inflection point; when the target chart is a pie chart, the components, percentages, etc. may be displayed in each sector.

Illustratively, as shown in fig. 2 (a), the wine list 001 is a target image obtained by the AR glasses, and the wine list 001 includes: the class of wine and data corresponding to the price (which data is of the price data type), and the service phone 136XXXX 1689. The AR device may acquire preset types of price data of mineral water 2 yuan, milk tea 5 yuan, coffee 5 yuan, beer 7 yuan, etc. as target data, and acquire positions of mineral water 2 yuan, milk tea 5 yuan, coffee 5 yuan, beer 7 yuan in the water sheet 001 (i.e., 4 first positions, specifically, positions on the left side of the position a, the position B, the position C, and the position D in the drawing, respectively), and then, the AR glasses determine four projected positions on the glasses lenses according to the positions: a1, B1, B1, and D1 (determined in such a way as to translate a preset distance to the right), and then the AR glasses display corresponding histograms at the a1, B1, B1, and D1 positions, respectively. The user sees an image as shown in fig. 4 using the AR glasses, in which a histogram 0021 in the alcohol price chart 002 is displayed at the a position (the a position corresponds to the a1 position in the AR lens), a histogram 0022 is displayed at the B position (the B position corresponds to the B1 position in the AR lens), a histogram 0023 is displayed at the C position (the C position corresponds to the C1 position in the AR lens), and a histogram 0024 is displayed at the D position (the D position corresponds to the D1 position in the AR lens). Thus, the user can see the target graph 002 displayed in the wine list 001 as an enhancement.

It can be understood that the AR device may obtain M first locations according to the locations of the M data items in the target image; and determining to obtain M second positions according to the mapping relation of each first position in a preset screen, and displaying M chart symbols at the M second positions, thereby achieving the effect of displaying the target chart. Therefore, the user can quickly acquire the information such as the maximum value and the minimum value in the chart symbols, and the user can achieve the purpose of data comparison by comparing the chart symbols, so that the user can use the chart symbols conveniently, and the use experience of the user is improved.

Alternatively, in conjunction with FIG. 1, as shown in FIG. 5, the target graph is a graph of the first graph type. After step 103A, the display method provided in the embodiment of the present application further includes the following steps 106 and 107.

Step 106, the display device receives a first input of a user.

Optionally, in this embodiment of the application, the first input is used to trigger the AR device to switch the display type of the target graph. Specifically, the first input may be a pressing input to a physical key of the AR device, where the physical key is used to trigger the AR device to switch the display type of the target graph. The first input may also be a touch input to a control or a virtual key in a display screen of the AR device, where the touch input is used to trigger the AR device to switch the display type of the target chart, and the touch input may be any one of the following: single click, double click, long press, drag according to a preset trajectory, etc. The determination may be specifically performed according to actual use requirements, and the embodiment of the present application is not specifically limited.

Step 107, the display device responds to the first input, and the target chart is updated and displayed from the first chart type to the second chart type.

Wherein the first chart type is different from the second chart type.

Optionally, in this embodiment of the application, the first chart type may be any one of the following: bar charts, line charts, pie charts, etc. The second chart type is a different type than the first chart type.

Optionally, in this embodiment of the application, the AR device switches and displays the first graph type to the second graph type in response to the first input, and displays the second graph at a position where the original first graph is displayed. That is, the display type of the chart is switched, and the display position of the chart is not changed.

For example, assume that the target image is a wine order that includes a plurality of wines and their corresponding prices, such as: 1 yuan mineral water; coffee 5 yuan; beer 7 yuan, etc. The AR glasses can acquire the alcohol water list through the first camera: display positions of 1, 5 and 7 units, and then the AR glasses display a bar graph representing the price at positions beside the 1, 5 and 7 units, respectively, according to the relative position of the wine order on the spectacle lenses (the height of the bar graph is used to identify the height of the price). Subsequently, the user presses a switching key on the frame of the AR glasses, and the AR glasses switch the bar chart to a line chart in response to the pressing input, and display it at the position of the original bar chart.

It is understood that the user may trigger the AR device to switch the chart type displaying the target chart through manual input to the AR device. Therefore, the user can manually switch the chart type of the target chart according to the actual use requirement, so that the user can conveniently check the data in the target chart, and the use experience of the user is improved.

Optionally, in this embodiment of the application, the target graph includes a first graph and a second graph, where the first graph is a graph drawn by using the target data, and the second graph is a graph drawn by using statistical data of the target data. The step 103A can be specifically realized by the following step 103 b.

And 103b, the display device displays the first chart in the preset screen area and displays the second chart on the first chart in an overlapping mode.

Optionally, in this embodiment of the application, the first graph is a graph directly drawn through the target data. For example, if the target data is the prices of various drinks, the first chart is a bar chart or a line chart of the prices of various drinks. If the target data is a nutrient content and its content in milk, the first graph is a pie chart of the nutrient content and its content in the milk.

Optionally, in this embodiment of the application, the second graph is a graph drawn according to statistical data of the target data, where the statistical data may be at least one of the following data: distribution data, arithmetic mean data, median data, etc. The determination can be specifically carried out according to the actual use requirement. For example, if the target data is the prices of various drinks, the second chart is a price distribution map (i.e., a price distribution map) of various drinks or an average price map of drinks.

Optionally, in this embodiment of the application, the first graph and the second graph may be displayed in different display manners to distinguish the first graph from the second graph. Specifically, the display mode may be at least one of the following: transparency of the chart, color of the chart, thickness of lines of the chart, size of color blocks in the chart, and the like. The determination may be specifically performed according to actual use requirements, and the embodiment of the present application is not specifically limited.

Optionally, in this embodiment of the application, the coordinate axes or scales of the first chart and the second chart may be the same or different. The second graph is displayed superimposed on the first graph in the following manner:

in the method a, when the coordinate axes or scales of the first graph and the second graph are the same, a curve of the second graph is superimposed on the first graph (which may be specifically implemented by superimposing a layer on the first graph, for example, superimposing a new layer on the first graph, where the layer includes the curve of the second graph), and the coordinate of the second graph is not displayed. For example, if the first chart is a line graph of various wine prices, the horizontal axis represents various wines, and the vertical axis represents the wine prices; the second graph may be an average price graph of the wine (i.e., a straight line parallel to the horizontal axis whose intersection with the vertical axis is the average price of the wine) superimposed on the line graph of the price of the wine (i.e., the first graph). Therefore, the user can conveniently know which wine is higher than the average price and which wine is lower than the average price, and the user can conveniently select the wine.

In the case of the mode B in which the coordinate axes or scales of the first chart and the second chart are the same, the second chart may be displayed superimposed on each other so that one coordinate axis of the first chart and one coordinate axis of the second chart overlap each other, or so that the first chart and the second chart are displayed superimposed on each other at corresponding positions.

For example, if the first chart is a line chart of various wine prices, the horizontal axis represents various wines, and the vertical axis represents the wine prices; the second graph may be a price distribution graph (i.e., a second graph) of the wine displayed superimposed on the line graph (i.e., the first graph) of the wine price, the horizontal axes of the two graphs being coincident with the kind of the wine and being plotted using different vertical axes, respectively, e.g., the first vertical axis located to the left of the horizontal axis is the wine price, and the line graph of the wine price is plotted in a coordinate system of the horizontal axis and the first vertical axis; the second vertical axis on the right side of the horizontal axis represents a distribution interval of the alcohol water price, and a distribution map of the alcohol water price is drawn in a coordinate system of the horizontal axis and the first vertical axis.

Illustratively, if the first graph is a pie chart of the nutrient content and its content in milk, the second graph is a bar chart of the distribution of the nutrient content and its content in qualified milk (the upper and lower ends of the bar chart represent the upper and lower limits of the qualified component, respectively, and the shape is similar to a Gantt chart). The AR device may display the histogram in a different color overlay in the first chart and make each region correspond. For example, if the pie chart has a 5% sector representing protein content (representing 5% protein content in the milk), then 4.5% -6.5% columns are displayed over the 5% sector (representing 4.5% -6.5% protein content in the qualified milk).

It can be understood that the AR device may display the second graph drawn by the statistical data in an overlapping manner on the first graph drawn by the target data, so that the user may obtain more information, such as various statistical information, through one target graph, thereby facilitating the use of the user and improving the use experience of the user.

In the display method provided in the embodiment of the present application, the execution main body may be a display device, or a control module for executing the display method in the display device. In the embodiment of the present application, a display device executing a display method is taken as an example to describe the device provided in the embodiment of the present application.

As shown in fig. 6, an embodiment of the present application provides a display device 600. The display apparatus 600 may include an acquisition module 601, a processing module 602, and a display module 603. The obtaining module 601 may be configured to identify a target image, and obtain target data that meets a preset condition in the target image, where the target image is an image collected by a first camera in the AR device. The processing module 602 may be configured to generate a target graph corresponding to the target data according to the target data. The display module 603 may be configured to display the target chart in a preset screen area of the AR device.

Optionally, in this embodiment of the application, the electronic device is an AR device, and the display module 603 may be specifically configured to display the target graph in a preset screen area of the AR device.

Optionally, in conjunction with fig. 6, as shown in fig. 7, the target data includes M data items, the target chart includes M chart symbols, each chart symbol is used for indicating a value of one data item, and M is a positive integer greater than or equal to 2. The display device also includes a determination module 604. The determining module 604 may be configured to display the target graph in a preset screen area of the AR device, and determine a position of each of the M data items in the target image, so as to obtain M first positions. The determining module 604 may be further configured to determine M second locations in the preset screen area according to the M first locations, where each second location is a mapping location of one first location in the preset screen area. The display module 603 may be further configured to display the M chart symbols at the M second positions, where each second position displays a corresponding chart symbol.

Alternatively, as shown in FIG. 7, the target chart is a chart of a first chart type; the display device further comprises a receiving module 605. The receiving module 605 may be configured to receive a first input of a user. The display module 603 may be further configured to update and display the target chart from the first chart type to a second chart type in response to the first input received by the receiving module 605, where the first chart type is different from the second chart type.

Optionally, in this embodiment of the application, the target graph includes a first graph and a second graph, where the first graph is a graph drawn by using the target data, and the second graph is a graph drawn by using statistical data of the target data. The display module 603 is specifically configured to display the first chart in a preset screen area, and display the second chart on the first chart in an overlapping manner.

The display device in the embodiment of the present application may be a functional entity and/or a functional module in the AR device, which executes the display method, or may be a component, an integrated circuit, or a chip in the terminal. The apparatus may be a mobile AR device or a non-mobile AR device. By way of example, the mobile AR device may be a mobile phone, a tablet computer, a laptop computer, a palmtop computer, a car-mounted AR device, a wearable device (e.g., AR glasses), an ultra-mobile personal computer (UMPC), a netbook or a Personal Data Assistant (PDA), and the like, and the non-mobile AR device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine, a self-service machine, and the like, and the embodiments of the present application are not particularly limited.

The display device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.

The display device provided in the embodiment of the present application can implement each process implemented by the display device in the method embodiments of fig. 1 to fig. 5, and is not described herein again to avoid repetition.

The embodiment of the application provides a display device, which can identify a target image, acquire target data meeting preset conditions in the target image, wherein the target image is an image acquired by a first camera in the display device; and generating a target chart corresponding to the target data according to the target data, and displaying the target chart. By the method, the display device can directly generate the acquired target data into the chart and display the chart in the preset area of the chart. For example, the display device may display an enhanced display image of the target chart through the AR function module in the display device, and the enhanced display image of the target chart may be displayed on the target image. Therefore, the user can quickly and intuitively check the target data through the target chart, so that the use of the user is facilitated, and the use experience of the user is prompted.

Optionally, as shown in fig. 8, an AR device 800 is further provided in this embodiment of the present application, and includes a processor 801, a memory 802, and a program or an instruction stored in the memory 802 and capable of running on the processor 801, where the program or the instruction is executed by the processor 801 to implement each process of the display method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

It should be noted that the AR device in the embodiment of the present application includes the mobile AR device and the non-mobile AR device described above.

Fig. 9 is a schematic diagram of a hardware structure of an AR device implementing an embodiment of the present application.

The AR device 2000 includes, but is not limited to: a radio frequency unit 2001, a network module 2002, an audio output unit 2003, an input unit 2004, a sensor 2005, a display unit 2006, a user input unit 2007, an interface unit 2008, a memory 2009, and a processor 2010.

Among other things, the input unit 2004 may include a graphic processor 20041 and a microphone 20042, the display unit 2006 may include a display panel 20061, the user input unit 2007 may include a touch panel 20071 and other input devices 20072, and the memory 2009 may be used to store software programs (e.g., an operating system, an application program required for at least one function), and various data.

Those skilled in the art will appreciate that the AR device 2000 may further include a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 2010 through a power management system, so as to manage charging, discharging, and power consumption management functions through the power management system. The AR device structure shown in fig. 9 does not constitute a limitation of the AR device, and the AR device may include more or less components than those shown, or combine some components, or a different arrangement of components, and will not be described again here.

The sensor 2005 may be configured to identify a target image, and acquire target data meeting a preset condition in the target image, where the target image is an image acquired by a first camera in the AR device. The processor 2010 may be configured to generate a target graph corresponding to the target data according to the target data. The display unit 2006 may be configured to display the target chart in a preset screen area of the AR device.

Optionally, in this embodiment of the application, the electronic device is an AR device, and the display unit 2006 is specifically configured to display the target chart in a preset screen area of the AR device.

The embodiment of the application provides an AR device. The AR equipment can identify a target image, and target data meeting preset conditions in the target image are obtained, wherein the target image is an image collected by a first camera in the AR equipment; and generating a target chart corresponding to the target data according to the target data, and displaying the target chart. By the method, the AR device can directly generate the acquired target data into the chart and display the chart in the preset area of the chart. For example, the user may see an augmented displayed image including the target chart through the AR device, and the augmented displayed image of the target chart may be displayed on the target image. Therefore, the user can quickly and intuitively check the target data through the target chart, so that the use of the user is facilitated, and the use experience of the user is prompted.

Optionally, in this embodiment of the application, the target data includes M data items, the target graph includes M graph symbols, each graph symbol is used to indicate a numerical value of one data item, and M is a positive integer greater than or equal to 2. The processor 2010 may be configured to display the target graph in a preset screen area of the AR device, determine a position of each of the M data items in the target image, and obtain M first positions. The processor 2010 may be further configured to determine M second locations in the preset screen area according to the M first locations, where each second location is a mapping location of one first location in the preset screen area. The display unit 2006 is further configured to display the M chart symbols at the M second positions, where each second position displays a corresponding chart symbol.

Optionally, in this embodiment of the application, the target chart is a chart of the first chart type. The user input unit 2007 may be used to receive a first input of the user. The display unit 2006, may also be configured to update and display the target chart from the first chart type to a second chart type in response to the first input received by the user input unit 2007, the first chart type being different from the second chart type.

Optionally, in this embodiment of the application, the target graph includes a first graph and a second graph, where the first graph is a graph drawn by using the target data, and the second graph is a graph drawn by using statistical data of the target data. The display unit 2006 is specifically configured to display the first graph in a preset screen area, and display the second graph on the first graph in an overlapping manner.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements the processes of the display method embodiment, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.

Wherein the processor is the processor in the AR device in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.

The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the display method embodiment, and can achieve the same technical effect, and details are not repeated here to avoid repetition.

It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.

Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.

While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.

Claims

1. A method of displaying, the method comprising:

identifying a target image, and acquiring target data meeting preset conditions in the target image, wherein the target image is an image acquired by a first camera in electronic equipment;

generating a target chart corresponding to the target data according to the target data;

and displaying the target chart.

2. The method of claim 1, wherein the electronic device is an AR device, and wherein displaying the target graph comprises:

and displaying the target chart in a preset screen area of the AR equipment.

3. The method of claim 2, wherein the preset condition comprises at least one of: the data type is a preset data type, and the user is watching data in an area with the watching time in the image being larger than or equal to a target threshold value.

4. The method of claim 2, wherein the target data includes M data items, the target chart includes M chart symbols, each chart symbol indicating a value of one data item, M being a positive integer greater than or equal to 2;

before the target graph is displayed in a preset screen area of the AR device, the method further includes:

determining the position of each data item in the M data items in the target image to obtain M first positions;

determining M second positions in the preset screen area according to the M first positions, wherein each second position is a mapping position of one first position in the preset screen area;

the displaying the target graph in a preset screen area of the AR device includes:

displaying the M chart symbols at the M second positions, wherein each second position displays a corresponding chart symbol.

5. The method of claim 2, wherein the target chart is a chart of a first chart type;

after the target graph is displayed in a preset screen area of the AR device, the method further comprises:

receiving a first input of a user;

in response to the first input, the target chart is updated to be displayed as a second chart type from the first chart type, the first chart type being different from the second chart type.

6. The method of any one of claims 2 to 5, wherein the target graph comprises a first graph and a second graph, the first graph being a graph plotted using the target data, the second graph being a graph plotted using statistics of the target data;

and displaying the first chart in the preset screen area, and displaying the second chart on the first chart in an overlapping manner.

7. A display device, characterized in that the device comprises: the device comprises an acquisition module, a processing module and a display module;

the acquisition module is used for identifying a target image and acquiring target data meeting preset conditions in the target image, wherein the target image is an image acquired by a first camera in the electronic equipment;

the processing module is used for generating a target chart corresponding to the target data according to the target data;

the display module is used for displaying the target chart.

8. The display apparatus according to claim 7, wherein the electronic device is an AR device, and the display module is specifically configured to display the target graph in a preset screen area of the AR device.

9. The apparatus of claim 8, wherein the preset condition comprises at least one of: the data type is a preset data type, and the user is watching data in an area with the watching time in the image being larger than or equal to a target threshold value.

10. The apparatus of claim 8, wherein the target data comprises M data items, wherein the target graph comprises M graph symbols, each graph symbol indicating a value of one data item, wherein M is a positive integer greater than or equal to 2; the apparatus also includes a determination module;

the determining module is configured to display the target graph in a preset screen area of the AR device, and determine a position of each data item in the M data items in the target image to obtain M first positions;

the determining module is further configured to determine M second positions in the preset screen area according to the M first positions, where each second position is a mapping position of one first position in the preset screen area;

the display module is further configured to display the M chart symbols at the M second positions, where each second position displays a corresponding chart symbol.

11. The apparatus of claim 8, wherein the target chart is a chart of a first chart type; the device also comprises a receiving module;

the receiving module is used for receiving a first input of a user;

the display module is further configured to update and display the target chart from the first chart type to a second chart type in response to the first input received by the receiving module, where the first chart type is different from the second chart type.

12. The apparatus of any one of claims 8 to 11, wherein the target graph comprises a first graph and a second graph, the first graph being a graph plotted using the target data, the second graph being a graph plotted using statistics of the target data;

the display module is specifically configured to display the first chart in the preset screen area, and display the second chart on the first chart in an overlapping manner.

13. An electronic device comprising a processor, a memory and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the display method according to any one of claims 1 to 5.

14. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the display method according to any one of claims 1 to 5.