WO2020192463A1 - Display method and apparatus - Google Patents

Display method and apparatus Download PDF

Info

Publication number
WO2020192463A1
WO2020192463A1 PCT/CN2020/079436 CN2020079436W WO2020192463A1 WO 2020192463 A1 WO2020192463 A1 WO 2020192463A1 CN 2020079436 W CN2020079436 W CN 2020079436W WO 2020192463 A1 WO2020192463 A1 WO 2020192463A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
standard
display element
attribute information
elements
Prior art date
Application number
PCT/CN2020/079436
Other languages
French (fr)
Chinese (zh)
Inventor
马瑞娴
关会华
黄伟
闻啸
Original Assignee
阿里巴巴集团控股有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 阿里巴巴集团控股有限公司 filed Critical 阿里巴巴集团控股有限公司
Priority to SG11202109770U priority Critical patent/SG11202109770UA/en
Publication of WO2020192463A1 publication Critical patent/WO2020192463A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/30Creation or generation of source code
    • G06F8/38Creation or generation of source code for implementing user interfaces

Definitions

  • the present invention relates to the field of computer technology, in particular to a display method and device.
  • the present invention proposes a display method and device, the main purpose of which is to provide non-professional users with a simple design solution for large-screen display and improve the efficiency of large-screen design.
  • the present invention mainly provides the following technical solutions:
  • the present invention provides a display method, which specifically includes:
  • a display image containing standard display elements is generated.
  • the present invention provides a display device, which specifically includes:
  • the acquisition unit is used to acquire design drawings containing multiple display elements
  • An identification unit for identifying the attribute information of the display elements in the design draft obtained by the obtaining unit
  • the generating unit is configured to generate a display image containing standard display elements according to the attribute information obtained by the identifying unit.
  • the present invention provides an information display method, which specifically includes:
  • a display interface containing standard display elements is generated according to the attribute information.
  • the present invention provides a storage medium for storing a computer program, wherein when the computer program is running, the device where the storage medium is located is controlled to execute the presentation method of the embodiment of the present invention.
  • the present invention provides an electronic device including a processor and a memory, and the processor is configured to call program instructions in the memory to execute the presentation method of the embodiment of the present invention.
  • the present invention provides a display method and device that recognizes the attribute information of the display elements in the design draft, determines the corresponding standard display elements, and creates new display diagrams based on these standard display elements.
  • the automatic creation of display diagrams greatly reduces the dependence of display diagrams on graphic design skills, allowing ordinary users to quickly create display diagrams according to their own needs.
  • the present invention can use the target detection model to recognize the design artwork of the large visual screen provided by the user, and re-create the chart that needs to be displayed in the large visual screen according to the recognition result. Typesetting and layout to obtain a large-scale visual display that meets the needs of users.
  • the present invention Compared with the existing design methods of large visualized screens, the present invention has no technical requirements for the design drawings provided by users, which can be screenshots in webpages or user hand-drawn drawings. Therefore, it reduces the impact of large-scale visualization design on users. Professional requirements allow more users who master graphic design or professionalism to freely display their creativity and put forward their own needs for large-screen display, which can automatically generate the required visualization large screen, and at the same time, it also improves the visualization large screen Show the design efficiency of the graph.
  • Fig. 1 shows a flowchart of a presentation method proposed by an embodiment of the present invention
  • Figure 2 shows a hand-drawn artwork in an embodiment of the present invention
  • Figure 3 shows a screenshot of the material in the embodiment of the present invention
  • FIG. 4 shows a flowchart of another display method proposed by an embodiment of the present invention.
  • FIG. 5 shows a block diagram of a display device according to an embodiment of the present invention
  • Fig. 6 shows a block diagram of another display device provided by an embodiment of the present invention.
  • the display method provided by the embodiment of the present invention can help users quickly and easily generate technical solutions for data display diagrams. For users, they do not need to master professional skills required for graphic design, such as typesetting, layout and other graphic design skills. , Users only need to provide the design sketches or material pictures that contain display elements they need to output the required data display diagrams.
  • the specific steps are shown in Figure 1, including:
  • Step 101 Obtain a design artwork containing multiple display elements.
  • the design artwork is an image input by the user according to his own needs, and the image contains at least a plurality of display elements for displaying data.
  • the design artwork may be a user's hand-drawn artwork, as shown in FIG. 2, or a large-screen material draft provided by the user, as shown in FIG. 3.
  • These design drawings are all hand-drawn by the user or retrieved on the web page according to the user’s own business needs. It can be seen from the design drawings shown in Figure 2 and Figure 3 that there are multiple charts in the figures, such as pie Graphs of different types and sizes such as graphs, bar graphs, and line graphs.
  • the graph is a type of display element.
  • the display element can also be a specific image logo, such as a portrait or a building. It should be noted that the display element in the present invention is a graphic element with a data display function.
  • the present invention collects design drawings provided by users, analyzes the display elements contained therein, and creates new display diagrams according to the structure of the design drawings. When it is specifically executed, it is not limited to collecting design drawings through an image acquisition device, such as a camera, or through a terminal (the user imports the design drawings into the terminal).
  • Step 102 Identify the attribute information of the elements displayed in the design draft.
  • This step is to identify the display elements in the design draft based on the existing image recognition technology, and determine the attribute information of each display element, such as the type of display element, the position and size of the display element in the design draft, etc. information.
  • the preferred solution for recognizing design drawings is to use a target detection model based on neural network training to recognize design drawings.
  • the attribute information of the element is displayed in.
  • the target detection model is mainly used to detect multiple charts of display data contained in the design draft, and output the attribute information of the identified chart.
  • the attribute information includes the type of the chart. , The relative position and size in the design artwork, the color used and other information.
  • the image recognition algorithm used in the target detection model is not specifically limited, such as neural network image recognition, image recognition based on wavelet moments, and infrared image recognition methods based on fractal features.
  • the display elements contained in multiple design drawings can be identified at the same time, as well as the type, position, size and other parameter information of the display elements.
  • Step 103 Generate a display image containing standard display elements according to the attribute information.
  • the attribute information in this step is the related information of the display element obtained by identifying the design artwork.
  • the added standard display element is not limited to be a standard display element drawn and generated according to the attribute information, or a standard display element that is matched from a specified component library that is closest to the attribute information. In practical applications, it takes a long time to draw multiple standard display elements. Therefore, in order to improve the response time of generating a display image, a preset component library is often used and a method similar to the standard display elements is matched.
  • the embodiment of the present invention can convert and adjust the obtained attribute information according to the size ratio, so as to ensure that the standard display elements in the display drawing are similar to the display elements in the design draft. You can re-layout layout (including adjustment of position and size) based on the added chart and the display range provided by the current display chart without making adjustments, so that the chart layout in the display chart is more reasonable and beautiful .
  • the display method provided by the embodiment of the present invention can automatically generate a new data display diagram based on the design draft provided by the user.
  • the embodiment of the present invention lowers the threshold for users to design data display diagrams, so that users who do not have professional graphic design knowledge can conveniently design required data display diagrams. Therefore, the present invention can motivate users to design data
  • the creativity of the display diagram can directly transform the idea into a display diagram through a hand-drawn drawing, so that the data display diagram can be applied to more application fields, especially in the field of large visualization screens, which can increase the application popularity of large visualization screens degree.
  • the target detection model used is obtained through convolutional neural network training. For this reason, before performing the steps shown in Figure 1, it is necessary to obtain samples for training the target detection model, and then train the target detection model.
  • the specific process is as follows:
  • the labeling information carried by the display image sample at least includes: the type of display element, the position and size in the display image and other information.
  • the position includes the position of the identification coordinate point of the display element in the display diagram, such as the upper left corner of the display element, or the center point of the display element, etc.
  • the size includes the area occupied by the display element in the display diagram, generally The length and height of the display element determine its size information.
  • the data display graph samples are mainly divided into two types.
  • One type is screenshot samples.
  • This type of sample is a screenshot taken from the page to display the data.
  • the main source of this type of sample is For designing the large-screen material of the website, the large-screen image in the movie screenshot, etc., in this sample, the display elements in the figure will be marked to form label information, which mainly includes the type of display element. Position, size, and color matching of display elements. That is to say, a screenshot sample will have at least multiple sets of labeling information of display elements to label the content of the display elements and the structural relationship between them and the display diagram.
  • the other type is hand-drawn samples, which are mostly data display diagrams drawn by different users uploading manually, as shown in Figure 2. Such samples will also carry label information corresponding to the type, location, size and other information, and since the hand-drawn drawings generally only depict the type, location, and size of each chart in the large screen, the specific color scheme is not particularly limited. Therefore, Color matching information is generally not marked in the hand drawing samples.
  • Faster R-CNN is an improved target detection algorithm based on R-CNN and Fast R-CNN. It improves the efficiency of determining candidate frames in the image by adding a neural network that extracts the edges, that is, in Fast R-CNN Introduce Region Proposal Network (RPN) instead of Selective Search, and introduce anchor box to deal with the change of target shape (an anchor is a box with a fixed position and size, which can be understood as a fixed proposal set in advance). Therefore, the use of Faster R-CNN for target detection is one of the current mainstream target detection methods that has the advantages of accuracy, fast speed, and simple detection process. The main principle and detection process are not described in detail here.
  • RPN Fast R-CNN Introduce Region Proposal Network
  • a preferred embodiment of the present invention can partially adjust the generated display diagram to obtain better visual effects.
  • the standard display element is the display element of the specified type in the component library, and the component library is based on the preset display element collection of the present invention.
  • the component library is provided with standard display elements of common types, which can be identified according to the type of display element. Match the corresponding standard display elements.
  • the standard display elements are laid out on the preset display screen to obtain the display image.
  • the layout operation is mainly performed for multiple standard display elements, and each standard display element is added to the display diagram of the preset display screen according to the identified position and size.
  • the position and size of the standard display elements will be adjusted according to the preset strategy, so that the standard display elements will not interfere with each other.
  • the preset strategy can be set separately according to specific application scenarios and specific industries. For example, you can adjust the position of the chart first. If there is still overlap, adjust the size of the chart. You can also directly account for the entire standard display element based on the overlapped part. To reduce the display ratio of the standard display elements that overlap each other, and then perform position adjustment operations such as alignment.
  • the display diagram obtained by the present invention is a new diagram composed of multiple standard display elements selected from the component library. Based on the display diagram, the user can add data to the corresponding standard display elements to obtain the desired display Data map, and finally display the display map through the preset display screen.
  • the standard display elements are generated based on the design draft provided by the user, there will be a certain deviation in the display effect. Therefore, in another embodiment of the present invention, After the display map is generated, it can also be combined with the user's adjustment instructions to manually adjust the layout of each standard display element in the display map.
  • This adjustment operation includes but is not limited to modifying the type of standard display elements, adding and deleting standard display elements, Standard display element position drag, size adjustment, etc., these user adjustment operations can receive user adjustment instructions through an interactive interface.
  • one of the main application scenarios of the display method described in the foregoing embodiment is the visualization of a large screen, and data is displayed through the visualization of the large screen.
  • the display element in the foregoing embodiment is a chart, specifically a broken line as shown in FIG. 3 Graphs, bar charts, pie charts, etc.
  • the design artwork is a visual large-screen design artwork, and the artwork may be a hand-drawn drawing or a screenshot of the large-screen material.
  • the above-mentioned standard display element is a standard chart in the preset component library.
  • the attribute information of the chart is based on the attribute information of each chart identified in the design draft, and then matches the corresponding standard chart in the preset component library for each chart.
  • a display diagram is generated based on the configuration information of the visualized large screen and standard charts.
  • the configuration information of the visualization large screen includes the hardware configuration information and software configuration information of the visualization large screen.
  • the hardware configuration information can determine the size and resolution of the display map
  • the software configuration information can determine the data interface of the display map. Based on the configuration information of the large visualization screen, layout and typeset the standard charts on the large visualization screen, and finally generate a display diagram displayed on the large visualization screen.
  • the present invention proposes a preferred embodiment of the display method applied to a large visual screen, as shown in Fig. 4, including:
  • Step 201 Obtain a sample of a large-screen visual display image carrying label information.
  • Step 202 Train the target detection model by using the large visual display image sample.
  • Step 203 Obtain the design artwork of the large visual screen.
  • Step 204 Use the target detection model to identify the design drawings, and obtain attribute information of multiple charts displaying data in the large visualization screen.
  • Step 205 Use the chart type in the attribute information to obtain a standard chart of the corresponding type from the preset component library.
  • Step 206 According to the position and size of the chart in the attribute information and the configuration information of the large visualization screen, the standard chart is laid out on the large visualization screen to obtain a display diagram of the large visualization screen.
  • Step 207 Perform an adjustment operation on the chart contained in the display diagram according to the received adjustment instruction.
  • the final output is a visualized large-screen display that meets user needs.
  • the embodiment of the present invention also provides an information display method, which is used for visual display of data information, and the specific steps are as follows:
  • the initial artwork may include the design artwork in the embodiment in FIG. 1
  • the display interface may include the display diagram in the embodiment in FIG. 1, the specific step description, and the steps between each step.
  • the execution logic of please refer to the specific description of the embodiment shown in FIG. 1, which will not be repeated here.
  • an embodiment of the present invention provides a display device, which is mainly used to recognize the design artwork of the large visual screen provided by the user, and reconstruct it according to the recognition result.
  • the display diagram of the large visual screen required by the user to simplify the design difficulty of the large visual screen.
  • this device embodiment will not repeat the details in the foregoing method embodiment one by one, but it should be clear that the device in this embodiment can correspondingly implement all the content in the foregoing method embodiment.
  • the device is shown in Figure 5 and specifically includes:
  • the obtaining unit 31 is used to obtain a design drawing containing multiple display elements
  • the identifying unit 32 is configured to identify the attribute information of the display elements in the design draft obtained by the obtaining unit 31;
  • the generating unit 33 is configured to generate a display image containing standard display elements according to the attribute information obtained by the identifying unit 32.
  • the recognition unit 32 is specifically configured to use a target detection model based on neural network training to recognize the attribute information of the display elements in the design drawing.
  • the device further includes:
  • the sample collection unit 34 is configured to obtain a display image sample carrying label information, where the label information includes at least: the type of the display element, the position and size of the display element in the display image;
  • the model training unit 35 is configured to train the target detection model using the display image samples acquired by the sample acquisition unit 34.
  • the attribute information of the display element includes at least the type of the display element, the position and size of the display element in the design draft, and the generating unit 33 includes:
  • the obtaining module 331 is configured to obtain a standard display element of a corresponding type by using the type of the display element;
  • the generating module 332 is configured to lay out the standard display elements obtained by the obtaining module 331 on a preset display screen according to the position and size of the display elements in the design draft to obtain the display image.
  • the generating module 332 is also used for:
  • the device further includes:
  • the adjustment unit 36 is configured to perform adjustment operations on the standard display elements contained in the display diagram obtained by the generating unit 33 according to the received adjustment instructions, and the adjustment operations include: modifying the type, position, size, and color of the standard display elements At least one operation.
  • the display element is a chart showing real-time data
  • the acquiring module 331 is further configured to extract the corresponding standard chart from the preset component library according to the attribute information of the chart;
  • the generating module 332 is further configured to generate the display diagram based on the configuration information of the large visualization screen and the standard diagram.
  • the display method and device proposed by the embodiment of the present invention recognize the design drawings provided by users, detect the type, position, and size of the charts contained therein, and use these designs
  • the information is combined with the preset component library to select matching charts to construct a new visual large-screen display diagram, allowing users to more easily design the required large-screen display diagram, and at the same time, in order to provide users with more freedom
  • the present invention also receives the user's adjustment instructions for a single chart in the large-screen display diagram through the interactive interface, so that the large-screen display diagram is more beautiful and more in line with the user's own needs.
  • an embodiment of the present invention also provides a processor, which is used to run a program, wherein the program is executed to cause the processor to execute the display method described in the embodiment of FIG. 1 or FIG. 4.
  • an embodiment of the present invention also provides an electronic device, which includes a processor and a memory, the memory is used to store a program, and the processor is coupled to the memory and is used to run the program to execute Or the display method described in the embodiment of FIG. 4.
  • memory may include non-permanent memory in computer-readable media, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM), and memory includes At least one memory chip.
  • RAM random access memory
  • ROM read-only memory
  • flash RAM flash random access memory
  • this application can be provided as methods, systems, or computer program products. Therefore, this application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.
  • These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device.
  • the device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
  • These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment.
  • the instructions provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.
  • the computing device includes one or more processors (CPU), input/output interfaces, network interfaces, and memory.
  • processors CPU
  • input/output interfaces network interfaces
  • memory volatile and non-volatile memory
  • the memory may include non-permanent memory in a computer readable medium, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM).
  • RAM random access memory
  • ROM read-only memory
  • flash RAM flash memory
  • Computer-readable media include permanent and non-permanent, removable and non-removable media, and information storage can be realized by any method or technology.
  • the information can be computer-readable instructions, data structures, program modules, or other data.
  • Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical storage, Magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media can be used to store information that can be accessed by computing devices. According to the definition in this article, computer-readable media does not include transitory media, such as modulated data signals and carrier waves.
  • this application can be provided as methods, systems, or computer program products. Therefore, this application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
  • computer-usable storage media including but not limited to disk storage, CD-ROM, optical storage, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

A display method and apparatus, which relate to the technical field of computers and which provide a simple design solution for large-screen display for non-professional users, thus increasing the efficiency of large-screen design. The method comprises: acquiring a design drawing that contains a plurality of display elements (101); identifying attribute information of the display elements in the design drawing (102); and according to the attribute information, generating a display diagram containing a standard display element (103).

Description

一种展示方法及装置Display method and device
本申请要求2019年03月27日递交的申请号为201910239091.7、发明名称为“一种展示方法及装置”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of a Chinese patent application with an application number of 201910239091.7 and an invention title of "a display method and device" filed on March 27, 2019, the entire content of which is incorporated into this application by reference.
技术领域Technical field
本发明涉及计算机技术领域,尤其涉及一种展示方法及装置。The present invention relates to the field of computer technology, in particular to a display method and device.
背景技术Background technique
大数据时代的来临,越来越多的公司开始意识到数据资源的管理和运用,大数据可视化大屏展示被更多的企业青睐。现有的展示大屏会根据不同用户的不同需求与文化设计出不同风格的大屏,而展示大屏的设计一般都需要专业的UI设计(User Interface Design,界面设计)团队针对企业需求进行定制化设计,包括大屏的排版、布局、编程等,而对于大多数企业在设计大屏时,大部分情况下不会聘请专业的设计团队,而是使用基于本行业的设计模板进行制作,而这种模式化的展示大屏就很难体现出用户的个性化展示需求与使用习惯等。With the advent of the era of big data, more and more companies are beginning to realize the management and application of data resources, and the large-scale visualization of big data is favored by more companies. The existing large display screens will design different styles of large screens according to the different needs and cultures of different users, and the design of large display screens generally requires a professional UI design (User Interface Design, interface design) team to customize according to corporate needs Design, including the layout, layout, programming, etc. of large screens. For most companies, when designing large screens, in most cases, they will not hire a professional design team, but use design templates based on the industry for production. This kind of modular display screen can hardly reflect the user's personalized display needs and usage habits.
发明内容Summary of the invention
鉴于上述问题,本发明提出了一种展示方法及装置,主要目的在于为非专业的用户提供大屏展示的简易设计方案,提高大屏设计的效率。In view of the above problems, the present invention proposes a display method and device, the main purpose of which is to provide non-professional users with a simple design solution for large-screen display and improve the efficiency of large-screen design.
为达到上述目的,本发明主要提供如下技术方案:To achieve the above objective, the present invention mainly provides the following technical solutions:
一方面,本发明提供一种展示方法,具体包括:In one aspect, the present invention provides a display method, which specifically includes:
获取含有多个显示元素的设计图稿;Obtain design drawings with multiple display elements;
识别所述设计图稿中显示元素的属性信息;Identify the attribute information of the elements displayed in the design draft;
根据所述属性信息生成含有标准显示元素的展示图。According to the attribute information, a display image containing standard display elements is generated.
另一方面,本发明提供一种展示装置,具体包括:On the other hand, the present invention provides a display device, which specifically includes:
获取单元,用于获取含有多个显示元素的设计图稿;The acquisition unit is used to acquire design drawings containing multiple display elements;
识别单元,用于识别所述获取单元得到的设计图稿中显示元素的属性信息;An identification unit for identifying the attribute information of the display elements in the design draft obtained by the obtaining unit;
生成单元,用于根据所述识别单元得到的属性信息生成含有标准显示元素的展示图。The generating unit is configured to generate a display image containing standard display elements according to the attribute information obtained by the identifying unit.
另一方面,本发明提供一种信息展示方法,具体包括:On the other hand, the present invention provides an information display method, which specifically includes:
获取含有多个显示元素的初始图稿;Get the initial artwork with multiple display elements;
识别所述初始图稿中显示元素的属性信息;Identifying the attribute information of the elements displayed in the initial artwork;
根据所述属性信息生成含有标准显示元素的展示界面。A display interface containing standard display elements is generated according to the attribute information.
另一方面,本发明提供一种存储介质,所述存储介质用于存储计算机程序,其中,所述计算机程序运行时控制所述存储介质所在设备执行本发明实施例的展示方法。In another aspect, the present invention provides a storage medium for storing a computer program, wherein when the computer program is running, the device where the storage medium is located is controlled to execute the presentation method of the embodiment of the present invention.
另一方面,本发明提供一种电子设备,所述电子设备中包括处理器和存储器,所述处理器用于调用所述存储器中的程序指令,以执行本发明实施例的展示方法。In another aspect, the present invention provides an electronic device including a processor and a memory, and the processor is configured to call program instructions in the memory to execute the presentation method of the embodiment of the present invention.
借由上述技术方案,本发明提供的一种展示方法及装置,是通过识别设计图稿中显示元素的属性信息,确定对应的标准显示元素,并基于这些标准显示元素创建新的展示图,实现展示图的自动创建,大大降低了展示图对图形设计技能的依赖性,可以让普通用户根据自身的需求快速创建展示图。将该方案应用于可视化大屏的设计中时,本发明可以利用目标检测模型对用户提供的可视化大屏的设计图稿进行识别,并根据识别结果对可视化大屏中所需展示的图表进行重新排版、布局,得到符合用户需求的可视化大屏的展示图。相对于现有的可视化大屏的设计方式,本发明对于用户所提供的设计图稿没有技术性要求,其可以是网页中的截图或者是用户的手绘图,因此,降低了可视化大屏设计对用户专业性的要求,让更多掌握平面设计或专业的用户可以自由发挥自身的创造性,提出自身对大屏的展示需求,就可以自动生成所需的可视化大屏,同时,也提高了可视化大屏展示图的设计效率。With the above technical solutions, the present invention provides a display method and device that recognizes the attribute information of the display elements in the design draft, determines the corresponding standard display elements, and creates new display diagrams based on these standard display elements. The automatic creation of display diagrams greatly reduces the dependence of display diagrams on graphic design skills, allowing ordinary users to quickly create display diagrams according to their own needs. When the solution is applied to the design of a large visual screen, the present invention can use the target detection model to recognize the design artwork of the large visual screen provided by the user, and re-create the chart that needs to be displayed in the large visual screen according to the recognition result. Typesetting and layout to obtain a large-scale visual display that meets the needs of users. Compared with the existing design methods of large visualized screens, the present invention has no technical requirements for the design drawings provided by users, which can be screenshots in webpages or user hand-drawn drawings. Therefore, it reduces the impact of large-scale visualization design on users. Professional requirements allow more users who master graphic design or professionalism to freely display their creativity and put forward their own needs for large-screen display, which can automatically generate the required visualization large screen, and at the same time, it also improves the visualization large screen Show the design efficiency of the graph.
上述说明仅是本发明技术方案的概述,为了能够更清楚了解本发明的技术手段,而可依照说明书的内容予以实施,并且为了让本发明的上述和其它目的、特征和优点能够更明显易懂,以下特举本发明的具体实施方式。The above description is only an overview of the technical solution of the present invention. In order to understand the technical means of the present invention more clearly, it can be implemented in accordance with the content of the description, and in order to make the above and other objectives, features and advantages of the present invention more obvious and understandable. In the following, specific embodiments of the present invention are specifically cited.
附图说明Description of the drawings
通过阅读下文优选实施方式的详细描述,各种其他的优点和益处对于本领域普通技术人员将变得清楚明了。附图仅用于示出优选实施方式的目的,而并不认为是对本发明的限制。而且在整个附图中,用相同的参考符号表示相同的部件。在附图中:By reading the detailed description of the preferred embodiments below, various other advantages and benefits will become clear to those of ordinary skill in the art. The drawings are only used for the purpose of illustrating the preferred embodiments, and are not considered as a limitation to the present invention. Also, throughout the drawings, the same reference symbols are used to denote the same components. In the attached picture:
图1示出了本发明实施例提出的一种展示方法的流程图;Fig. 1 shows a flowchart of a presentation method proposed by an embodiment of the present invention;
图2示出了本发明实施例中的手绘图稿;Figure 2 shows a hand-drawn artwork in an embodiment of the present invention;
图3示出了本发明实施例中的素材截图稿;Figure 3 shows a screenshot of the material in the embodiment of the present invention;
图4示出了本发明实施例提出的另一种展示方法的流程图;FIG. 4 shows a flowchart of another display method proposed by an embodiment of the present invention;
图5示出了本发明实施例提出的一种展示装置的组成框图;FIG. 5 shows a block diagram of a display device according to an embodiment of the present invention;
图6示出了本发明实施例提出的另一种展示装置的组成框图。Fig. 6 shows a block diagram of another display device provided by an embodiment of the present invention.
具体实施方式detailed description
下面将参照附图更详细地描述本发明的示例性实施例。虽然附图中显示了本发明的示例性实施例,然而应当理解,可以以各种形式实现本发明而不应被这里阐述的实施例所限制。相反,提供这些实施例是为了能够更透彻地理解本发明,并且能够将本发明的范围完整的传达给本领域的技术人员。Hereinafter, exemplary embodiments of the present invention will be described in more detail with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art.
本发明实施例提供的一种展示方法,能够帮助用户快速、简便地生成数据展示图的技术方案,对于用户而言,无需掌握设计图形设计所需的专业技能,如排版、布局等平面设计技能,只需要用户提供其所需含有显示元素的设计草图或素材图片即可对应输出所需的数据展示图。其具体步骤内容如图1所示,包括:The display method provided by the embodiment of the present invention can help users quickly and easily generate technical solutions for data display diagrams. For users, they do not need to master professional skills required for graphic design, such as typesetting, layout and other graphic design skills. , Users only need to provide the design sketches or material pictures that contain display elements they need to output the required data display diagrams. The specific steps are shown in Figure 1, including:
步骤101、获取含有多个显示元素的设计图稿。Step 101: Obtain a design artwork containing multiple display elements.
其中,设计图稿为用户根据自身需求输入的图像,该图像中至少含有多个用于展示数据的显示元素。具体的,该设计图稿可以为用户的手绘图稿,如图2所示,或者是用户提供的大屏素材稿,如图3所示。这些设计图稿都是根据用户自身的业务需求由用户手绘或在网页上检索得到的,由图2和图3所示的设计图稿中可以看出,图中都具有多个图表,比如饼状图、柱状图、折线图等不同类型、大小的图表,在本发明中,图表为显示元素的一种,此外,显示元素还可以是特定的图像标识,如人像、建筑等。需要说明的是,本发明中的显示元素为具有数据展示功能的图形元素。Among them, the design artwork is an image input by the user according to his own needs, and the image contains at least a plurality of display elements for displaying data. Specifically, the design artwork may be a user's hand-drawn artwork, as shown in FIG. 2, or a large-screen material draft provided by the user, as shown in FIG. 3. These design drawings are all hand-drawn by the user or retrieved on the web page according to the user’s own business needs. It can be seen from the design drawings shown in Figure 2 and Figure 3 that there are multiple charts in the figures, such as pie Graphs of different types and sizes such as graphs, bar graphs, and line graphs. In the present invention, the graph is a type of display element. In addition, the display element can also be a specific image logo, such as a portrait or a building. It should be noted that the display element in the present invention is a graphic element with a data display function.
本发明是采集用户所提供的设计图稿,通过分析其中所含有的显示元素,按照该设计图稿的结构创建新的展示图。其具体执行时,不限定是通过图像采集设备,如摄像头,或者是通过终端(由用户将设计图稿导入该终端内)采集设计图稿。The present invention collects design drawings provided by users, analyzes the display elements contained therein, and creates new display diagrams according to the structure of the design drawings. When it is specifically executed, it is not limited to collecting design drawings through an image acquisition device, such as a camera, or through a terminal (the user imports the design drawings into the terminal).
步骤102、识别设计图稿中显示元素的属性信息。Step 102: Identify the attribute information of the elements displayed in the design draft.
本步骤是基于现有的图像识别技术对设计图稿中的显示元素进行识别,并确定各个显示元素的属性信息,比如,显示元素的类型,显示元素在设计图稿中的位置、大小等属性信息。This step is to identify the display elements in the design draft based on the existing image recognition technology, and determine the attribute information of each display element, such as the type of display element, the position and size of the display element in the design draft, etc. information.
进一步的,现有的图像识别技术中,常用的是经过训练的模型对图像识别,本步骤中,在对设计图稿进行识别的优先方案是利用基于神经网络训练的目标检测模型识别设计图稿中显示元素的属性信息。其中,在显示元素具体为图表时,该目标检测模型主要是用于检测设计图稿中的含有的多个展示数据的图表,并输出所识别图表的属性信息, 该属性信息包括有图表的类型,在设计图稿中的相对位置与大小,使用的配色等信息。在本发明实施例中,对于目标检测模型所采用的图像识别算法不做具体限定,如神经网络图像识别、基于小波矩的图像识别、基于分形特征的红外图像识别方法等。Furthermore, in the existing image recognition technology, a trained model is commonly used to recognize images. In this step, the preferred solution for recognizing design drawings is to use a target detection model based on neural network training to recognize design drawings. The attribute information of the element is displayed in. Wherein, when the display element is specifically a chart, the target detection model is mainly used to detect multiple charts of display data contained in the design draft, and output the attribute information of the identified chart. The attribute information includes the type of the chart. , The relative position and size in the design artwork, the color used and other information. In the embodiment of the present invention, the image recognition algorithm used in the target detection model is not specifically limited, such as neural network image recognition, image recognition based on wavelet moments, and infrared image recognition methods based on fractal features.
经过本步骤的执行,可以同时识别出多个设计图稿中含有的显示元素,以及显示元素的类型、位置、大小等参数信息。After the execution of this step, the display elements contained in multiple design drawings can be identified at the same time, as well as the type, position, size and other parameter information of the display elements.
步骤103、根据属性信息生成含有标准显示元素的展示图。Step 103: Generate a display image containing standard display elements according to the attribute information.
该步骤中的属性信息为识别设计图稿所得到的显示元素的相关信息,而要生成数据的展示图,需要在指定的展示图中添加对应的标准显示元素,从而得到新的数据展示图,其中,所添加的标准显示元素不限定是根据属性信息而绘制生成的标准显示元素,或者是从指定的构件库中匹配出的与属性信息最相近的标准显示元素。在实际应用中,由于绘制多个标准显示元素所需的时间较长,因此,为了提高生成展示图的响应时间,多采用预设构件库,并从中匹配近似标准显示元素的方式。The attribute information in this step is the related information of the display element obtained by identifying the design artwork. To generate a data display diagram, you need to add the corresponding standard display element to the designated display diagram to obtain a new data display diagram. Among them, the added standard display element is not limited to be a standard display element drawn and generated according to the attribute information, or a standard display element that is matched from a specified component library that is closest to the attribute information. In practical applications, it takes a long time to draw multiple standard display elements. Therefore, in order to improve the response time of generating a display image, a preset component library is often used and a method similar to the standard display elements is matched.
需要说明的是,由于数据展示图的尺寸是可以预先设定的,因此,可能会导致设计图稿与该数据展示图的尺寸比例不同,使得在展示图中布局标准显示元素时出现位置、大小的偏移,为此,本发明实施例可以根据该尺寸比例对所得到属性信息进行换算调整,以确保在展示图中的标准显示元素与设计图稿中的显示元素的结构比例相近似,也可以在不做调整的情况下,根据所添加的图表,基于当前展示图所提供的展示范围进行再次排版布局(包括位置、大小的调整),以使得展示图中的图表布局更为合理、美观。It should be noted that since the size of the data display diagram can be set in advance, it may cause the size ratio of the design drawing and the data display diagram to be different, making the position and size appear when the standard display elements are laid out in the display diagram. For this reason, the embodiment of the present invention can convert and adjust the obtained attribute information according to the size ratio, so as to ensure that the standard display elements in the display drawing are similar to the display elements in the design draft. You can re-layout layout (including adjustment of position and size) based on the added chart and the display range provided by the current display chart without making adjustments, so that the chart layout in the display chart is more reasonable and beautiful .
通过上述是实施例可见,本发明实施例所提供的一种展示方法,能够根据用户所提供的设计图稿自动生成一幅新的数据展示图。对于用户而言,本发明实施例降低了用户设计数据展示图的门槛,让不具有专业图形设计知识的用户也可以方便的设计出所需的数据展示图,因此,本发明可以激发用户设计数据展示图的创造性,能够将构想通过手绘图直接转化为展示图,由此可以将数据展示图应用至更多的应用领域,特别是在可视化大屏的领域中,可以提高可视化大屏的应用普及程度。It can be seen from the above embodiments that the display method provided by the embodiment of the present invention can automatically generate a new data display diagram based on the design draft provided by the user. For users, the embodiment of the present invention lowers the threshold for users to design data display diagrams, so that users who do not have professional graphic design knowledge can conveniently design required data display diagrams. Therefore, the present invention can motivate users to design data The creativity of the display diagram can directly transform the idea into a display diagram through a hand-drawn drawing, so that the data display diagram can be applied to more application fields, especially in the field of large visualization screens, which can increase the application popularity of large visualization screens degree.
进一步的,为了提高对用户提供的设计图稿的识别准确率,本发明的一个优选实施例中,其所使用的目标检测模型是通过卷积神经网络训练得到的。为此,在执行图1所示的各步骤之前,需要先获取用于训练目标检测模型的样本,之后对目标检测模型进行训练,其具体过程如下:Further, in order to improve the recognition accuracy of the design artwork provided by the user, in a preferred embodiment of the present invention, the target detection model used is obtained through convolutional neural network training. For this reason, before performing the steps shown in Figure 1, it is necessary to obtain samples for training the target detection model, and then train the target detection model. The specific process is as follows:
首先,获取携带标注信息的展示图样本。First, get a sample of the display image that carries the annotation information.
展示图样本所携带的标注信息至少包括:显示元素的类型,在展示图中的位置、大小等信息。其中,位置包括显示元素的标识坐标点在展示图中的位置,比如显示元素左上角的点,或者是显示元素的中心点等;大小包括显示元素在展示图中所占的区域面积,一般以显示元素的长、高值确定其大小信息。The labeling information carried by the display image sample at least includes: the type of display element, the position and size in the display image and other information. Among them, the position includes the position of the identification coordinate point of the display element in the display diagram, such as the upper left corner of the display element, or the center point of the display element, etc.; the size includes the area occupied by the display element in the display diagram, generally The length and height of the display element determine its size information.
此外,本实施例中,数据展示图样本主要分为两类,一类为截图样本,这类样本是从页面中截取的用于展示数据的截图,如图3所示,这类样本主要来源于设计网站的大屏素材、电影截图中的大屏图像等,在该样本中,会对图中的显示元素进行标注,形成标注信息,主要包括显示元素的类型,显示元素在展示图中的位置、大小以及显示元素的配色等信息。也就是说,一个截图样本中至少会有多组显示元素的标注信息,用以标注显示元素的内容以及其与展示图之间的结构关系。In addition, in this embodiment, the data display graph samples are mainly divided into two types. One type is screenshot samples. This type of sample is a screenshot taken from the page to display the data. As shown in Figure 3, the main source of this type of sample is For designing the large-screen material of the website, the large-screen image in the movie screenshot, etc., in this sample, the display elements in the figure will be marked to form label information, which mainly includes the type of display element. Position, size, and color matching of display elements. That is to say, a screenshot sample will have at least multiple sets of labeling information of display elements to label the content of the display elements and the structural relationship between them and the display diagram.
另一类为手绘图样本,这类样本多为不同用户通过上传手工绘制的数据展示图,如图2所示。这类样本中同样会携带有对应类型、位置、大小等信息的标注信息,而由于手绘图一般只是描绘出大屏中各个图表的种类、位置、大小,并不会特别限定具体配色,因此,在手绘图样本中一般不会标注有配色信息。The other type is hand-drawn samples, which are mostly data display diagrams drawn by different users uploading manually, as shown in Figure 2. Such samples will also carry label information corresponding to the type, location, size and other information, and since the hand-drawn drawings generally only depict the type, location, and size of each chart in the large screen, the specific color scheme is not particularly limited. Therefore, Color matching information is generally not marked in the hand drawing samples.
其次,利用展示图样本训练目标检测模型。Second, use the display image samples to train the target detection model.
在本实施例中,训练目标检测模型时,优选的是采用Faster R-CNN网络进行训练。Faster R-CNN是在R-CNN、Fast R-CNN的基础上改进的目标检测算法,其通过加入一个提取边缘的神经网络来提高确定图像中的候选框的效率,即在Fast R-CNN中引入Region Proposal Network(RPN)替代Selective Search,同时引入anchor box应对目标形状的变化问题(anchor就是位置和大小固定的box,可以理解成事先设置好的固定的proposal)。因此,使用Faster R-CNN进行目标检测是目前主流的目标检测方法中一种具有精度稿、速度快、检测流程简便等优点的检测方法。其主要原理与检测流程在此不做详细说明。In this embodiment, when training the target detection model, it is preferable to use the Faster R-CNN network for training. Faster R-CNN is an improved target detection algorithm based on R-CNN and Fast R-CNN. It improves the efficiency of determining candidate frames in the image by adding a neural network that extracts the edges, that is, in Fast R-CNN Introduce Region Proposal Network (RPN) instead of Selective Search, and introduce anchor box to deal with the change of target shape (an anchor is a box with a fixed position and size, which can be understood as a fixed proposal set in advance). Therefore, the use of Faster R-CNN for target detection is one of the current mainstream target detection methods that has the advantages of accuracy, fast speed, and simple detection process. The main principle and detection process are not described in detail here.
进一步的,为了生成更加符合用户需求的数据展示图,在执行图1所示的步骤103时,本发明的一个优选实施例可以对所生成的展示图进行局部调整,以得到更好的视觉效果,具体的:Further, in order to generate a data display diagram that is more in line with user needs, when step 103 shown in FIG. 1 is performed, a preferred embodiment of the present invention can partially adjust the generated display diagram to obtain better visual effects. ,specific:
首先,利用属性信息中显示元素的类型获取对应类型的标准显示元素。First, use the type of the display element in the attribute information to obtain the standard display element of the corresponding type.
其中,标准显示元素为构件库中指定类型的显示元素,构件库则是基于本发明预先设置的显示元素集合,该构件库中设置有常用类型的标准显示元素,可以根据识别出的 显示元素类型匹配出对应的标准显示元素。Among them, the standard display element is the display element of the specified type in the component library, and the component library is based on the preset display element collection of the present invention. The component library is provided with standard display elements of common types, which can be identified according to the type of display element. Match the corresponding standard display elements.
其次,根据属性信息中显示元素在设计图稿中的位置、大小,将标准显示元素在预设展示屏幕中进行布局,得到展示图。Secondly, according to the position and size of the display element in the design draft in the attribute information, the standard display elements are laid out on the preset display screen to obtain the display image.
在进行布局时,主要是针对多个标准显示元素进行的排版布局操作,将每个标准显示元素按照所识别出的位置、大小添加至预设展示屏幕的展示图中。During the layout, the layout operation is mainly performed for multiple standard display elements, and each standard display element is added to the display diagram of the preset display screen according to the identified position and size.
在具体布局时,当判断在预设展示屏幕中的标准显示元素存在相互重叠展示时,将根据预置策略对标准显示元素的位置、大小进行调整,使得标准显示元素之间不会相互干扰。其中,预置策略可以根据具体的应用场景、具体行业进行单独设置,比如,可以先调整图表的位置,若依然存在重叠情况,再调整图表的大小,也可以直接根据重叠部分占标准显示元素整体的比例来缩小相互重叠的标准显示元素的展示比例,之后在进行对齐等位置调整操作。In the specific layout, when it is judged that the standard display elements on the preset display screen overlap each other, the position and size of the standard display elements will be adjusted according to the preset strategy, so that the standard display elements will not interfere with each other. Among them, the preset strategy can be set separately according to specific application scenarios and specific industries. For example, you can adjust the position of the chart first. If there is still overlap, adjust the size of the chart. You can also directly account for the entire standard display element based on the overlapped part. To reduce the display ratio of the standard display elements that overlap each other, and then perform position adjustment operations such as alignment.
可见,本发明所得到的展示图是由多个从构件库中选出的标准显示元素所组成的新图,基于该展示图,用户可以在相应的标准显示元素中加入数据从而得到所要展示的数据图,最后通过预设展示屏幕展示该展示图。It can be seen that the display diagram obtained by the present invention is a new diagram composed of multiple standard display elements selected from the component library. Based on the display diagram, the user can add data to the corresponding standard display elements to obtain the desired display Data map, and finally display the display map through the preset display screen.
进一步的,对于所生成的展示图,由于其中的标准显示元素是基于用户所提供的设计图稿生成的,在展示效果上会存在一定偏差,因此,本发明的另一种实施例中,在生成展示图之后,还能够结合用户的调整指令,对展示图中各个标准显示元素的布局进行人工调整操作,该调整操作包括但不限于修改标准显示元素的类型,标准显示元素的添加与删除,标准显示元素位置的拖拽、大小的调节等等,这些用户的调整操作可以通过交互界面的方式接收用户的调整指令。Further, for the generated display diagram, since the standard display elements are generated based on the design draft provided by the user, there will be a certain deviation in the display effect. Therefore, in another embodiment of the present invention, After the display map is generated, it can also be combined with the user's adjustment instructions to manually adjust the layout of each standard display element in the display map. This adjustment operation includes but is not limited to modifying the type of standard display elements, adding and deleting standard display elements, Standard display element position drag, size adjustment, etc., these user adjustment operations can receive user adjustment instructions through an interactive interface.
进一步的,上述实施例所述的展示方法的一个主要应用场景为可视化大屏,通过可视化大屏展示数据,对应的,上述实施例中的显示元素为图表,具体如图3中所示的折线图、柱状图、饼图等。在该场景中,上述实施例中的,设计图稿为可视化大屏设计图稿,该图稿可以为手绘图、也可以是大屏素材截图。那么,上述的标准显示元素为预置组件库中标准图表,在执行根据属性信息生成含有标准显示元素的展示图的步骤时,其具体实现如下:Further, one of the main application scenarios of the display method described in the foregoing embodiment is the visualization of a large screen, and data is displayed through the visualization of the large screen. Correspondingly, the display element in the foregoing embodiment is a chart, specifically a broken line as shown in FIG. 3 Graphs, bar charts, pie charts, etc. In this scenario, in the foregoing embodiment, the design artwork is a visual large-screen design artwork, and the artwork may be a hand-drawn drawing or a screenshot of the large-screen material. Then, the above-mentioned standard display element is a standard chart in the preset component library. When the step of generating a display chart containing the standard display element according to the attribute information is executed, the specific implementation is as follows:
首先,根据图表的属性信息从预置组件库中提取对应的标准图表。First, extract the corresponding standard chart from the preset component library according to the attribute information of the chart.
其中,图表的属性信息是基于设计图稿中识别得到的各个图表的属性信息,进而针 对每个图表在预置组件库中匹配对应的标准图表。Among them, the attribute information of the chart is based on the attribute information of each chart identified in the design draft, and then matches the corresponding standard chart in the preset component library for each chart.
其次,基于可视化大屏的配置信息与标准图表生成展示图。Secondly, a display diagram is generated based on the configuration information of the visualized large screen and standard charts.
其中,可视化大屏的配置信息包括可视化大屏的硬件配置信息和软件配置信息,硬件配置信息可以确定展示图的尺寸、分辨率等信息,软件配置信息则可以确定展示图的数据接口等信息。基于可视化大屏的配置信息,将标准图表在可视化大屏中进行布局排版,最终生成在可视化大屏中显示的展示图。Among them, the configuration information of the visualization large screen includes the hardware configuration information and software configuration information of the visualization large screen. The hardware configuration information can determine the size and resolution of the display map, and the software configuration information can determine the data interface of the display map. Based on the configuration information of the large visualization screen, layout and typeset the standard charts on the large visualization screen, and finally generate a display diagram displayed on the large visualization screen.
综合上述实施例的内容,本发明提出了展示方法应用在可视化大屏中的一个优选实施例,具体如图4所示,包括:Based on the content of the above embodiments, the present invention proposes a preferred embodiment of the display method applied to a large visual screen, as shown in Fig. 4, including:
步骤201、获取携带标注信息的可视化大屏展示图样本。Step 201: Obtain a sample of a large-screen visual display image carrying label information.
步骤202、利用可视化大屏展示图样本训练目标检测模型。Step 202: Train the target detection model by using the large visual display image sample.
步骤203、获取可视化大屏的设计图稿。Step 203: Obtain the design artwork of the large visual screen.
步骤204、利用目标检测模型识别设计图稿,得到多个展示数据的图表在可视化大屏中的属性信息。Step 204: Use the target detection model to identify the design drawings, and obtain attribute information of multiple charts displaying data in the large visualization screen.
步骤205、利用属性信息中的图表类型从预置组件库中获取对应类型的标准图表。Step 205: Use the chart type in the attribute information to obtain a standard chart of the corresponding type from the preset component library.
步骤206、根据属性信息中的图表位置和大小以及可视化大屏的配置信息,将标准图表在可视化大屏中进行布局,得到可视化大屏的展示图。Step 206: According to the position and size of the chart in the attribute information and the configuration information of the large visualization screen, the standard chart is laid out on the large visualization screen to obtain a display diagram of the large visualization screen.
步骤207、根据接收的调整指令对展示图中含有的图表进行调整操作。Step 207: Perform an adjustment operation on the chart contained in the display diagram according to the received adjustment instruction.
经过调整后,最终输出符合用户需求的可视化大屏的展示图。After adjustment, the final output is a visualized large-screen display that meets user needs.
进一步的,本发明实施例还提供的一种信息展示方法,用于对数据信息的可视化展示,其具体步骤如下:Further, the embodiment of the present invention also provides an information display method, which is used for visual display of data information, and the specific steps are as follows:
首选,获取含有多个显示元素的初始图稿。First, get the initial artwork with multiple display elements.
其次,识别所述初始图稿中显示元素的属性信息。Secondly, identifying the attribute information of the elements displayed in the initial artwork.
最后,根据所述属性信息生成含有标准显示元素的展示界面。Finally, according to the attribute information, a display interface containing standard display elements is generated.
在本发明实施例中,初始图稿可以包括上述图1实施例中的设计图稿,而展示界面中则可以包括上述图1实施例中的展示图,具体的步骤说明,以及各步骤之间的执行逻辑可参见图1所示实施例的具体说明,此处不再赘述。In the embodiment of the present invention, the initial artwork may include the design artwork in the embodiment in FIG. 1, and the display interface may include the display diagram in the embodiment in FIG. 1, the specific step description, and the steps between each step. For the execution logic of, please refer to the specific description of the embodiment shown in FIG. 1, which will not be repeated here.
此外,上述针对图1实施例的进一步扩展说明,也可以对应应用于本实施例的信息展示方法中,具体参见上述说明内容,此处不再赘述。In addition, the above-mentioned further expanded description of the embodiment in FIG. 1 can also be correspondingly applied to the information display method of this embodiment. For details, please refer to the above-mentioned description content, which will not be repeated here.
进一步的,作为对上述图1、图4所示方法的实现,本发明实施例提供了一种展示装置,该装置主要用于识别用户提供的可视化大屏的设计图稿,根据识别结果重新构建用户所需的可视化大屏的展示图,以简化可视化大屏的设计难度。为便于阅读,本装置实施例不再对前述方法实施例中的细节内容进行逐一赘述,但应当明确,本实施例中的装置能够对应实现前述方法实施例中的全部内容。该装置如图5所示,具体包括:Further, as an implementation of the methods shown in Figs. 1 and 4, an embodiment of the present invention provides a display device, which is mainly used to recognize the design artwork of the large visual screen provided by the user, and reconstruct it according to the recognition result. The display diagram of the large visual screen required by the user to simplify the design difficulty of the large visual screen. For ease of reading, this device embodiment will not repeat the details in the foregoing method embodiment one by one, but it should be clear that the device in this embodiment can correspondingly implement all the content in the foregoing method embodiment. The device is shown in Figure 5 and specifically includes:
获取单元31,用于获取含有多个显示元素的设计图稿;The obtaining unit 31 is used to obtain a design drawing containing multiple display elements;
识别单元32,用于识别所述获取单元31得到的设计图稿中显示元素的属性信息;The identifying unit 32 is configured to identify the attribute information of the display elements in the design draft obtained by the obtaining unit 31;
生成单元33,用于根据所述识别单元32得到的属性信息生成含有标准显示元素的展示图。The generating unit 33 is configured to generate a display image containing standard display elements according to the attribute information obtained by the identifying unit 32.
进一步的,所述识别单元32具体用于,利用基于神经网络训练的目标检测模型识别所述设计图稿中显示元素的属性信息。Further, the recognition unit 32 is specifically configured to use a target detection model based on neural network training to recognize the attribute information of the display elements in the design drawing.
进一步的,如图6所示,所述装置还包括:Further, as shown in FIG. 6, the device further includes:
样本采集单元34,用于获取携带标注信息的展示图样本,所述标注信息至少包括:显示元素的类型,显示元素在展示图中的位置和大小;The sample collection unit 34 is configured to obtain a display image sample carrying label information, where the label information includes at least: the type of the display element, the position and size of the display element in the display image;
模型训练单元35,用于利用所述样本采集单元34获取的展示图样本训练所述目标检测模型。The model training unit 35 is configured to train the target detection model using the display image samples acquired by the sample acquisition unit 34.
进一步的,如图6所示,所述显示元素的属性信息至少包括显示元素的类型,显示元素在设计图稿中的位置和大小,所述生成单元33包括:Further, as shown in FIG. 6, the attribute information of the display element includes at least the type of the display element, the position and size of the display element in the design draft, and the generating unit 33 includes:
获取模块331,用于利用所述显示元素的类型获取对应类型的标准显示元素;The obtaining module 331 is configured to obtain a standard display element of a corresponding type by using the type of the display element;
生成模块332,用于根据所述显示元素在设计图稿中的位置和大小,将所述获取模块331得到的标准显示元素在预设展示屏幕中进行布局,得到所述展示图。The generating module 332 is configured to lay out the standard display elements obtained by the obtaining module 331 on a preset display screen according to the position and size of the display elements in the design draft to obtain the display image.
进一步的,所述生成模块332还用于:Further, the generating module 332 is also used for:
判断布局在所述预设展示屏幕中的标准显示元素是否存在重叠展示;Judging whether the standard display elements laid out in the preset display screen have overlapping display;
若存在,则缩小相互重叠的标准显示元素的展示比例。If it exists, reduce the display ratio of overlapping standard display elements.
进一步的,如图6所示,所述装置还包括:Further, as shown in FIG. 6, the device further includes:
调整单元36,用于根据接收的调整指令对所述生成单元33得到的展示图中含有的标准显示元素进行调整操作,所述调整操作包括:修改标准显示元素的类型、位置、大小、颜色中的至少一种操作。The adjustment unit 36 is configured to perform adjustment operations on the standard display elements contained in the display diagram obtained by the generating unit 33 according to the received adjustment instructions, and the adjustment operations include: modifying the type, position, size, and color of the standard display elements At least one operation.
进一步的,所述装置应用于可视化大屏时,所述显示元素为展示实时数据的图表;Further, when the device is applied to a large visualization screen, the display element is a chart showing real-time data;
所述生成单元33中,所述获取模块331,还用于根据所述图表的属性信息从预置组 件库中提取对应的标准图表;In the generating unit 33, the acquiring module 331 is further configured to extract the corresponding standard chart from the preset component library according to the attribute information of the chart;
所述生成模块332,还用于基于所述可视化大屏的配置信息与标准图表生成所述展示图。The generating module 332 is further configured to generate the display diagram based on the configuration information of the large visualization screen and the standard diagram.
综上所述,本发明实施例所提出的一种展示方法及装置,通过对用户所提供的设计图稿进行识别,检测其中所含有的图表类型、位置、大小等设计信息,并利用这些设计信息结合预置的构件库中选择相匹配的图表,从而构建出新的可视化大屏的展示图,让用户可以更加轻松的设计出所需的大屏展示图,同时,为了提供用户更为自由的创造性,本发明还通过交互界面接收用户对大屏展示图中单个图表的调整指令,以使大屏展示图更为美观,更加符合用户的自身需求。To sum up, the display method and device proposed by the embodiment of the present invention recognize the design drawings provided by users, detect the type, position, and size of the charts contained therein, and use these designs The information is combined with the preset component library to select matching charts to construct a new visual large-screen display diagram, allowing users to more easily design the required large-screen display diagram, and at the same time, in order to provide users with more freedom The present invention also receives the user's adjustment instructions for a single chart in the large-screen display diagram through the interactive interface, so that the large-screen display diagram is more beautiful and more in line with the user's own needs.
进一步的,本发明实施例还提供了处理器,该处理器用于运行程序,其中,所述程序运行时使得处理器执行如图1或图4实施例所述的展示方法。Further, an embodiment of the present invention also provides a processor, which is used to run a program, wherein the program is executed to cause the processor to execute the display method described in the embodiment of FIG. 1 or FIG. 4.
另外,本发明实施例还提供了一种电子设备,该电子设备中包括处理器和存储器,存储器用于存储程序,处理器耦合至所述存储器,用于运行所述程序,以执行如图1或图4实施例所述的展示方法。In addition, an embodiment of the present invention also provides an electronic device, which includes a processor and a memory, the memory is used to store a program, and the processor is coupled to the memory and is used to run the program to execute Or the display method described in the embodiment of FIG. 4.
在上述实施例中,对各个实施例的描述都各有侧重,某个实施例中没有详述的部分,可以参见其他实施例的相关描述。In the above-mentioned embodiments, the description of each embodiment has its own focus. For parts that are not described in detail in an embodiment, reference may be made to related descriptions of other embodiments.
可以理解的是,上述方法及装置中的相关特征可以相互参考。另外,上述实施例中的“第一”、“第二”等是用于区分各实施例,而并不代表各实施例的优劣。It can be understood that the relevant features in the above method and device can be referred to each other. In addition, the “first”, “second”, etc. in the foregoing embodiments are used to distinguish the embodiments, and do not represent the advantages and disadvantages of the embodiments.
所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and conciseness of description, the specific working process of the above-described system, device, and unit can refer to the corresponding process in the foregoing method embodiment, which will not be repeated here.
在此提供的算法和显示不与任何特定计算机、虚拟系统或者其它设备固有相关。各种通用系统也可以与基于在此的示教一起使用。根据上面的描述,构造这类系统所要求的结构是显而易见的。此外,本发明也不针对任何特定编程语言。应当明白,可以利用各种编程语言实现在此描述的本发明的内容,并且上面对特定语言所做的描述是为了披露本发明的最佳实施方式。The algorithms and displays provided here are not inherently related to any particular computer, virtual system or other equipment. Various general-purpose systems can also be used with the teaching based on this. From the above description, the structure required to construct this type of system is obvious. In addition, the present invention is not directed to any specific programming language. It should be understood that various programming languages can be used to implement the content of the present invention described herein, and the above description of a specific language is to disclose the best embodiment of the present invention.
此外,存储器可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM),存储器包括至少一个存储芯片。In addition, memory may include non-permanent memory in computer-readable media, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM), and memory includes At least one memory chip.
本领域内的技术人员应明白,本申请的实施例可提供为方法、系统、或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例、或结合软件和硬件方面 的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, this application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
本申请是参照根据本申请实施例的方法、设备(系统)、和计算机程序产品的流程图和/或方框图来描述的。应理解可由计算机程序指令实现流程图和/或方框图中的每一流程和/或方框、以及流程图和/或方框图中的流程和/或方框的结合。可提供这些计算机程序指令到通用计算机、专用计算机、嵌入式处理机或其他可编程数据处理设备的处理器以产生一个机器,使得通过计算机或其他可编程数据处理设备的处理器执行的指令产生用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的装置。This application is described with reference to flowcharts and/or block diagrams of methods, equipment (systems), and computer program products according to the embodiments of this application. It should be understood that each process and/or block in the flowchart and/or block diagram, and the combination of processes and/or blocks in the flowchart and/or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing equipment to generate a machine, so that the instructions executed by the processor of the computer or other programmable data processing equipment are generated It is a device that realizes the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
这些计算机程序指令也可存储在能引导计算机或其他可编程数据处理设备以特定方式工作的计算机可读存储器中,使得存储在该计算机可读存储器中的指令产生包括指令装置的制造品,该指令装置实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能。These computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing equipment to work in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture including the instruction device. The device implements the functions specified in one process or multiple processes in the flowchart and/or one block or multiple blocks in the block diagram.
这些计算机程序指令也可装载到计算机或其他可编程数据处理设备上,使得在计算机或其他可编程设备上执行一系列操作步骤以产生计算机实现的处理,从而在计算机或其他可编程设备上执行的指令提供用于实现在流程图一个流程或多个流程和/或方框图一个方框或多个方框中指定的功能的步骤。These computer program instructions can also be loaded on a computer or other programmable data processing equipment, so that a series of operation steps are executed on the computer or other programmable equipment to produce computer-implemented processing, so as to execute on the computer or other programmable equipment. The instructions provide steps for implementing functions specified in a flow or multiple flows in the flowchart and/or a block or multiple blocks in the block diagram.
在一个典型的配置中,计算设备包括一个或多个处理器(CPU)、输入/输出接口、网络接口和内存。In a typical configuration, the computing device includes one or more processors (CPU), input/output interfaces, network interfaces, and memory.
存储器可能包括计算机可读介质中的非永久性存储器,随机存取存储器(RAM)和/或非易失性内存等形式,如只读存储器(ROM)或闪存(flash RAM)。存储器是计算机可读介质的示例。The memory may include non-permanent memory in a computer readable medium, random access memory (RAM) and/or non-volatile memory, such as read-only memory (ROM) or flash memory (flash RAM). The memory is an example of a computer-readable medium.
计算机可读介质包括永久性和非永久性、可移动和非可移动媒体可以由任何方法或技术来实现信息存储。信息可以是计算机可读指令、数据结构、程序的模块或其他数据。计算机的存储介质的例子包括,但不限于相变内存(PRAM)、静态随机存取存储器(SRAM)、动态随机存取存储器(DRAM)、其他类型的随机存取存储器(RAM)、只读存储器(ROM)、电可擦除可编程只读存储器(EEPROM)、快闪记忆体或其他内存技术、只读光盘只读存储器(CD-ROM)、数字多功能光盘(DVD)或其他光学存储、磁盒式磁带,磁带磁磁盘存储或其他磁性存储设备或任何其他非传输介质,可用于存储可以被计 算设备访问的信息。按照本文中的界定,计算机可读介质不包括暂存电脑可读媒体(transitory media),如调制的数据信号和载波。Computer-readable media include permanent and non-permanent, removable and non-removable media, and information storage can be realized by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disc (DVD) or other optical storage, Magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices or any other non-transmission media can be used to store information that can be accessed by computing devices. According to the definition in this article, computer-readable media does not include transitory media, such as modulated data signals and carrier waves.
还需要说明的是,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、商品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、商品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括要素的过程、方法、商品或者设备中还存在另外的相同要素。It should also be noted that the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, product or equipment including a series of elements not only includes those elements, but also includes Other elements that are not explicitly listed, or include elements inherent to this process, method, commodity, or equipment. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, commodity or equipment that includes the element.
本领域技术人员应明白,本申请的实施例可提供为方法、系统或计算机程序产品。因此,本申请可采用完全硬件实施例、完全软件实施例或结合软件和硬件方面的实施例的形式。而且,本申请可采用在一个或多个其中包含有计算机可用程序代码的计算机可用存储介质(包括但不限于磁盘存储器、CD-ROM、光学存储器等)上实施的计算机程序产品的形式。Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, this application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, this application may adopt the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.
以上仅为本申请的实施例而已,并不用于限制本申请。对于本领域技术人员来说,本申请可以有各种更改和变化。凡在本申请的精神和原理之内所作的任何修改、等同替换、改进等,均应包含在本申请的权利要求范围之内。The above are only examples of the application, and are not used to limit the application. For those skilled in the art, this application can have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included in the scope of the claims of this application.

Claims (18)

  1. 一种展示方法,其特征在于,所述方法包括:A display method, characterized in that the method includes:
    获取含有多个显示元素的设计图稿;Obtain design drawings with multiple display elements;
    识别所述设计图稿中显示元素的属性信息;Identify the attribute information of the elements displayed in the design draft;
    根据所述属性信息生成含有标准显示元素的展示图。According to the attribute information, a display image containing standard display elements is generated.
  2. 根据权利要求1所述的方法,其特征在于,识别所述设计图稿中显示元素的属性信息包括:The method according to claim 1, wherein identifying the attribute information of the display element in the design draft comprises:
    利用基于神经网络训练的目标检测模型识别所述设计图稿中显示元素的属性信息。A target detection model based on neural network training is used to identify the attribute information of the display elements in the design draft.
  3. 根据权利要求2所述的方法,其特征在于,所述方法还包括:The method of claim 2, wherein the method further comprises:
    获取携带标注信息的展示图样本,所述标注信息至少包括:显示元素的类型,显示元素在展示图中的位置和大小;Obtain a display image sample carrying label information, where the label information at least includes: the type of display element, the position and size of the display element in the display image;
    利用所述展示图样本训练所述目标检测模型。Training the target detection model using the display image samples.
  4. 根据权利要求1所述的方法,其特征在于,所述显示元素的属性信息至少包括显示元素的类型,显示元素在设计图稿中的位置和大小,所述根据所述属性信息生成含有标准显示元素的展示图,包括:The method according to claim 1, wherein the attribute information of the display element includes at least the type of the display element, the position and size of the display element in the design draft, and the generation of a standard display based on the attribute information The display diagram of the elements, including:
    利用所述显示元素的类型获取对应类型的标准显示元素;Obtaining a standard display element of a corresponding type by using the type of the display element;
    根据所述显示元素在设计图稿中的位置和大小,将所述标准显示元素在预设展示屏幕中进行布局,得到所述展示图。According to the position and size of the display element in the design draft, the standard display element is laid out on a preset display screen to obtain the display image.
  5. 根据权利要求4所述的方法,其特征在于,根据所述显示元素在设计图稿中的位置和大小,将所述标准显示元素在预设展示屏幕中进行布局,具体包括:The method according to claim 4, wherein, according to the position and size of the display element in the design draft, the standard display element is laid out on a preset display screen, which specifically comprises:
    判断布局在所述预设展示屏幕中的标准显示元素是否存在重叠展示;Judging whether the standard display elements laid out in the preset display screen have overlapping display;
    若存在,则缩小相互重叠的标准显示元素的展示比例。If it exists, reduce the display ratio of overlapping standard display elements.
  6. 根据权利要求3所述的方法,其特征在于,所述展示图样本包括:截图样本与手绘图样本,其中,所述截图样本中的标注信息还包括截图配色信息和显示元素配色信息。The method according to claim 3, wherein the display image sample comprises: a screenshot sample and a hand drawing sample, wherein the annotation information in the screenshot sample further includes screenshot color matching information and display element color matching information.
  7. 根据权利要求1所述的方法,其特征在于,所述方法还包括:The method of claim 1, wherein the method further comprises:
    根据接收的调整指令对所述展示图中含有的标准显示元素进行调整操作,所述调整操作包括:修改标准显示元素的类型、位置、大小、颜色中的至少一种操作。The adjustment operation is performed on the standard display elements contained in the display diagram according to the received adjustment instruction, and the adjustment operation includes: modifying at least one of the type, position, size, and color of the standard display element.
  8. 根据权利要求1-7中任一项所述的方法,其特征在于,所述方法应用于可视化大屏时,所述显示元素为展示数据的图表;7. The method according to any one of claims 1-7, wherein when the method is applied to a large visualization screen, the display element is a chart showing data;
    所述根据所述属性信息生成含有标准显示元素的展示图,包括:The generating a display diagram containing standard display elements according to the attribute information includes:
    根据所述图表的属性信息从预置组件库中提取对应的标准图表;Extracting the corresponding standard chart from the preset component library according to the attribute information of the chart;
    基于所述可视化大屏的配置信息与标准图表生成所述展示图。The display diagram is generated based on the configuration information of the visual large screen and the standard diagram.
  9. 一种展示装置,其特征在于,所述装置包括:A display device, characterized in that the device comprises:
    获取单元,用于获取含有多个显示元素的设计图稿;The acquisition unit is used to acquire design drawings containing multiple display elements;
    识别单元,用于识别所述获取单元得到的设计图稿中显示元素的属性信息;An identification unit for identifying the attribute information of the display elements in the design draft obtained by the obtaining unit;
    生成单元,用于根据所述识别单元得到的属性信息生成含有标准显示元素的展示图。The generating unit is configured to generate a display image containing standard display elements according to the attribute information obtained by the identifying unit.
  10. 根据权利要求9所述的装置,其特征在于,所述识别单元具体用于,利用基于神经网络训练的目标检测模型识别所述设计图稿中显示元素的属性信息。The device according to claim 9, wherein the recognition unit is specifically configured to use a target detection model based on neural network training to recognize the attribute information of the display elements in the design draft.
  11. 根据权利要求10所述的装置,其特征在于,所述装置还包括:The device according to claim 10, wherein the device further comprises:
    样本采集单元,用于获取携带标注信息的展示图样本,所述标注信息至少包括:显示元素的类型,显示元素在展示图中的位置和大小;The sample collection unit is used to obtain a sample of the display image carrying label information, the label information at least including: the type of the display element, the position and size of the display element in the display image;
    模型训练单元,用于利用所述样本采集单元获取的展示图样本训练所述目标检测模型。The model training unit is configured to train the target detection model by using the display image samples obtained by the sample collection unit.
  12. 根据权利要求9所述的装置,其特征在于,所述显示元素的属性信息至少包括显示元素的类型,显示元素在设计图稿中的位置和大小,所述生成单元,包括:The device according to claim 9, wherein the attribute information of the display element includes at least the type of the display element, the position and size of the display element in the design draft, and the generating unit includes:
    获取模块,用于利用所述显示元素的类型获取对应类型的标准显示元素;An obtaining module, configured to obtain a standard display element of a corresponding type by using the type of the display element;
    生成模块,用于根据所述显示元素在设计图稿中的位置和大小,将所述获取模块得到的标准显示元素在预设展示屏幕中进行布局,得到所述展示图。The generating module is configured to lay out the standard display elements obtained by the obtaining module on a preset display screen according to the position and size of the display elements in the design draft to obtain the display image.
  13. 根据权利要求12所述的装置,其特征在于,所述生成模块还用于:The device according to claim 12, wherein the generating module is further configured to:
    判断布局在所述预设展示屏幕中的标准显示元素是否存在重叠展示;Judging whether the standard display elements laid out in the preset display screen have overlapping display;
    若存在,则缩小相互重叠的标准显示元素的展示比例。If it exists, reduce the display ratio of overlapping standard display elements.
  14. 根据权利要求9所述的装置,其特征在于,所述装置还包括:The device according to claim 9, wherein the device further comprises:
    调整单元,用于根据接收的调整指令对所述生成单元得到的展示图中含有的标准显示元素进行调整操作,所述调整操作包括:修改标准显示元素的类型、位置、大小、颜色中的至少一种操作。The adjustment unit is configured to perform an adjustment operation on the standard display elements contained in the display diagram obtained by the generating unit according to the received adjustment instruction, and the adjustment operation includes: modifying at least one of the type, position, size, and color of the standard display element An operation.
  15. 根据权利要求9-14中任一项所述的装置,其特征在于,所述装置应用于可视化大屏时,所述显示元素为展示数据的图表;The device according to any one of claims 9-14, wherein when the device is applied to a large visualization screen, the display element is a chart displaying data;
    所述生成单元还用于:The generating unit is also used for:
    所述获取模块,用于根据所述图表的属性信息从预置组件库中提取对应的标准图 表;The acquiring module is configured to extract the corresponding standard chart from the preset component library according to the attribute information of the chart;
    所述生成模块,用于基于所述可视化大屏的配置信息与标准图表生成所述展示图。The generating module is configured to generate the display diagram based on the configuration information of the large visualization screen and the standard diagram.
  16. 一种信息展示方法,其特征在于,所述方法包括:An information display method, characterized in that the method includes:
    获取含有多个显示元素的初始图稿;Get the initial artwork with multiple display elements;
    识别所述初始图稿中显示元素的属性信息;Identifying the attribute information of the elements displayed in the initial artwork;
    根据所述属性信息生成含有标准显示元素的展示界面。A display interface containing standard display elements is generated according to the attribute information.
  17. 一种存储介质,其特征在于,所述存储介质用于存储计算机程序,其中,所述计算机程序运行时控制所述存储介质所在设备执行权利要求1-8中任意一项所述的展示方法。A storage medium, characterized in that the storage medium is used to store a computer program, wherein when the computer program is running, the device where the storage medium is located is controlled to execute the display method according to any one of claims 1-8.
  18. 一种电子设备,其特征在于,所述电子设备中包括处理器和存储器,所述处理器用于调用所述存储器中的程序指令,以执行权利要求1-8中任意一项所述的展示方法。An electronic device, characterized in that the electronic device includes a processor and a memory, and the processor is used to call program instructions in the memory to execute the display method according to any one of claims 1-8 .
PCT/CN2020/079436 2019-03-27 2020-03-16 Display method and apparatus WO2020192463A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
SG11202109770U SG11202109770UA (en) 2019-03-27 2020-03-16 Display method and apparatus

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910239091.7 2019-03-27
CN201910239091.7A CN111752557A (en) 2019-03-27 2019-03-27 Display method and device

Publications (1)

Publication Number Publication Date
WO2020192463A1 true WO2020192463A1 (en) 2020-10-01

Family

ID=72609171

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/079436 WO2020192463A1 (en) 2019-03-27 2020-03-16 Display method and apparatus

Country Status (3)

Country Link
CN (1) CN111752557A (en)
SG (1) SG11202109770UA (en)
WO (1) WO2020192463A1 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112685489A (en) * 2020-12-21 2021-04-20 珠海格力电器股份有限公司 Data display method, device, terminal, storage medium and processor
CN112906086A (en) * 2021-02-02 2021-06-04 广东博智林机器人有限公司 Model display method and device, electronic equipment and computer readable storage medium
CN112926108A (en) * 2021-02-22 2021-06-08 杭州优工品科技有限公司 Industrial component visual customization method and device and storage medium
CN112966160A (en) * 2021-03-08 2021-06-15 浪潮云信息技术股份公司 Template-based multi-slide page large-screen display method and device
CN113590997A (en) * 2020-12-30 2021-11-02 绿盟科技集团股份有限公司 Data display method and device
CN113791783A (en) * 2021-09-14 2021-12-14 科东(广州)软件科技有限公司 Control generation method, device, equipment and storage medium
CN115098163A (en) * 2022-08-29 2022-09-23 塬数科技(无锡)有限公司 Multi-end adaptation method based on configuration visualization product
CN116863054A (en) * 2023-07-18 2023-10-10 上海秉匠信息科技有限公司 Method, device, equipment and storage medium for generating three-dimensional visual scene

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112751836A (en) * 2020-12-24 2021-05-04 华人运通(上海)云计算科技有限公司 Vehicle data display method, device, storage medium and system
CN114143477B (en) * 2021-12-06 2023-12-08 北京淳中科技股份有限公司 Image labeling method and device

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005293042A (en) * 2004-03-31 2005-10-20 Hitachi Ltd Piping drawing recognition method, piping drawing recognition device, and program therefor
CN101981583A (en) * 2008-03-28 2011-02-23 智能技术Ulc公司 Method and tool for recognizing a hand-drawn table
CN103605970A (en) * 2013-12-02 2014-02-26 华中师范大学 Drawing architectural element identification method and system based on machine learning
CN103970750A (en) * 2013-01-25 2014-08-06 腾讯科技(深圳)有限公司 Method and device for generating HTML (Hypertext Markup Language) web pages
CN104737160A (en) * 2012-10-15 2015-06-24 微软公司 Pictures from sketches
CN105700791A (en) * 2016-03-04 2016-06-22 沈阳天择智能交通工程有限公司 Road traffic accident field sketch recognizing and drawing method
CN108804093A (en) * 2018-06-15 2018-11-13 联想(北京)有限公司 A kind of code generating method and electronic equipment
CN109359366A (en) * 2018-09-30 2019-02-19 中民筑友科技投资有限公司 A kind of automatic identifying method, device, equipment and the storage medium of electromechanical mark

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005293042A (en) * 2004-03-31 2005-10-20 Hitachi Ltd Piping drawing recognition method, piping drawing recognition device, and program therefor
CN101981583A (en) * 2008-03-28 2011-02-23 智能技术Ulc公司 Method and tool for recognizing a hand-drawn table
CN104737160A (en) * 2012-10-15 2015-06-24 微软公司 Pictures from sketches
CN103970750A (en) * 2013-01-25 2014-08-06 腾讯科技(深圳)有限公司 Method and device for generating HTML (Hypertext Markup Language) web pages
CN103605970A (en) * 2013-12-02 2014-02-26 华中师范大学 Drawing architectural element identification method and system based on machine learning
CN105700791A (en) * 2016-03-04 2016-06-22 沈阳天择智能交通工程有限公司 Road traffic accident field sketch recognizing and drawing method
CN108804093A (en) * 2018-06-15 2018-11-13 联想(北京)有限公司 A kind of code generating method and electronic equipment
CN109359366A (en) * 2018-09-30 2019-02-19 中民筑友科技投资有限公司 A kind of automatic identifying method, device, equipment and the storage medium of electromechanical mark

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112685489A (en) * 2020-12-21 2021-04-20 珠海格力电器股份有限公司 Data display method, device, terminal, storage medium and processor
CN113590997A (en) * 2020-12-30 2021-11-02 绿盟科技集团股份有限公司 Data display method and device
CN113590997B (en) * 2020-12-30 2024-05-17 绿盟科技集团股份有限公司 Data display method and device
CN112906086A (en) * 2021-02-02 2021-06-04 广东博智林机器人有限公司 Model display method and device, electronic equipment and computer readable storage medium
CN112926108A (en) * 2021-02-22 2021-06-08 杭州优工品科技有限公司 Industrial component visual customization method and device and storage medium
CN112966160A (en) * 2021-03-08 2021-06-15 浪潮云信息技术股份公司 Template-based multi-slide page large-screen display method and device
CN113791783A (en) * 2021-09-14 2021-12-14 科东(广州)软件科技有限公司 Control generation method, device, equipment and storage medium
CN113791783B (en) * 2021-09-14 2022-11-29 科东(广州)软件科技有限公司 Control generation method, device, equipment and storage medium
CN115098163A (en) * 2022-08-29 2022-09-23 塬数科技(无锡)有限公司 Multi-end adaptation method based on configuration visualization product
CN116863054A (en) * 2023-07-18 2023-10-10 上海秉匠信息科技有限公司 Method, device, equipment and storage medium for generating three-dimensional visual scene

Also Published As

Publication number Publication date
SG11202109770UA (en) 2021-10-28
CN111752557A (en) 2020-10-09

Similar Documents

Publication Publication Date Title
WO2020192463A1 (en) Display method and apparatus
US11392752B2 (en) Visualized editing method, device and apparatus, and storage medium
US11176415B2 (en) Assisted image annotation
JP5340441B2 (en) Shape parameterization for editable document generation
JP5774558B2 (en) Handwritten document processing apparatus, method and program
Rahman et al. A framework for fast automatic image cropping based on deep saliency map detection and gaussian filter
WO2019000681A1 (en) Information layout method, device, apparatus and computer storage medium
KR101773574B1 (en) Method for chart visualizing of data table
JP2003303047A (en) Image input and display system, usage of user interface as well as product including computer usable medium
US10649618B2 (en) System and method for creating visual representation of data based on generated glyphs
CN111240669B (en) Interface generation method and device, electronic equipment and computer storage medium
US11017266B2 (en) Aggregated image annotation
US20240160413A1 (en) Application Development Platform, Micro-program Generation Method, and Device and Storage Medium
US20220392242A1 (en) Method for training text positioning model and method for text positioning
US9465785B2 (en) Methods and apparatus for comic creation
US20220301307A1 (en) Video Generation Method and Apparatus, and Promotional Video Generation Method and Apparatus
CN105808682A (en) Relational graph display method and apparatus
US11055526B2 (en) Method, system and apparatus for processing a page of a document
Chen et al. UI layers merger: merging UI layers via visual learning and boundary prior
CN112799583B (en) Point location schematic drawing system based on android platform
US20150058710A1 (en) Navigating fixed format document in e-reader application
US20200364034A1 (en) System and Method for Automated Code Development and Construction
US20200082586A1 (en) Generating and providing composition effect tutorials for creating and editing digital content
US11663398B2 (en) Mapping annotations to ranges of text across documents
CN111626023A (en) Automatic generation method, device and system for visualization chart highlighting and annotation

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20777000

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20777000

Country of ref document: EP

Kind code of ref document: A1