CN109388461A - Display methods, device and the display terminal of object are identified in screen-picture screenshot - Google Patents

Display methods, device and the display terminal of object are identified in screen-picture screenshot Download PDF

Info

Publication number
CN109388461A
CN109388461A CN201811133159.5A CN201811133159A CN109388461A CN 109388461 A CN109388461 A CN 109388461A CN 201811133159 A CN201811133159 A CN 201811133159A CN 109388461 A CN109388461 A CN 109388461A
Authority
CN
China
Prior art keywords
layer
screenshot
identification
frame
plotted
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201811133159.5A
Other languages
Chinese (zh)
Inventor
付延松
宋虎
鲍姗娟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Hisense Electronics Co Ltd
Original Assignee
Qingdao Hisense Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Electronics Co Ltd filed Critical Qingdao Hisense Electronics Co Ltd
Priority to CN201811133159.5A priority Critical patent/CN109388461A/en
Publication of CN109388461A publication Critical patent/CN109388461A/en
Priority to PCT/CN2019/098446 priority patent/WO2020063095A1/en
Priority to US16/530,233 priority patent/US11039196B2/en
Priority to PCT/CN2019/099631 priority patent/WO2020063123A1/en
Priority to US17/322,572 priority patent/US11812188B2/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Abstract

This application discloses a kind of in screen-picture screenshot identifies display methods, device and the display terminal of object, visualization focus condition and real-time operation interaction feedback are provided to be embodied as user, to meet the needs of users, and reduces calculation amount, reduces memory consumption.A kind of display methods provided by the embodiments of the present application, comprising: obtain screen and currently show the screenshot of picture, and the screenshot is plotted in the first figure layer;The object identification information of the screenshot is obtained, and object identification frame is plotted in by the second figure layer according to the object identification information, wherein second figure layer is covered on first figure layer;It determines the currently selected middle object on the screenshot, and the focus frame of the currently selected middle object is covered to the identification frame of the currently selected middle object, and be plotted in second figure layer.

Description

Display methods, device and the display terminal of object are identified in screen-picture screenshot
Technical field
This application involves intelligent television field more particularly to a kind of display sides that object is identified in screen-picture screenshot Method, device and display terminal.
Background technique
In the prior art, it by the non-touch screen picture reproducer (smart television) of remote control control, is needed at object identification interface The identification object/person object head portrait currently to be chosen by way of focus to user feedback.Actual object identifies in interface because not having There are extra focal controls, can not directly provide a user such feedback.And if directly drawn in the figure layer for placing screenshot Focus frame, then since screenshot picture self EMS memory is larger, then focus frame is drawn on it, pass through graphics processor (Graphics Processing Unit, GPU) refreshing is shown in figure layer, causes computationally intensive, memory consumption is big.
Summary of the invention
The embodiment of the present application provides display methods, device and the display of a kind of identification object in screen-picture screenshot eventually End provides visual focus condition and real-time operation interaction feedback to be embodied as user, and reduces calculation amount, reduces Memory consumption.
A kind of display methods identifying object in screen-picture screenshot provided by the embodiments of the present application, comprising:
It obtains screen and currently shows the screenshot of picture, and the screenshot is plotted in the first figure layer;
The object identification information of the screenshot is obtained, and object identification frame is plotted according to the object identification information Two figure layers, wherein second figure layer is covered on first figure layer;
Determine the currently selected middle object on the screenshot, and will be described in the covering of the focus frame of the currently selected middle object The identification frame of currently selected middle object, and be plotted in second figure layer.
In this way, obtaining screen currently shows the screenshot of picture, and the screenshot is plotted in the first figure layer;It obtains The object identification information of the screenshot, and object identification frame is plotted in by the second figure layer according to the object identification information, wherein Second figure layer is covered on first figure layer;It determines the currently selected middle object on the screenshot, and works as by described in The focus frame of preceding selected object covers the identification frame of the currently selected middle object, and is plotted in second figure layer.This Sample can provide visual focus condition and real-time operation interaction feedback, for user not only to meet user demand;Moreover, Compared with directly drawing focus frame in the figure layer for placing screenshot, screenshot and focus frame are plotted in two figure layers respectively, it is not necessary to Figure layer where refreshing screenshot when focus moves every time, it is only necessary to refresh figure layer where focus frame, thus reduce calculation amount, Reduce memory consumption.
Optionally, the object identification information includes the location information of object;
Object identification frame is plotted in the second figure layer according to the object identification information, is specifically included:
The identification frame is filled into image views ImageView control, and described be filled with is identified into frame ImageView ActiveX drafting is in the second figure layer, wherein the ImageView control is created according to the location information of object 's.
Optionally, the focus frame of the currently selected middle object is covered to the identification frame of the currently selected middle object, and It is plotted in second figure layer, specifically includes:
The focus frame of the currently selected middle object is filled into ImageView control, by described filled with focus frame ImageView ActiveX drafting covers the identification frame of the currently selected middle object in the second figure layer, wherein described ImageView control is created according to the location information of the currently selected middle object.
Optionally, while the focus frame of the currently selected middle object is plotted in second figure layer, by before The focus frame being plotted in second figure layer is deleted.
Optionally, this method further include:
By screenshot sharing two dimensional code be plotted in third figure layer, wherein the third figure layer be located at second figure layer it On.
In this way, screenshot sharing two dimensional code is plotted in third figure layer, wherein the third figure layer is located at described On second figure layer, to reduce calculation amount, reduce memory consumption.
Optionally, this method further include:
According to the instruction that user is exported by remote controler, the third figure layer show or hide is controlled.
Optionally, this method further include:
Traversal calculates the abscissa difference in the centre coordinate and other identification object centre coordinates of currently selected middle object Or ordinate difference;
Other the smallest described identification objects of difference are taken as next focus frame and draw position;
If there is the identical identification object of difference, calculated in the identical identification object of the difference further according to Pythagorean theorem Heart coordinate takes apart from the smallest identification object at a distance from the currently selected middle object centre coordinate as next focus frame Draw position.
Correspondingly, in device side, a kind of display identifying object in screen-picture screenshot provided by the embodiments of the present application Device, the device include:
First unit currently shows the screenshot of picture for obtaining screen, and the screenshot is plotted in the first figure layer;
Second unit, for obtaining the object identification information of the screenshot, and according to the object identification information by object Identification frame is plotted in the second figure layer, wherein second figure layer is covered on first figure layer;
Third unit, for determining the currently selected middle object on the screenshot, and by the currently selected middle object Focus frame covers the identification frame of the currently selected middle object, and is plotted in second figure layer.
A kind of display terminal that the embodiment of the present application also provides, the display terminal include:
Memory, for storing program instruction;
Processor executes this above-mentioned Shen according to the program of acquisition for calling the program instruction stored in the memory It please any method for providing of embodiment.
Another embodiment of the application provides a kind of computer storage medium, and the computer storage medium is stored with calculating Machine executable instruction, the computer executable instructions are for making the computer execute any of the above-described kind of method.
Detailed description of the invention
In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment Attached drawing is briefly introduced, it should be apparent that, the drawings in the following description are only some examples of the present application, for this For the those of ordinary skill in field, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.
Fig. 1 is object identification interface layout schematic diagram provided by the embodiments of the present application;
Fig. 2 is figure layer distributed architecture schematic diagram in object identification interface provided by the embodiments of the present application;
Fig. 3 is a kind of display methods schematic diagram that object is identified in screen-picture screenshot provided by the embodiments of the present application;
Fig. 4 is that object identification frame location information provided by the embodiments of the present application marks schematic diagram;
Fig. 5 is object identification interface alternation flow diagram provided by the embodiments of the present application;
Fig. 6~Figure 11 is scheme case interaction flow schematic diagram provided by the embodiments of the present application;
Figure 12 is a kind of display device schematic diagram that object is identified in screen-picture screenshot provided by the embodiments of the present application;
Figure 13 is a kind of display terminal schematic diagram that the embodiment of the present application also provides.
Specific embodiment
Below in conjunction with the attached drawing in the embodiment of the present application, technical solutions in the embodiments of the present application carries out clear, complete Site preparation description, it is clear that described embodiments are only a part of embodiments of the present application, is not whole embodiments.It is based on Embodiment in the application, it is obtained by those of ordinary skill in the art without making creative efforts every other Embodiment shall fall in the protection scope of this application.
The embodiment of the present application provides display methods, device and the display of a kind of identification object in screen-picture screenshot eventually End provides visualization focus condition and real-time operation interaction feedback to be embodied as user, to meet the needs of users, and subtracts Small calculation amount reduces memory consumption.
The each embodiment of the application is described in detail with reference to the accompanying drawings of the specification.It should be noted that the application The displaying sequence of embodiment only represents the sequencing of embodiment, does not represent the superiority and inferiority of technical solution provided by embodiment.
Object identification interface layout schematic diagram is as shown in Figure 1, the figure is shown in terminal device display interface.Object identification Interface constitutes and is divided into 3 parts, as shown in Fig. 2, being object identification interface figure layer distributed architecture schematic diagram, wherein figure layer B is Bottom view View, the content drawn in figure layer are terminal device screenshot (OSD/VEDIO mixing screenshot), and figure layer M is centre Layer View is top layer View for placement identification frame and focus frame, figure layer T, shares two dimensional code for placing screenshot.
Figure layer B, figure layer M and figure layer T are full frame ViewGroup controls, and these three figure layers successively cover, figure layer T is covered on other two layers in top layer, thus synchronization should control button only by a figure layer monitored and located Reason, such as situation shown in Fig. 2, key are only monitored and are handled by figure layer T, do not monitored by figure layer B and figure layer T.
First figure layer as described below is figure layer B, and the second figure layer is figure layer M, and third figure layer is figure layer T.
Referring to Fig. 3, a kind of display methods identifying object in screen-picture screenshot provided by the embodiments of the present application, packet It includes:
S101, acquisition screen currently show the screenshot of picture, and the screenshot are plotted in the first figure layer;
For example, the screen is the screen of smart television, user can be carried out currently playing video by remote controler Screenshot after getting screenshot from the background, is plotted in the first figure layer by screenshot.
S102, the object identification information for obtaining the screenshot, and drawn object identification frame according to the object identification information System is in the second figure layer, wherein second figure layer is covered on first figure layer;
For example, the object identification information of the screenshot include object in the screenshot type (such as personage, animal, dress ornament, Logo etc.), location information (location information of abbreviation object) of the object on the screenshot, the title of object, object is relevant pushes away Recommend information etc..
S103, it determines currently selected middle object on the screenshot, and the focus frame of the currently selected middle object is covered The identification frame of the currently selected middle object is covered, and is plotted in second figure layer.
Optionally, the object identification information includes the location information of object;
Object identification frame is plotted in the second figure layer according to the object identification information, is specifically included:
The identification frame is filled into image views ImageView control, and described be filled with is identified into frame ImageView ActiveX drafting is in the second figure layer, wherein the ImageView control is created according to the location information of object 's.
Optionally, the focus frame of the currently selected middle object is covered to the identification frame of the currently selected middle object, and It is plotted in second figure layer, specifically includes:
The focus frame of the currently selected middle object is filled into ImageView control, by described filled with focus frame ImageView ActiveX drafting covers the identification frame of the currently selected middle object in the second figure layer, wherein described ImageView control is created according to the location information of the currently selected middle object.
Optionally, while the focus frame of the currently selected middle object is plotted in second figure layer, by before The focus frame being plotted in second figure layer is deleted.
Optionally, this method further include:
By screenshot sharing two dimensional code be plotted in third figure layer, wherein the third figure layer be located at second figure layer it On.
Optionally, this method further include:
According to the instruction that user is exported by remote controler, the third figure layer show or hide is controlled.
Optionally, this method further include:
Traversal calculates the abscissa difference in the centre coordinate and other identification object centre coordinates of currently selected middle object Or ordinate difference;
Other the smallest described identification objects of difference are taken as next focus frame and draw position;
If there is the identical identification object of difference, calculated in the identical identification object of the difference further according to Pythagorean theorem Heart coordinate takes apart from the smallest identification object at a distance from the currently selected middle object centre coordinate as next focus frame Draw position.
Specific step explanation is given below.
The first step directly draws the first figure layer after the starting of terminal device display interface, and the screenshot that will acquire is set as first The background content of figure layer.
Second step, while the starting of screenshot function, Xiang Houtai service request obtains the data that content is identified in screenshot.When When having data return, visible state is set by the second figure layer, while according to the location information of the identification object got, will know The profile frame of the identification frame of other object, i.e. identification object is drawn out.Specifically process includes:
The location information of each identification object, and one image of object creation each to recognize are got by traversing View ImageView control, ImageView control control the position and big of itself according to the location information of each identification object It is small, and identification block diagram piece is filled into ImageView control, the ImageView ActiveX drafting that will be filled with object identification frame arrives On ViewGroup control represented by second figure layer, and visible state is set by the second figure layer.Here visible state for example may be used To be not set Background in the second figure layer, so being transparent.
Wherein, the location information of object is identified as shown in figure 4, including but is not limited to this 4 partial information: for example identified object The x-axis coordinate X0 in the body upper left corner is identified the y-axis coordinate Y0 in the object upper left corner, is identified the width of object, i.e. length in x-axis W0 is spent, the height of object, i.e., the length H0 in y-axis are identified.
In addition, the identification object in currently selected is determined according to the sequence of user's operation remote controller key, while according to The location information of the selected object got draws out the focus frame of selected object, and specific process includes:
According to the location information of selected object, to be selected one ImageView control of object creation, and by focus frame Picture is filled into ImageView control, will be filled with represented by the ImageView ActiveX drafting to the second figure layer of object focus frame ViewGroup control on, while being covered on above the identification frame of currently selected middle object.In this way, not having to move every time in focus All refresh the first figure layer where screenshot when dynamic, and second figure layer most areas is in no content accounts for refreshing It deposits small, therefore overall saves many memories.
When drawing the focus frame of currently selected middle object, while the focus frame for being plotted in the second figure layer before can be deleted It removes, to guarantee that only one current position has focus frame, focus frame moves variation in real time when realizing remote controller operation Effect.
Further, next acquisition methods for closing on focal position include: when remote controller operation
Firstly, the identification object centre coordinate that traversal calculates other identification object centre coordinates (X, Y) and currently chooses Abscissa difference or ordinate difference in (X0, Y0) calculate | X-X0 | or | Y-Y0 |, take other the smallest identification objects of difference Body is as next selected focal position;If there is the identical identification object of difference, then distinguish further according to Pythagorean theorem Each identification object center is calculated at a distance from current identification object center, is taken apart from the smallest identification object as next selected In focal position.
Third step draws screenshot in third figure layer and shares two dimensional code, and be shown in screen after the starting of object identification interface Left position, as shown in Figure 1, in this state, user presses right button, then the figure layer by animation form along X axis coordinate, to It moves left a certain distance and skids off screen, such as moving distance w, meanwhile, focus frame is plotted in the selected object of the leftmost side On position;When user presses left button, and current focus frame position is that the leftmost side is selected on the position of object, and the third figure layer is logical It crosses animation mode to move right identical distance w along X axis coordinate, be presented on screen, while by the focus frame in the second figure layer It removes.
It is object identification interface alternation flow diagram provided by the embodiments of the present application, concrete implementation step referring to Fig. 5 Are as follows:
(1) it after obtaining screenshot capture, generates and draws screenshot in third figure layer and share two dimensional code;
(2) after obtaining screenshot capture, backstage obtains the information of identification object, and when user presses remote controler right button, judgement is swept If whether barcode scanning region View be not less than 0, is moved to the left certain distance w, simultaneously less than 0 by code area coordinate .get () It obtains the most left object information in position and focus frame View is drawn according to its location information;If barcode scanning area coordinate .get () Less than 0, then continues to judge currently to identify whether object space is the rightmost side, if it is the rightmost side, then keep current focus state Attonity feedback then obtains right side identification object information and draws new focus according to its location information if not the rightmost side Frame View, while destroying the focus frame View of current identification object;
(3) when user press remote controler left button when, judge barcode scanning area coordinate .get () whether less than 0, if be not less than 0, Current focus state attonity is then kept to feed back;If it is less than 0, then continue to judge currently to identify whether object space is most left The focus frame View of current identification object is then destroyed if it is the leftmost side in side, while barcode scanning region View being moved right centainly Distance w then obtains left side identification object information and draws new focus frame according to its location information if not the leftmost side View, while destroying the focus frame View of current identification object.
It is scheme case interaction flow schematic diagram provided by the embodiments of the present application referring to Fig. 6~Figure 11.
(1) as shown in fig. 6, starting intelligent image function by shortcut key, screenshot content, while screenshot are shown on the screen It uploads to backstage and carries out Classical correlation processing and recommendation search;
(2) as shown in fig. 7, back-end data returns, terminal is according to established rule, display data content of classifying;
(3) as shown in figure 8, in the state of second step median surface, the OK key of remote controler is pressed on screenshot, then is started full frame Object identification shows interface, and third figure layer interface display is up front at this time;
(4) as shown in Figures 9 and 10, by remote controler right button, figure layer T is moved to the left by animation form and removes screen;This When focus frame show, and be plotted in above the identification object of the leftmost side;Continue to frame shift by right button according to identification frame and focus The dynamic description with during realization, focus frame are repainted and are located on corresponding identification object space;
(5) remote controler OK key is pressed in current focus frame position such as Figure 11, will starts and shows that the identification object is relevant Identification and recommendation information.
Correspondingly, in device side, referring to Figure 12, one kind provided by the embodiments of the present application identifies object in screen-picture screenshot The display device of body, comprising:
First unit 11 currently shows the screenshot of picture for obtaining screen, and the screenshot is plotted in the first figure layer;
Second unit 12, for obtaining the object identification information of the screenshot, and according to the object identification information by object Body identification frame is plotted in the second figure layer, wherein second figure layer is covered on first figure layer;
Third unit 13, for determining the currently selected middle object on the screenshot, and by the currently selected middle object Focus frame cover the identification frame of the currently selected middle object, and be plotted in second figure layer.
Referring to Figure 13, a kind of display terminal that the embodiment of the present application also provides, comprising:
Processor 600 executes following process for reading the program in memory 620:
It obtains screen and currently shows the screenshot of picture, and the screenshot is plotted in the first figure layer;
The object identification information of the screenshot is obtained, and object identification frame is plotted according to the object identification information Two figure layers, wherein second figure layer is covered on first figure layer;
Determine the currently selected middle object on the screenshot, and will be described in the covering of the focus frame of the currently selected middle object The identification frame of currently selected middle object, and be plotted in second figure layer.
In this way, obtaining screen currently shows the screenshot of picture, and the screenshot is plotted in the first figure layer;It obtains The object identification information of the screenshot, and object identification frame is plotted in by the second figure layer according to the object identification information, wherein Second figure layer is covered on first figure layer;It determines the currently selected middle object on the screenshot, and works as by described in The focus frame of preceding selected object covers the identification frame of the currently selected middle object, and is plotted in second figure layer, real Visualization focus condition and real-time operation interaction feedback now are provided for user, to meet the needs of users, and reduces calculating It measures, reduce memory consumption.
Optionally, the object identification information includes the location information of object;
Object identification frame is plotted in the second figure layer according to the object identification information, is specifically included:
The identification frame is filled into image views ImageView control, and described be filled with is identified into frame ImageView ActiveX drafting is in the second figure layer, wherein the ImageView control is created according to the location information of object 's.
Optionally, the focus frame of the currently selected middle object is covered to the identification frame of the currently selected middle object, and It is plotted in second figure layer, specifically includes:
The focus frame of the currently selected middle object is filled into ImageView control, by described filled with focus frame ImageView ActiveX drafting covers the identification frame of the currently selected middle object in the second figure layer, wherein described ImageView control is created according to the location information of the currently selected middle object.
Optionally, while the focus frame of the currently selected middle object is plotted in second figure layer, by before The focus frame being plotted in second figure layer is deleted.
Optionally, this method further include:
By screenshot sharing two dimensional code be plotted in third figure layer, wherein the third figure layer be located at second figure layer it On.
Optionally, this method further include:
According to the instruction that user is exported by remote controler, the third figure layer show or hide is controlled.
Optionally, this method further include:
Traversal calculates the abscissa difference in the centre coordinate and other identification object centre coordinates of currently selected middle object Or ordinate difference;
Other the smallest described identification objects of difference are taken as next focus frame and draw position;
If there is the identical identification object of difference, calculated in the identical identification object of the difference further according to Pythagorean theorem Heart coordinate takes apart from the smallest identification object at a distance from the currently selected middle object centre coordinate as next focus frame Draw position.
Wherein, in Figure 13, bus architecture may include the bus and bridge of any number of interconnection, specifically by processor The various circuits for the memory that 600 one or more processors represented and memory 610 represent link together.Bus architecture Various other circuits of such as peripheral equipment, voltage-stablizer and management circuit or the like can also be linked together, these It is all it is known in the art, therefore, it will not be further described herein.Bus interface provides interface.
The embodiment of the present application provides a kind of display terminal, which is specifically as follows desktop computer, portable Computer, smart phone, tablet computer, personal digital assistant (Personal Digital Assistant, PDA) etc..This is aobvious Show that terminal may include central processing unit (Center Processing Unit, CPU), memory, input-output apparatus etc., Input equipment may include keyboard, mouse, touch screen etc., and output equipment may include display equipment, such as liquid crystal display (Liquid Crystal Display, LCD), cathode-ray tube (Cathode Ray Tube, CRT) etc..
For different display terminals, optionally, user interface 620, which can be external to be inscribed, needs connecing for equipment Mouthful, the equipment of connection includes but is not limited to keypad, display, loudspeaker, microphone, control stick etc..
Processor 600, which is responsible for management bus architecture and common processing, memory 610, can store processor 600 and is holding Used data when row operation.
Optionally, processor 600 can be CPU (centre buries device), ASIC (Application Specific Integrated Circuit, specific integrated circuit), (Field-Programmable Gate Array, scene can compile FPGA Journey gate array) or CPLD (Complex Programmable Logic Device, Complex Programmable Logic Devices).
Memory 610 may include read-only memory (ROM) and random access memory (RAM), and provide to processor The program instruction and data stored in memory.In the embodiment of the present application, memory can be used for storing the embodiment of the present application The program of any the method provided.
Processor is by the program instruction for calling memory to store, and processor is for executing sheet according to the program instruction of acquisition Apply for any the method that embodiment provides.
The embodiment of the present application provides a kind of computer storage medium, above-mentioned provided by the embodiments of the present application for being stored as Computer program instructions used in device, it includes the programs for executing above-mentioned either method provided by the embodiments of the present application.
The computer storage medium can be any usable medium or data storage device that computer can access, packet Include but be not limited to magnetic storage (such as floppy disk, hard disk, tape, magneto-optic disk (MO) etc.), optical memory (such as CD, DVD, BD, HVD etc.) and semiconductor memory (such as it is ROM, EPROM, EEPROM, nonvolatile memory (NAND FLASH), solid State hard disk (SSD)) etc..
In conclusion it is provided by the embodiments of the present application it is a kind of based in screen-picture screenshot identify object display methods, Device and display terminal can provide visualization focus condition and real-time operation interaction feedback, for user to meet the need of user It asks, and reduces calculation amount, reduces memory consumption.
It should be understood by those skilled in the art that, embodiments herein can provide as method, system or computer program Product.Therefore, complete hardware embodiment, complete software embodiment or reality combining software and hardware aspects can be used in the application Apply the form of example.Moreover, it wherein includes the computer of computer usable program code that the application, which can be used in one or more, The shape for the computer program product implemented in usable storage medium (including but not limited to magnetic disk storage and optical memory etc.) Formula.
The application is referring to method, the process of equipment (system) and computer program product according to the embodiment of the present application Figure and/or block diagram describe.It should be understood that every one stream in flowchart and/or the block diagram can be realized by computer program instructions The combination of process and/or box in journey and/or box and flowchart and/or the block diagram.It can provide these computer programs Instruct the processor of general purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices to produce A raw machine, so that being generated by the instruction that computer or the processor of other programmable data processing devices execute for real The device for the function of being specified in present one or more flows of the flowchart and/or one or more blocks of the block diagram.
These computer program instructions, which may also be stored in, is able to guide computer or other programmable data processing devices with spy Determine in the computer-readable memory that mode works, so that it includes referring to that instruction stored in the computer readable memory, which generates, Enable the manufacture of device, the command device realize in one box of one or more flows of the flowchart and/or block diagram or The function of being specified in multiple boxes.
These computer program instructions also can be loaded onto a computer or other programmable data processing device, so that counting Series of operation steps are executed on calculation machine or other programmable devices to generate computer implemented processing, thus in computer or The instruction executed on other programmable devices is provided for realizing in one or more flows of the flowchart and/or block diagram one The step of function of being specified in a box or multiple boxes.
Obviously, those skilled in the art can carry out various modification and variations without departing from the essence of the application to the application Mind and range.In this way, if these modifications and variations of the application belong to the range of the claim of this application and its equivalent technologies Within, then the application is also intended to include these modifications and variations.

Claims (10)

1. a kind of display methods for identifying object in screen-picture screenshot, which is characterized in that this method comprises:
It obtains screen and currently shows the screenshot of picture, and the screenshot is plotted in the first figure layer;
The object identification information of the screenshot is obtained, and object identification frame is plotted in by the second figure according to the object identification information Layer, wherein second figure layer is covered on first figure layer;
Determine the currently selected middle object on the screenshot, and the covering of the focus frame of the currently selected middle object is described current The identification frame of selected object, and be plotted in second figure layer.
2. the method according to claim 1, wherein the object identification information includes the location information of object;
It is described that object identification frame is plotted in by the second figure layer according to the object identification information, it specifically includes:
The identification frame is filled into image views ImageView control, and the ImageView filled with identification frame is controlled Part is plotted in the second figure layer, wherein the ImageView control is created according to the location information of object.
3. the method according to claim 1, wherein by described in the covering of the focus frame of the currently selected middle object The identification frame of currently selected middle object, and be plotted in second figure layer, it specifically includes:
The focus frame of the currently selected middle object is filled into ImageView control, by described filled with focus frame ImageView ActiveX drafting covers the identification frame of the currently selected middle object in the second figure layer, wherein described ImageView control is created according to the location information of the currently selected middle object.
4. according to the method described in claim 3, it is characterized in that, the focus frame in the currently selected middle object is plotted in institute While stating in the second figure layer, the focus frame being plotted in second figure layer before is deleted.
5. according to the method described in claim 4, it is characterized in that, this method further include: screenshot sharing two dimensional code to be plotted in In third figure layer, wherein the third figure layer is located on second figure layer.
6. according to the method described in claim 5, it is characterized in that, this method further include: exported according to user by remote controler Instruction, control the third figure layer show or hide.
7. the method according to claim 1, wherein this method further include:
Traversal calculates the abscissa difference or vertical in the centre coordinate and other identification object centre coordinates of currently selected middle object Coordinate difference;
Other the smallest described identification objects of difference are taken as next focus frame and draw position;
If there is the identical identification object of difference, the identical identification object center of the difference is calculated further according to Pythagorean theorem and is sat Mark takes and draws apart from the smallest identification object as next focus frame at a distance from the currently selected middle object centre coordinate Position.
8. a kind of display device for identifying object in screen-picture screenshot, which is characterized in that the device includes:
First unit currently shows the screenshot of picture for obtaining screen, and the screenshot is plotted in the first figure layer;
Second unit, for obtaining the object identification information of the screenshot, and according to the object identification information by object identification Frame is plotted in the second figure layer, wherein second figure layer is covered on first figure layer;
Third unit, for determining the currently selected middle object on the screenshot, and by the focus of the currently selected middle object Frame covers the identification frame of the currently selected middle object, and is plotted in second figure layer.
9. a kind of display terminal, which is characterized in that the display terminal includes:
Memory, for storing program instruction;
Processor requires 1~7 according to the program execution benefit of acquisition for calling the program instruction stored in the memory Described in any item methods.
10. a kind of computer storage medium, which is characterized in that the computer storage medium is stored with the executable finger of computer It enables, the computer executable instructions are for making the computer perform claim require 1 to 7 described in any item methods.
CN201811133159.5A 2018-09-27 2018-09-27 Display methods, device and the display terminal of object are identified in screen-picture screenshot Pending CN109388461A (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CN201811133159.5A CN109388461A (en) 2018-09-27 2018-09-27 Display methods, device and the display terminal of object are identified in screen-picture screenshot
PCT/CN2019/098446 WO2020063095A1 (en) 2018-09-27 2019-07-30 Screenshot display method and device
US16/530,233 US11039196B2 (en) 2018-09-27 2019-08-02 Method and device for displaying a screen shot
PCT/CN2019/099631 WO2020063123A1 (en) 2018-09-27 2019-08-07 Graphical user interface method for displaying screenshot and display device
US17/322,572 US11812188B2 (en) 2018-09-27 2021-05-17 Method and device for displaying a screen shot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811133159.5A CN109388461A (en) 2018-09-27 2018-09-27 Display methods, device and the display terminal of object are identified in screen-picture screenshot

Publications (1)

Publication Number Publication Date
CN109388461A true CN109388461A (en) 2019-02-26

Family

ID=65418968

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811133159.5A Pending CN109388461A (en) 2018-09-27 2018-09-27 Display methods, device and the display terminal of object are identified in screen-picture screenshot

Country Status (1)

Country Link
CN (1) CN109388461A (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110471658A (en) * 2019-07-10 2019-11-19 成都摹客科技有限公司 A kind of selection method of figure layer, system and computer storage medium
WO2020063095A1 (en) * 2018-09-27 2020-04-02 青岛海信电器股份有限公司 Screenshot display method and device
US11039196B2 (en) 2018-09-27 2021-06-15 Hisense Visual Technology Co., Ltd. Method and device for displaying a screen shot
US11102441B2 (en) 2017-12-20 2021-08-24 Hisense Visual Technology Co., Ltd. Smart television and method for displaying graphical user interface of television screen shot
CN114661263A (en) * 2022-02-25 2022-06-24 荣耀终端有限公司 Display method, electronic equipment and storage medium
US11601719B2 (en) 2017-12-20 2023-03-07 Juhaokan Technology Co., Ltd. Method for processing television screenshot, smart television, and storage medium

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100331041A1 (en) * 2009-06-26 2010-12-30 Fuji Xerox Co., Ltd. System and method for language-independent manipulations of digital copies of documents through a camera phone
CN104516644A (en) * 2014-12-09 2015-04-15 广东欧珀移动通信有限公司 Method for free screen capture and terminal
CN106020448A (en) * 2016-05-06 2016-10-12 深圳市国华识别科技开发有限公司 An intelligent terminal-based man-machine interaction method and system
CN106792101A (en) * 2017-01-03 2017-05-31 青岛海信电器股份有限公司 Home interface method of adjustment, device and intelligent television
CN107133576A (en) * 2017-04-17 2017-09-05 北京小米移动软件有限公司 Age of user recognition methods and device
CN107590495A (en) * 2017-09-18 2018-01-16 哈尔滨成长科技有限公司 Answer sheet picture method for correcting error, device, readable storage medium storing program for executing and electronic equipment
CN108062510A (en) * 2017-11-17 2018-05-22 维库(厦门)信息技术有限公司 Dynamic display method and computer equipment during a kind of multiple target tracking fructufy
CN108259973A (en) * 2017-12-20 2018-07-06 青岛海信电器股份有限公司 The display methods of the graphic user interface of smart television and television image sectional drawing

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20100331041A1 (en) * 2009-06-26 2010-12-30 Fuji Xerox Co., Ltd. System and method for language-independent manipulations of digital copies of documents through a camera phone
CN104516644A (en) * 2014-12-09 2015-04-15 广东欧珀移动通信有限公司 Method for free screen capture and terminal
CN106020448A (en) * 2016-05-06 2016-10-12 深圳市国华识别科技开发有限公司 An intelligent terminal-based man-machine interaction method and system
CN106792101A (en) * 2017-01-03 2017-05-31 青岛海信电器股份有限公司 Home interface method of adjustment, device and intelligent television
CN107133576A (en) * 2017-04-17 2017-09-05 北京小米移动软件有限公司 Age of user recognition methods and device
CN107590495A (en) * 2017-09-18 2018-01-16 哈尔滨成长科技有限公司 Answer sheet picture method for correcting error, device, readable storage medium storing program for executing and electronic equipment
CN108062510A (en) * 2017-11-17 2018-05-22 维库(厦门)信息技术有限公司 Dynamic display method and computer equipment during a kind of multiple target tracking fructufy
CN108259973A (en) * 2017-12-20 2018-07-06 青岛海信电器股份有限公司 The display methods of the graphic user interface of smart television and television image sectional drawing

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11102441B2 (en) 2017-12-20 2021-08-24 Hisense Visual Technology Co., Ltd. Smart television and method for displaying graphical user interface of television screen shot
US11558578B2 (en) 2017-12-20 2023-01-17 Hisense Visual Technology Co., Ltd. Smart television and method for displaying graphical user interface of television screen shot
US11601719B2 (en) 2017-12-20 2023-03-07 Juhaokan Technology Co., Ltd. Method for processing television screenshot, smart television, and storage medium
US11812189B2 (en) 2017-12-20 2023-11-07 Hisense Visual Technology Co., Ltd. Smart television and method for displaying graphical user interface of television screen shot
WO2020063095A1 (en) * 2018-09-27 2020-04-02 青岛海信电器股份有限公司 Screenshot display method and device
US11039196B2 (en) 2018-09-27 2021-06-15 Hisense Visual Technology Co., Ltd. Method and device for displaying a screen shot
US11812188B2 (en) 2018-09-27 2023-11-07 Hisense Visual Technology Co., Ltd. Method and device for displaying a screen shot
CN110471658A (en) * 2019-07-10 2019-11-19 成都摹客科技有限公司 A kind of selection method of figure layer, system and computer storage medium
CN114661263A (en) * 2022-02-25 2022-06-24 荣耀终端有限公司 Display method, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN109388461A (en) Display methods, device and the display terminal of object are identified in screen-picture screenshot
US10789776B2 (en) Structural modeling using depth sensors
US11290651B2 (en) Image display system, information processing apparatus, image display method, image display program, image processing apparatus, image processing method, and image processing program
US10600169B2 (en) Image processing system and image processing method
CN107562316B (en) Method for showing interface, device and terminal
CN110058685A (en) Display methods, device, electronic equipment and the computer readable storage medium of virtual objects
WO2015027953A1 (en) Method, apparatus and terminal device for dynamic image processing
CN107577414A (en) The method and mobile terminal of split screen display available
CN109271983B (en) Display method and display terminal for identifying object in screenshot
CN110442245A (en) Display methods, device, terminal device and storage medium based on physical keyboard
JP2022019748A (en) Device and method for generating dynamic virtual content in mixed reality
US11039196B2 (en) Method and device for displaying a screen shot
Martin et al. Human friendly interface design for virtual fitting room applications on android based mobile devices
US11043027B2 (en) Three-dimensional graphics image processing
CN108205431A (en) Show equipment and its control method
WO2020192195A1 (en) Image processing method and apparatus, and electronic device
CN110971953B (en) Video playing method, device, terminal and storage medium
CN107924690A (en) For promoting the methods, devices and systems of the navigation in extended scene
JP5650740B2 (en) Design support apparatus, design support program, design support method, and integrated circuit
WO2023071861A1 (en) Data visualization display method and apparatus, computer device, and storage medium
CN114185466A (en) Service processing method and device, electronic equipment and storage medium
JP7467780B2 (en) Image processing method, apparatus, device and medium
CN111475089B (en) Task display method, device, terminal and storage medium
CN109388309A (en) Display methods, device, terminal and the storage medium of menu
WO2020063095A1 (en) Screenshot display method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information

Address after: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218

Applicant after: Hisense Video Technology Co., Ltd

Address before: 266555 Qingdao economic and Technological Development Zone, Shandong, Hong Kong Road, No. 218

Applicant before: HISENSE ELECTRIC Co.,Ltd.

CB02 Change of applicant information