CN109922363A - A kind of graphical user interface method and display equipment of display screen shot - Google Patents

A kind of graphical user interface method and display equipment of display screen shot Download PDF

Info

Publication number
CN109922363A
CN109922363A CN201910199952.3A CN201910199952A CN109922363A CN 109922363 A CN109922363 A CN 109922363A CN 201910199952 A CN201910199952 A CN 201910199952A CN 109922363 A CN109922363 A CN 109922363A
Authority
CN
China
Prior art keywords
display
identification
frame
selection
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910199952.3A
Other languages
Chinese (zh)
Inventor
付延松
付友苹
李玉倩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qingdao Hisense Electronics Co Ltd
Original Assignee
Qingdao Hisense Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Qingdao Hisense Electronics Co Ltd filed Critical Qingdao Hisense Electronics Co Ltd
Priority to CN201910199952.3A priority Critical patent/CN109922363A/en
Publication of CN109922363A publication Critical patent/CN109922363A/en
Priority to PCT/CN2019/098446 priority patent/WO2020063095A1/en
Priority to US16/530,233 priority patent/US11039196B2/en
Priority to PCT/CN2019/099631 priority patent/WO2020063123A1/en
Priority to US17/322,572 priority patent/US11812188B2/en
Pending legal-status Critical Current

Links

Abstract

This application discloses a kind of graphical user interface methods for showing screen shot, more multiple-content information associated with broadcasting pictures are provided to be embodied as user, to improve user experience.This method comprises: showing current picture on display；The input instruction of screenshot is carried out to the current picture in response to being used to indicate, the screenshot image of the current picture is shown on the display, and the location information based at least one identification object in the screenshot image, the identification frame for identifying the identification object is shown on the display；The input instruction moved between at least one identification frame in response to being used to indicate selector, the display selector at the identification frame that one identifies object, and when determining the identification frame size by selection identification object in preset threshold, show amplification identifies object image by selection.

Description

A kind of graphical user interface method and display equipment of display screen shot
Technical field
The application relate to field of display technology more particularly to it is a kind of provide display screen shot graphical user interface method and Show equipment.
Background technique
Display equipment is usually that user provides the function of broadcasting pictures, and broadcasting pictures are, for example, live television programming, video Request program, screen protection picture etc..However, display equipment does not provide a user more content letters associated with broadcasting pictures currently Breath, so that user satisfaction is lower.
Summary of the invention
The embodiment of the present application provides the graphical user interface method and display equipment of a kind of display screen shot, to reality More multiple-content information associated with broadcasting pictures now is provided for user, to improve user experience.
In a first aspect, providing a kind of graphical user interface method for showing screen shot, which comprises
Current picture is shown on display；
The input instruction for carrying out screenshot to the current picture in response to being used to indicate, shows described current on the display The screenshot image of picture, and the location information based at least one identification object in the screenshot image, on the display Show the identification frame for identifying the identification object；
The input instruction moved between at least one identification frame in response to being used to indicate selector, the identification of object is identified at one When showing the selector at frame, and determining the identification frame size by selection identification object in preset threshold, amplification display quilt Selection identification object image.
Second aspect, provides a kind of display equipment, and the display equipment includes:
User interface, for receiving user input instruction；
Display, for showing that graphic user interface and selector, the selector can be moved based on user input instruction Its position over the display；
Controller shows graphic user interface for the control display that inputs a command in response to user interface, specific to execute:
The input instruction for carrying out screenshot to the current picture shown on display in response to being used to indicate, shows on the display Show the screenshot image of the current picture, and the location information based at least one identification object in the screenshot image, in institute State the identification frame shown on display for identifying the identification object；
The input instruction moved between at least one identification frame in response to being used to indicate selector, the identification of object is identified at one When showing the selector at frame, and determining the identification frame size by selection identification object in preset threshold, amplification display quilt Selection identification object image.
In above-described embodiment, when showing the display picture of device plays such as episodes, is inputted, shown based on user Show that equipment can provide a user the content letter of the identification object identified in the screenshot image and the screenshot image of the display picture Breath, so that user is in the display picture that viewing plays, it will be appreciated that with the associated more multiple-content information of the display picture, promoted User experience.
Detailed description of the invention
In order to more clearly explain the technical solutions in the embodiments of the present application, make required in being described below to embodiment Attached drawing is briefly introduced, it should be apparent that, the drawings in the following description are only some examples of the present application, for this For the those of ordinary skill in field, without creative efforts, it can also be obtained according to these attached drawings other Attached drawing.
The schematic diagram of operation scenario between display equipment and control device is illustrated in Figure 1A；
The configuration block diagram of control device 100 in Figure 1A is illustrated in Figure 1B；
The configuration block diagram that equipment 200 is shown in Figure 1A is illustrated in Fig. 1 C；
The architecture configuration block diagram of operating system in display 200 memory of equipment is illustrated in Fig. 1 D;
The schematic diagram for the display picture that display equipment 200 provides is illustrated in Fig. 2;
The schematic diagram for the GUI400 that display equipment 200 provides is illustrated in Fig. 3 A- Fig. 3 L；
Fig. 4 A-4C illustrates the flow chart of the gui display method of display screen shot；
Fig. 5 A illustrates the figure layer distributed architecture schematic diagram that identification object shows interface；
Fig. 5 B illustrates the location information schematic diagram of identification object.
Specific embodiment
To keep the purposes, technical schemes and advantages of the application exemplary embodiment clearer, below in conjunction with the application The technical solution in the application exemplary embodiment is clearly and completely described in attached drawing in exemplary embodiment, shows So, described exemplary embodiment is only some embodiments of the present application, instead of all the embodiments.
Based on exemplary embodiment shown in the application, those of ordinary skill in the art are not making creative work Under the premise of every other embodiment obtained, shall fall in the protection scope of this application.Although in addition, content disclosed herein It is introduced according to exemplary one or several examples, it should be appreciated that can be with regard to the various aspects of these disclosures or single Solely constitute a complete technical solution.
It should be appreciated that specification and claims and term " first " in above-mentioned attached drawing in the application, " second ", " third " etc. is to be used to distinguish similar objects, without being used to describe a particular order or precedence order.It should be understood that in this way The data used are interchangeable under appropriate circumstances, for example, can according to the embodiment of the present application illustrate or describe in provide those with Outer sequence is implemented.
In addition, term " includes " and " having " and their any deformation, it is intended that covering but it is non-exclusive include, It for example, containing a series of product of components or those of equipment is not necessarily limited to be clearly listed component, but may include not having Other components being clearly listed or intrinsic for these products or equipment.
Term " module " used herein refers to hardware that is any known or developing later, software, firmware, artificial The combination of intelligence, fuzzy logic or hardware or/and software code, is able to carry out function relevant to the element.
Term " gesture " used herein refers to that user is acted by a kind of variation of hand-type or hand exercise etc., For expressing expected idea, movement, purpose/or the user behavior of result.
Term " user interface object " used herein, refer to the expression provided on the display device such as link, The visual object of the corresponding contents such as icon, thumbnail, figure.For example, when user interface object is content link, user interface pair As the corresponding image of content or figure can be shown as；When user interface object is application program, user interface object can be shown as The icon of application program, or capture when application program is performed nearest execution the content screenshot of application program；User interface When object is movie or television play, user interface object can be shown as the poster of movie or television play.
The schematic diagram of operation scenario between display equipment and control device is illustrated in Figure 1A.As shown in Figure 1A, It can be communicated in a wired or wireless fashion between control device 100 and display equipment 200.
Wherein, control device 100 is configured as control display equipment 200, can receive the operational order of user's input, and Operational order, which is converted to display equipment 200, can recognize and the instruction of response, plays user and shows and interacts between equipment 200 Intermediation.Such as: user passes through channel add-substract key on operating control device 100, the behaviour of display 200 response channel of equipment plus-minus Make.
Control device 100 can be remote controler 100A, such as hand-held touch remote controller, be taken with user interface in touch screen For hardkey built in most of physics in general remote controler.Remote controler generally use infrared protocol communication, Bluetooth protocol communication and Other short haul connection modes etc. are connect with display equipment, and display equipment 200 is controlled by wireless or other wired modes.With It family can be by the input user instruction such as key, voice input, control panel input on remote controler, to control display equipment 200. Such as: user can be pressed by volume add-substract key, channel control key, the mobile key of up/down/left/right, voice input on remote controler The corresponding control instruction of the inputs such as key, Menu key, switching on and shutting down key, to realize the function of control display equipment 200.
Control device 100 is also possible to smart machine, such as mobile terminal 100B, tablet computer, computer, laptop Deng.For example, showing equipment 200 using the application program controlling run on intelligent devices.The application program can be with by configuring With on the associated screen of smart machine, various controls are provided for user by intuitive user interface (UI).
Illustratively, mobile terminal 100B can install software application with display equipment 200, be realized by network communication protocol Connection communication realizes one-to-one control operation and data communication purpose.Such as: mobile terminal 100B and display equipment can be made 200 establish control instruction agreement, the various function keys of user interface by providing on operation mobile terminal 100B or virtually press Button, to realize the function such as the remote controler 100A physical button arranged.The audio-video that can also will be shown on mobile terminal 100B In content transmission to display equipment 200, simultaneous display function is realized.
Display equipment 200 can be implemented as TV, it is possible to provide broadcast reception TV functions and computer supported function Intelligent TV network function.Show device examples includes DTV, Web TV, smart television, Internet protocol television (IPTV) etc..
It shows equipment 200, can be liquid crystal display, organic light emitting display, projection display apparatus.It is particularly shown equipment Type, size and resolution ratio etc. are not construed as limiting.
Display equipment 200 also carries out data communication by communication with server 300.Allow display to set here Standby 200 are communicatively coupled by local area network (LAN), WLAN (WLAN) and other networks.Server 300 can be to aobvious Show that equipment 200 provides various contents and interaction.Exemplary, display equipment 200 can send and receive information, such as: receive electricity Sub- program guide (EPG) data receive the digital media library that software program updates or accesses remote storage.Server 300 can be with One group, can also be with multiple groups, it can a kind of or multiclass server.By server 300 provide video on demand and advertising service etc. its His network service content.
The configuration block diagram of control device 100 is illustrated in Figure 1B.As shown in Figure 1B, control device 100 includes control Device 110 processed, memory 120, communicator 130, user input interface 140, output interface 150, power supply 160.
Controller 110 includes random-access memory (ram) 111, read-only memory (ROM) 112, processor 113, communication Interface and communication bus.Controller 110 is used to control between the operation and operation of control device 100, and internal each component Communication cooperation, data processing function outwardly and inwardly.
Illustratively, when the interaction of key or touch in remote controler for detecting that user's pressing is arranged on remote controler 100A When the interaction for the touch panel arranged on 100A, controller 110 is controllable to generate signal corresponding with the interaction detected, and will The signal is sent to display equipment 200.
Memory 120, the various operations for storage driving under control of the controller 110 and control control device 100 Procedure, data and application.Memory 120 can store all kinds of control signal instructions of user's input.
Communicator 130 under control of the controller 110, realizes the control signal and data signal between display equipment 200 Communication.Such as: control signal (such as touch signal or button signal) is sent to aobvious by control device 100 via communicator 130 Show in equipment 200, control device 100 can receive the signal sent by display equipment 200 via communicator 130.Communicator 130 can To include infrared signal interface 131 and radiofrequency signal interface 132.Such as: when infrared signal interface, need user input instruction It is infrared control signal according to infrared control protocol translation, carries out being sent to display equipment 200 through infrared sending module.For another example: When radiofrequency signal interface, user input instruction need to be converted to digital signal, then according to RF control signal modulation protocol into After row modulation, terminal is sent by radio frequency and is sent to display equipment 200.
User input interface 140, it may include at least one in microphone 141, touch tablet 142, sensor 143, key 144 etc. Person, so that the user instruction about control display equipment 200 can be input to by user by voice, touch, gesture, pressing etc. Control device 100.
Output interface 150, by by the received user instruction of user input interface 140 export to display equipment 200, or Person exports by the received image of display equipment 200 or voice signal.Here, output interface 150 may include LED interface 151, Generate vibration interface 152, the sound output interface 153 for exporting sound and the display 154 for exporting image etc. of vibration.For example, Remote controler 100A can receive the output signals such as audio, video or data from output interface 150, and by output signal in display Be shown as on 154 image format, sound output interface 153 output be audio form or vibration interface 152 export be vibration Form.
Power supply 160, for providing operation power branch under control of the controller 110 for each element of control device 100 It holds.Form can be battery and relevant control circuit.
The hardware configuration block diagram of display equipment 200 is illustrated in Fig. 1 C.As shown in Figure 1 C, it shows in equipment 200 It may further include tuning demodulator 210, communicator 220, detector 230, external device interface 240, controller 250, deposit Reservoir 260, video processor 270, display 275, audio processor 280, audio input interface 285, supplies user interface 265 Power supply 290.
Tuning demodulator 210, by wired or wireless way receive broadcast television signal, can amplify, be mixed and The modulation /demodulation such as resonance processing, for demodulating the selected TV frequency of user from multiple wirelessly or non-wirelessly broadcast television signals Entrained audio-video signal and additional information (such as EPG data) in the frequency in road.
Tuning demodulator 220 can be selected according to user, and be controlled by controller 250, the TV frequency of response user's selection TV signal entrained by the frequency in road and the frequency.
Tuning demodulator 220, different according to the broadcast system of TV signal, there are many kinds of the approach that can receive signal, : terrestrial broadcasting, wired broadcasting, satellite broadcasting or Internet radio etc.；It, can number tune and according to modulation type difference Mode or analogue modulation system processed；And it is different according to the type for receiving TV signal, it can be with demodulated analog signal and number letter Number.
In some other exemplary embodiment, tuning demodulator 220 can also be in external equipment, such as external set top box Deng.In this way, set-top box is input to display equipment 200 by outgoing television signal after modulation /demodulation, by external device interface 240 In.
Communicator 220 is for being communicated according to various communication protocol types with external equipment or external server Component.Such as display equipment 200 content-data can be sent to the external equipment connected via communicator 220, alternatively, from via The external equipment browsing and downloading content-data that communicator 220 connects.Communicator 220 may include that WIFI module 221, bluetooth are logical Believe network communication protocols module or the near field communication protocols modules such as protocol module 222, wired ethernet communication protocol module 223, To which communicator 220 can be realized according to the control signal for controlling and receiving control device 100 of controller 250, and by control signal For WIFI signal, Bluetooth signal, radiofrequency signal etc..
Detector 230 is to show equipment 200 for acquiring the component of external environment or the signal interacted with outside.Detection Device 230 may include image acquisition device 231, such as camera, camera, can be used for acquiring external environment scene, with adaptive The display parameters of variation display equipment 200；And attribute for acquiring user or with user's interaction gesture, to realize that display is set The standby function of being interacted between user.It can also include optical receiver 232, for acquiring ambient light intensity, adaptively to show Show the display parameters variation etc. of equipment 200.
In some other exemplary embodiment, detector 230 can also include temperature sensor, such as pass through sensing ring Border temperature, display equipment 200 can adaptively adjust the display colour temperature of image.Illustratively, adjustable when the environment of temperature drift Whole display equipment 200 shows the colder tone of color temp；When the relatively low environment of temperature, adjustable display equipment 200 is shown The inclined warm tones of color temp.
In some other exemplary embodiment, detector 230 can also include sound collector, and such as microphone can be with For receiving the sound of user, as user's control shows the voice signal of the control instruction of equipment 200；Alternatively, use can be acquired In the ambient sound of environment-identification scene type, realize that display equipment 200 can be with adaptive environment noise.
External device interface 240 is to provide what data between the control of controller 210 display equipment 200 and external equipment were transmitted Component.External device interface 240 can be external according to wire/wireless mode and set-top box, game device, laptop etc. Equipment connection can receive such as vision signal (such as moving image), audio signal (such as music), additional letter of external equipment Cease data such as (such as EPG).
Wherein, external device interface 240 may include: high-definition media interface (HDMI) terminal 241, composite video blanking Synchronous (CVBS) terminal 242, analog or digital component terminal 243, universal serial bus (USB) terminal 244, component (Component) terminal (not shown), RGB (RGB) terminal (not shown) etc. any one or more.
Controller 250, by running the various software control procedures being stored on memory 260 (such as operating system and each Kind application program), to control the work of display equipment 200 and respond the operation of user.
As shown in Figure 1 C, controller 250 includes random-access memory (ram) 251, read-only memory (ROM) 252, figure Shape processor 253, CPU processor 254, communication interface 255 and communication bus 256.Wherein, RAM251, ROM252 and figure Shape processor 253,254 communication interface 255 of CPU processor are connected by communication bus 256.
ROM252, for storing various system enabled instructions.Such as when receiving starting-up signal, 200 power supply of equipment is shown Start to start, CPU processor 254 runs the system enabled instruction in ROM252, and the operating system for being stored in memory 260 is copied Shellfish is into RAM251, with the start-up operation system that brings into operation.After the completion of os starting, CPU processor 254 again will storage Various application programs are copied in RAM251 in device 260, then, are brought into operation and are started various application programs.
Graphics processor 253, for generating the screen picture of various Drawing Objects, such as icon, image and actions menu Deng.Graphics processor 253 may include arithmetic unit, for inputting various interactive instructions progress operations by receiving user, in turn Various objects are shown according to display properties；It, will be into for generating the various objects obtained based on arithmetic unit and including renderer Row rendering as the result is shown on display 275.
CPU processor 254, for executing the operating system and application program instructions of storage in memory 260.And root It is each finally to show and to play to execute the processing of various application programs, data and content according to received user input instruction Kind audio-video frequency content.
In some exemplary embodiments, CPU processor 254 may include multiple processors.Multiple processors may include One primary processor and a multiple or sub-processor.Primary processor, it is aobvious for being executed in display equipment preloading mode Show some initialization operations of equipment 200, and/or, the operation of picture is shown in the normal mode.A multiple or subprocessing Device, for executing a kind of operation under the states such as display device standby mode.
Communication interface 255, it may include first interface to the n-th interface.These interfaces can be to be connected to outside via network The network interface of portion's equipment.
Controller 250 can control the integrated operation of display equipment 200.Such as: it is used to select aobvious in response to receiving Show that the user of the GUI object shown on device 275 inputs order, controller 250 can execute and input command selection by user The related operation of object.
Wherein, which can be any one of optional object, such as hyperlink or icon.Should with it is selected right As related operation, such as shows and be connected to the operation such as the hyperlink page, document, image, or execute corresponding with icon The operation of program.This is used to select the user of GUI object to input order, can be by being connected to the various of display equipment 200 Input unit (for example, mouse, keyboard, touch tablet etc.) input order is either said the corresponding voice of voice with user and is ordered It enables.
Memory 260, various types of data, the software program run for storage driving and control display equipment 200 Or application program.Memory 260 may include volatibility and or nonvolatile memory.And term " memory " includes storage Device 260, the RAM251 of controller 250 and ROM252 or display equipment 200 in storage card.
In some embodiments, memory 260 is specifically used for the operation that storage driving shows controller 250 in equipment 200 Program；Various application programs built in storage display equipment 200 and that user downloads from external equipment；Storage is for configuring by showing Show various GUI, various objects relevant to GUI and the visual effect figure for selecting the selector of GUI object that device 275 provides The data such as picture.
In some embodiments, memory 260 is specifically used for storage tuning demodulator 210, communicator 220, detector 230, the driver and dependency number of external device interface 240, video processor 270, display 275, audio processor 280 etc. According to, from the received external data of external device interface (such as audio, video data) or the received user data of user interface (such as Key information, voice messaging, touch information etc.).
In some embodiments, memory 260 specifically stores the software and/or program for indicating operating system (OS), These softwares and/or program may include, for example: kernel, middleware, Application Programming Interface (API) and/or application program.Example Property, function (such as described middleware, API or the application that kernel can control or management system resource and other programs are implemented Program)；Meanwhile kernel can provide interface, to allow middleware, API or application program access controller, with realize control or Management system resource.
The architecture configuration block diagram of operating system in display 200 memory of equipment is illustrated in Fig. 1 D.The operation system Framework of uniting is successively application layer, ccf layer and inner nuclear layer from top to bottom.
The application program of application layer, application program and nonsystematic grade built in system is all to belong to application layer.Be responsible for User carries out directly interactive.Application layer may include multiple application programs, such as live telecast application program, video-on-demand applications journey Sequence, media center applications program, screenshot application program etc..
Live telecast application program can provide live telecast by different signal sources.For example, live telecast application journey It can be used and provide TV from cable television, radio broadcasting, satellite service or the input of other kinds of live telecast service Signal.And live telecast application program can show the video of direct broadcast television signals in display equipment 200.
Video-on-demand applications program can provide the video from different storage sources.Different from live telecast application program, Video on demand provides the video from certain storage sources and shows.For example, video on demand can come from the server end of cloud storage, come The self-contained local hard drive reservoir for having deposited video program.
Media center applications program can provide the application program that various multimedia content play.For example, media center, It can be for different from live telecast or video on demand, user can be each by storing in media center applications routine access memory Kind image or audio-video.
Screenshot application program can carry out screenshot to picture is currently shown on display, and to wrapping in screen shot image The identification object (such as personage, channel logo, building) contained carries out the mark of mark identification frame, title etc., to mention for user Displaying function for the various identification object information for including in display picture.Current display picture, can be text, image, video At least one of.
Ccf layer is responsible for API required for providing application layer.For example, live telecast application program, video-on-demand applications journey The interface that sequence, media center applications program can be provided by ccf layer calls decoder to carry out audio/video decoding.For another example, screenshot is answered The screenshot image of the current display picture intercepted is called with the interface that program can be provided by ccf layer.
Inner nuclear layer provides core system service, such as: file management, memory management, management of process, network management, system The service such as security permission management.Kernel also provides the communication between system software and hardware simultaneously, provides equipment for various hardware Driving service, such as: display driving software is provided for display, webcam driver program is provided for camera, is that remote controler mentions WiFi driver is provided for key driver, for WIFI module, audio driver is provided for audio output interface, is electricity Source control (PM) module provides power management driving etc..
Illustratively, when display equipment executes screenshot processing function to the picture on display, on user's touch remote controller The corresponding key assignments of screenshot key is first converted to screenshot input and referred to by the screenshot key of arrangement, the key driver in inner nuclear layer It enables, and screenshot input instruction is transferred to ccf layer；Ccf layer gives screenshot input instruction notification to screenshot application program, simultaneously Screenshot application notification ccf layer starts to carry out screenshot processing to the picture on display, and stores the screen shot；To After screenshot application program gets the screen shot, handles and show over the display.
User interface 265 receives various user's interactions.Specifically, for the input signal of user to be sent to controller 250, alternatively, by user is sent to from the output signal of controller 250.Illustratively, remote controler 100A can input user The input signals such as power switch signal, channel selecting signal, volume adjustment signals are sent to user interface 265, then by with Family interface 265 transfers to controller 250；Alternatively, the receivable processing of via controller 250 of remote controler 100A is defeated from user interface 265 The output signals such as audio, video or data out, and show received output signal or be by the output of received output signal Audio or vibration mode.
In some embodiments, graphic user interface (GUI) input user's life that user can show on display 275 It enables, then user interface 265 receives user by GUI and inputs order.Specifically, user interface 265 can receive for controlling choosing The position of device in the gui is selected to select the user of different objects to input order.
Alternatively, user can carry out inputting user command by inputting specific sound or gesture, then user interface 265 passes through Sensor identifies sound or gesture, inputs order to receive user.
Video processor 270, for receiving external vision signal, according to the standard encoding and decoding agreement of input signal, into The video datas processing such as row decompression, decoding, the conversion of scaling, noise reduction, frame per second, conversion of resolution, image synthesis, can be obtained directly The vision signal for showing or playing on display 275.
Exemplary, video processor 270, including demultiplexing module, Video decoding module, image synthesis module, frame per second turn Change the mold block, display format module etc..
Wherein, demultiplexing module such as inputs MPEG-2 stream for carrying out demultiplexing process to input audio and video data streams (compression standard based on digital storage media moving image and voice), then demultiplexing module is carried out demultiplexing into video letter Number and audio signal etc..
Video decoding module, for handling the vision signal after demultiplexing, including decoding and scaling processing etc..
Image synthesis module, such as image synthesizer, be used for by graphic generator according to user input or itself generate GUI signal is overlapped mixed processing with scaling processing rear video image, to generate picture signal available for display.
Frame per second conversion module is converted for the frame per second to input video, and the frame per second for the 60Hz video that will such as input turns It is changed to the frame per second of 120Hz or 240Hz, common format is used as interleave mode is realized.
Display format module, the signal for exporting frame per second conversion module are changed into and meet such as display and show The signal of format such as formats the signal that frame per second conversion module exports to export rGB data signal.
Display 275, for receive be originated from video processor 270 export picture signal, carry out display video, image with And menu operation and control interface.For example, display can show the video in the received broadcast singal of tuning demodulator 210, It can show the video from communicator 220 or the input of external device interface 240, can also show and store in memory 260 Image.Display 275, while showing and being generated in display equipment 200 and for controlling the user's operation and control interface for showing equipment 200 UI。
And display 275 may include the driving that the display screen component of picture and driving image are shown for rendering Component.If alternatively, display 275 be a kind of projection display, can also include a kind of projection arrangement and projection screen.
Audio processor 280, for receiving external audio signal, according to the standard encoding and decoding agreement of input signal, into Row decompression and the audio datas processing such as decoding and noise reduction, digital-to-analogue conversion and enhanced processing, obtaining can be in loudspeaker 286 The audio signal of middle broadcasting.
Illustratively, audio processor 280 can support various audio formats.Such as MPEG-2, MPEG-4, advanced audio Encode (AAC), efficient AAC(HE-AAC) etc. formats.
Audio output interface 285, for receiving the audio signal for being originated from audio processor 280 and exporting.For example, audio output Interface can be exported via the audio in the received broadcast singal of tuning demodulator 210, can also export via communicator 220 or The audio that external device interface 240 inputs, can also export the audio stored in memory 260.Audio output interface 285 can It including loudspeaker 286, or exports to the boom box output terminal 287 of the generating device of external equipment, such as ear-piece output.
In some other exemplary embodiment, video processor 270 may include on one or more chips composition.Audio Processor 280 also may include on one or more chips composition.
And in some other exemplary embodiment, video processor 270 and audio processor 280 can be independent Chip, can also be integrated on one or more chips together with controller 250.
Power supply 290, under control of the controller 250, the electric power by external power supply input to be display equipment 200 Power supply power supply is provided to support.Power supply 290 can be mounted in the built-in power circuit inside display equipment 200, can also be with The power supply being mounted in outside display equipment 200.
The schematic diagram for the display picture that display equipment 200 provides is illustrated in Fig. 2.
As shown in Fig. 2, display equipment can provide current playing frames 41 to display, which can be text At least one of word, image, video.For example, Fig. 2 shows current playing frames 41 be an episodes.
It in Fig. 2, shows in equipment when playing an episodes, user is it should be understood that personage in current playing frames Information, dress ornament information or channel information etc., then user can be shown by pressing programmable button in pressure control device (such as screenshot key) Show that equipment can be instructed in response to the corresponding shot operation of the programmable button, screenshot is carried out to current playing frames and obtains screenshot figure Picture, while the screenshot image is transferred to image recognition server and carries out content recognition processing, it is wrapped with returning in the screenshot image The content information and recommendation relevant to identification object of the identification object contained, for user's classified browse.
Here, when image recognition server returns to identification data, display equipment can divide according to preset rules Class shows the identification data returned.Such as: image recognition server identifies to include 5 personages in the screenshot image, then to The identification data that display equipment returns may include: location information in the screenshot image of 5 personages in the screenshot image, Dress ornament information etc. of the other movie and television play information, personage that the encyclopaedia recommended information of personage, personage played in the screenshot image.
The schematic diagram for the GUI400 that display equipment 200 provides is illustrated in Fig. 3 A- Fig. 3 L.
As shown in Figure 3A, display equipment is instructed in response to the corresponding shot operation of the programmable button, can be provided to display It include that current playing frames 41 and suspension are shown in current playing frames 41 and are located at current playing frames in one GUI, the GUI The suspension display area 42 of 41 bottoms.Wherein, display screenshot image and the personage identified and dress ornament letter in suspension display area 42 Breath etc..It is intermediate in suspension display area 42 to show screenshot image 420 such as in the GUI shown in Fig. 3 A, and in screenshot image 420 Two sides show the user interface objects such as the personage's head portrait 421 ~ 424 identified in the screenshot image respectively.
In addition, further include the selector 43 for indicating any user interface object and being selected in the GUI that display equipment provides, it can The position of selector in the gui is moved by the input of user operation control apparatus, selects different user interfaces to change Object.For example, in GUI shown in Fig. 3 A, display screenshot image 420 and personage's head portrait 421 ~ 422 in suspension display area 42, choosing It selects device 43 and indicates that screenshot image 420 is selected.For another example, in the GUI shown in Fig. 3 C, distinguish at multiple personage's head portraits 421 ~ 425 Show that multiple objects identify that frame 4201 ~ 4205,43 indicator body of selector identification frame 4201 are selected.
The display format of selector can be focus frame.The input of control device 100, control display can be passed through according to user The movement of focus frame is shown in equipment 200 to select or control user interface object.Such as: user can be by control device 100 Movement of the direction key control focus frame between user interface object selects and controls user interface object.
The form of identification of focus frame is unlimited.It is exemplary, as drawn thick line by user interface object edge in Fig. 3 A come real Existing or mark focus frame 43 position, can also pass through size, color, transparency and the profile of change focused user interface object Deng the position of mark focus frame 43.
In figure 3 a, when user operation control apparatus indicates that selector has selected screenshot image 420, as user presses Acknowledgement key on control device, as shown in Figure 3B, display equipment is in response to activating the input of screenshot image to instruct, over the display It is displayed in full screen the screenshot image, and the identification object for including in the screenshot image returned based on image recognition server is in this section Location information in figure image, respectively display is used to identify the object identification frame for identifying object at identification object over the display.Such as scheme In GUI shown in 3B, in screenshot image 420, object identification frame is shown respectively at the 5 personage's head portraits 421 ~ 422 identified 4201 ~ 4205, object identification frame is, for example, rectangular shaped rim here.In this way, a kind of intuitive identification can not only be provided for user The notation methods of object, so that user fully understands the identification object for including in the screenshot image；And it can be browsed for subsequent user Identify that the content information of object provides browsing prompt.
It in some embodiments, then, can be according to the screenshot image when user needs to watch the content information of identification object In respectively identify the instruction of the corresponding object identification frame of object, by the directionkeys on operating control device, show that equipment can respond The position of selector 43 in the gui is moved in the corresponding move of direction key, to indicate that different objects identify frame quilt Selection, so as to activate the object identification frame corresponding content to link, browsing is by the content information of selection identification object.
As shown in Figure 3 C, when instruction selector has selected the corresponding object of personage's head portrait 421 of the leftmost side in the screenshot image When body identifies frame 4201, then selector 43 is shown at object identification frame 4201；And it is shown as near selector 43 The personage's head portrait 421 and object identification frame 4201 of ratio enlargement.In this way, due to the usual relatively long distance viewing of user or operation display The GUI that equipment provides, when the character image size in screenshot image is smaller, so that user is not easy viewing or image is obscured and is not easy Identification；So the character image size in screenshot image shows amplified character image when smaller, be able to use family compared with Clearer viewing personage's head portrait in long range.The title of the personage's head portrait 421 returned simultaneously according to image recognition server, Name-poplar that personage is marked out at the object identification frame 4201 of amplification is purple.In this way, clearly watching people in user's relatively long distance When object head portrait, the corresponding actor names of personage's head portrait can be tentatively understood, promote user satisfaction.
Here, connection can also be shown between selector and personage's head portrait of amplification and its corresponding object identification frame Line, personage's head portrait object identification frame corresponding with its to prompt the user with the amplification is the object for belonging to selector and currently selecting It identifies frame, further uses viewing personage's head portrait that family is more clear.Such as in the GUI shown in Fig. 3 C, connecting line 44 is connected The object identification frame 4201 of selector 43 and amplification.
Here, the size and shape of selector object identification frame corresponding with personage's head portrait that selector is fallen into is identical, but It is that selector distinctly displays the corresponding object identification frame of other personage's head portraits not fallen in selector, such as shown in Fig. 3 C In GUI, the frame line of selector 43 can be shown with overstriking or be shown using other colors, with object identification frame 4202 ~ 4205 distinguish, to prompt the user with the personage's head portrait for being currently concerned with selector selection.
It in fig. 3 c, can be according to each in the screenshot image when user needs to watch the content information of next identification object The instruction for identifying the corresponding object identification frame of object, by the directionkeys on operating control device, such as right direction key, such as Fig. 3 D institute Show, display equipment can be in response to the corresponding move of right direction key, so that selector 43 moves right to object identification On frame 4202；And the personage's head portrait 422 and object identification frame 4202 of equal proportion amplification are shown as near selector 43；Together When according to image recognition server return personage's head portrait 422 title, mark out people at the object identification frame 4202 of amplification Name-the Liu Tao of object.In such manner, it is possible to make user's clearer sight in relatively long distance when the size of character image 422 is smaller See personage's head portrait and the corresponding actor names of preliminary understanding personage's head portrait.
Same way, it is also possible to connecting line 44 be shown between selector 43 and the object identification frame 4202 of amplification, to user Prompting personage's head portrait 422 of amplification object identification frame 4202 corresponding with its is the object identification for belonging to selector and currently selecting Frame, further use viewing personage's head portrait that family is more clear.
It in fig. 3d, can be according to the screenshot image when user needs to continue to watch the content information of next identification object In respectively identify the instruction of the corresponding object identification frame of object, such as schemed by the directionkeys on operating control device such as right direction key Shown in 3E, display equipment can be in response to the corresponding move of right direction key, so that selector 43 moves right to object It identifies on frame 4203；The title of the personage's head portrait 423 returned simultaneously according to image recognition server is marked at 43 position of selector Outpour the name-Qiao Xin of personage.In this way, since the size of character image is larger and marks out at personage's head portrait personage's surname Name, user can clearly watch personage's head portrait and the corresponding actor names of preliminary understanding personage's head portrait in relatively long distance.
It in fig. 3e, can be according to the screenshot image when user needs to continue to watch the content information of next identification object In respectively identify the instruction of the corresponding object identification frame of object, such as schemed by the directionkeys on operating control device such as right direction key Shown in 3F, display equipment can be in response to the corresponding move of right direction key, so that selector 43 moves right to object It identifies on frame 4204；The title of the personage's head portrait 424 returned simultaneously according to image recognition server is marked at 43 position of selector Outpour the name-Jiang Xin of personage.In this way, since the size of character image is larger and marks out at personage's head portrait personage's surname Name, user can clearly watch personage's head portrait and the corresponding actor names of preliminary understanding personage's head portrait in relatively long distance.
It, can be according to the screenshot image when user needs to continue to watch the content information of next identification object in Fig. 3 F In respectively identify the instruction of the corresponding object identification frame of object, such as schemed by the directionkeys on operating control device such as right direction key Shown in 3G, display equipment can be in response to the corresponding move of right direction key, so that selector 43 moves right to object It identifies on frame 4205；The title of the personage's head portrait 425 returned simultaneously according to image recognition server is marked at 43 position of selector Outpour name-prince's text of personage.In this way, since the size of character image is larger and marks out at personage's head portrait personage's surname Name, user can clearly watch personage's head portrait and the corresponding actor names of preliminary understanding personage's head portrait in relatively long distance.
It similarly,, can basis if user needs to return the content information of the upper identification object of viewing in Fig. 3 G The instruction that the corresponding object identification frame of object is respectively identified in the screenshot image, by the directionkeys on operating control device, such as to the left Directionkeys, display equipment can be in response to the corresponding move of left direction key, according to the inversion of Fig. 3 G-3F-3E-3D-3C Change display GUI.
In further embodiments, when user operation control apparatus indicates selector activation by the object of selection identification object When identifying frame, if user is by the acknowledgement key in pressure control device, display equipment is known in response to activating the object by selection identification object The input of other frame instructs, and display recommendation relevant to by identification object is selected, more detailed to provide for user over the display Thin identification object information.
For example, in fig. 3 c, display equipment can be in response to activating the input of object identification frame 4201 to instruct, such as Fig. 3 H institute Show, display and the associated recommendation 4211 of personage's head portrait 421 on the right side of display, such as encyclopaedia recommended information, the Yang Zi of poplar purple Same money dress ornament information etc. of other movie and television play information, poplar purple played in current television play segment.In fig. 3d, equipment is shown It can be in response to activating the input of object identification frame 4202 to instruct, as shown in fig. 31, display and personage's head portrait on the right side of display 422 associated recommendations 4221, other movie and television play information played such as encyclopaedia recommended information, the Liu Tao of Liu Tao, Liu Tao are working as Same money dress ornament information in preceding episodes etc..Similarly, in Fig. 3 E-3G, display equipment can be respectively responsive to activator Body identify frame 4203 ~ 4205 input instruction, on the right side of display respectively display as shown in Fig. 3 J-3L with personage's head portrait 423 ~ 425 associated recommendations 4231 ~ 4251.
In further embodiments, in figure 3 a, when user operation control apparatus indicates that selector has selected personage's head When as 421 ~ 424, if user is by the acknowledgement key in pressure control device, display equipment can also be respectively responsive to activation personage's head portrait 421 ~ 424 input instruction, display is associated with as shown in Fig. 3 H-3K with personage's head portrait 421 ~ 424 respectively on right side over the display Recommendation 4211 ~ 4241, to provide more detailed people information for user.
In addition, user can be with operating control device, as by pressure control device in any GUI shown in above-mentioned Fig. 3 A-3L Return key continuously presses return key in pressure control device, and display equipment can be instructed in response to the corresponding input of return key, so that The identification content that display equipment exits in display screenshot image and screenshot image is shown, to continue to show figure over the display Episodes shown in 2, so that user continues to watch.
It as described in above example, when showing one episodes of device plays, is inputted based on user, display equipment can Provide a user the identification object identified in the screenshot image and the screenshot image of the display picture of such as episodes Content information, so that user is when watching episodes, it will be appreciated that performer's relevant information in the episodes is promoted User experience.
Further, during identifying that the content information of object is shown in providing a user screenshot image, knowledge can be passed through The mark of the corresponding object identification frame of other object provides the identification object for including in a kind of visual browsing screenshot image for user Mode and real-time operation interaction feedback.
Further, during the identification object for including in browsing screenshot image, it is contemplated that user is usually remote Viewing display equipment, so showing the identification object image and identification object name information of amplification, energy when the size for identifying object is smaller It is enough so that user's browsing identification object image and information relatively sharp in relatively long distance, to meet user demand.
Fig. 4 A-4C illustrates the flow chart of the gui display method of display screen shot.
For the method in conjunction with shown in Fig. 4 A, this approach includes the following steps S51 ~ S54:
Step S51: display shows current picture.For example, display can show episodes shown in Fig. 2.
Step S52: the shot operation that the instruction that user is inputted by control device carries out screenshot to current picture is received Instruction.For example, user presses the programmable button (such as screenshot key) in pressure control device.
Step S53: instructing in response to the shot operation of input, show the screenshot image of current picture over the display, with And the location information based at least one identification object in screenshot image, display is for identifying the identification of identification object over the display Frame.For example, being displayed in full screen the screenshot image 420 of current picture, and identify in screenshot image 420 in GUI shown in Fig. 3 B Object identification frame 4201 ~ 4205 is shown respectively at 5 personage's head portraits 421 ~ 425 out.
Specifically, the method in conjunction with shown in Fig. 4 B, identification object shown in Fig. 5 A show the figure layer distributed architecture signal at interface Figure and Fig. 5 B shown in identification object location information schematic diagram for, step S53 can specifically include following steps:
It should be noted that identifying that object shows that interface is constituted and is divided into 2 parts in screenshot image shown in Fig. 5 A, figure layer B is Bottom view View, the content drawn in the figure layer are the screenshot image of current picture；Figure layer M is on figure layer B View, for drawing object identification frame, selector, identifying the name information of object, the identification object image of amplification and for connecting The connecting object of the identification object image and selector of amplification.
Step S531: instructing in response to the shot operation of input, carries out screenshot to current picture and obtains screenshot image, aobvious Show the screenshot image that current picture is drawn on the figure layer B of device.
Step S532: screenshot image is sent to image recognition server, and is cut according to what image recognition server returned The content information that object is identified in figure image, draws the corresponding object identification frame of each identification object on the figure layer M of display.
When image recognition server returns to the content information of identification object, figure layer M is set as visible state.Wherein, it identifies The content information of object includes at least: identifying the type (such as personage, animal, dress ornament, logo type) of object, identifies object in screenshot figure The title (such as characters name or animal name) of location information, identification object as in, associated recommendation information (such as personage for identifying object The film played) etc..The location information of identification object is used to indicate the corresponding object identification frame of identification object in screenshot image Display position and size.Here, the corresponding object identification frame of identification object is by taking rectangular shaped rim as an example.The location information of object is identified herein Including but not limited to: the coordinate information at any angle, the width of rectangular shaped rim and the height of the corresponding rectangular shaped rim of identification object profile. Such as shown in Fig. 5 B, the location information of object is identified are as follows: the X axis coordinate in the upper left corner of the corresponding rectangular shaped rim of identification object head portrait profile Information X0, Y axis coordinate information Y0, the corresponding rectangular shaped rim of identification object head portrait profile is in the width in screenshot image (i.e. in X-axis Length) W0, the corresponding rectangular shaped rim of identification object head portrait profile is in height (length i.e. in Y-axis) H in screenshot image0。
Specifically, the location information of each identification object got first by traversal, for each identification object creation one A ImageView control, the position of the ImageView control and size are controlled with the location information of identification object as shown in Figure 5 B System.Then the object identification block diagram piece for showing device memory storage can be filled to the ImageView control, and will be filled with object Body identifies the ImageView ActiveX drafting of block diagram piece on figure layer M.So as to the knowledge returned according to image recognition server The location information of other object draws the corresponding object identification frame of each identification object on the figure layer M of display.
Step S54: it receives the instruction selector that user is inputted by control device and is moved between at least one identification frame Dynamic move.For example, user is by the direction key (such as right key) in pressure control device.
Step S55: in response to the move of input, selector is shown at the identification frame that one identifies object, and really When the fixed identification frame size by selection identification object is in preset threshold, show amplification identifies object image by selection.For example, Fig. 3 C Shown in GUI, selector 43 is shown at object identification frame 4201；And judge the size of object identification frame 4201 pre- If in threshold value, the personage's head portrait 421 and object identification frame 4201 of equal proportion amplification are shown as near selector 43.
Specifically, the method in conjunction with shown in Fig. 4 C, identification object shown in Fig. 5 A show the figure layer distributed architecture signal at interface Figure and Fig. 5 B shown in identification object location information schematic diagram for, step S55 can specifically include following steps:
Step S551: in response to the move of input, determine on screenshot image it is currently selected select identification object, and by selector It is plotted on figure layer M, and is covered on by the object identification frame of selection identification object.
Here, the location information of object is still identified to control created ImageView by selection with as shown in Figure 5 B The position of control and size.First according to the sequence of user operation control apparatus directionkeys, currently quilt is determined on screenshot image Then selection identification object will show that the selector picture stored in equipment is filled into ImageView control, and will be filled with selecting The ImageView ActiveX drafting of device picture covers the currently selected object identification frame for selecting identification object on figure layer M.Due to It is based on and is known by selection by the position and size of the object identification frame of selection identification object and the corresponding ImageView control of selector The location information of other object and create, so the size and shape of the two is overlapped.
Further, under the instruction that the corresponding object identification frame of each identification object is drawn on figure layer M, according to user's operation control The sequence of device directionkeys processed determines next object identification frame by selection identification object that selector will be moved to.
Selector will be moved to it is next by selection identification object object identification frame determination method, may include:
Firstly, traversal calculates the coordinate (X, Y) and currently quilt in the upper left corner of the corresponding rectangular shaped rim of other identification object head portrait profiles (the X in the upper left corner of the corresponding rectangular shaped rim of identification object head portrait profile of selection0, Y0) in abscissa difference or ordinate difference, Calculate | X-X0| or | Y-Y0|。
Then, other the smallest corresponding rectangular shaped rims of identification object head portrait profile of difference is taken to be identified as next by selection The position that the object identification frame of object, i.e. selector are moved to next time.
It, then can be further according to Pythagorean theorem if there is the corresponding rectangular shaped rim of head portrait profile of the identical identification object of difference The top left corner apex and currently selected select for calculating separately the corresponding rectangular shaped rim of each identification object head portrait profile identify object head portrait profile The distance (linear distance of the top left corner apex of i.e. two rectangular shaped rims) of the top left corner apex of corresponding rectangular shaped rim, takes distance It is the smallest to identify the corresponding rectangular shaped rim of object head portrait profile as next object identification frame by selection identification object.
Step S552: judge the size of the currently selected object identification frame for selecting identification object whether in preset threshold；If so, Then follow the steps S553；Otherwise terminate process.
Continue with for the location information schematic diagram of identification object as shown in Figure 5 B, when by the object identification of selection identification object The area W of frame0*H0Less than or equal to preset threshold, alternatively, when by the width W of the object identification frame of selection identification object0And/or it is high Spend H0Less than or equal to preset threshold, it is determined that by the size of the object identification frame of selection identification object in preset threshold.Otherwise, Determine that the size by the object identification frame of selection identification object not in preset threshold, terminates the process.
Step S553: show that the currently selected of amplification selects identification object and its object identification frame.
Specifically, it takes off from screenshot image or intercepts the currently selected object identification frame range for selecting identification object again Interior identification object image, and the identification object image and its object identification block diagram piece equal proportion are amplified.It can be selected to be currently selected Identify that object creates an ImageView control, the size of the control can be for shown in Fig. 5 B: width W1, height H1, the control Position can be shown in Fig. 5 B: the coordinate in the control upper left corner be (X1, Y1)；Later by the identification object image of amplification and its object Body identification block diagram piece is filled to the ImageView control, and by the filled ImageView ActiveX drafting on figure layer M.
In addition, it is contemplated that amplified identification object image can smudgy Chu, here can also be by interpolation algorithm to putting Identification object image after big optimizes.Interpolation algorithm can use method in the prior art.For example, original image can be extracted Fringe region and smooth region, sampled pixel is increased separately to smooth region and fringe region.In such manner, it is possible to further make The clearer identification of user identifies object.
In some embodiments, it can also identify that display is selected at frame position with it by selection identification object image in amplification Select the name information of identification object.For example, in GUI shown in Fig. 3 C, in the personage's head portrait 421 and object identification frame 4201 of amplification The upper left corner shows that name-poplar of personage's head portrait 421 is purple.Here, as shown in Figure 5 B, one can be created for selected identification object of selecting TextView control will be filled to the TextView control by title-poplar purple of selection identification object, and will be somebody's turn to do filled TextView ActiveX drafting is on figure layer M.
In some embodiments, connecting object can also be shown, the visual connection selector of the connecting object and amplification By selection identification object image and its identification frame；Wherein, connecting object is with amplification by selection identification object image and its identification frame one Play display.For example, the personage's head portrait 421 and object identification frame 4201 of selector 43 and amplification pass through company in GUI shown in Fig. 3 C The visual connection of wiring 44.Here, as shown in Figure 5 B, an ImageView control can be created for selected identification object of selecting, will shown Show that the connecting line of device memory storage breaks through filling to the ImageView control, and by the filled ImageView ActiveX drafting On figure layer M.
In some embodiments, display equipment can be with: receiving and inputs instruction activation by user and identify object by selection Object identification frame activation instruction；In response to the activation instruction of input, display is related to by selection identification object over the display The identification content of connection.For example, in GUI shown in Fig. 3 H, display and the associated recommendation of personage's head portrait 421 on the right side of display 4211, other movie and television play information for playing such as encyclopaedia recommended information, the poplar purple of poplar purple, poplar purple are same in current television play segment Money dress ornament information etc..Here it is possible to show these associated identification contents on figure layer T on figure layer M.
As described in above example, shows in the screenshot image process of current playing frames, use first over the display Object identification collimation mark outpours each identification object in the screenshot image, then according to the mark of the corresponding object identification frame of each identification object Instruction, selected identification object is highlighted in the form of selector, with feedback user.Meanwhile for selected identification object The lesser situation of size can amplify the selected identification object of display, further to provide clearly viewing experience for user.
It, can be by screenshot image, the corresponding object identification frame of identification object and selected identification when stating function in realization Selector etc. on object is plotted in a figure layer.However, it is contemplated that needing to keep the clarity of screenshot image itself, to aobvious Show that the EMS memory occupation of equipment is larger.If directly selector is drawn in the figure layer for placing screenshot image, due to screenshot figure Picture self EMS memory is larger, and selector mobile choose draws selector when identifying object on it again every time, at this time by figure When reason device (Graphics Processing Unit, GPU) refreshing is shown in figure layer, the calculation amount of display equipment will lead to Greatly, memory consumption is big, reduced performance.
Therefore, by the way that by screenshot Image Rendering, in a figure layer, object identification frame, selector etc. are plotted in the present embodiment Another figure layer realizes above-mentioned function, so especially with directly draw selector phase in the figure layer for placing screenshot image Than screenshot image and selector are plotted in two figure layers respectively, it is not necessary to refresh screenshot image when selector moves every time Place figure layer, it is only necessary to which figure layer where refresh selector reduces memory consumption so as to reduce calculation amount, improves performance；Together When, the visualization and real-time operation interaction feedback that object is identified in the screenshot image are also provided for user.
In addition, being shown for equipment in conjunction with shown in Fig. 1 C, the members in the display equipment are as follows:
Display, for showing GUI and selector, which can move it in display based on user input instruction On position.For example, display can show GUI shown in Fig. 3 A, it include current playing frames 41 and the display that suspends in the GUI In current playing frames 41 and it is located at finger in the suspension display area 42 and suspension display area 42 of 41 bottom of current playing frames Show the selector 43 that screenshot image 420 is selected.
User interface, the input for receiving control selections device instruct.For example, user interface can receive user by by Left/right directionkeys in pressure control device, the control selections device mobile instruction of to the left/right direction in the gui, to change selector Position in the gui.
Controller, for executing:
The input instruction of screenshot is carried out to the current picture shown on display in response to being used to indicate, display is worked as over the display The screenshot image of preceding picture, and the location information based at least one identification object in screenshot image, show use over the display In the identification frame of mark identification object.For example, it is displayed in full screen the screenshot image 420 of current picture in GUI shown in Fig. 3 B, and Object identification frame 4201 ~ 4205 is shown respectively at the 5 personage's head portraits 421 ~ 425 identified in screenshot image 420.
In some embodiments, controller is also used to execute:
The input instruction moved between at least one identification frame in response to being used to indicate selector, the identification of object is identified at one When showing selector at frame, and determining the identification frame size by selection identification object in preset threshold, the selected of amplification is shown Select identification object image.For example, showing selector 43 at object identification frame 4201 in GUI shown in Fig. 3 C；And judge object Body identifies that the size of frame 4201 in preset threshold, is shown as personage's head portrait 421 of equal proportion amplification near selector 43.
In some embodiments, controller is also used to execute: showing the identification frame by selection identification object of amplification.For example, In GUI shown in Fig. 3 C, selector 43 is shown at object identification frame 4201；And the ratio such as it is shown as near selector 43 The personage's head portrait 421 and object identification frame 4201 of example amplification.
In some embodiments, controller is also used to execute: in amplification by selection identification object image and its identification frame position Place's display is set by the name information of selection identification object.For example, in GUI shown in Fig. 3 C, in the personage's head portrait 421 and object of amplification Identify that the upper left corner of frame 4201 shows that name-poplar of personage's head portrait 421 is purple.
In some embodiments, controller is also used to execute: display connecting object, the visual connection choosing of the connecting object It selects device and that amplifies is identified object image and its identification frame by selection；Wherein, connecting object is with amplification by selection identification object image Identify that frame is display together with it.For example, in GUI shown in Fig. 3 C, the personage's head portrait 421 and object identification of selector 43 and amplification The connection visual by connecting line 44 of frame 4201.
In some embodiments, controller is also used to execute: in response to being used to indicate activation by the input of selection identification object Instruction shows identification content associated with by identification object is selected over the display.For example, being shown in GUI shown in Fig. 3 H Display and the associated recommendation 4211 of personage's head portrait 421 on the right side of device, play such as encyclopaedia recommended information, the poplar purple of poplar purple other The same money dress ornament information etc. of movie and television play information, poplar purple in current television play segment.
Obviously, those skilled in the art can carry out various modification and variations without departing from the essence of the application to the application Mind and range.In this way, if these modifications and variations of the application belong to the range of the claim of this application and its equivalent technologies Within, then the application is also intended to include these modifications and variations.

Claims (16)

1. a kind of provide the graphical user interface method of display screen shot on the display device, which is characterized in that the method Include:
Current picture is shown on display；
The input instruction for carrying out screenshot to the current picture in response to being used to indicate, shows described current on the display The screenshot image of picture, and the location information based at least one identification object in the screenshot image, on the display Show the identification frame for identifying the identification object；
The input instruction moved between at least one identification frame in response to being used to indicate selector, the identification of object is identified at one When showing the selector at frame, and determining the identification frame size by selection identification object in preset threshold, amplification display quilt Selection identification object image.
2. the method according to claim 1, wherein the method also includes:
Amplification display is by the identification frame of selection identification object.
3. according to the method described in claim 2, it is characterized in that, the method also includes:
Identify that display is by the name information of selection identification object at frame position with it by selection identification object image in amplification display.
4. according to the method described in claim 2, it is characterized in that, the method also includes:
Show that connecting object, the visual connection selector of the connecting object identify object image by selection with amplification display Frame is identified with it；Wherein, the connecting object is display together with what amplification was shown by selection identification object image and its identification frame.
5. the method according to claim 1, wherein the location information of the identification object is used to indicate the identification Display position and size of the corresponding identification frame of object in the screenshot image.
6. according to the method described in claim 5, it is characterized in that, the display position of the selector and size are based on the quilt Selection identifies the location information of object and determines, so that the selector and the identification frame by selection identification object are overlapped.
7. the method according to claim 1, wherein the identification frame be rectangular shaped rim shape when, the knowledge The location information of other object includes at least: the coordinate information at any angle of the corresponding rectangular shaped rim of identification object profile, rectangular shaped rim Width and height.
8. the method according to the description of claim 7 is characterized in that the determination identification frame size by selection identification object In preset threshold, specifically include it is following any one:
Determine the area by the rectangular shaped rim of selection identification object in preset threshold；Alternatively, determining by the rectangle of selection identification object The length and/or width of frame are in preset threshold.
9. the method according to claim 1, wherein the method also includes:
The input instruction for being selected identification object is activated in response to being used to indicate, display is chosen with described on the display Select the identification associated identification content of object.
10. a kind of display equipment characterized by comprising
User interface, for receiving user input instruction；
Display, for showing that graphic user interface and selector, the selector can be moved based on user input instruction Its position over the display；
Controller shows graphic user interface for the control display that inputs a command in response to user interface, specific to execute:
The input instruction for carrying out screenshot to the current picture shown on display in response to being used to indicate, shows on the display Show the screenshot image of the current picture, and the location information based at least one identification object in the screenshot image, in institute State the identification frame shown on display for identifying the identification object；
The input instruction moved between at least one identification frame in response to being used to indicate selector, the identification of object is identified at one When showing the selector at frame, and determining the identification frame size by selection identification object in preset threshold, amplification display quilt Selection identification object image.
11. display equipment according to claim 10, which is characterized in that the controller controls display:
Amplification display is by the identification frame of selection identification object.
12. display equipment according to claim 11, which is characterized in that the controller controls display:
Identify that display is by the name information of selection identification object at frame position with it by selection identification object image in amplification display.
13. display equipment according to claim 11, which is characterized in that the controller controls display:
Show that connecting object, the visual connection selector of the connecting object identify object image by selection with amplification display Frame is identified with it；Wherein, the connecting object is display together with what amplification was shown by selection identification object image and its identification frame.
14. display equipment according to claim 10, which is characterized in that when the identification frame is rectangular shaped rim shape, The location information of the identification object includes at least: coordinate information, the rectangle at any angle of the corresponding rectangular shaped rim of identification object profile The width and height of frame.
15. display equipment according to claim 14, which is characterized in that the determination identification by selection identification object Frame size in preset threshold, specifically include it is following any one:
Determine the area by the rectangular shaped rim of selection identification object in preset threshold；Alternatively, determining by the rectangle of selection identification object The length and/or width of frame are in preset threshold.
16. display equipment according to claim 10, which is characterized in that the controller also executes:
The input instruction for being selected identification object is activated in response to being used to indicate, display is chosen with described on the display Select the identification associated identification content of object.
CN201910199952.3A 2018-09-27 2019-03-15 A kind of graphical user interface method and display equipment of display screen shot Pending CN109922363A (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CN201910199952.3A CN109922363A (en) 2019-03-15 2019-03-15 A kind of graphical user interface method and display equipment of display screen shot
PCT/CN2019/098446 WO2020063095A1 (en) 2018-09-27 2019-07-30 Screenshot display method and device
US16/530,233 US11039196B2 (en) 2018-09-27 2019-08-02 Method and device for displaying a screen shot
PCT/CN2019/099631 WO2020063123A1 (en) 2018-09-27 2019-08-07 Graphical user interface method for displaying screenshot and display device
US17/322,572 US11812188B2 (en) 2018-09-27 2021-05-17 Method and device for displaying a screen shot

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910199952.3A CN109922363A (en) 2019-03-15 2019-03-15 A kind of graphical user interface method and display equipment of display screen shot

Publications (1)

Publication Number Publication Date
CN109922363A true CN109922363A (en) 2019-06-21

Family

ID=66965430

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910199952.3A Pending CN109922363A (en) 2018-09-27 2019-03-15 A kind of graphical user interface method and display equipment of display screen shot

Country Status (1)

Country Link
CN (1) CN109922363A (en)

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2020063123A1 (en) * 2018-09-27 2020-04-02 青岛海信电器股份有限公司 Graphical user interface method for displaying screenshot and display device
CN111931692A (en) * 2020-08-31 2020-11-13 青岛聚看云科技有限公司 Display device and image recognition method
CN112269553A (en) * 2019-11-04 2021-01-26 青岛海信激光显示股份有限公司 Display system, display method and computing device
CN112565892A (en) * 2019-09-26 2021-03-26 聚好看科技股份有限公司 Method for identifying roles of video programs and related equipment
CN112580625A (en) * 2020-12-11 2021-03-30 海信视像科技股份有限公司 Display device and image content identification method
CN112584213A (en) * 2020-12-11 2021-03-30 海信视像科技股份有限公司 Display device and display method of image recognition result
US11039196B2 (en) 2018-09-27 2021-06-15 Hisense Visual Technology Co., Ltd. Method and device for displaying a screen shot
CN112995724A (en) * 2021-02-05 2021-06-18 江苏有线技术研究院有限公司 Intelligent picture recognizing method based on broadcasting and television set top box
CN113253903A (en) * 2021-05-13 2021-08-13 维沃移动通信有限公司 Operation method and operation device
US11102441B2 (en) 2017-12-20 2021-08-24 Hisense Visual Technology Co., Ltd. Smart television and method for displaying graphical user interface of television screen shot
CN113434072A (en) * 2021-05-31 2021-09-24 浙江大学 Mobile terminal application control identification method based on computer vision
CN113805993A (en) * 2021-09-03 2021-12-17 四川新网银行股份有限公司 Method for quickly and continuously capturing pictures
WO2022012299A1 (en) * 2020-07-14 2022-01-20 海信视像科技股份有限公司 Display device and person recognition and presentation method
CN114302206A (en) * 2021-06-24 2022-04-08 海信视像科技股份有限公司 Content display method, display equipment and server
CN114339347A (en) * 2020-09-30 2022-04-12 聚好看科技股份有限公司 Display device and image recognition result display method
WO2022078172A1 (en) * 2020-10-16 2022-04-21 海信视像科技股份有限公司 Display device and content display method
WO2022100283A1 (en) * 2020-11-13 2022-05-19 海信视像科技股份有限公司 Display device, control triggering method and scrolling text detection method
US11601719B2 (en) 2017-12-20 2023-03-07 Juhaokan Technology Co., Ltd. Method for processing television screenshot, smart television, and storage medium
WO2023231622A1 (en) * 2022-05-30 2023-12-07 荣耀终端有限公司 Video editing method and electronic device
US11863829B2 (en) 2020-05-25 2024-01-02 Juhaokan Technology Co., Ltd. Display apparatus and method for displaying image recognition result

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102106145A (en) * 2008-07-30 2011-06-22 三星电子株式会社 Apparatus and method for displaying an enlarged target region of a reproduced image
CN107105340A (en) * 2017-03-21 2017-08-29 百度在线网络技术（北京）有限公司 People information methods, devices and systems are shown in video based on artificial intelligence
US20170289643A1 (en) * 2016-03-31 2017-10-05 Valeria Kachkova Method of displaying advertising during a video pause
CN108322806A (en) * 2017-12-20 2018-07-24 青岛海信电器股份有限公司 The display methods of the graphic user interface of smart television and television image sectional drawing
CN109271983A (en) * 2018-09-27 2019-01-25 青岛海信电器股份有限公司 The display methods and display terminal of object are identified in screen-picture screenshot

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102106145A (en) * 2008-07-30 2011-06-22 三星电子株式会社 Apparatus and method for displaying an enlarged target region of a reproduced image
US20170289643A1 (en) * 2016-03-31 2017-10-05 Valeria Kachkova Method of displaying advertising during a video pause
CN107105340A (en) * 2017-03-21 2017-08-29 百度在线网络技术（北京）有限公司 People information methods, devices and systems are shown in video based on artificial intelligence
CN108322806A (en) * 2017-12-20 2018-07-24 青岛海信电器股份有限公司 The display methods of the graphic user interface of smart television and television image sectional drawing
CN109271983A (en) * 2018-09-27 2019-01-25 青岛海信电器股份有限公司 The display methods and display terminal of object are identified in screen-picture screenshot

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11102441B2 (en) 2017-12-20 2021-08-24 Hisense Visual Technology Co., Ltd. Smart television and method for displaying graphical user interface of television screen shot
US11812189B2 (en) 2017-12-20 2023-11-07 Hisense Visual Technology Co., Ltd. Smart television and method for displaying graphical user interface of television screen shot
US11601719B2 (en) 2017-12-20 2023-03-07 Juhaokan Technology Co., Ltd. Method for processing television screenshot, smart television, and storage medium
US11558578B2 (en) 2017-12-20 2023-01-17 Hisense Visual Technology Co., Ltd. Smart television and method for displaying graphical user interface of television screen shot
WO2020063095A1 (en) * 2018-09-27 2020-04-02 青岛海信电器股份有限公司 Screenshot display method and device
US11812188B2 (en) 2018-09-27 2023-11-07 Hisense Visual Technology Co., Ltd. Method and device for displaying a screen shot
WO2020063123A1 (en) * 2018-09-27 2020-04-02 青岛海信电器股份有限公司 Graphical user interface method for displaying screenshot and display device
US11039196B2 (en) 2018-09-27 2021-06-15 Hisense Visual Technology Co., Ltd. Method and device for displaying a screen shot
CN112565892A (en) * 2019-09-26 2021-03-26 聚好看科技股份有限公司 Method for identifying roles of video programs and related equipment
CN112565892B (en) * 2019-09-26 2022-12-27 聚好看科技股份有限公司 Method for identifying roles of video programs and related equipment
CN112784137A (en) * 2019-11-04 2021-05-11 海信视像科技股份有限公司 Display device, display method and computing device
CN112269553A (en) * 2019-11-04 2021-01-26 青岛海信激光显示股份有限公司 Display system, display method and computing device
CN112269553B (en) * 2019-11-04 2023-11-07 青岛海信激光显示股份有限公司 Display system, display method and computing device
US11863829B2 (en) 2020-05-25 2024-01-02 Juhaokan Technology Co., Ltd. Display apparatus and method for displaying image recognition result
WO2022012299A1 (en) * 2020-07-14 2022-01-20 海信视像科技股份有限公司 Display device and person recognition and presentation method
CN111931692A (en) * 2020-08-31 2020-11-13 青岛聚看云科技有限公司 Display device and image recognition method
CN114339347A (en) * 2020-09-30 2022-04-12 聚好看科技股份有限公司 Display device and image recognition result display method
WO2022078172A1 (en) * 2020-10-16 2022-04-21 海信视像科技股份有限公司 Display device and content display method
WO2022100283A1 (en) * 2020-11-13 2022-05-19 海信视像科技股份有限公司 Display device, control triggering method and scrolling text detection method
CN112584213A (en) * 2020-12-11 2021-03-30 海信视像科技股份有限公司 Display device and display method of image recognition result
CN112580625A (en) * 2020-12-11 2021-03-30 海信视像科技股份有限公司 Display device and image content identification method
CN112995724A (en) * 2021-02-05 2021-06-18 江苏有线技术研究院有限公司 Intelligent picture recognizing method based on broadcasting and television set top box
CN113253903A (en) * 2021-05-13 2021-08-13 维沃移动通信有限公司 Operation method and operation device
CN113434072B (en) * 2021-05-31 2022-06-07 浙江大学 Mobile terminal application control identification method based on computer vision
CN113434072A (en) * 2021-05-31 2021-09-24 浙江大学 Mobile terminal application control identification method based on computer vision
CN114302206A (en) * 2021-06-24 2022-04-08 海信视像科技股份有限公司 Content display method, display equipment and server
CN113805993B (en) * 2021-09-03 2023-06-06 四川新网银行股份有限公司 Method for rapidly and continuously capturing images
CN113805993A (en) * 2021-09-03 2021-12-17 四川新网银行股份有限公司 Method for quickly and continuously capturing pictures
WO2023231622A1 (en) * 2022-05-30 2023-12-07 荣耀终端有限公司 Video editing method and electronic device

Similar Documents

Publication Publication Date Title
CN109922363A (en) A kind of graphical user interface method and display equipment of display screen shot
CN111200746B (en) Method for awakening display equipment in standby state and display equipment
CN109618206A (en) The method and display equipment at presentation user interface
CN110032357A (en) The output method and display equipment of the audio data of application program
WO2021147299A1 (en) Content display method and display device
CN111479152A (en) Display device
CN109960556A (en) A kind of display equipment
CN111427643A (en) Display device and display method of operation guide based on display device
CN109862413A (en) Show the method and display equipment of facility information simultaneously in broadcasting pictures
CN111629249B (en) Method for playing startup picture and display device
CN110012340A (en) A kind of graphical user interface method and display equipment of offer menu item
CN111414216A (en) Display device and display method of operation guide based on display device
CN111176603A (en) Image display method for display equipment and display equipment
CN111726673B (en) Channel switching method and display device
CN111107428A (en) Method for playing two-way media stream data and display equipment
CN109857972A (en) A kind of method for updating pages and display equipment
CN112272331B (en) Method for rapidly displaying program channel list and display equipment
CN112055245B (en) Color subtitle realization method and display device
CN111093106B (en) Display device
CN109922364A (en) A kind of display equipment
CN111601143A (en) Eye protection mode service starting method and display device
CN111277911A (en) Image processing method of panoramic video, display device and server
CN111050197B (en) Display device
CN111314739B (en) Image processing method, server and display device
CN113259733B (en) Display device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: 266100 No. 151, Zhuzhou Road, Laoshan District, Shandong, Qingdao

Applicant after: Hisense Video Technology Co.,Ltd.

Address before: 266100 No. 151, Zhuzhou Road, Laoshan District, Shandong, Qingdao

Applicant before: QINGDAO HISENSE ELECTRONICS Co.,Ltd.

RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190621