WO2022156729A1 - 一种显示设备及显示方法 - Google Patents
一种显示设备及显示方法 Download PDFInfo
- Publication number
- WO2022156729A1 WO2022156729A1 PCT/CN2022/072894 CN2022072894W WO2022156729A1 WO 2022156729 A1 WO2022156729 A1 WO 2022156729A1 CN 2022072894 W CN2022072894 W CN 2022072894W WO 2022156729 A1 WO2022156729 A1 WO 2022156729A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- file
- display
- files
- area
- preview
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 96
- 230000004044 response Effects 0.000 claims abstract description 47
- 230000009471 action Effects 0.000 claims description 3
- 238000009877 rendering Methods 0.000 description 66
- 230000008569 process Effects 0.000 description 48
- 238000010586 diagram Methods 0.000 description 38
- 239000007787 solid Substances 0.000 description 23
- 238000004891 communication Methods 0.000 description 17
- 230000006870 function Effects 0.000 description 16
- 238000010187 selection method Methods 0.000 description 15
- 230000003993 interaction Effects 0.000 description 12
- 238000012545 processing Methods 0.000 description 10
- 239000003086 colorant Substances 0.000 description 6
- 230000000694 effects Effects 0.000 description 6
- 238000006243 chemical reaction Methods 0.000 description 5
- 230000002093 peripheral effect Effects 0.000 description 5
- 230000005540 biological transmission Effects 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000002452 interceptive effect Effects 0.000 description 3
- 239000002131 composite material Substances 0.000 description 2
- 238000012217 deletion Methods 0.000 description 2
- 230000037430 deletion Effects 0.000 description 2
- 230000005611 electricity Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000005236 sound signal Effects 0.000 description 2
- 230000001960 triggered effect Effects 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 230000007613 environmental effect Effects 0.000 description 1
- 230000007849 functional defect Effects 0.000 description 1
- 230000000977 initiatory effect Effects 0.000 description 1
- 230000009191 jumping Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 238000003786 synthesis reaction Methods 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
Definitions
- the present application relates to the technical field of document display, and in particular, to a display device and a display method.
- 3D devices can be presented to the user in a 360-degree horizontal and 180-degree vertical field of view, which is favored by users.
- the functions of 3D devices have become more and more powerful, and accordingly, the content that can be displayed by 3D devices has become more and more abundant.
- a 3D device can display local content, and the local content can include locally stored 3D pictures or local 3D movies; another example, a 3D device can also display network content, and the network content can include network 3D pictures or network 3D movies.
- a first aspect of the embodiments of the present application shows a display device, including:
- the display is used to present to the user a spatial viewing area surrounded by 360 degrees in the horizontal direction and 180 degrees in the vertical direction, the spatial viewing area includes a browsing area and a preview area, the browsing area is an area corresponding to the user's visible area, and the The browsing area is used for displaying browsing files, the preview area is an area bordering the browsing area, and the preview area is used for displaying preview files;
- Controller configured as:
- a first set is generated, and the files contained in the first set are the files displayed on the preview page where the clicked preview file is located;
- a browsing area of the display is controlled to display the files contained in the first collection.
- a second aspect of the embodiments of the present application shows a display method, and the method is applicable to a display device and includes:
- a first set is generated, and the files contained in the first set are the files displayed on the preview page where the clicked preview file is located;
- a browsing area of the display is controlled to display the files contained in the first collection.
- FIG. 1 illustrates a usage scenario of a display device according to some embodiments
- FIG. 2 shows a block diagram of the hardware configuration of the control apparatus 100 according to some embodiments
- FIG. 3 shows a block diagram of a hardware configuration of a display device 200 according to some embodiments
- FIG. 4 shows a software configuration diagram in the display device 200 according to some embodiments
- FIG. 5 is a flowchart of interaction between a display device and a user provided according to an embodiment of the present application
- FIG. 6 is a spatial field of view provided according to an embodiment of the present application.
- FIG. 7 is a schematic diagram of a spatial field of view provided according to an embodiment of the present application.
- FIG. 8 is a schematic diagram of a spatial field of view shown in an embodiment of the application.
- FIG. 9 is a schematic diagram of a spatial field of view before and after a user clicks to browse a file according to an embodiment of the present application.
- FIG. 10 is a schematic diagram of a spatial view before and after a user clicks to browse a file according to an embodiment of the present application
- FIG. 11 is a schematic diagram of a spatial view before and after a user clicks a preview file according to an embodiment of the present application
- FIG. 12 is a schematic diagram of a spatial field of view shown in an embodiment of the application.
- FIG. 13 is a flowchart illustrating a file display method according to an embodiment of the present application.
- FIG. 14 is a schematic diagram of a spatial field of view provided according to an embodiment of the present application.
- FIG. 15 is a schematic diagram of a spatial field of view provided according to an embodiment of the present application.
- 16 is a flowchart illustrating a method for generating a first set according to an embodiment of the present application
- FIG. 17 is a schematic diagram of a spatial field of view provided according to an embodiment of the present application.
- FIG. 18 is a schematic diagram of a spatial field of view provided according to an embodiment of the present application.
- FIG. 19 is a schematic diagram of a spatial field of view provided according to an embodiment of the present application.
- FIG. 21 is a schematic diagram of a spatial field of view provided according to an embodiment of the present application.
- FIG. 22 is a schematic diagram of a spatial field of view provided according to an embodiment of the present application.
- FIG. 23 is a flowchart of interaction between a display device and a user provided according to an embodiment of the present application.
- 24 is a schematic diagram of the i-th picture provided according to an embodiment of the present application.
- 25 is a schematic diagram of the i-th picture provided according to an embodiment of the present application.
- 26 is a schematic diagram of the i-th picture provided according to an embodiment of the present application.
- FIG. 27 is a schematic diagram of the i-th picture provided according to an embodiment of the present application.
- 29 is a flowchart of a method for intercepting the i-th picture according to an embodiment of the present application.
- FIG. 30 is a structural block diagram of a display device according to an embodiment of the present application.
- FIG. 31 is a flowchart showing the interaction between a display and a controller according to an embodiment of the present application.
- FIG. 32 is a flowchart showing the interaction between a display and a controller according to an embodiment of the present application.
- FIG. 33 is a work flow diagram of an application according to an embodiment of the present application.
- module refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware or/and software code capable of performing the functions associated with that element.
- FIG. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in FIG. 1 , the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the smart device 300 or the control device 100 .
- control device 100 may be a remote control, and the communication between the remote control and the display device includes at least one of infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, and the display is controlled wirelessly or wiredly. device 200.
- the user can control the display device 200 by inputting user instructions through at least one of keys on the remote control, voice input, and control panel input.
- the smart device 300 may include any one of a mobile terminal, a tablet computer, a computer, a laptop computer, an AR/VR device, and the like.
- the smart device 300 may also be used to control the display device 200 .
- the display device 200 is controlled using an application running on the smart device.
- the smart device 300 and the display device may also be used to communicate data.
- the display device 200 can also be controlled in a manner other than the control apparatus 100 and the smart device 300.
- the module for acquiring voice commands configured inside the display device 200 can directly receive the user's voice command for control.
- the user's voice command control can also be received through the voice control device provided outside the display device 200 .
- the display device 200 is also in data communication with the server 400 .
- the display device 200 may be allowed to communicate via local area network (LAN), wireless local area network (WLAN), and other networks.
- the server 400 may provide various contents and interactions to the display device 200 .
- the server 400 may be a cluster or multiple clusters, and may include one or more types of servers.
- the software steps executed by one step execution body can be migrated to another step execution body that is in data communication with it for execution as required.
- the software steps executed by the server may be migrated to be executed on the display device with which it is in data communication as required, and vice versa.
- FIG. 2 exemplarily shows a configuration block diagram of the control apparatus 100 according to an exemplary embodiment.
- the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply.
- the control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .
- the communication interface 130 is used for external communication, including at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.
- the user input/output interface 140 includes at least one of a microphone, a touchpad, a sensor, a button, or an alternative module.
- FIG. 3 is a block diagram showing a hardware configuration of the display apparatus 200 according to an exemplary embodiment.
- display device 200 includes tuner 210, communicator 220, detector 230, external device interface 240, controller 250, display 260, audio output interface 270, memory, power supply, user interface at least one.
- the controller includes a central processing unit, a video processing unit, an audio processing unit, a graphics processing unit, a RAM, a ROM, and a first interface to an nth interface for input/output.
- the display 260 includes a display screen component for presenting a picture, and a driving component for driving the image display, for receiving the image signal output from the controller, for displaying the video content, the image content and the menu manipulation interface Components and user-manipulated UI interfaces, etc.
- the display 260 may be at least one of a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
- the tuner demodulator 210 receives broadcast television signals through wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or cable broadcast television signals.
- communicator 220 is a component for communicating with external devices or servers according to various communication protocol types.
- the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver.
- the display device 200 may establish transmission and reception of control signals and data signals with the control apparatus 100 or the server 400 through the communicator 220 .
- the detector 230 is used to collect signals from the external environment or interaction with the outside.
- the detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, for receiving external sound.
- the external device interface 240 may include, but is not limited to, the following: High Definition Multimedia Interface (HDMI), Analog or Data High Definition Component Input Interface (Component), Composite Video Input Interface (CVBS), USB Input Interface (USB), Any one or more interfaces such as RGB ports. It may also be a composite input/output interface formed by a plurality of the above-mentioned interfaces.
- HDMI High Definition Multimedia Interface
- Component Analog or Data High Definition Component Input Interface
- CVBS Composite Video Input Interface
- USB Input Interface USB
- Any one or more interfaces such as RGB ports. It may also be a composite input/output interface formed by a plurality of the above-mentioned interfaces.
- the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box Wait.
- the controller 250 controls the operation of the display device and responds to user operations.
- the controller 250 controls the overall operation of the display apparatus 200 .
- the controller 250 may perform an operation related to the object selected by the user command.
- the object may be any of the selectable objects, such as a hyperlink, icon, or other operable area of operation.
- the operations related to the selected object are: display operations connected to hyperlinked pages, documents, images, etc., or execute operations corresponding to the icons.
- the controller includes a central processing unit (Central Processing Unit, CPU), a video processor, an audio processor, a graphics processor (Graphics Processing Unit, GPU), RAM (Random Access Memory, RAM), ROM (Read- Only Memory, ROM), at least one of the first interface to the nth interface for input/output, a communication bus (Bus), and the like.
- CPU Central Processing Unit
- video processor video processor
- audio processor audio processor
- graphics processor Graphics Processing Unit, GPU
- RAM Random Access Memory
- ROM Read- Only Memory
- CPU processor It is used to execute the operating system and application instructions stored in the memory, and to execute various applications, data and contents according to various interactive instructions received from external inputs, so as to finally display and play various audio and video contents.
- CPU processor which can include multiple processors. For example, it includes a main processor and one or more sub-processors.
- the graphics processor is used to generate various graphic objects, such as at least one of icons, operation menus, and user input instructions to display graphics.
- the graphics processor includes an operator, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to the display attributes; it also includes a renderer, which renders various objects obtained based on the operator, and the rendered objects are used for rendering. displayed on the display.
- the video processor is used to decompress, decode, scale, reduce noise, convert frame rate, convert resolution, and synthesize images according to the standard codec protocol of the received external video signal. At least one of the processes can obtain a signal that is directly displayed or played on the displayable device 200 .
- the video processor includes at least one of a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.
- the demultiplexing module is used for demultiplexing the input audio and video data stream.
- the video decoding module is used to process the demultiplexed video signal, including decoding and scaling.
- the image synthesizing module such as an image synthesizer, is used for superimposing and mixing the GUI signal generated by the graphics generator according to the user's input or itself, and the zoomed video image, so as to generate an image signal that can be displayed.
- the frame rate conversion module is used to convert the input video frame rate.
- the display formatting module is used to convert the received frame rate into the video output signal, and change the signal to conform to the display format signal, such as outputting the RGB data signal.
- the audio processor is configured to receive an external audio signal, perform decompression and decoding according to a standard codec protocol of the input signal, and perform at least one of noise reduction, digital-to-analog conversion, and amplification processing. , to get a sound signal that can be played in the loudspeaker.
- the user may input user commands on a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input commands through the graphical user interface (GUI).
- GUI graphical user interface
- the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
- a "user interface” is a medium interface for interaction and information exchange between an application or an operating system and a user, which enables conversion between an internal form of information and a form acceptable to the user.
- the commonly used form of user interface is Graphical User Interface (GUI), which refers to a user interface related to computer operations displayed in a graphical manner. It can be an icon, window, operation area and other interface elements displayed on the display screen of the electronic device, wherein the operation area can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets At least one of the visible interface elements.
- GUI Graphical User Interface
- the user interface 280 is an interface that can be used to receive control input (eg, physical buttons on the display device body, or others).
- control input eg, physical buttons on the display device body, or others.
- the system of the display device may include a kernel (Kernel), a command parser (shell), a content system and an application.
- kernel Kernel
- shell command parser
- the kernel, shell, and content system make up the basic operating system structures that allow users to manage content, run programs, and use the system.
- the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, scheduler, signals and inter-thread communication (IPC).
- IPC inter-thread communication
- the Shell and user applications are loaded.
- the application is compiled into machine code after startup, forming a thread.
- the system of the display device may include a kernel (Kernel), a command parser (shell), a content system, and an application program.
- kernel Kernel
- shell command parser
- content system a content system
- an application program a program that handles the basic operating system structures that allow users to manage content, run programs, and use the system.
- the kernel starts, activates the kernel space, abstracts hardware, initializes hardware parameters, etc., runs and maintains virtual memory, scheduler, signals and inter-process communication (IPC).
- IPC inter-process communication
- the shell and user applications are loaded.
- An application is compiled into machine code after startup, forming a process.
- the system of the display device is divided into three layers, from top to bottom, the application layer, the middleware layer and the hardware layer are respectively.
- the application layer mainly includes common applications on the TV and Application Framework (Application Framework), among which, common applications are mainly applications developed based on browser Browser, such as: HTML5APPs; and native applications (Native APPs);
- Application Framework is a complete program model, with all the basic functions required by standard application software, such as: content access, data exchange..., and the use interface of these functions (toolbar, status bar, menu , dialog).
- Native APPs can support online or offline, message push or local resource access.
- the middleware layer includes middleware such as various TV protocols, multimedia protocols, and system components.
- the middleware can use the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, and can achieve the purpose of resource sharing and function sharing.
- the hardware layer mainly includes the HAL interface, hardware and drivers.
- the HAL interface is a unified interface for connecting all TV chips, and the specific logic is implemented by each chip.
- Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.
- the display device after the display device is started, it can directly enter the display interface of the last selected signal source, or the signal source selection interface, where the signal source can be a preset video-on-demand program, and can also be an HDMI interface, a live TV interface At least one of etc., after the user selects different signal sources, the display can display the content obtained from the different signal sources. applications in can.
- the display device supports different external audio output devices in order to satisfy the user's advanced experience of sound effects.
- External audio output devices mainly include the following: Display Speaker (built-in speaker, hereinafter referred to as Speaker), ARC (Audio Return Channel, sound return) device, Bluetooth Device (Bluetooth device, hereinafter referred to as BT), wired headphones, USB audio equipment Wait.
- 3D devices can be presented to the user in a 360-degree horizontal and 180-degree vertical field of view, which is favored by users.
- the functions of 3D devices have become more and more powerful, and accordingly, the content that can be displayed by 3D devices has become more and more abundant.
- a 3D device can display local content, and the local content can include locally stored 3D pictures or local 3D movies; another example, a 3D device can also display network content, and the network content can include network 3D pictures or network 3D movies.
- the content that can be displayed by the 3D device is usually displayed on the browsing page in the form of thumbnails.
- 3D devices can display more and more content, and 3D devices display all the content through scroll bars. Users can flip up and down pages by sliding the slider of the scroll bar to browse more content. With the increase in the number of contents that can be displayed by 3D devices, a problem is brought about. When users search for the contents they need, they need to frequently adjust the position of the progress bar up and down, resulting in poor user experience.
- an embodiment of the present application provides a display device, the display device includes at least a display and a controller.
- the structures and functions of the display and the controller may refer to the foregoing embodiments.
- the newly added functions of the display and the controller will be described below with reference to the specific drawings.
- FIG. 5 is a flowchart of interaction between a display device and a user according to an embodiment of the present application.
- a display used to perform step S501 and present it to the user space visual field
- the spatial viewing area is a viewing area that is completely surrounded by 360 degrees in the horizontal direction and 180 degrees in the vertical direction.
- the spatial viewing area is further described below with reference to the specific drawings.
- FIG. 6 is a spatial viewing area provided according to an embodiment of the present application; it can be seen that the spatial viewing area includes a display angle of 360 degrees in the horizontal direction and 180 degrees in the vertical direction.
- the browsing area is the area corresponding to the user's visible area, and the user's visible area is determined by the user's visual field limit.
- the field of view is within the range of ⁇ 50-70 degrees ⁇ in the vertical direction, and the field of view is less than 180 degrees in the horizontal direction. Therefore, in this embodiment, the browsing area is smaller than the spatial viewing area, so the spatial viewing area can be divided into a browsing area and a preview area. Specifically, please refer to FIG.
- the spatial viewing area is divided into a browsing area 71 and a preview area 72 , wherein the preview area 72 is located on the left and right sides of the browsing area 71 .
- FIG. 7 is only an example of an exemplary introduction that the preview area is located on the left and right sides of the browsing area.
- the present application does not specify the relative position of the preview area and the browsing area and the number of preview areas.
- the spatial color gamut may include a browsing area and a preview area, and the preview area may be located above the browsing area.
- the spatial color gamut may include a browsing area.
- FIG. 8 is a schematic diagram of a spatial view area shown in an embodiment of the present application. It can be seen that the spatial view area is divided into a browsing area 801 and a preview area 802, wherein the browsing area 801 is displayed in the form of a rectangle, The preview area 802 is presented in the form of a trapezoid. It is worth noting that FIG. 8 only exemplarily introduces a display form in which the preview area is a trapezoid and the browsing area is a rectangle. The above display form does not constitute a limitation. In the process of practical application, the display styles of the browsing area are different. With regard to the display style of the preview area, it can be achieved in the present application that both the display forms that distinguish between the browsing area and the preview area can be applied.
- the browsing area is used to display browsing files
- the preview area is used to display preview files
- the browsing file when displaying the browsing file, the browsing file needs to be loaded to ensure the operation of the user clicking the browsing file, and the controller can control the browsing area to display the content contained in the browsing file.
- the preview file when the preview file is presented, the preview file may be loaded.
- the thumbnail or icon of the preview file when displaying the preview file, it is not necessary to load the preview file, and the thumbnail or icon of the preview file can be displayed in the preview area.
- the controller is configured to perform step S502 in response to the operation of the user clicking to browse the file, to control the browsing area to display the content contained in the browse file;
- the browsing file may be a file in the form of a folder, or may be an independent file, such as an audio file, a video file, a picture file, and the like.
- the browsing file in response to the operation of the user clicking to browse the file, the files contained in the folder are displayed in the browsing area.
- the browse file is an independent file, the file is displayed in the browse area in response to the user's operation of clicking on the browse file. The following describes the process of displaying the content included in the browsing file in the browsing area with reference to the specific drawings.
- FIG. 9 is a schematic diagram of a spatial field of view before and after a user clicks to browse a file according to an embodiment of the present application.
- the browsing area displays 10 browsing files, respectively file browsing files 911, 912... 920.
- the user clicks to browse the file 912 .
- the browse file 912 is a folder, which contains 6 video files, namely, video 1, 2, 3, 4, 5, and 6.
- the spatial view can refer to (92) in FIG. 9 .
- FIG. 10 is a schematic diagram of a spatial field of view before and after a user clicks to browse a file according to an embodiment of the present application.
- the browsing area displays 10 browsing files, respectively file browsing files 1011, 1012... 1020.
- the browsing file 1012 is a file in a picture format.
- the spatial view can refer to (102) in FIG. 10, and the browsing area displays the picture 1020 in the form of a full screen.
- the controller is configured to perform step S503 in response to the operation of the user clicking on the preview file to generate a first set, where the files contained in the first set are the files displayed on the preview page where the clicked preview file is located;
- the controller will load the file displayed on the preview page where the clicked preview file is located to obtain the first set.
- the files displayed on the preview page where the clicked preview file is located include file 1 , file 2 and file 3 .
- the generated first set includes file 1, file 2 and file 3.
- the controller is configured to execute step S504 to control the browsing area of the display to display the files included in the first set.
- FIG. 11 is a schematic diagram of the spatial view before and after the user clicks on the preview file according to the embodiment of the present application.
- the initial time-space view can refer to ( 111 ) in FIG. 11 .
- the preview area displays four browsing files, namely file preview files 1111 , 1112 , 1113 and 1114 .
- the user clicks on the preview file 1112 .
- the controller In response to clicking on the preview file 1112, the controller generates a first set including browse files 1111, 1112, 1113, and 1114.
- the controller controls the browsing area to display the browsing files 1111 , 1112 , 1113 and 1114 .
- the spatial view can refer to ( 112 ) in FIG. 11 .
- the display is used to display the browsing area and the preview area
- the browsing area is used to display the browsing file
- the preview area is used to display the preview file.
- the controller converts the file displayed in the preview area into a browse file and displays it in the browse area. And then realize the page switching process. It can be seen that in the process of turning pages in the technical solutions shown in the embodiments of the present application, the user only needs to click on the preview file to realize the page switching, and the user experience is better.
- FIG. 12 is a schematic diagram of a spatial viewing area shown in an embodiment of the present application. It can be seen that the spatial viewing area is divided into a browsing area 121 and a preview area 122 , wherein the browsing file displayed in the browsing area is larger than the preview area 122 Displayed preview file. It is worth noting that FIG. 12 is only an exemplary introduction of a display form in which the browsing file is larger than the preview file. The above-mentioned display form does not constitute a limitation. In the process of practical application, the display style of the browsing file is different from the preview. The presentation style of the file can be applied to the present application where both the presentation form of the differentiated browsing file and the preview area can be applied, for example, the preview file can be virtualized.
- the browsing area can accommodate all files.
- the display does not need to display the preview area, so as to improve the response rate of the display device.
- FIG. 13 is a flowchart showing a file display method according to an embodiment of the present application.
- the controller is further configured as:
- S131 reads the first number in response to the action of the user initiating the file manager.
- the first number is the number of files to be displayed, and each of the files corresponds to a serial number; the serial number may be the serial number of the file in the file manager.
- S132 judges whether the number of the first files is less than or equal to the number of the second files
- the number of second files is the number of files that can be displayed in the browsing area; for example, in this embodiment of the application, the number of files that can be displayed in the browsing area is 10, and correspondingly, the number of second files is equal to 10.
- the first set includes at least one browsing file
- the browsing files are files with serial numbers from 1 to N, where N is the number of second files
- the second set includes at least one preview file
- the preview file To be a file adjacent to the browse file.
- the files adjacent to the browsing file may include files whose serial numbers are located before the serial numbers of the browsing files, or files whose serial numbers are located after the serial numbers of the browsing files.
- the number of preview files is determined by the number of preview files.
- the file size that the region can hold is determined.
- the file manager contains 20 files, which are: file 1, file 2... file 20, and the number of files that can be displayed by browsing files is 5, then N is equal to 5, and it is opened for the first time.
- the first set generated by the controller includes file 1, file 2...file,5.
- the preview area can display 5 files, and the files included in the second set are file 6, file 7...file 10.
- the number of files displayed in the browsing area and the number of files displayed in the preview area may be different.
- the number of files displayed in the browsing area and the number of files displayed in the preview area may be the same.
- FIG. 14 is a schematic diagram of a spatial field of view provided according to an embodiment of the present application.
- the file manager contains 4 files (the first number of files), the files that can be displayed by browsing files are 10 files (the second number of files), and the number of the first files is less than the number of the second files. Therefore, The controller only draws the browsing area, and displays all four files in the browsing area. See Figure 14 for the spatial view at this time.
- FIG. 15 is a schematic diagram of a spatial field of view provided according to an embodiment of the present application.
- the file manager contains 14 files (the number of the first files), the files that can be displayed by browsing files are 10 files (the number of the second files), and the number of the first files is greater than the number of the second files. Therefore, The controller only draws the browsing area and the preview area, and displays 10 browsing files in the browsing area and 4 preview files in the preview area. See Figure 15 for the spatial view at this time.
- this embodiment also shows a method for generating the first set.
- FIG. 16 is a flowchart showing the method for generating the first set in this embodiment of the present application.
- the controller is further configured to: in response to the operation of the user clicking the preview file, the controller is further configured to:
- S161 reads the first page number value C1, the first page number value is the page number corresponding to the clicked preview file;
- the number of files that can be displayed in the preview area is equal to the number of files that can be displayed in the browsing area. Therefore, when the file manager is opened, all files can be divided into N groups according to the number of files that can be displayed in the preview area, and the page number value corresponding to each group of files is already a fixed value.
- the file manager includes 25 files, and the number of files that can be displayed in the preview area is 5.
- the controller can divide the 25 files into 5 groups, wherein file 1 to file 5 is the first group of files, the page value of the first group of files is 1; file 6 to file 10 are the second group of files, the page value of the second group of files is 2; file 11 to file 15 are the third group of files, the third The page value of group files is 3; files 16 to 20 are the fourth group of files, and the page value of the fourth group of files is 4; files 21 to 25 are the fifth group of files, and the page value of the fifth group of files is 5.
- the file manager includes 8 files, the number of files that can be displayed in the preview area is 4, the first page number is 2, and the first subset includes ⁇ file 1 to file 4 ⁇ . See Figure 17 for the spatial view.
- S164 controls the browsing area to display the first set and does not display the first sub-preview area.
- the file manager includes 4 files, the number of files that can be displayed in the preview area is 4, and the value of the first page number is 1.
- the spatial view can refer to FIG. 18 .
- the controller is further configured to execute step S165 to determine whether the first page number value is less than the total page number value
- the controller is further configured to execute step S166 to control the display not to display the second sub-preview area.
- FIG. 18 For details, please refer to FIG. 18 for the display effect of the spatial field of view.
- the second sub-preview area is located on the other side, and the second sub-preview area and the first sub-preview area are located on different sides of the browsing area.
- the different sides may be opposite sides, eg, left and right. It can also be adjacent sides, such as top and right.
- the controller is further configured to perform step S166 to generate a second subset, the second subset includes a sequence number of ⁇ C1*N+1 , the file corresponding to the termination sequence number ⁇ , the termination sequence number is determined by the value of the first page number and the first quantity;
- the file manager includes 12 files, the number of files that can be displayed in the preview area is 4, the first page number value is 2, the first subset includes ⁇ file 1 to file 4 ⁇ , the first The set includes ⁇ file 5 to file 8 ⁇ , and the second subset includes ⁇ file 9 to file 12 ⁇ .
- the spatial view can refer to FIG. 19 .
- the controller executes step S167 to control the second sub-preview area of the display to display the files included in the second sub-set.
- This embodiment shows a method for generating a second subset.
- the controller is further configured as:
- the first subset contains ⁇ File 13 ⁇ File 15 ⁇ , the first subset contains ⁇ File 16 ⁇ File 20 ⁇ , and the second subset contains ⁇ File 21 ⁇ File 23 ⁇ .
- the spatial view can refer to Figure 21.
- the first subset contains ⁇ File 13 ⁇ File 15 ⁇ , the first subset contains ⁇ File 16 ⁇ File 20 ⁇ , and the second subset contains ⁇ File 21 ⁇ File 24 ⁇ .
- the spatial view can refer to Figure 22.
- a second aspect of the embodiments of the present application provides a file display method, and the method is applicable to a display device, including:
- a first set is generated, and the files contained in the first set are the files displayed on the preview page where the clicked preview file is located;
- a browsing area of the display is controlled to display the files contained in the first collection.
- the controller in response to the user's operation of clicking on the preview file, the controller converts the file displayed in the preview area into a browsing file and displays it in the browsing area, thereby realizing the page switching process. It can be seen that in the process of turning pages in the technical solutions shown in the embodiments of the present application, the user only needs to click on the preview file to realize the page switching, and the user experience is better.
- the display device can display the picture-type files in the form of pictures.
- picture-type files There are generally two ways to display picture-type files in the form of pictures: one is to reduce the original picture and display it, which will take up a lot of memory resources; the other is to separately display the pictures contained in the folder opened by the user.
- Generate a thumbnail that displays the thumbnail In the production process of video type files, scene conversion is often involved. Usually, in order to improve the user's viewing effect, a solid color picture is inserted between the two-pin pictures of the converted scene. This may cause the thumbnail of the intercepted video type file to be a solid-color image, and the user experience is poor.
- an embodiment of the present application provides a display device, the display device includes at least a display and a controller.
- the structures and functions of the display and the controller may refer to the foregoing embodiments.
- the newly added functions of the display and the controller will be described below with reference to the specific drawings.
- Embodiments of the present application provide a display device, including:
- Controller configured as:
- the i-th picture is a frame picture in the video file
- i is the number of times the picture is intercepted in the video file during the thumbnail generation process
- i is a positive integer greater than or equal to 1;
- N is a positive integer greater than or equal to 2;
- the ith picture is reduced to obtain a thumbnail of the video file.
- An embodiment of the present application provides a display device, including: the controller is further configured to:
- N color parameters are all the same, select M pixels on the i-th picture, where M is a positive integer, greater than or equal to 2, and the selection method of M pixels is different from that of N pixels selection method;
- An embodiment of the present application provides a display device. If the M color parameters are all the same, the controller is further configured to:
- the number of times threshold is a set positive integer greater than or equal to 2;
- i is equal to the number of times threshold, the i-th picture is reduced to obtain the thumbnail of the video file.
- An embodiment of the present application provides a display device, and the controller is further configured to:
- the display In response to the user triggering the thumbnail, the display is controlled to play the video file, and the video file is played at the starting point of the video frame corresponding to the thumbnail.
- An embodiment of the present application provides a display device.
- i is equal to 1
- the i-th picture is a frame picture of the first frame in the video file.
- An embodiment of the present application provides a display device, and the controller is further configured to:
- a binary search method is used to select N pixels on the i-th picture.
- An embodiment of the present application provides a display device that randomly selects M pixels on the i-th picture.
- the embodiment of the present application provides a display device, a first pixel point, a second pixel point, a third pixel point, a fourth pixel point and a fifth pixel point;
- the first pixel is the pixel corresponding to the center position of the i-th picture
- the second pixel point is the pixel point corresponding to the center position of the first connecting line
- the first connecting line is the connecting line between the center position of the ith picture and the upper left corner of the ith picture
- the third pixel point is the pixel point corresponding to the center position of the second connecting line, and the second connecting line is the connecting line between the center position of the ith picture and the upper right corner of the ith picture;
- the fourth pixel point is the pixel point corresponding to the center position of the third connecting line
- the third connecting line is the connecting line between the center position of the i-th picture and the lower-left corner position of the i-th picture
- the fifth pixel point is a pixel point corresponding to a center position of a fourth connection line
- the fourth connection line is a connection line between the center position of the i-th picture and the lower-right corner position of the i-th picture.
- An embodiment of the present application provides a display device, wherein the i-th picture is a picture of the j-th frame in the video file,
- the embodiment of the present application provides a thumbnail generation method, including:
- the i-th picture is a frame picture in the video file
- i is the number of times the picture is intercepted in the video file during the thumbnail generation process
- i is a positive integer greater than or equal to 1;
- N is a positive integer greater than or equal to 2;
- the ith picture is reduced to obtain a thumbnail of the video file.
- FIG. 23 is a flowchart of interaction between a display device and a user according to an embodiment of the present application.
- the user is used to execute step S51 to trigger the thumbnail generation function.
- the display device may be configured with a thumbnail generating control. After the user selects a video file, the user may generate a thumbnail of the video file by touching the thumbnail generating control. In some feasible embodiments, the user can select multiple video files at the same time, and then the user can generate thumbnails of multiple video files by touching the thumbnail generating control.
- the implementation manner of the user-triggered thumbnail generation function may be, but not limited to, the above-mentioned manner, and the applicant does not limit the process herein.
- the controller is configured to perform step S52 to intercept the i-th picture
- the i-th picture is a frame picture in a video file
- i is the number of times a picture is intercepted in the video file during the thumbnail generation process
- i is a positive integer greater than or equal to 1
- i pictures need to be intercepted, where i is a positive integer greater than or equal to 1.
- the interception process of the i-th picture is described below with reference to a specific example.
- the video frame captured by the controller for the first time is called the first picture
- the video frame captured by the controller for the second time is called the second picture.
- the controller will not intercept the second picture, and if the first picture is a solid color picture, the controller will continue to intercept the second picture.
- the controller is further configured to: in response to a user triggering the thumbnail image, to control the display to play the video file, and the playing process of the video file is based on the corresponding thumbnail image. The start of the video frame is played.
- the picture displayed on the display is jumped from the thumbnail to the frame picture of the video file, because in the technical solution shown in this embodiment, the playback process of the video file starts from the thumbnail image Therefore, the picture seen from the user's point of view is a picture that changes smoothly, and the user experience is better.
- the playback process of the video file starts from the thumbnail image. Therefore, in the process of selecting the i-th picture, the controller selects the picture of the first frame in the video file as 1 picture for the first time, so as to ensure that in the process of playing the video file with the thumbnail as the starting point, any part of the video file will not be missed.
- One frame of picture to enhance the user's viewing experience.
- the controller is configured to perform step S53 to select N pixels on the i-th picture, where N is a positive integer greater than or equal to 2;
- This embodiment does not limit the selection method of N pixels; for example, in some feasible embodiments, the controller may randomly select N pixels on the i-th picture; for another example, in some feasible embodiments , the controller can select N pixels on the i-th picture according to a certain rule.
- the applicant does not make too many limitations here, and the selection process of the N pixel points is described below with reference to specific examples.
- FIG. 24 is a schematic diagram of an i-th picture provided according to an embodiment of the present application. It can be seen that in this embodiment, N is equal to 4, and the controller divides the i-th picture into 5 equal parts in the horizontal direction, and the dividing lines are the first dividing line 61, the second dividing line 62, and the third dividing line 63. , the fourth dividing line 64.
- the four pixel points are the center point 65 of the first dividing line 61, the center point 66 of the second dividing line 62, the center point 67 of the third dividing line 63, and the center of the fourth dividing line 64. point 68.
- FIG. 25 is a schematic diagram of the ith picture provided according to an embodiment of the present application. It can be seen that in this embodiment, N is equal to 3, and the controller divides the i-th picture into 4 equal parts in the horizontal direction, and the dividing lines are the first dividing line 71, the second dividing line 72, and the third dividing line 73. , the three pixel points are respectively the center point 74 of the first dividing line 71 , the center point 75 of the second dividing line 72 , and the center point 76 of the third dividing line 73 .
- FIG. 26 is a schematic diagram of an i-th picture provided according to an embodiment of the present application. It can be seen that in this embodiment, N is equal to 5, and the controller randomly selects 5 pixels on the i-th picture, pixel 81, pixel 82, pixel 83, pixel 84, and pixel 85.
- the controller is further configured to: select N pixels on the i-th picture by using a binary search method. If there are pixels with different color parameters in the ith picture, using the binary search method to select N pixels on the ith picture can find the pixels with different color parameters in a relatively short time.
- FIG. 27 is a schematic diagram of the i-th picture provided according to an embodiment of the present application.
- N is equal to 5
- the 5 pixels are: the first pixel 91, the second pixel 92, the third pixel 93, the fourth pixel 94 and the fifth pixel 95; the first pixel 91, the second pixel 92, the third pixel 93, the fourth pixel 94 and the fifth pixel 95;
- the pixel point is the pixel point corresponding to the center position of the ith picture;
- the second pixel point is the pixel point corresponding to the center position of the first connecting line, and the first connecting line is the center position of the ith picture and the
- the third pixel point is the pixel point corresponding to the center position of the second connection line, and the second connection line is the center position of the i-th picture and the The connection line between the upper left corner of the i-th picture;
- the third pixel point is the
- connection line between the lower left corner positions of the picture; the fifth pixel point is the pixel point corresponding to the center position of the fourth connection line, and the fourth connection line is the center position of the i-th picture and the i-th picture The line between the lower right corner positions.
- this implementation is only an example to introduce an implementation manner of selecting N pixels on the i-th picture by using the binary search method.
- the above selection method does not constitute a limitation.
- other binary search methods can be used to select N pixels on the i-th picture. Again, the applicant does not limit too much.
- the controller is configured to execute step S54 to read the color parameters of the N pixel points respectively.
- the color parameter is a feature value representing the color of the pixel, which may be, but is not limited to, RGB (RED, Green, Blue, color system) value, HSV (Hue, Saturation, Value, color model) value.
- RGB RED, Green, Blue, color system
- HSV Hue, Saturation, Value, color model
- RGB value RGB color mode is a color standard in the industry, which is obtained by changing the three color channels of red (R), green (G), and blue (B) and superimposing them on each other.
- RGB is the color representing the three channels of red, green and blue. This standard includes almost all colors that human vision can perceive, and is one of the most widely used color systems. If the RGB values of the two pixels are the same, it means that the two pixels have the same color.
- HSV is closer to people's perceptual experience of color than RGB. It is very intuitive to express the hue, vividness and lightness and darkness of the color, which is convenient for color contrast. In the HSV color space, it is easier to track objects of a certain color than BGR, and it is often used to segment objects of a specified color.
- Hue Hue, hue
- Saturation saturated, color purity
- Value lightness
- the controller is configured to perform step S55 if there are at least two different color parameters, then reduce the i-th picture to obtain a thumbnail of the video file.
- the controller reduces the ith picture to obtain the thumbnail of the video file.
- the ith picture may be a solid color picture.
- the display device shown in the embodiments of the present application includes a display and a controller.
- the controller is configured to intercept the ith picture of the video file, and then determine whether the ith picture of the screenshot is a solid color picture by judging whether the color parameters of N pixels on the ith picture are equal, and if the ith picture is a solid color picture If it is not a solid color picture, the content displayed by the i-th picture can represent the content corresponding to the video file to a certain extent, so the i-th picture can be used as a thumbnail. It can be seen that the display device shown in this embodiment can avoid the generated thumbnails from being solid-color pictures during the generating process of the thumbnails, and the user experience is better.
- the color parameters of N pixels are the same, M pixels of the picture can be collected again, and then The color parameters of the M pixels are further compared to determine whether the ith picture is a solid color picture.
- FIG. 28 is a flowchart of a method for judging whether the i-th picture is a solid color picture according to an embodiment of the present application.
- the controller is further configured to perform the following steps:
- the number of M and the number of M are not limited in this embodiment, where M may be equal to or not equal to N. However, it is necessary to ensure that the selection method of the M described pixel points is different from the selection method of the N pixel points;
- N pixels adopt the selection method shown in FIG. 27
- M pixels adopt the selection method shown in FIG. 26 or the selection method shown in FIG. 25 .
- the controller reduces the ith picture to obtain the thumbnail of the video file.
- the ith picture may be a solid color picture.
- the sampling interval of the i-th picture is not limited.
- the controller may capture an i-th picture every 10 video frames in the video file.
- the first screenshot controller can capture the first video frame of the video file
- the second screenshot controller can capture the 11th video frame of the video file
- the third screenshot controller can capture the 21st video frame of the video file. frame video frame... .
- the i-th picture in order to ensure that the user does not miss any pictures when watching the video, the i-th picture is to be intercepted in the first few frames of the video file. All are solid-color pictures or there are multiple consecutive frames of solid-color pictures at the beginning of the video. In an application scenario where there are consecutive multiple frames of solid-color pictures at the beginning, in order to quickly find non-solid-color pictures, this embodiment limits the way of intercepting pictures.
- the i-th picture is the j-th frame in the video file. screen;
- the controller may capture the 1st, 2nd, 3rd, 5th, 8th, 13th, and 21st frames respectively as the i-th image.
- the video file is a screen image video
- the screen image video consists of a series of solid-color images. If the video file is a screen image card video, the controller will continue to perform the action of capturing the i-th picture.
- an embodiment of the present application shows a method for intercepting the i-th picture.
- the controller is further configured to perform the following steps:
- the number of times threshold is a set positive integer greater than or equal to 2; the number of times threshold can be set according to actual conditions.
- the number of times threshold may be equal to 10.
- the video file may be a screen card video.
- the i-th picture obtains the thumbnail of the video file.
- a second aspect of the embodiment of the present application shows a thumbnail image generation method, including:
- the i-th picture is a frame picture in the video file
- i is the number of times the picture is intercepted in the video file during the thumbnail generation process
- i is a positive integer greater than or equal to 1;
- N is a positive integer greater than or equal to 2;
- the ith picture is reduced to obtain a thumbnail of the video file.
- the thumbnail image generation method shown in the embodiment of the present application A controller suitable for display devices, the controller is configured to capture the i-th picture of the video file, and then determine whether the i-th picture in this screenshot is a solid color by judging whether the color parameters of N pixels on the i-th picture are equal. Picture, if the ith picture is not a solid color picture, the content displayed by the ith picture can represent the content corresponding to the video file to a certain extent, so the ith picture can be used as a thumbnail. It can be seen that the thumbnail generation method shown in this embodiment can avoid the generated thumbnails from being solid color pictures during the thumbnail generation process, and the user experience is better.
- the display device after the display device is started, it can directly enter the display interface of the last selected signal source, or the signal source selection interface, where the signal source can be a preset video-on-demand program, and can also be an HDMI interface, a live TV interface At least one of etc., after the user selects different signal sources, the display can display the content obtained from the different signal sources. applications in can.
- the VR device system like the Android system, there will be some system notifications that need to pop up on any interface. These notifications include low battery, plug-in peripherals, usage time reminders, insufficient memory, and so on.
- the system notification is to inform the user through the SystemUI pop-up interface.
- the pop-up of the notification must be that the JAR package listens to the Android system notification and reports it to unity (in this embodiment, it can also be called the 3D rendering thread), which is only available in the unity scene. Unity will not be notified until the display is fully loaded.
- an embodiment of the present application provides a display device, including:
- the application is configured to: in response to application startup, traverse the data list; if the data list records a system notification, use the JAR package of the application to retrieve the system notification stored in the data list; if the data list System notifications are not recorded, use the application's JAR package to monitor system notifications;
- the 3D rendering thread is configured to draw a notification interface using the system notification output by the application.
- An embodiment of the present application provides a display device, and the controller is further configured to call a UI thread, and the UI thread is started when the display device is powered on.
- An embodiment of the present application provides a display device, and the UI thread is configured as:
- the received system notification is written into the data list.
- An embodiment of the present application provides a display device, and the UI thread is further configured as:
- the system notification is broadcast.
- An embodiment of the present application provides a display device, and the UI thread is further configured as:
- the repackaged system notification is written into the data list.
- An embodiment of the present application provides a display device, and the application is further configured to:
- the next one of the system notifications is invoked using the JAR package.
- An embodiment of the present application provides a display device, and the application is further configured to:
- the traversal of the data list is terminated, and the JAR package is used to monitor system notifications.
- An embodiment of the present application provides a display device, and the application is further configured to:
- the JAR package In response to the startup of the application, the JAR package is called to register for UI thread broadcast, so that the JAR package receives the system notification broadcast by the UI thread.
- An embodiment of the present application provides a display device, wherein each repackaged system notification includes a type identifier, and the type identifier includes a first type identifier and a second type identifier;
- the application is further configured to: read the type identifier of the system notification;
- the 3D rendering thread is not notified to draw the notified jump control
- the 3D rendering thread is notified to draw the notified jump control.
- the embodiment of the present application provides a method for invoking a system notification, including:
- FIG. 30 is a structural block diagram of a display device according to a feasible embodiment, wherein the display device at least includes a display 3002 and a controller 3001, wherein, A memory 3011 and a processor 3012 are provided in the controller, and the memory 3011 is used for storing files downloaded by the display device.
- a processor for executing operating system and application instructions or threads stored in memory. And according to the received user input instructions, various applications, data and content processing are performed. Specifically applied to the solution shown in this embodiment, the processor may call the application 3121 and the 3D rendering thread 3122 . See Figure 31 for a flowchart of the interaction between the display and the controller.
- the application is configured to perform step S3101 in response to the application being started, calling the JAR package to traverse the data list;
- an application refers to a third-party application installed on a display device, which can provide convenience for a user's life.
- the application may be a video playback application, and the user may use the video playback application to watch videos; in some feasible embodiments, the application may be a chat application, and the user may use the chat application to chat with relatives and friends. It should be noted that this embodiment is only an example to introduce several applications, and in the process of practical application, the applications may be but not limited to the above-mentioned applications.
- the corresponding application When the user needs to use the application, the corresponding application needs to be started.
- This embodiment does not limit the application startup method.
- the corresponding application is started through the touch display.
- the corresponding application is started by touching the keys of the remote control.
- the data list is used to record system notifications, where the system notifications may include low battery, inserted peripherals (TF card, sdcard, etc.), usage duration reminder, insufficient memory, and so on.
- system notifications may include low battery, inserted peripherals (TF card, sdcard, etc.), usage duration reminder, insufficient memory, and so on.
- JAR Java ARchive, Java Archive
- the JAR package can implement the following functions. (1) Used to publish and use data; (2) Used as a building unit for applications and extensions; (3) As a deployment unit of components, APPlets or plug-ins; (4) Used to package auxiliary resources associated with components.
- the JAR package can invoke the system notification in the data list.
- FIG. 32 is a flowchart showing the interaction between the display and the controller according to a feasible embodiment.
- the UI thread is configured to perform step S3211 when starting, register the broadcast of the system, so that the system UI receives the system notification sent by the system;
- the embodiment of the present application shows the UI thread in the solution, which is a main thread (main thread) created when the system is started.
- This main thread is responsible for dispatching events (including drawing events) to UI components, and it is also in this main thread that applications interact with Android's UI components. So the main thread is also called UI thread or UI thread.
- the UI thread is created when the system is started (also called when the display device is started), and when the UI thread is created, the UI thread registers the broadcast of the system.
- This embodiment does not limit the implementation of the broadcast of the UI thread registration system.
- the UI thread can register the broadcast of the system by customizing the dynamic registration broadcast; for another example, in a feasible embodiment
- the UI thread can register the broadcast of the system by statically registering the broadcast.
- step S3212 is executed to write the received system notification into the data list.
- the UI thread can monitor the system notification and write the monitored system notification into the data list in real time.
- Table 1 is a data list according to a feasible embodiment.
- the sequence of the sequence numbers of the system notification may be the time sequence in which the UI thread listens to the system notification.
- the application is configured to perform step S3221 to retrieve the system notification stored in the data list by using the JAR package of the application;
- the application uses the JAR package to retrieve the system notification stored in the data list; wherein, the implementation of the JAR package to retrieve the system notification stored in the data list can adopt the data invocation method commonly used in the art , the applicant does not make too many restrictions here.
- the JAR package can sequentially call the corresponding system notifications according to the sequence of the corresponding serial numbers of the system notifications in the data list. Taking the data shown in Table 1 as an example, the calling sequence of the system notifications is described. .
- the 3D rendering thread of the application in response to the startup of the application, the 3D rendering thread of the application starts to configure the 3D application scene of the application. When the configuration of the 3D application scene is completed, the application calls the JAR package to traverse the data list. In this application, the data list The recorded data can be found in Table 1.
- the JAR package first calls the power system notification corresponding to serial number 1, then calls the system notification for inserting peripheral TF card corresponding to serial number 1, and finally calls the memory insufficient system notification.
- the application is configured to perform step S3222 to monitor the system notification by using the JAR package of the application;
- the application in response to the application being started, the application is configured to call the JAR package to register UI thread broadcast, so that the JAR package receives the system notification broadcast by the UI thread.
- This embodiment does not limit the implementation of the JAR package registration UI thread broadcast.
- the JAR package can register the UI thread broadcast by customizing the dynamic registration broadcast; for another example, in a In a feasible embodiment, the JAR package can register the broadcast of the UI thread by using a static registration broadcast method.
- the JAR package of the APP when the JAR package of the APP receives the system notification sent by the UI thread, it will send the system notification content to Unity by calling the SendeMessage function in UnityPlayer (also called 3D rendering in this implementation). thread).
- the application is configured to perform step S3203 to output the system notification
- the transmission mode of the system notification may adopt the notification transmission mode commonly used in the art, and the applicant does not make too many restrictions here.
- the 3D rendering thread is configured to execute step S3204 to draw a notification interface using the system notification output by the application;
- the 3D rendering thread may be called Unity.
- 3D rendering thread is a real-time 3D interactive content creation and operation platform. Unity can render the application's scene into a 3D effect.
- the 3D rendering thread is configured to perform step S3205 to output the notification interface to the display, so that the display displays the notification interface.
- the technical solution shown in this embodiment utilizes the monitoring system notification in the UI thread of the Android system, and adds the monitored system notification to the data list and saves it in the database.
- the application notifies the 3D rendering thread to render the application scene of the application.
- the application uses the JAR package to read whether there is any system notification in the data list, and if so, notifies the 3D rendering thread to render the system. Notification; if not, use the JAR package to directly monitor the system notification broadcast by the UI thread, and notify the 3D rendering thread to render the system notification when the system notification is monitored.
- the UI thread in the process of rendering the application scene by the 3D rendering thread, can write the system notification into the data list.
- the application can use the JAR to call the 3D rendering thread
- the system notification that writes the data list in the process of rendering the application scene, and uses this to notify the 3D rendering thread to render each system notification.
- the technical solution provided by the embodiment of the present application can well solve the application startup or jump process in the display device. The problem of missing notifications in the system ensures that users will not miss any system notifications, which greatly improves the user experience.
- application A and application B are installed on the display device.
- application A is in the open state
- the display of the display device shows the application scene of application A
- application A calls the JAR package to monitor the system notification broadcast by the UI thread
- application A notifies the 3D rendering thread to render the system Notice.
- the user starts application B.
- the 3D rendering thread starts to construct the application scene of application B.
- the UI thread can write the system notification into data list.
- application B can use JAR to call the system notification written in the data list during the process of rendering the application scene by the 3D rendering thread, and notify the 3D rendering thread to render each system notification.
- Application B completes reading all system notifications in the data list, and application B terminates traversing the data list, and uses the JAR package to monitor system notifications.
- application A is installed on the display device.
- the user starts application A.
- the 3D rendering thread starts to construct the application scene of application A.
- the UI thread can write the system notification into the data list.
- no system notification is written into the data list.
- application A traverses the data list. In this embodiment, there is no record of any system notification in the data list, and application A terminates the traversal of the data list, and uses the JAR package to monitor system notifications.
- the UI thread is further configured to: repackage the monitored system notifications, so that each of the system notifications is configured with A notification ID; write the repackaged system notification into the data list.
- each system notification is configured with a notification ID
- each system notification is configured with a unique notification ID
- the notification ID plays a role of unique identification
- FIG. 33 is a flow chart of an application according to a feasible embodiment.
- the application is further configured as:
- S321 reads the notification ID of the system notification
- Table 3 is a data list shown according to a feasible embodiment
- the JAR package When the JAR package calls the system notification corresponding to sequence number 1, the JAR package directly reads the notification ID corresponding to sequence number 1 as notification ID-1; when the JAR package calls the system notification corresponding to sequence number 2, the JAR package directly reads sequence number 2
- the corresponding notification ID is notification ID-2...
- the JAR package in response to the 3D rendering thread completing the rendering of the notification interface corresponding to the system notification, the JAR package is based on the previously read notification. ID deletes the system notification corresponding to the notification ID, so as to avoid the problem that the system notification is repeatedly called.
- the JAR package when the JAR package calls the system notification corresponding to sequence number 1, the JAR package directly reads the notification ID corresponding to sequence number 1 as notification ID-1; in response to the 3D rendering thread completing the power system The notification corresponds to the rendering of the notification interface, and the JAR package deletes the system notification corresponding to notification ID-1.
- the technical solution shown in this embodiment uses the UI thread to monitor system notifications, and adds the notifications to a data list and saves them in the database.
- the data list stores information such as notification title, notification content, and a unique notification id for each notification.
- the application notifies the 3D rendering thread to render the application scene of the application.
- the application uses the JAR package to read whether there is any system notification in the data list, and if so, notifies the 3D rendering thread to render the system.
- Notification when the system notification is completed, delete the system notification from the data list; if not, use the JAR package to directly monitor the system notification broadcast by the UI thread, and notify the 3D rendering thread to render the system notification when the system notification is monitored.
- the display device shown in the embodiment of the present application can ensure that each system notification is displayed only once, avoiding the problem of repeated display of system notifications.
- the application is further configured to: in response to completing the reading of all the system notifications in the data list, terminate the traversal of the data list, and use the JAR package of the application to monitor the system notifications.
- each repackaged system notification includes a type identifier, and the type identifier includes a first type identifier and a second type identifier; the application is further configured as : read the type identifier of the system notification; if the type identifier is the first type identifier, do not notify the 3D rendering thread to draw the notified jump control; if the type identifier is the second type identifier, notify The 3D rendering thread draws the notification jump control.
- the UI thread configures the non-storage class message with the first type identifier and the storage class message with the second type identifier when repackaging the system notification.
- the non-storage messages are system notifications that do not require user participation, such as power system notifications.
- the storage class message is a system notification that requires user participation, such as a system notification for inserting a USB flash drive.
- the 3D rendering thread is in the process of drawing the notification interface. When you need to draw a jump control.
- a second aspect of the embodiment of the present application shows a method for invoking a system notification, including:
- the system notification calling method shown in this embodiment is applicable to display devices.
- the display device uses the Android system independent thread UI thread to monitor system notifications, and adds the monitored system notifications to the data list.
- the application notifies the 3D rendering thread to render the application scene of the application.
- the application uses the JAR package to read whether there is any system notification in the data list, and if so, notifies the 3D rendering thread to render the system. Notification; if not, use the JAR package to directly monitor the system notification broadcast by the UI thread, and notify the 3D rendering thread to render the system notification when the system notification is monitored.
- the UI thread in the process of rendering the application scene by the 3D rendering thread, can write the system notification into the data list.
- the application can use the JAR to call the 3D rendering thread
- the system notification that writes the data list in the process of rendering the application scene, and uses this to notify the 3D rendering thread to render each system notification.
- the technical solution provided by the embodiment of the present application can well solve the application startup or jump process in the display device. The problem of missing notifications in the system ensures that users will not miss any system notifications, which greatly improves the user experience.
- the present invention also provides a computer-readable non-volatile storage medium, wherein the computer storage medium can store a program, and when the program is executed, it can include the custom method and startup of the control keys provided by the present invention some or all of the steps in various embodiments of the method.
- the storage medium can be a magnetic disk, an optical disc, a read-only memory (English: read-only memory, abbreviated: ROM) or a random access memory (English: random access memory, abbreviated: RAM), etc.
- the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform.
- the technical solutions in the embodiments of the present invention may be embodied in the form of software products in essence or the parts that make contributions to the prior art, and the computer software products may be stored in a storage medium, such as ROM/RAM , magnetic disk, optical disk, etc., including several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform the methods of various embodiments or parts of embodiments of the present invention.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Digital Computer Display Output (AREA)
- Testing And Monitoring For Control Systems (AREA)
Abstract
本申请实施例示出一种显示设备及显示方法。显示设备包括显示器和控制器。显示器用于展示浏览区域和预览区域,浏览区域用于展示浏览文件,预览区域用于展示预览文件。响应于用户点击预览文件的操作,控制器将预览区域展示的文件转换为浏览文件,并显示在浏览区域内。
Description
本申请要求在2021年1月22日提交的、申请号为202110089476.7、发明名称为“一种显示设备及系统通知调用方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中;本申请要求在2021年6月18日提交的、申请号为202110678680.2、发明名称为“一种显示设备及缩略图生成方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中;本申请要求在2021年6月18日提交的、申请号为202110678653.5、发明名称为“一种显示设备及文件展示方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。
本申请涉及文件显示技术领域,尤其是涉及一种显示设备及显示方法。
3D设备可以呈现给用户水平方向360度、垂直方向180度全包围的空间视域,而受到用户的喜爱。近年来,3D设备功能越来越强大,相应的,3D设备可以展示的内容越来越丰富。例如,3D设备可展示放本地内容,本地内容可以包括本地存储的3D图片或本地3D影片;再例如3D设备也可展示网络内容,网络内容可以包括网络3D图片或网络3D影片。
发明内容
本申请实施例第一方面示出一种显示设备,包括:
显示器,用于呈现给用户水平方向360度、垂直方向180度全包围的空间视域,所述空间视域包括浏览区域和预览区域,所述浏览区域为用户可视区域对应的区域,所述浏览区域用于展示浏览文件,所述预览区域为与所述浏览区域接壤的区域,所述预览区域用于展示预览文件;
控制器,被配置为:
响应于用户点击浏览文件的操作,控制浏览区域展示浏览文件包含的内容;
响应于用户点击预览文件的操作,生成第一集合,所述第一集合中包含的文件为被点击的预览文件所在预览页面展示的文件;
控制所述显示器的浏览区域展示所述第一集合包含的文件。
本申请实施例第二方面示出一种显示方法,所述方法适用于显示设备包括:
响应于用户点击浏览文件的操作,控制浏览区域展示浏览文件包含的内容;
响应于用户点击预览文件的操作,生成第一集合,所述第一集合中包含的文件为被点击的预览文件所在预览页面展示的文件;
控制所述显示器的浏览区域展示所述第一集合包含的文件。
为了更清楚地说明本申请实施例或相关技术中的实施方式,下面将对实施例或相关技术描述中所需要使用的附图进行介绍,显而易见地,下面描述中的附图是本申请的一些实 施例,对于本领域普通技术人员来讲,还可以根据这些附图获得其他的附图。
图1示出了根据一些实施例的显示设备的使用场景;
图2示出了根据一些实施例的控制装置100的硬件配置框图;
图3示出了根据一些实施例的显示设备200的硬件配置框图;
图4示出了根据一些实施例的显示设备200中软件配置图;
图5为根据本申请实施例提供的显示设备与用户的交互流程图;
图6为根据本申请实施例提供的空间视域;
图7根据本申请实施例提供的空间视域的示意图;
图8为本申请实施例示出的空间视域的示意图;
图9为本申请实施例示出的用户点击浏览文件前后,空间视域的示意图;
图10为本申请实施例示出的用户点击浏览文件前后,空间视域的示意图;
图11为本申请实施例示出的用户点击预览文件前后,空间视域的示意图;
图12为本申请实施例示出的空间视域的示意图;
图13为本申请实施例示出文件展示方法的流程图;
图14为根据本申请实施例提供的空间视域的示意图;
图15为根据本申请实施例提供的空间视域的示意图;
图16为本申请实施例示出第一集合的生成方法的流程图;
图17为根据本申请实施例提供的空间视域的示意图;
图18为根据本申请实施例提供的空间视域的示意图;
图19为根据本申请实施例提供的空间视域的示意图;
图20为本申请实施例示出的第二子集合的生成方法的流程图;
图21为根据本申请实施例提供的空间视域的示意图;
图22为根据本申请实施例提供的空间视域的示意图;
图23为根据本申请实施例提供的显示设备与用户的交互流程图;
图24为根据本申请实施例提供的第i图片的示意图;
图25为根据本申请实施例提供的第i图片的示意图;
图26为根据本申请实施例提供的第i图片的示意图;
图27为根据本申请实施例提供的第i图片的示意图;
图28为根据本申请实施例示出的判断第i图片是否为纯色图片方法的流程图;
图29为根据本申请实施例示出的截取第i图片方法的流程图;
图30为根据本申请实施例示出的显示设备的结构框图;
图31为根据本申请实施例示出的显示器与控制器的交互流程图;
图32为根据本申请实施例示出的显示器与控制器的交互流程图;
图33为根据本申请实施例示出的应用的作业流程图。
为使本申请的目的和实施方式更加清楚,下面将结合本申请示例性实施例中的附图,对本申请示例性实施方式进行清楚、完整地描述,显然,描述的示例性实施例仅是本申请一部分实施例,而不是全部的实施例。
需要说明的是,本申请中对于术语的简要说明,仅是为了方便理解接下来描述的实施 方式,而不是意图限定本申请的实施方式。除非另有说明,这些术语应当按照其普通和通常的含义理解。
本申请中说明书和权利要求书及上述附图中的术语“第一”、“第二”、“第三”等是用于区别类似或同类的对象或实体,而不必然意味着限定特定的顺序或先后次序,除非另外注明。应该理解这样使用的用语在适当情况下可以互换。
术语“包括”和“具有”以及他们的任何变形,意图在于覆盖但不排他的包含,例如,包含了一系列组件的产品或设备不必限于清楚地列出的所有组件,而是可包括没有清楚地列出的或对于这些产品或设备固有的其它组件。
术语“模块”是指任何已知或后来开发的硬件、软件、固件、人工智能、模糊逻辑或硬件或/和软件代码的组合,能够执行与该元件相关的功能。
图1为根据实施例中显示设备的使用场景的示意图。如图1所示,显示设备200还与服务器400进行数据通信,用户可通过智能设备300或控制装置100操作显示设备200。
在一些实施例中,控制装置100可以是遥控器,遥控器和显示设备的通信包括红外协议通信或蓝牙协议通信,及其他短距离通信方式中的至少一种,通过无线或有线方式来控制显示设备200。用户可以通过遥控器上按键、语音输入、控制面板输入等至少一种输入用户指令,来控制显示设备200。
在一些实施例中,智能设备300可以包括移动终端、平板电脑、计算机、笔记本电脑,AR/VR设备等中的任意一种。
在一些实施例中,也可以使用智能设备300以控制显示设备200。例如,使用在智能设备上运行的应用控制显示设备200。
在一些实施例中,也可以使用智能设备300和显示设备进行数据的通信。
在一些实施例中,显示设备200还可以采用除了控制装置100和智能设备300之外的方式进行控制,例如,可以通过显示设备200设备内部配置的获取语音指令的模块直接接收用户的语音指令控制,也可以通过显示设备200设备外部设置的语音控制装置来接收用户的语音指令控制。
在一些实施例中,显示设备200还与服务器400进行数据通信。可允许显示设备200通过局域网(LAN)、无线局域网(WLAN)和其他网络进行通信连接。服务器400可以向显示设备200提供各种内容和互动。服务器400可以是一个集群,也可以是多个集群,可以包括一类或多类服务器。
在一些实施例中,一个步骤执行主体执行的软件步骤可以随需求迁移到与之进行数据通信的另一步骤执行主体上进行执行。示例性的,服务器执行的软件步骤可以随需求迁移到与之数据通信的显示设备上执行,反之亦然。
图2示例性示出了根据示例性实施例中控制装置100的配置框图。如图2所示,控制装置100包括控制器110、通信接口130、用户输入/输出接口140、存储器、供电电源。控制装置100可接收用户的输入操作指令,且将操作指令转换为显示设备200可识别和响应的指令,起用用户与显示设备200之间交互中介作用。
在一些实施例中,通信接口130用于和外部通信,包含WIFI芯片,蓝牙模块,NFC或可替代模块中的至少一种。
在一些实施例中,用户输入/输出接口140包含麦克风,触摸板,传感器,按键或可替代模块中的至少一种。
图3示出了根据示例性实施例中显示设备200的硬件配置框图。
在一些实施例中,显示设备200包括调谐解调器210、通信器220、检测器230、外部装置接口240、控制器250、显示器260、音频输出接口270、存储器、供电电源、用户接口中的至少一种。
在一些实施例中控制器包括中央处理器,视频处理器,音频处理器,图形处理器,RAM,ROM,用于输入/输出的第一接口至第n接口。
在一些实施例中,显示器260包括用于呈现画面的显示屏组件,以及驱动图像显示的驱动组件,用于接收源自控制器输出的图像信号,进行显示视频内容、图像内容以及菜单操控界面的组件以及用户操控UI界面等。
在一些实施例中,显示器260可为液晶显示器、OLED显示器、以及投影显示器中的至少一种,还可以为一种投影装置和投影屏幕。
在一些实施例中,调谐解调器210通过有线或无线接收方式接收广播电视信号,以及从多个无线或有线广播电视信号中解调出音视频信号,如以及EPG数据信号。
在一些实施例中,通信器220是用于根据各种通信协议类型与外部设备或服务器进行通信的组件。例如:通信器可以包括Wifi模块,蓝牙模块,有线以太网模块等其他网络通信协议芯片或近场通信协议芯片,以及红外接收器中的至少一种。显示设备200可以通过通信器220与控制装置100或服务器400建立控制信号和数据信号的发送和接收。
在一些实施例中,检测器230用于采集外部环境或与外部交互的信号。例如,检测器230包括光接收器,用于采集环境光线强度的传感器;或者,检测器230包括图像采集器,如摄像头,可以用于采集外部环境场景、用户的属性或用户交互手势,再或者,检测器230包括声音采集器,如麦克风等,用于接收外部声音。
在一些实施例中,外部装置接口240可以包括但不限于如下:高清多媒体接口(HDMI)、模拟或数据高清分量输入接口(分量)、复合视频输入接口(CVBS)、USB输入接口(USB)、RGB端口等任一个或多个接口。也可以是上述多个接口形成的复合性的输入/输出接口。
在一些实施例中,控制器250和调谐解调器210可以位于不同的分体设备中,即调谐解调器210也可在控制器250所在的主体设备的外置设备中,如外置机顶盒等。
在一些实施例中,控制器250,通过存储在存储器上中各种软件控制程序,来控制显示设备的工作和响应用户的操作。控制器250控制显示设备200的整体操作。例如:响应于接收到用于选择在显示器260上显示UI对象的用户命令,控制器250便可以执行与由用户命令选择的对象有关的操作。
在一些实施例中,对象可以是可选对象中的任何一个,例如超链接、图标或其他可操作的操作区域。与所选择的对象有关操作有:显示连接到超链接页面、文档、图像等操作,或者执行与图标相对应程序的操作。
在一些实施例中控制器包括中央处理器(Central Processing Unit,CPU),视频处理器,音频处理器,图形处理器(Graphics Processing Unit,GPU),RAM Random Access Memory,RAM),ROM(Read-Only Memory,ROM),用于输入/输出的第一接口至第n接口,通信总线(Bus)等中的至少一种。
CPU处理器。用于执行存储在存储器中操作系统和应用指令,以及根据接收外部输入的各种交互指令,来执行各种应用、数据和内容,以便最终显示和播放各种音视频内容。CPU处理器,可以包括多个处理器。如,包括一个主处理器以及一个或多个子处理器。
在一些实施例中,图形处理器,用于产生各种图形对象,如:图标、操作菜单、以及用户输入指令显示图形等中的至少一种。图形处理器包括运算器,通过接收用户输入各种交互指令进行运算,根据显示属性显示各种对象;还包括渲染器,对基于运算器得到的各种对象,进行渲染,上述渲染后的对象用于显示在显示器上。
在一些实施例中,视频处理器,用于将接收外部视频信号,根据输入信号的标准编解码协议,进行解压缩、解码、缩放、降噪、帧率转换、分辨率转换、图像合成等视频处理中的至少一种,可得到直接可显示设备200上显示或播放的信号。
在一些实施例中,视频处理器,包括解复用模块、视频解码模块、图像合成模块、帧率转换模块、显示格式化模块等中的至少一种。其中,解复用模块,用于对输入音视频数据流进行解复用处理。视频解码模块,用于对解复用后的视频信号进行处理,包括解码和缩放处理等。图像合成模块,如图像合成器,其用于将图形生成器根据用户输入或自身生成的GUI信号,与缩放处理后视频图像进行叠加混合处理,以生成可供显示的图像信号。帧率转换模块,用于对转换输入视频帧率。显示格式化模块,用于将接收帧率转换后视频输出信号,改变信号以符合显示格式的信号,如输出RGB数据信号。
在一些实施例中,音频处理器,用于接收外部的音频信号,根据输入信号的标准编解码协议,进行解压缩和解码,以及降噪、数模转换、和放大处理等处理中的至少一种,得到可以在扬声器中播放的声音信号。
在一些实施例中,用户可在显示器260上显示的图形用户界面(GUI)输入用户命令,则用户输入接口通过图形用户界面(GUI)接收用户输入命令。或者,用户可通过输入特定的声音或手势进行输入用户命令,则用户输入接口通过传感器识别出声音或手势,来接收用户输入命令。
在一些实施例中,“用户界面”,是应用或操作系统与用户之间进行交互和信息交换的介质接口,它实现信息的内部形式与用户可以接受形式之间的转换。用户界面常用的表现形式是图形用户界面(Graphic User Interface,GUI),是指采用图形方式显示的与计算机操作相关的用户界面。它可以是在电子设备的显示屏中显示的一个图标、窗口、操作区域等界面元素,其中操作区域可以包括图标、按钮、菜单、选项卡、文本框、对话框、状态栏、导航栏、Widget等可视的界面元素中的至少一种。
在一些实施例中,用户接口280,为可用于接收控制输入的接口(如:显示设备本体上的实体按键,或其他等)。
在一些实施例中,显示设备的系统可以包括内核(Kernel)、命令解析器(shell)、内容系统和应用。内核、shell和内容系统一起组成了基本的操作系统结构,它们让用户可以管理内容、运行程序并使用系统。上电后,内核启动,激活内核空间,抽象硬件、初始化硬件参数等,运行并维护虚拟内存、调度器、信号及线程间通信(IPC)。内核启动后,再加载Shell和用户应用。应用在启动后被编译成机器码,形成一个线程。
如图4所示,显示设备的系统可以包括内核(Kernel)、命令解析器(shell)、内容系统和应用程序。内核、shell和内容系统一起组成了基本的操作系统结构,它们让用户可以管理内容、运行程序并使用系统。上电后,内核启动,激活内核空间,抽象硬件、初始化硬件参数等,运行并维护虚拟内存、调度器、信号及进程间通信(IPC)。内核启动后,再加载Shell和用户应用程序。应用程序在启动后被编译成机器码,形成一个进程。
如图4所示,将显示设备的系统分为三层,从上至下分别为应用层、中间件层和硬件 层。
应用层主要包含电视上的常用应用,以及应用框架(Application Framework),其中,常用应用主要是基于浏览器Browser开发的应用,例如:HTML5APPs;以及原生应用(Native APPs);
应用框架(Application Framework)是一个完整的程序模型,具备标准应用软件所需的一切基本功能,例如:内容存取、资料交换...,以及这些功能的使用接口(工具栏、状态列、菜单、对话框)。
原生应用(Native APPs)可以支持在线或离线,消息推送或本地资源访问。
中间件层包括各种电视协议、多媒体协议以及系统组件等中间件。中间件可以使用系统软件所提供的基础服务(功能),衔接网络上应用系统的各个部分或不同的应用,能够达到资源共享、功能共享的目的。
硬件层主要包括HAL接口、硬件以及驱动,其中,HAL接口为所有电视芯片对接的统一接口,具体逻辑由各个芯片来实现。驱动主要包含:音频驱动、显示驱动、蓝牙驱动、摄像头驱动、WIFI驱动、USB驱动、HDMI驱动、传感器驱动(如指纹传感器,温度传感器,压力传感器等)、以及电源驱动等。
在一些实施例中,显示设备启动后可以直接进入上次选择的信号源的显示界面,或者信号源选择界面,其中信号源可以是预置的视频点播程序,还可以是HDMI接口,直播电视接口等中的至少一种,用户选择不同的信号源后,显示器可以显示从不同信号源获得的内容。中的应用可以。
显示设备为满足用户对音效的高级体验,支持不同的外部音频输出设备。外部音频输出设备主要有以下几种:Display Speaker(内置扬声器,以下简称Speaker),ARC(Audio Return Channel,声音回传)设备,Bluetooth Device(蓝牙装置,以下简称BT),有线耳机,USB音频设备等。
第一部分:
3D设备可以呈现给用户水平方向360度、垂直方向180度全包围的空间视域,而受到用户的喜爱。近年来,3D设备功能越来越强大,相应的,3D设备可以展示的内容越来越丰富。例如,3D设备可展示放本地内容,本地内容可以包括本地存储的3D图片或本地3D影片;再例如3D设备也可展示网络内容,网络内容可以包括网络3D图片或网络3D影片。为了便于用户在一个页面上了解更多的内容,通常将3D设备可以展示的内容以缩略图的形式展示在浏览页面上,当用户需要对某一个内容进行放大时,用户通过点击该内容对应的缩略图来打开该内容。近年来3D设备可以展示内容的数量越来越多,3D设备通过滚动条展示全部的内容。用户通过滑动滚动条的滑块进行上下翻页,以浏览更多的内容。随着3D设备可以展示内容数量的增多,带来一个问题,用户在寻找自己所需的内容时,需要频繁的进行上下调整进度条的位置,用户体验感较差。
为了解决上述技术问题,本申请实施例提供一种显示设备,显示设备至少包括:显示器和控制器。其中,显示器和控制器的结构和功能可以参阅上述实施例。下面结合具体的附图对显示器和控制器的新添功能作以说明。
图5为根据本申请实施例提供的显示设备与用户的交互流程图。
显示器,用于执行步骤S501呈现给用户空间视域;
本申请中,空间视域为水平方向360度、垂直方向180度全包围的视域。下面结合具体的附图对空间视域进一步说明,图6为根据本申请实施例提供的空间视域;可以看出空间视域包括水平方向360度,垂直方向180度的展示角度。
本申请中,浏览区域为用户可视区域对应的区域,用户可视区域由用户的视野界限决定。通常情况下的视野界限在垂直方向上{50-70度}范围内,视野界限在水平方向上小于180度。因此本实施例中浏览区域要小于空间视域,因此可以将空间视域划分为浏览区域和预览区域,具体的,可以参阅图7,图7根据本申请实施例提供的空间视域的示意图,可以看出空间视域划分为浏览区域71和预览区域72,其中预览区域72位于浏览区域71的左右两侧。值得注意的是,图7仅是示例性的介绍预览区域位于浏览区域的左右两侧的一种示例,在实际应用的过程中本申请并不对预览区域与浏览区域的相对位置和预览区域的数量作以限定,例如在一些可行性实施例中可以空间色域可以包含一个浏览区域和一个预览区域,所述预览区域可以位于所述浏览区域的上方。例如在一些可行性实施例中可以空间色域可以包含一个浏览区域。
为了方便区分浏览区域和预览区域,作为一种可行性实施方式,所述浏览区域的展示样式不同于所述预览区域的展示样式。具体的可以参阅图8;图8为本申请实施例示出的空间视域的示意图,可以看出空间视域划分为浏览区域801和预览区域802,其中,浏览区域801以矩形的形式进行展示,预览区域802以梯形的形式进行展示。值得注意的是,图8仅是示例性的介绍一种预览区域为梯形,浏览区域为矩形的展示形式,上述展示形式并不构成限定,在实际应用的过程中,凡是浏览区域的展示样式不同于所述预览区域的展示样式,可以达到区分浏览区域和预览区域的展示形式均可以应用的本申请中。
本申请中,所述浏览区域用于展示浏览文件,所述预览区域用于展示预览文件;
本申请中,在展示浏览文件时,需要对浏览文件进行加载,以保证用户点击浏览文件的操作,控制器可以控制浏览区域展示浏览文件包含的内容。在一些可行性实施例中,在展示预览文件时,可以加载预览文件。为了提升显示设备的响应速率,在一些可行性实施例中,在展示预览文件时,无需对预览文件进行加载,在预览区域内可以展示预览文件的缩略图或图标。
控制器,被配置为执行步骤S502响应于用户点击浏览文件的操作,控制浏览区域展示浏览文件包含的内容;
本申请中,浏览文件可以是文件夹形式的文件,也可以是一个独立的文件,例如音频文件,视频文件,图片文件等。浏览文件为文件夹形式的文件时,响应于用户点击浏览文件的操作,在浏览区域展示文件夹中包含的文件。浏览文件为独立文件时,响应于用户点击浏览文件的操作,在浏览区域展示该文件。下面结合具体的附图对浏览区域展示浏览文件包含的内容的过程作以说明。
图9为本申请实施例示出的用户点击浏览文件前后,空间视域的示意图。初始时空间视域可以参阅图9中的(91),浏览区域展示10个浏览文件,分别文件浏览文件911、912……920。本实施例中,用户点击浏览文件912。浏览文件912为文件夹,包含6个视 频文件分别为视频1,2,3,4,5,6,此时,空间视域可以参阅图9中的(92)。
图10为本申请实施例示出的用户点击浏览文件前后,空间视域的示意图。初始时空间视域可以参阅图10中的(101),浏览区域展示10个浏览文件,分别文件浏览文件1011、1012……1020。本实施例中,用户点击浏览文件1012。浏览文件1012为图片格式的文件,响应于用于点击浏览文件1012,空间视域可以参阅图10中的(102),浏览区域以全屏的形式展示图片1020。
控制器,被配置为执行步骤S503响应于用户点击预览文件的操作,生成第一集合,所述第一集合中包含的文件为被点击的预览文件所在预览页面展示的文件;
响应于用户点击预览文件的操作,控制器将加载被点击的预览文件所在预览页面展示的文件,得到第一集合。举例说明,在本申请实施例中,被点击的预览文件所在预览页面展示的文件包括文件1,文件2及文件3。那么生成的第一集合中包含文件1,文件2及文件3。
控制器,被配置为执行步骤S504控制所述显示器的浏览区域展示所述第一集合包含的文件。
下面结合具体的附图对预览区域展示的内容的过程作以说明;图11为本申请实施例示出的用户点击预览文件前后,空间视域的示意图。初始时空间视域可以参阅图11中的(111),预览区域展示4个浏览文件,分别文件预览文件1111、1112、1113及1114。本实施例中,用户点击预览文件1112。响应于用于点击预览文件1112,控制器生成的第一集合中包括浏览文件1111、1112、1113及1114。控制器控制浏览区域展示浏览文件1111、1112、1113及1114,此时空间视域可以参阅图11中的(112)。
显示器用于展示浏览区域和预览区域,浏览区域用于展示浏览文件,预览区域用于展示预览文件。响应于用户点击预览文件的操作,控制器将预览区域展示的文件转换为浏览文件,并显示在浏览区域内。进而实现页面的切换过程。可见本申请实施例示出的技术方案在翻页的过程中,用户仅需点击预览文件便可以实现页面的切换,用户体验感较好。
为了方便区分浏览文件和预览文件,作为一种可行性实施方式,所述浏览文件的展示样式可以不同于所述预览文件的展示样式。具体的可以参阅图12;图12为本申请实施例示出的空间视域的示意图,可以看出空间视域划分为浏览区域121和预览区域122,其中,浏览区域展示的浏览文件大于预览区域122展示的预览文件。值得注意的是,图12仅是示例性的介绍一种浏览文件大于预览文件的展示形式,上述展示形式并不构成限定,在实际应用的过程中,凡是浏览文件的展示样式不同于所述预览文件的展示样式,可以达到区分浏览文件和预览区域的展示形式均可以应用的本申请中,例如,可以对预览文件进行虚化处理。
在一些应用场景下,浏览区域可以容纳下全部的文件,在此情况下,显示器无需显示预览区域,以提升显示设备的响应速率。下面结合具体的附图对显示设备的作业过程作以说明。
图13为本申请实施例示出文件展示方法的流程图,在上述实施例示出的显示设备的基础上所述控制器被进一步配置为:
S131响应于用户启动文件管理器的动作,读取第一数量。
本申请中,所述第一数量为需要展示文件的数量,每个所述文件对应一个序列号;所 述序列可以为文件在文件管理器中的序号。
S132判断所述第一文件数量是否小于或等于第二文件数量;
本申请中,所述第二文件数量为所述浏览区域能够展示文件的数量;举例说明,在本申请实施例中浏览区域能够展示文件的数量为10,相应的,第二文件数量等于10。
S133如果所述第一文件数量小于或等于第二文件数量,则控制所述浏览区域展示全部文件;
S134如果所述第一文件数量大于第二文件数量,控制所述浏览区域展示第一集合中的文件,控制所述预览区域展示第二集合中的文件。
所述第一集合包括至少一个浏览文件,所述浏览文件为序列号为1到序列号为N的文件,N为第二文件数量,所述第二集合包括至少一个预览文件,所述预览文件为与所述浏览文件临近为文件。
本申请中,与所述浏览文件临近为文件可以包括序列号位于所述浏览文件序列号之前的文件,也可以包括序列号位于浏览文件序列号之后的文件,具体的,预览文件的数量由预览区域所能容纳的文件决定。举例说明,在本申请实施例中,文件管理器包含的文件为20个,分别为:文件1,文件2……文件20,浏览文件可以展示的文件为5个,则N等于5,首次开启文件管理器时,控制器生成的第一集合中包含文件1、文件2……文件,5。预览区域可以展示5个文件,第二集合中包含的文件为文件6、文件7……文件10。
本申请中,浏览区域展示文件的数量与预览区域展示文件的数量可以不同。在一些可行性实施例中,为了降低处理器的计算量浏览区域展示文件的数量与预览区域展示文件的数量可以相同。
下面结合具体的附图对浏览文件以及预览文件的展示效果作以说明。
图14为根据本申请实施例提供的空间视域的示意图。本实施例中,文件管理器包含的文件为4个(第一文件数量),浏览文件可以展示的文件为10个文件(第二文件数量),第一文件数量小于第二文件数量,因此,控制器仅绘制浏览区域,并将4个文件均展示在浏览区域内,此时的空间视域可以参阅图14。
图15为根据本申请实施例提供的空间视域的示意图。本实施例中,文件管理器包含的文件为14个(第一文件数量),浏览文件可以展示的文件为10个文件(第二文件数量),第一文件数量大于第二文件数量,因此,控制器仅绘制浏览区域和预览区域,并将10个浏览文件展示在浏览区域内,将4个预览文件展示在预览区域内,此时的空间视域可以参阅图15。
为了实现上述效果,本实施例还示出一种第一集合的生成方法,具体的可以参阅图16,图16为本申请实施例示出第一集合的生成方法的流程图,在上述实施例示出的显示设备的基础上所述控制器被进一步配置为:响应于用户点击预览文件的操作,所述控制器还配置为:
S161读取第一页码值C1,所述第一页码值为被点击的所述预览文件对应的页码;
本实施例适用的技术方案中,预览区域可以展示的文件数量等于浏览区域可以展示的文件数量。因此打开文件管理器时,可以将全部的文件按照预览区域可以展示的文件数量将全部文件划分为N组,每组文件对应的页码值已经是一个定值。举例说明,在本申请实施例中文件管理器包含25个文件,预览区域可以展示的文件数量为5,在此情况下,控制器可以将25个文件划分为5组,其中文件1~文件5为第一组文件,第一组文件的页面值 为1;文件6~文件10为第二组文件,第二组文件的页面值为2;文件11~文件15为第三组文件,第三组文件的页面值为3;文件16~文件20为第四组文件,第四组文件的页面值为4;文件21~文件25为第五组文件,第五组文件的页面值为5。
S162判断所述第一页码值是否大于1;
S163如果所述第一页码值大于1,则控制所述显示器的第一子预览区域展示第一子集合,所述第一子集合包含序列号为{(C1-2)*N+1,(C1-1)-1}*N}对应的文件,所述第一子预览区域位于所述浏览区域的一侧。
举例说明,在本申请实施例中文件管理器包含8个文件,预览区域可以展示的文件数量为4,第一页码值为2,第一子集合中包含{文件1~文件4},此时空间视域可以参阅图17。
如果所述第一页码等于1,S164控制所述浏览区域展示第一集合,不显示第一子预览区域。
举例说明,在本申请实施例中文件管理器包含4个文件,预览区域可以展示的文件数量为4,第一页码值为1,此时空间视域可以参阅图18。
请继续参阅图16,所述控制器还被配置为执行步骤S165判断所述第一页码值是否小于总页码值;
如果所述第一页码值等于总页码值,控制器还被配置为执行步骤S166控制所述显示器不显示第二子预览区域。
具体的,空间视域展示效果可以参阅图18。
本申请中,所述第二子预览区域位于所述另一侧,所述第二子预览区域和所述第一子预览区域位于所述浏览区域不同的两侧。
本申请中,不同的两侧可以是相对的两侧,例如,左侧和右侧。也可以是临近的两侧,例如上面和右侧。
请继续参阅图16如果所述第一页码值小于总页码数,所述控制器还被配置为执行步骤S166生成第二子集合,所述第二子集合包括序列号为{C1*N+1,终止序列号}对应的文件,所述终止序列号由所述第一页码值和所述第一数量决定;
举例说明,在本申请实施例中文件管理器包含12个文件,预览区域可以展示的文件数量为4,第一页码值为2,第一子集合中包含{文件1~文件4},第一集合中包含{文件5~文件8},第二子集合中包含{文件9~文件12},此时空间视域可以参阅图19。
控制器执行步骤S167控制所述显示器的第二子预览区域展示第二子集合包含的文件。
本实施例示出一种第二子集合的生成方法,具体的可以参阅图20,在上述实施例示出的显示设备的基础上所述控制器被进一步配置为:
S201判断C1*(N+1)是否大于或等于第一数量;
S202如果C1*(N+1)大于或等于第一数量,终止序列号等于C1*(N+1)。
S203如果C1*(N+1)小于第一数量,则终止序列号等于第一数量;
举例说明,在本申请实施例中文件管理器包含23个文件,预览区域可以展示的文件数量为4,第一页码值为5,C1*(N+1)=4*(5+1)大于23,第一子集合中包含{文件13~文件15},第一集合中包含{文件16~文件20},第二子集合中包含{文件21~文件23},此时空间视域可以参阅图21。
举例说明,在本申请实施例中文件管理器包含25个文件,预览区域可以展示的文件 数量为4,第一页码值为5,C1*(N+1)=4*(5+1)小于25,第一子集合中包含{文件13~文件15},第一集合中包含{文件16~文件20},第二子集合中包含{文件21~文件24},此时空间视域可以参阅图22。
本申请实施例第二方面提供一种文件展示方法,所述方法适用于显示设备,包括:
响应于用户点击浏览文件的操作,控制浏览区域展示浏览文件包含的内容;
响应于用户点击预览文件的操作,生成第一集合,所述第一集合中包含的文件为被点击的预览文件所在预览页面展示的文件;
控制所述显示器的浏览区域展示所述第一集合包含的文件。
本申请实施例示出的文件展示方法,响应于用户点击预览文件的操作,控制器将预览区域展示的文件转换为浏览文件,并显示在浏览区域内,进而实现页面的切换过程。可见本申请实施例示出的技术方案在翻页的过程中,用户仅需点击预览文件便可以实现页面的切换,用户体验感较好。
第二部分:
在显示设备上显示文件时如果只显示文件类型与名称,给用户带来很多不方便。尤其是对于图片类型视频类型的文件,如果只显示文件的名称,不能帮助用户识别出每个图片内容。显示设备可以以图片形式展示图片类型的文件。以图片形式展示图片类型文件的实现方式一般有两种:一种是将原图缩小后显示,该方法会占用大量的内存资源;另一种方式是分别将用户打开的文件夹中包含的图片生成一个缩略图,显示缩略图。视频类型的文件在制作的过程中,常涉及到场景的转换,通常为了提升用户的观影效果,在转换场景的两针画面之间插入纯色图片。这就可能导致截取的视频类型文件的缩略图为纯色图片,用户体验感较差。
为了解决上述技术问题,本申请实施例提供一种显示设备,显示设备至少包括:显示器和控制器。其中,显示器和控制器的结构和功能可以参阅上述实施例。下面结合具体的附图对显示器和控制器的新添功能作以说明。
本申请实施例提供一种显示设备,包括:
显示器;
控制器,被配置为:
截取第i图片,所述第i图片为视频文件中的帧画面,i为在缩略图生成过程中在所述视频文件中截取图片的次数,i为正整数,大于或等于1;
在所述第i图片上选取N个像素点,所述N为正整数,大于或等于2;
分别读取N个像素点的颜色参数,所述颜色参数为表征所述像素点颜色的特征值;
如果存在至少2个所述颜色参数不同,则缩小所述第i图片得到所述视频文件的缩略图。
本申请实施例提供一种显示设备,包括:所述控制器还被配置为:
如果N个所述颜色参数均相同,在所述第i图片上选取M个像素点,所述M为正整数,大于或等于2,M个所述像素点的选取方式不同于N个像素点的选取方式;
分别读取M个像素点的颜色参数;
如果M个所述颜色参数均相同,则截取第i图片。
本申请实施例提供一种显示设备,如果M个所述颜色参数均相同,所述控制器还被配置为:
判断所述i是否等于次数阈值,所述次数阈值一个设定的正整数,大于或等于2;
如果i小于次数阈值,则截取第i图片;
如果i等于次数阈值,则缩小所述第i图片得到所述视频文件的缩略图。
本申请实施例提供一种显示设备,所述控制器还被配置为:
响应于用户对所述缩略图的触发,控制所述显示器播放所述视频文件,所述视频文件的播放过程以缩略图对应的视频帧起点进行播放。
本申请实施例提供一种显示设备,当i等于1时,所述第i图片为所述视频文件中第一帧的帧画面。
本申请实施例提供一种显示设备,所述控制器被进一步配置为:
采用二分查找法在所述第i图片上选取N个像素点。
本申请实施例提供一种显示设备,随机在所述第i图片上选取M个像素点。
本申请实施例提供一种显示设备,第一像素点,第二像素点,第三像素点,第四像素点和第五像素点;
所述第一像素点为第i图片的中心位置对应的像素点;
所述第二像素点为第一连接线中心位置对应的像素点,所述第一连接线为所述第i图片的中心位置与所述第i图片的左上角位置之间的连线;
所述第三像素点为第二连接线中心位置对应的像素点,所述第二连接线为所述第i图片的中心位置与所述第i图片的右上角位置之间的连线;
所述第四像素点为第三连接线中心位置对应的像素点,所述第三连接线为所述第i图片的中心位置与所述第i图片的左下角位置之间的连线;
所述第五像素点为第四连接线中心位置对应的像素点,所述第四连接线为所述第i图片的中心位置与所述第i图片的右下角位置之间的连线。
本申请实施例提供一种显示设备,所述第i图片为所述视频文件中第j帧的画面,
当i=1时,j=1;
当i=2时,j=2;
当i>2时,j=(i-1)+(i-2)。
本申请实施例提供一种缩略图生成法,包括:
截取第i图片,所述第i图片为视频文件中的帧画面,i为在缩略图生成过程中在所述视频文件中截取图片的次数,i为正整数,大于或等于1;
在所述第i图片上选取N个像素点,所述N为正整数,大于或等于2;
分别读取N个像素点的颜色参数,所述颜色参数为表征所述像素点颜色的特征值;
如果存在至少2个所述颜色参数不同,则缩小所述第i图片得到所述视频文件的缩略图。
图23为根据本申请实施例提供的显示设备与用户的交互流程图。
用户用于执行步骤S51触发缩略图生成功能。
用户触发缩略图生成功能的实现方式有多种。作为一种可行性实施例,显示设备可以配置有缩略图生成控件,当用户选中一个视频文件后,用户可以通过触控缩略图生成控件的方式生成该视频文件的缩略图。在一些可行性实施例中,用户可以同时选中多个视频文件,然后用户可以通过触控缩略图生成控件的方式生成多个视频文件的缩略图。在实际应用的过程中用户触发缩略图生成功能的实现方式可以是但不限于上述一种方式,在此申请人不做过程的限定。
控制器被配置为执行步骤S52截取第i图片;
本申请中,所述第i图片为视频文件中的帧画面,i为在缩略图生成过程中,在所述视频文件中截取图片的次数,i为正整数,大于或等于1;
本申请中,控制器在截取视频帧画面时,可能截取到纯色图片。在这种情况下,控制器需要再次截取视频帧。因此,本实施例涉及的方案中需要截取i个图片,i为正整数,大于或等于1。下面结合具体的实例对第i图片的截取过程作以说明。
控制器首次截取的视频帧称之为第1图片,控制器第二次截取的视频帧称之为第2图片……。本申请中,如果控制器第1图片不是纯色图片,则控制器不再截取第2图片,如果第1图片是纯色图片,则控制器继续截取第2图片。
为了保证在视频文件播放的过程中,在用户观看的角度显示器展示的画面由缩略图平稳的过度到视频文件。在一些可行性实施例中,所述控制器还被配置为:响应于用户对所述缩略图的触发,控制所述显示器播放所述视频文件,所述视频文件的播放过程以缩略图对应的视频帧起点进行播放。
本实施例示出的方案,在视频文件播放的过程中,显示器展示的画面由缩略图跳转为视频文件的帧画面,由于本实施例示出技术方案中,视频文件的播放过程以缩略图为起点进行播放,因此在用户的角度看到的画面是平稳变化的画面,用户体验感较好。
进一步的,由于本实施例示出的技术方案中视频文件的播放过程以缩略图为起点进行播放。因此在第i图片选取的过程中,控制器首次选取述视频文件中第一帧的画面作为1图片,以保证在以缩略图为起点进行视频文件播放的过程中,不会遗漏视频文件的任何一帧画面,提升用户观影体验感。
控制器被配置为执行步骤S53在所述第i图片上选取N个像素点,所述N为正整数,大于或等于2;
本实施例对N个像素点的选取方式不做限定;例如,在一些可行性实施例中,控制器可以随机的在第i图片上选取N个像素点;再例如,在一些可行性实施例中,控制器可以按照一定的规律在第i图片上选取N个像素点。在此申请人不做过多的限定,下面结合具体的实例对N个像素点的选取过程作以说明。
图24为根据本申请实施例提供的第i图片的示意图。可以看出,本实施例中N等于4,控制器在横向方向上将第i图片平均划分为5等分,分割线分别为第一分割线61,第二分割线62,第三分割线63,第四分割线64。4个像素点分别为第一分割线61的中心点65,第二分割线62的中心点66,第三分割线63的中心点67,第四分割线64的中心点68。
图25为根据本申请实施例提供的第i图片的示意图。可以看出,本实施例中N等于3, 控制器在横向方向上将第i图片平均划分为4等分,分割线分别为第一分割线71,第二分割线72,第三分割线73,3个像素点分别为第一分割线71的中心点74,第二分割线72的中心点75,第三分割线73的中心点76。
图26为根据本申请实施例提供的第i图片的示意图。可以看出,本实施例中N等于5,控制器随机在第i图片上选取5个像素点,像素点81,像素点82,像素点83,像素点84,像素点85。
可选择的在一些可行性实施例中,所述控制器被进一步配置为:采用二分查找法在所述第i图片上选取N个像素点。如果第i图片存在颜色参数不同的像素点,采用二分查找法在所述第i图片上选取N个像素点可以在较短的时间内找到颜色参数不同的像素点。
下面结合具体的附图采用二分查找法在所述第i图片上选取N个像素点的实现方式作以说明。图27为根据本申请实施例提供的第i图片的示意图。本实施例中,N等于5,5个像素点分别为:第一像素点91,第二像素点92,第三像素点93,第四像素点94和第五像素点95;所述第一像素点为第i图片的中心位置对应的像素点;所述第二像素点为第一连接线中心位置对应的像素点,所述第一连接线为所述第i图片的中心位置与所述第i图片的左上角位置之间的连线;所述第三像素点为第二连接线中心位置对应的像素点,所述第二连接线为所述第i图片的中心位置与所述第i图片的右上角位置之间的连线;所述第四像素点为第三连接线中心位置对应的像素点,所述第三连接线为所述第i图片的中心位置与所述第i图片的左下角位置之间的连线;所述第五像素点为第四连接线中心位置对应的像素点,所述第四连接线为所述第i图片的中心位置与所述第i图片的右下角位置之间的连线。
值得注意的是,本实施仅是示例性的介绍一种采用二分查找法在所述第i图片上选取N个像素点的实现方式。上述选取方式并不构成限定,在实际应用的过程中可以采用其他的二分查找法在所述第i图片上选取N个像素点再次申请人不做过多的限定。
控制器被配置为执行步骤S54分别读取N个像素点的颜色参数。
本申请中,所述颜色参数为表征所述像素点颜色的特征值,可以为但不限于RGB(RED,Green,Blue,颜色系统)值,HSV(Hue,Saturation,Value,颜色模型)值。
其中,RGB值,RGB色彩模式是工业界的一种颜色标准,是通过对红(R)、绿(G)、蓝(B)三个颜色通道的变化以及它们相互之间的叠加来得到各式各样的颜色的,RGB即是代表红、绿、蓝三个通道的颜色,这个标准几乎包括了人类视力所能感知的所有颜色,是运用最广的颜色系统之一。如果两个像素点的RGB值相同,则正明两个像素点具有相同的颜色。
HSV它比RGB更接近人们对彩色的感知经验。非常直观地表达颜色的色调、鲜艳程度和明暗程度,方便进行颜色的对比。在HSV颜色空间下,比BGR更容易跟踪某种颜色的物体,常用于分割指定颜色的物体。HSV表达彩色图像的方式由三个部分组成:Hue(色调、色相);Saturation(饱和度、色彩纯净度);Value(明度)。如果两个像素点的HSV值相同,则正明两个像素点具有相同的颜色。
控制器被配置为执行步骤S55如果存在至少2个所述颜色参数不同,则缩小所述第i图片得到所述视频文件的缩略图。
本申请中,如果N个像素点的颜色参数中,存在至少2个所述颜色参数不同,则证明第i图片中至少两个像素点的颜色不同,进一步可以证明该第i图片不是纯色图片。对于不是纯色图片的第i图片,控制器缩小所述第i图片得到所述视频文件的缩略图。
本申请中,如果N个像素点的颜色参数均相同,则证明第i图片N个像素点的颜色相同,进一步可以证明该第i图片可能是纯色图片。
本申请实施例示出的显示设备包括显示器和控制器。其中,控制器被配置为截取视频文件的第i图片,然后通过判断第i图片上N个像素点的颜色参数是否相等的方式确定此次截图的第i图片是否为纯色图片,如果第i图片不是纯色图片,则第i图片展示的内容可以在一定程度上表示视频文件对应的内容,因此可以将该第i图片作为缩略图。可见,本实施例示出的显示设备在缩略图的生成过程中可以避免生成的缩略图为纯色图片,用户体验感较好。
为了保证本实施例对第i图片是否为纯色图片判断结果的准确性,在本申请实施例中,如果N个像素点的颜色参数均相同,可以再一次采集该图片的M个像素点,然后对M个像素点的颜色参数进一步比对以此来确定第i图片是否为纯色图片。
下面结合具体的附图对判断第i图片是否为纯色图片的实现过程作以说明。图28为根据本申请实施例示出的判断第i图片是否为纯色图片方法的流程图,在上述实施例示出的显示设备的基础上,控制器被进一步配置为执行以下步骤:
S101如果N个所述颜色参数均相同,在所述第i图片上选取M个像素点,所述M为正整数,大于或等于2。
本申请中,本实施例中并不对M的数量和M的数量作以限定,其中,M可以等于N也可以不等于N。但是,要保证M个所述像素点的选取方式不同于N个像素点的选取方式;
举例说明,如果N个像素点采用的是图27示出的选取方式,那么如果M个像素点可以采用图26示出的选取方式或图25示出的选取方式。
如果N个像素点采用的是图26示出的选取方式,那么如果M个像素点可以采用图27示出的选取方式或图25示出的选取方式。
值得注意的是本申请实施例中仅是示例性的介绍了几种像素点的选取方式,上述选取方式并不构成限定,在实际应用的过程中可以根据需求采取相应的像素点选取方式,在此申请人不做过多的限定。
S102分别读取M个像素点的颜色参数;
读取M个像素点的颜色参数的实现方式可以参阅上述实施例,在此申请人不再赘述。
S103如果M个所述颜色参数均相同,则截取第i图片。
本申请中,如果M个像素点的颜色参数中,存在至少2个所述颜色参数不同,则证明第i图片中至少两个像素点的颜色不同,进一步可以证明该第i图片不是纯色图片。对于不是纯色图片的第i图片,控制器缩小所述第i图片得到所述视频文件的缩略图。
本申请中,如果M个像素点的颜色参数均相同,则证明第i图片M个像素点的颜色相同,进一步可以证明该第i图片可能是纯色图片。
本实施例,并不对第i图片的采样间隔作以限定。例如作为一种可行性实施例,控制器可以在视频文件中每间隔10帧视频帧采集一个第i图片。举例说明,第一次截图控制器 可以截取视频文件的第1帧视频帧,第二次截图控制器可以截取视频文件的第11帧视频帧,第三次截图控制器可以截取视频文件的第21帧视频帧……。
本申请实施例示出的技术方案,为了保证用户观看视频时,尽量不错过任何画面,因此在前几次截取第i图片是尽量在视频文件的前几帧进行图片的截取,如果连续截取的图片均为纯色图片或视频的开头有连续多帧纯色图片。在开头有连续多帧纯色图片的应用场景下,为了快速找到非纯色图片,本实施例对图片的截取方式作以限定,具体的,所述第i图片为所述视频文件中第j帧的画面;
当i=1时,j=1;
当i=2时,j=2;
当i>2时,j=(i-1)+(i-2);
举例说明,控制器可以分别截取第1、2、3、5、8、13、21帧画面作为第i图像。
在一些应用场景下,视频文件为屏幕图卡视频,屏幕图卡视频由一系列纯色的图像组成。如果视频文件为屏幕图卡视频那么控制器将持续执行截取第i图片的动作。为了避免上述问题的出现,本申请实施例示出一种第i图片的截取方法。
图29为根据本申请实施例示出的截取第i图片方法的流程图,在上述实施例示出的显示设备的基础上,控制器被进一步配置为执行以下步骤:
S111判断所述i是否等于次数阈值;
本实施例中,所述次数阈值一个设定的正整数,大于或等于2;次数阈值可以根据实际情况设定。例如,在本申请实施例中次数阈值可以等于10。
本实施例中,控制器每次确定第i图片是纯色图片之后均会判断所述i是否等于次数阈值。
S112如果i小于次数阈值,则截取第i图片;
S113如果i等于次数阈值,则缩小所述第i图片得到所述视频文件的缩略图。
本申请中,如果在视频文件中i次截取的图片均为纯色图片,则证明该视频文件可能为屏幕图卡视频,在此情况下,当确定成第i图片为纯色图片时,控制缩小所述第i图片得到所述视频文件的缩略图。
本申请实施例第二方面示出一种缩略图生成法,包括:
截取第i图片,所述第i图片为视频文件中的帧画面,i为在缩略图生成过程中在所述视频文件中截取图片的次数,i为正整数,大于或等于1;
在所述第i图片上选取N个像素点,所述N为正整数,大于或等于2;
分别读取N个像素点的颜色参数,所述颜色参数为表征所述像素点颜色的特征值;
如果存在至少2个所述颜色参数不同,则缩小所述第i图片得到所述视频文件的缩略图。
本申请实施例示出的缩略图生成法。适用于显示设备的控制器,控制器被配置为截取视频文件的第i图片,然后通过判断第i图片上N个像素点的颜色参数是否相等的方式确定此次截图的第i图片是否为纯色图片,如果第i图片不是纯色图片,则第i图片展示的内容可以在一定程度上表示视频文件对应的内容,因此可以将该第i图片作为缩略图。可见,本实施例示出的缩略图生成法在缩略图的生成过程中可以避免生成的缩略图为纯色图片,用户体验感较好。
第三部分:
在一些实施例中,显示设备启动后可以直接进入上次选择的信号源的显示界面,或者信号源选择界面,其中信号源可以是预置的视频点播程序,还可以是HDMI接口,直播电视接口等中的至少一种,用户选择不同的信号源后,显示器可以显示从不同信号源获得的内容。中的应用可以。
但是在VR设备系统开发时,像安卓系统一样会有一些系统通知在任何界面都需要弹出,这些通知包括低电量、插入外设、使用时长提醒、内存不足等等。系统通知是通过SystemUI弹出界面告知用户,通知的弹出肯定是JAR包监听到安卓系统通知然后上报给unity(在本实施例中也可称之为3D渲染线程),这也就是只能在unity场景完全加载显示后,unity才会收到通知。当两个APP跳转之间(unity开发的APP由于有3D场景往往启动比较慢,有的加载空隙为几秒),这时如果正好有通知发出,由于旧的场景在销毁,新的APP的场景还未创建完成,并且新的应用的JAR包未启动完成,肯定也无法完成广播的注册。这时系统发出的通知,unity界面收不到,用户也就不到相应的通知,造成通知的遗漏。这是一个功能缺陷,使得用户会遗漏重要通知,极大地影响用户体验,比如如果正好弹出的是内存不足提示用户去清理内存的通知,unity收不到用户也就看不到,导致用户并不知道内存已经不足,但是内存不足后系统会卡顿,用户还不知道原因,将导致用户的使用体验极差,又或者是低电提醒通知,用户看不到提醒,在大多数应用中没有状态栏,那用户不知电量已经低了,继续使用可能很快VR设备就会关机,极大地影响了用户体验。
为了解决现有技术存在的问题,本申请实施例提供一种显示设备,包括:
显示器;
控制器,用于调用已安装的应用和3D渲染线程
所述应用被配置为:响应于应用的启动,遍历所述数据列表;如果所述数据列表记录有系统通知,利用应用的JAR包调取存储在数据列表内的系统通知;如果所述数据列表未记录有系统通知,利用应用的JAR包监听系统通知;
所述3D渲染线程被配置为:利用所述应用输出的系统通知绘制通知界面。
本申请实施例提供一种显示设备,所述控制器还用于调用UI线程,所述UI线程在所述显示设备开机时启动。
本申请实施例提供一种显示设备,所述UI线程被配置为:
所述显示设备启动时,注册系统的广播,以使得所述系统UI接收所述系统发送的系统通知;
每次接收到所述系统通知,将接收到的所述系统通知写入所述数据列表内。
本申请实施例提供一种显示设备,所述UI线程还被配置为:
每次接收到所述系统通知,广播所述系统通知。
本申请实施例提供一种显示设备,所述UI线程被进一步配置为:
将监听到的系统通知重新封装,以使得每个所述系统通知配置一个通知ID;
将重新封装的所述系统通知写入所述数据列表内。
本申请实施例提供一种显示设备,所述应用被进一步配置为:
读取所述系统通知的通知ID;
响应于所述3D渲染线程完成所述系统通知对应通知界面的渲染,在所述数据列表内删除所述通知ID对应的系统通知;
响应于完成一个系统通知的删除,利用所述JAR包调取下一个所述系统通知。
本申请实施例提供一种显示设备,所述应用还被配置为:
响应于完成所述数据列表内全部系统通知的读取,终止遍历所述数据列表,利用所述JAR包监听系统通知。
本申请实施例提供一种显示设备,所述应用还被配置为:
响应于所述应用的启动,调用JAR包注册UI线程广播,以使得所述JAR包接收UI线程广播的系统通知。
本申请实施例提供一种显示设备,每个重新封装后的所述系统通知包括类型标识,所述类型标识包括第一类型标识和第二类型标识;
所述应用还被配置为:读取所述系统通知的类型标识;
如果所述类型标识为第一类型标识,不通知所述3D渲染线程绘制所述通知的跳转控件;
如果所述类型标识为第二类型标识,通知所述3D渲染线程绘制所述通知的跳转控件。
本申请实施例提供一种系统通知调用方法,包括:
响应于应用的启动,遍历所述数据列表;如果所述数据列表记录有系统通知,利用应用的JAR包调取存储在数据列表内的系统通知;如果所述数据列表未记录有系统通知,利用应用的JAR包监听系统通知;
利用所系统通知绘制通知界面。
本申请实施例示出的一种显示设备,具体的可以参阅图30,图30为根据一可行性实施例示出的显示设备的结构框图,其中,显示设备至少包括显示器3002和控制器3001,其中,控制器内设置有存储器3011和处理器3012,存储器3011用于存储显示设备下载的文件。处理器,用于执行存储在存储器中的操作系统和应用指令或线程。以及根据接收的用户输入指令,来执行各种应用、数据和内容的处理。具体应用到本实施例示出的方案中,处理器可以调用应用3121和3D渲染线程3122。显示器与控制器的交互流程图可以参阅图31。
所述应用被配置为执行步骤S3101响应于应用的启动,调用JAR包遍历所述数据列表;
本申请中应用(APPlication),指的是安装在显示设备上的第三方应用,可以为用户的生活提供便利。例如在一些可行性实施例中,应用可以是视频播放应用,用户可以利用视频播放应用观看视频;在一些可行性实施例中,应用可以是聊天应用,用户可以利用聊天应用与亲友们进行聊天。值得注意的是,本实施例仅是示例性的介绍几种应用,在实际应用的过程中,所述应用可以是但不限于上述几种应用。
用户需要使用应用时,需要启动相应的应用,本实施例并不对应用的启动方式作以限定,例如在一些可行性实施例中,通过触控显示器开启相应的应用,再例如在一些可行性实施例中,通过触控遥控器的按键开启相应的应用。
本实施例示出的技术方案中数据列表用于记录系统通知,其中系统通知这些通知可以包括低电量、插入外设(TF卡、sdcard等)、使用时长提醒、内存不足等等。
本实施例中,JAR(Java ARchive,Java归档)是一种与平台无关的文件格式,JAR包可将多个文件合成一个文件。用户可将多个Java APPlet及其所需组件(.class文件、图像和声音)绑定到JAR包中。JAR包可以实现以下的功能。(1)用于发布和使用数据; (2)作为应用和扩展的构建单元;(3)作为组件、APPlet或者插件程序的部署单位;(4)用于打包与组件相关联的辅助资源。具体应用到本实施例的方案中,JAR包可以调用数据列表内的系统通知。
为了保证数据列表可以记录在显示器设备处于开机状态下的全部系统通知,避免系统通知遗漏的问题出现,本申请实施例示出的技术方案采用UI线程123将监听到的系统通知写入数据列表,具体的实现过程可以参阅图32;图32为根据一可行性实施例示出的显示器与控制器的交互流程图。
所述UI线程被配置为执行步骤S3211启动时,注册系统的广播,以使得所述系统UI接收所述系统发送的系统通知;
本申请实施例示出方案中UI线程,为系统启动时,创建一个主线程(main thread)。这个主线程负责向UI组件分发事件(包括绘制事件),也是在这个主线程里,应用和Android的UI组件发生交互。所以main thread也叫UI thread也即UI线程。
系统启动时(也可称之为显示设备启动时)创建UI线程,当UI线程完成创建时,UI线程注册系统的广播。本实施例并不对UI线程注册系统的广播的实现方式作以限定,例如,在一可行性实施例中,UI线程可以采用自定义动态注册广播的方式注册系统的广播;再例如,在一可行性实施例中,UI线程可以采用静态注册广播的方式注册系统的广播。
每次接收到所述系统通知执行步骤S3212将接收到的系统通知写入所述数据列表内。
UI线程完成系统广播的注册,UI线程便可以监听系统通知,并实时的将监听到的系统通知写入数据列表内。
表1为根据一可行性实施例示出的数据列表。
表1
序号 | 系统通知 | 备注 |
1 | 电量 | - |
2 | 插入外设TF卡 | - |
3 | 内存不足 | - |
…… | - | - |
在一些可行性实施例中系统通知的序号的排列顺序可以是UI线程监听到系统通知的时间顺序。
如果所述数据列表记录系统通知,所述应用被配置为执行步骤S3221利用应用的JAR包调取存储在数据列表内的系统通知;
如果所述数据列表记录系统通知,应用利用JAR包调取存储在数据列表内的系统通知;其中,JAR包调取存储在数据列表内的系统通知的实现方式可以采用本领域惯用的数据调用方式,在此申请人不做过多的限定。
在一可行性实施例中,JAR包可以按照数据列表内系统通知对应序号的排列顺序依次调取相应的系统通知,以表1示出的数据为例,对系统通知的调取顺序作以说明。在一可行性实施例中,响应于应用的启动,应用的3D渲染线程开始配置该应用的3D应用场景,当完成3D应用场景的配置,应用调用JAR包遍历数据列表,本申请中,数据列表记录的数据可以参阅表1,JAR包首先调用序号1对应的电量系统通知,而后调用序号1对应的插入外设TF卡系统通知,最后调用内存不足系统通知。
如果所述数据列表未记录有系统通知,所述应用被配置为执行步骤S3222利用应用的 JAR包监听系统通知;
本申请实施例示出的方案中,响应于所述应用的启动,应用被配置为调用JAR包注册UI线程广播,以使得所述JAR包接收UI线程广播的系统通知。本实施例并不对JAR包注册UI线程广播的实现方式作以限定,例如,在一可行性实施例中,JAR包可以采用自定义动态注册广播的方式注册UI线程的广播;再例如,在一可行性实施例中,JAR包可以采用静态注册广播的方式注册UI线程的广播。
在一可行性实施例中,当APP的JAR包收到UI线程发过来的系统通知后,会通过调用UnityPlayer中SendeMessage函数将系统通知内容发送给Unity(在本实施中也可称之为3D渲染线程)。
所述应用被配置为执行步骤S3203输出所述系统通知;
本实施例在中,系统通知的传输方式可以采用本领域惯用的通知传输方式,在此申请人不做过多的限定。
3D渲染线程被配置为执行步骤S3204利用所述应用输出的系统通知绘制通知界面;
本实施例中,3D渲染线程可以称之为Unity。3D渲染线程是实时3D互动内容创作和运营平台。Unity可以将应用的场景渲染成3D效果。
3D渲染线程被配置为执行步骤S3205输出通知界面至显示器,以使得所述显示器对所述通知界面进行展示。
本实施例示出的技术方案利用安卓系统UI线程中监听系统通知,并将监听到的系统通知添加到数据列表中保存在数据库中。在应用启动的过程中,应用通知3D渲染线程渲染该应用的应用场景,当完成应用场景的渲染后,应用利用JAR包读取数据列表中有无系统通知,若有则通知3D渲染线程渲染系统通知;若无则利用JAR包直接监听UI线程广播的系统通知,当监听到系统通知时,通知3D渲染线程渲染系统通知。可见本实施例示出的技术方案,在3D渲染线程渲染应用场景过程中,UI线程可以将系统通知写入数据列表,当3D渲染线程完成应用场景的渲染,应用可以利用JAR调取在3D渲染线程渲染应用场景过程中写入数据列表的系统通知,并以此通知3D渲染线程渲染每个系统通知,采用本申请实施例提供的技术方案可以很好的解决了显示设备中应用启动或跳转过程中遗漏通知的问题,使得用户不会错过任何系统通知,极大提升了用户体验。
为了对本实施例示出的方案做进一步的说明,下面结合具体的实例对本实施例示出的技术方案做进一步的说明:
实施例1:
在一可行性实施例中,显示设备安装有应用A和应用B。其中,应用A处于开启的状态,显示设备的显示器展示应用A的应用场景,应用A调用JAR包监听UI线程广播的系统通知,当应用A监听到系统通知时,应用A通知3D渲染线程渲染系统通知。在某一时刻,用户启动应用B,响应于应用B的启动,3D渲染线程开始构建应用B的应用场景,在3D渲染线程渲染应用B的应用场景过程中,UI线程可以将系统通知写入数据列表。当3D渲染线程完成应用B应用场景的渲染,应用B可以利用JAR调取在3D渲染线程渲染应用场景过程中写入数据列表的系统通知,并通知3D渲染线程渲染每个系统通知。应用B完成对所述数据列表内全部系统通知的读取,应用B终止遍历所述数据列表,利用JAR包监听系统通知。
实施例2:
在一可行性实施例中,显示设备安装有应用A。用户启动应用A。响应于应用A的启动,3D渲染线程开始构建应用A的应用场景,在3D渲染线程渲染应用A的应用场景过程中,UI线程可以将系统通知写入数据列表。本实施例,在3D渲染线程渲染应用A的应用场景过程中,并无任何系统通知写入数据列表内。当3D渲染线程完成应用A应用场景的渲染,应用A遍历数据列表,本实施例中数据列表中无任何系统通知的记录,应用A终止遍历所述数据列表,利用JAR包监听系统通知。
在一些可行性实时中,为了防止系统通知重复出现的问题本实施例示出的方案中,所述UI线程被进一步配置为:将监听到的系统通知重新封装,以使得每个所述系统通知配置一个通知ID;将重新封装的所述系统通知写入所述数据列表内。
重新封装的系统通知包含的内容可以参考表2;
表2
具体的在一可行性实施例中,每个所述系统通知配置一个通知ID,每个系统通知配置唯一一个通知ID,所述通知ID起到唯一识别的作用。
图33为根据一可行性实施例示出的应用的作业流程图,本实施例中所述应用被进一步配置为:
S321读取所述系统通知的通知ID;
举例说明:表3为根据一可行性实施例示出的数据列表;
表3
序号 | 系统通知 | 通知ID | 备注 |
1 | 电量 | 通知ID-1 | - |
2 | 插入外设TF卡 | 通知ID-2 | - |
3 | 内存不足 | 通知ID-3 | - |
…… | …… | …… | …… |
当JAR包调取序号1对应的系统通知时,JAR包直接读取序号1对应的通知ID为通 知ID-1;当JAR包调取序号2对应的系统通知时,JAR包直接读取序号2对应的通知ID为通知ID-2……
S322响应于所述3D渲染线程完成所述系统通知对应通知界面的渲染,在所述数据列表内删除所述通知ID对应的系统通知;
本实施例示出的技术方案为了避免通知消息的重复展示,在一可行性实施例中,响应于所述3D渲染线程完成所述系统通知对应通知界面的渲染,JAR包基于之前读取到的通知ID删除通知ID对应的系统通知,以此来避免系统通知被重复调用问题的出现。
举例说明,在一可行性实施例中当JAR包调取序号1对应的系统通知时,JAR包直接读取序号1对应的通知ID为通知ID-1;响应于所述3D渲染线程完成电量系统通知对应通知界面的渲染,JAR包删除通知ID-1对应的系统通知。
S323响应于完成一个系统通知的删除,利用应用的JAR包调取下一个系统通知。
本实施例示出的技术方案利用UI线程中监听系统通知,并将通知添加到数据列表中保存在数据库中,该数据列表中保存有通知标题、通知内容、每个通知的唯一通知id等消息。在应用启动的过程中,应用通知3D渲染线程渲染该应用的应用场景,当完成应用场景的渲染后,应用利用JAR包读取数据列表中有无系统通知,若有则通知3D渲染线程渲染系统通知,当完成系统通知时,将该系统通知从数据列表中删除;若无则利用JAR包直接监听UI线程广播的系统通知,当监听到系统通知时,通知3D渲染线程渲染系统通知。本申请实施例示出的显示设备可以保证每个系统通知只会展示一次,避免系统通知重复展示问题的出现。
在一可行性实施例中,所述应用还被配置为:响应于完成所述数据列表内全部系统通知的读取,终止遍历所述数据列表,利用应用的JAR包监听系统通知。
本实施例示出的技术方案中,响应于完成所述数据列表内全部系统通知的读取,终止遍历所述数据列表,可以降低应用的数据处理量。应用可以利用JAR包监听UI线程广播的系统通知。
请继续参阅表2,在一可行性实施例中,每个重新封装后的所述系统通知包括类型标识,所述类型标识包括第一类型标识和第二类型标识;所述应用还被配置为:读取所述系统通知的类型标识;如果所述类型标识为第一类型标识,不通知所述3D渲染线程绘制所述通知的跳转控件;如果所述类型标识为第二类型标识,通知所述3D渲染线程绘制所述通知的跳转控件。
本实施例示出的技术方案中UI线程在重新封装系统通知时将非存储类消息配置第一类型标识,将存储类消息配置第二类型标识。本实施例中非存储类消息为不需要用户参与的系统通知,例如电量系统通知,对于电量通知界面,因为不涉及到用户的操作,因此,无需配置跳转控件。本实施例中存储类消息为需要用户参与的系统通知,例如插入U盘系统通知,对于插入U盘通知界面,因为需要用户选择是否对U盘进行识别,因此,3D渲染线程在绘制通知界面的时候需要绘制跳转控件。
本申请实施例第二方面示出一种系统通知调用方法,包括:
响应于应用的启动,遍历所述数据列表;如果所述数据列表记录有系统通知,利用应用的JAR包调取存储在数据列表内的系统通知;如果所述数据列表未记录有系统通知,利用应用的JAR包监听系统通知;
利用所系统通知绘制通知界面。
本实施例示出的系统通知调用方法。所述方法适用于显示设备。显示设备利用安卓系统独立线程UI线程中监听系统通知,并将监听到的系统通知添加到数据列表中。在应用启动的过程中,应用通知3D渲染线程渲染该应用的应用场景,当完成应用场景的渲染后,应用利用JAR包读取数据列表中有无系统通知,若有则通知3D渲染线程渲染系统通知;若无则利用JAR包直接监听UI线程广播的系统通知,当监听到系统通知时,通知3D渲染线程渲染系统通知。可见本实施例示出的技术方案,在3D渲染线程渲染应用场景过程中,UI线程可以将系统通知写入数据列表,当3D渲染线程完成应用场景的渲染,应用可以利用JAR调取在3D渲染线程渲染应用场景过程中写入数据列表的系统通知,并以此通知3D渲染线程渲染每个系统通知,采用本申请实施例提供的技术方案可以很好的解决了显示设备中应用启动或跳转过程中遗漏通知的问题,使得用户不会错过任何系统通知,极大提升了用户体验。
具体实现中,本发明还提供一种计算机可读的非易失性存储介质,其中,该计算机存储介质可存储有程序,该程序执行时可包括本发明提供的控制按键的自定义方法和启动方法的各实施例中的部分或全部步骤。的存储介质可为磁碟、光盘、只读存储记忆体(英文:read-only memory,简称:ROM)或随机存储记忆体(英文:random access memory,简称:RAM)等。
本领域的技术人员可以清楚地了解到本发明实施例中的技术可借助软件加必需的通用硬件平台的方式来实现。基于这样的理解,本发明实施例中的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品可以存储在存储介质中,如ROM/RAM、磁碟、光盘等,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本发明各个实施例或者实施例的某些部分的方法。
最后应说明的是:以上各实施例仅用以说明本申请的技术方案,而非对其限制;尽管参照前述各实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分或者全部技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的范围。
为了方便解释,已经结合具体的实施方式进行了上述说明。但是,上述示例性的讨论不是意图穷尽或者将实施方式限定到上述公开的具体形式。根据上述的教导,可以得到多种修改和变形。上述实施方式的选择和描述是为了更好的解释原理以及实际的应用,从而使得本领域技术人员更好的使用实施方式以及适于具体使用考虑的各种不同的变形的实施方式。
Claims (10)
- 一种显示设备,包括:显示器,用于呈现给用户水平方向360度、垂直方向180度全包围的空间视域,所述空间视域包括浏览区域和预览区域,所述浏览区域为用户可视区域对应的区域,所述浏览区域用于展示浏览文件,所述预览区域为与所述浏览区域接壤的区域,所述预览区域用于展示预览文件;控制器,被配置为:响应于用户点击浏览文件的操作,控制浏览区域展示浏览文件包含的内容;响应于用户点击预览文件的操作,生成第一集合,所述第一集合中包含的文件为被点击的预览文件所在预览页面展示的文件;控制所述显示器的浏览区域展示所述第一集合包含的文件。
- 根据权利要求1所述的显示设备,所述控制器被进一步配置为:响应于用户启动文件管理器的动作,读取第一数量,所述第一数量为需要展示文件的数量,每个所述文件对应一个序列号;如果所述第一文件数量小于或等于第二文件数量,则控制所述浏览区域展示全部文件,所述第二文件数量为所述浏览区域能够展示文件的数量;如果所述第一文件数量大于第二文件数量,控制所述浏览区域展示浏览文件,控制所述预览区域展示第二集合中的文件,所述N为第二文件数量,所述浏览文件为序列号为1到序列号为N的文件,所述第二集合包括至少一个预览文件,所述预览文件为与所述浏览文件临近为文件。
- 根据权利要求2所述的显示设备,响应于用户点击预览文件的操作,所述控制器还配置为:读取第一页码值C1,所述第一页码值为被点击的所述预览文件对应的页码;如果所述第一页码值大于1,则控制所述显示器的第一子预览区域展示第一子集合,所述第一子集合包含序列号为{(C1-2)*N+1,(C1-1)-1}*N}对应的文件,所述第一子预览区域位于所述浏览区域的一侧。
- 根据权利要求3所述的显示设备,所述控制器还被配置为:如果所述第一页码值等于总页码值,则控制所述显示器不显示第二子预览区域,所述第二子预览区域位于所述另一侧,所述第二子预览区域和所述第一子预览区域位于所述浏览区域不同的两侧。
- 根据权利要求4所述的显示设备,所述控制器还被配置为:如果所述第一页码值小于总页码数,生成第二子集合,所述第二子集合包括序列号为{(C1*N+1,终止序列号}对应的文件,所述终止序列号由所述第一页码值和所述第一数量决定;控制所述显示器的第二子预览区域展示第二子集合包含的文件。
- 根据权利要求5所述的显示设备,所述控制器还被配置为:判断C1*(N+1)是否大于或等于第一数量;如果C1*(N+1)大于或等于第一数量,终止序列号等于C1*(N+1)。
- 根据权利要求5所述的显示设备,其特征在于,所述控制器还被配置为:如果C1*(N+1)小于第一数量,则终止序列号等于第一数量。
- 根据权利要求1-7任一项所述的显示设备,其特征在于,所述浏览区域的展示样式不同于所述预览区域的展示样式。
- 根据权利要求1-7任一项所述的显示设备,所述浏览文件的展示样式不同于所述预览文件的展示样式。
- 一种显示方法,所述方法适用于显示设备,包括:响应于用户点击浏览文件的操作,控制浏览区域展示浏览文件包含的内容;响应于用户点击预览文件的操作,生成第一集合,所述第一集合中包含的文件为被点击的预览文件所在预览页面展示的文件;控制所述显示器的浏览区域展示所述第一集合包含的文件。
Applications Claiming Priority (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110089476.7 | 2021-01-22 | ||
CN202110089476.7A CN112749033B (zh) | 2021-01-22 | 2021-01-22 | 一种显示设备及系统通知调用方法 |
CN202110678653.5A CN113360066B (zh) | 2021-06-18 | 2021-06-18 | 一种显示设备及文件展示方法 |
CN202110678653.5 | 2021-06-18 | ||
CN202110678680.2 | 2021-06-18 | ||
CN202110678680.2A CN113453069B (zh) | 2021-06-18 | 2021-06-18 | 一种显示设备及缩略图生成方法 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022156729A1 true WO2022156729A1 (zh) | 2022-07-28 |
Family
ID=82548520
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/072894 WO2022156729A1 (zh) | 2021-01-22 | 2022-01-20 | 一种显示设备及显示方法 |
Country Status (1)
Country | Link |
---|---|
WO (1) | WO2022156729A1 (zh) |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102238353A (zh) * | 2010-05-06 | 2011-11-09 | Lg电子株式会社 | 用于操作图像显示设备的方法及图像显示设备 |
CN102447861A (zh) * | 2010-07-13 | 2012-05-09 | Lg电子株式会社 | 按照3d图像来显示图形用户界面的电子设备及方法 |
CN105094624A (zh) * | 2015-09-15 | 2015-11-25 | 北京金山安全软件有限公司 | 图片预览方法、装置及终端 |
CN105989180A (zh) * | 2015-04-08 | 2016-10-05 | 乐视移动智能信息技术(北京)有限公司 | 操作图片的方法及装置 |
US20170344242A1 (en) * | 2004-06-25 | 2017-11-30 | Apple Inc. | Visual Characteristics of User Interface Elements in a Unified Interest Layer |
CN113360066A (zh) * | 2021-06-18 | 2021-09-07 | 海信视像科技股份有限公司 | 一种显示设备及文件展示方法 |
-
2022
- 2022-01-20 WO PCT/CN2022/072894 patent/WO2022156729A1/zh active Application Filing
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170344242A1 (en) * | 2004-06-25 | 2017-11-30 | Apple Inc. | Visual Characteristics of User Interface Elements in a Unified Interest Layer |
CN102238353A (zh) * | 2010-05-06 | 2011-11-09 | Lg电子株式会社 | 用于操作图像显示设备的方法及图像显示设备 |
CN102447861A (zh) * | 2010-07-13 | 2012-05-09 | Lg电子株式会社 | 按照3d图像来显示图形用户界面的电子设备及方法 |
CN105989180A (zh) * | 2015-04-08 | 2016-10-05 | 乐视移动智能信息技术(北京)有限公司 | 操作图片的方法及装置 |
CN105094624A (zh) * | 2015-09-15 | 2015-11-25 | 北京金山安全软件有限公司 | 图片预览方法、装置及终端 |
CN113360066A (zh) * | 2021-06-18 | 2021-09-07 | 海信视像科技股份有限公司 | 一种显示设备及文件展示方法 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN114302194A (zh) | 一种显示设备及多设备切换时的播放方法 | |
WO2022073392A1 (zh) | 图像显示方法及显示设备 | |
WO2020248714A1 (zh) | 一种数据传输方法及设备 | |
CN113535019B (zh) | 显示设备及应用图标的显示方法 | |
WO2022048203A1 (zh) | 一种输入法控件的操控提示信息的显示方法及显示设备 | |
WO2021121051A1 (zh) | 一种显示方法及显示设备 | |
CN112667184A (zh) | 一种显示设备 | |
CN113630654B (zh) | 显示设备及媒资片源推送方法 | |
WO2022021669A1 (zh) | 一种控制智能图像模式切换的方法及显示设备 | |
CN114302204B (zh) | 一种分屏播放方法及显示设备 | |
CN112118468A (zh) | 一种外设设备颜色跟随画面颜色变化的方法及显示设备 | |
CN112486921B (zh) | 一种文件同步方法、显示设备及移动终端 | |
CN113268199A (zh) | 一种显示设备及功能项设置方法 | |
CN115776585A (zh) | 显示设备和内容展示方法 | |
WO2022161401A1 (zh) | 一种投屏数据的处理方法及显示设备 | |
CN113360066B (zh) | 一种显示设备及文件展示方法 | |
CN111954059A (zh) | 屏保的展示方法及显示设备 | |
CN113613047B (zh) | 一种媒体文件播放控制方法及显示设备 | |
WO2022028060A1 (zh) | 一种显示设备及显示方法 | |
CN113111214A (zh) | 一种播放记录的显示方法及显示设备 | |
CN113825002A (zh) | 显示设备及焦距控制方法 | |
CN113453069B (zh) | 一种显示设备及缩略图生成方法 | |
CN113573149B (zh) | 一种频道搜索方法及显示设备 | |
WO2022156729A1 (zh) | 一种显示设备及显示方法 | |
CN113132809B (zh) | 一种通道切换方法、通道节目播放方法及显示设备 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22742208 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22742208 Country of ref document: EP Kind code of ref document: A1 |