CN113051432B - Display device and media asset playing method - Google Patents

Display device and media asset playing method Download PDF

Info

Publication number
CN113051432B
CN113051432B CN202110448074.1A CN202110448074A CN113051432B CN 113051432 B CN113051432 B CN 113051432B CN 202110448074 A CN202110448074 A CN 202110448074A CN 113051432 B CN113051432 B CN 113051432B
Authority
CN
China
Prior art keywords
playing
window
target video
playing window
display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202110448074.1A
Other languages
Chinese (zh)
Other versions
CN113051432A (en
Inventor
赖园园
薛梅
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Juhaokan Technology Co Ltd
Original Assignee
Juhaokan Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Juhaokan Technology Co Ltd filed Critical Juhaokan Technology Co Ltd
Priority to CN202110448074.1A priority Critical patent/CN113051432B/en
Publication of CN113051432A publication Critical patent/CN113051432A/en
Priority to PCT/CN2021/119052 priority patent/WO2022078154A1/en
Priority to CN202180068337.4A priority patent/CN116324700A/en
Application granted granted Critical
Publication of CN113051432B publication Critical patent/CN113051432B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/74Browsing; Visualisation therefor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0483Interaction with page-structured environments, e.g. book metaphor
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/44Arrangements for executing specific programs
    • G06F9/451Execution arrangements for user interfaces

Abstract

The embodiment of the application provides a display device and a media asset playing method, wherein the display device comprises: a display; a controller connected with the display, the controller configured to: receiving a media asset playing instruction input by a user; responding to the media asset playing instruction, and acquiring a target video corresponding to the media asset playing instruction; when a control is not arranged above a first playing window corresponding to the target video, the target video is played in the first playing window; when the control is arranged above a first playing window corresponding to the target video, the display position of the target video is moved in the first playing window in the direction away from the control, so that the central position of the picture of the target video is close to the central position of a target display area which is not shielded by the control in the first playing window for display, wherein the control is opaque and shields one side of the first playing window. The method and the device improve the display effect of media asset playing.

Description

Display device and media asset playing method
Technical Field
The present application relates to the field of display technologies, and in particular, to a display device and a media asset playing method.
Background
At present, the method for exercising by following the fitness video on the television is a popular fitness mode, in order to better master whether the fitness action of the user is standard or not, part of the television can acquire user images through the camera, the user images and the fitness video are played on the television at the same time, so that the user can see the action of the user on the television, and the action of the user can be compared and analyzed with the action in the fitness video terminal.
At present, the display ratio of most televisions is 16:9, the ratio of fitness videos is usually 16:9, if the television only plays the fitness videos, the fitness videos can be displayed in a full screen mode, and if the fitness videos and the user images are displayed simultaneously, the display area of the fitness videos may not be 16:9 due to the fact that the user images occupy part of the display area of the television. In the related art, when the ratio of a video is not consistent with the ratio of a playing window, the video is usually scaled to a smaller size so as to be displayed in the playing window, however, a black edge appears around the video, and the video also becomes smaller, and for the fitness video, the video becomes smaller, which causes some fitness actions to be difficult to see, and seriously affects the viewing experience of the user.
Disclosure of Invention
In order to solve the technical problem that the body-building video playing effect is poor, the application provides a display device and a media asset playing method.
In a first aspect, the present application provides a display device comprising:
a display;
a controller connected with the display, the controller configured to:
receiving a media asset playing instruction input by a user;
responding to the media asset playing instruction, and acquiring a target video corresponding to the media asset playing instruction;
when a control is not arranged above a first playing window corresponding to the target video, the target video is played in the first playing window;
when the control is arranged above a first playing window corresponding to the target video, the display position of the target video is moved in the first playing window in the direction away from the control, so that the central position of the picture of the target video is close to the central position of a target display area which is not shielded by the control in the first playing window for display, wherein the control is opaque and shields one side of the first playing window.
In a second aspect, the present application provides a method for playing media assets, including:
receiving a media asset playing instruction input by a user;
responding to the media asset playing instruction, and acquiring a target video corresponding to the media asset playing instruction;
when a control is not arranged above a first playing window corresponding to the target video, the target video is played in the first playing window;
when the control is arranged above a first playing window corresponding to the target video, the display position of the target video is moved in the first playing window in the direction away from the control, so that the central position of the picture of the target video is close to the central position of a target display area, which is not shielded by the control, in the first playing window for display, wherein the control is opaque and shields one side of the first playing window.
The display equipment and the media asset playing method provided by the application have the beneficial effects that:
according to the embodiment of the application, the display area which is not shielded by the target video is detected on the display equipment and is determined as the target display area, then after the target video is zoomed, the image of the target video is controlled to be displayed in a shifting mode in the target display area, the problem that the display effect is poor due to the fact that the target video is shielded by the second playing window when being played in the follow-training mode is solved, and the watching experience of a user is improved.
Drawings
In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.
Fig. 1 is a schematic diagram illustrating an operational scenario between a display device and a control apparatus according to some embodiments;
fig. 2 illustrates a block diagram of a hardware configuration of the control apparatus 100 according to some embodiments;
a block diagram of a hardware configuration of a display device 200 according to some embodiments is illustrated in fig. 3;
a schematic diagram of a software configuration in a display device 200 according to some embodiments is illustrated in fig. 4;
FIG. 5 illustrates a fitness home page schematic according to some embodiments;
a schematic diagram of a asset detail interface according to some embodiments is illustrated in fig. 6;
FIG. 7 illustrates a play mode selection interface diagram according to some embodiments;
FIG. 8 is a diagram illustrating a full screen play interface in normal mode according to some embodiments;
FIG. 9 illustrates a dual window schematic in a follow-through mode, according to some embodiments;
FIG. 10 illustrates a schematic diagram of a target display area in a follow-through mode, in accordance with some embodiments;
FIG. 11 illustrates an offset diagram in a follow-through mode, according to some embodiments;
FIG. 12 illustrates an occlusion diagram in a follow-through mode, according to some embodiments;
a schematic diagram of a dual-window play interface in a follow-through mode according to some embodiments is illustrated in fig. 13.
Detailed Description
To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.
It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.
The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, the user may operate the display device 200 through the smart device 300 or the control apparatus 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200.
In some embodiments, a smart device 300 (e.g., a mobile terminal, a tablet, a computer, a laptop, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.
In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received by a module configured inside the display device 200 to obtain a voice command, or may be received by a voice control device provided outside the display device 200.
In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.
Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction of a user and convert the operation instruction into an instruction recognizable and responsive to the display device 200, serving as an interaction intermediary between the user and the display device 200.
Fig. 3 illustrates a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.
In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.
In some embodiments the controller comprises a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.
In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, performing display of video content, image content, and a menu manipulation interface, and a user manipulation UI interface.
In some embodiments, the display 260 may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
In some embodiments, communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example: the communicator may include at least one of a Wifi module, a bluetooth module, a wired ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display apparatus 200 may establish transmission and reception of control signals and data signals with the external control apparatus 100 or the server 400 through the communicator 220.
In some embodiments, the user interface may be configured to receive control signals for controlling the apparatus 100 (e.g., an infrared remote control, etc.).
In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; alternatively, the detector 230 includes an image collector, such as a camera, which may be used to collect external environment scenes, attributes of the user, or user interaction gestures, or the detector 230 includes a sound collector, such as a microphone, which is used to receive external sounds.
In some embodiments, the external device interface 240 may include, but is not limited to, the following: high Definition Multimedia Interface (HDMI), analog or data high definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, and the like. The interface may be a composite input/output interface formed by the plurality of interfaces.
In some embodiments, the tuner demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio/video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
In some embodiments, the controller 250 and the modem 210 may be located in different separate devices, that is, the modem 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. Operations related to the selected object are: displaying an operation of connecting to a hyperlink page, document, image, etc., or performing an operation of a program corresponding to the icon.
In some embodiments, the controller includes at least one of a Central Processing Unit (CPU), a video processor, an audio processor, a Graphic Processing Unit (GPU), a RAM Random Access Memory (RAM), a ROM (Read-Only Memory), a first interface to an nth interface for input/output, a communication Bus (Bus), and the like.
In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
Referring to fig. 4, in some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer from top to bottom.
In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (Window) programs carried by an operating system, system setting programs, clock programs or the like; or may be an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.
The framework layer provides an Application Programming Interface (API) and a programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.
As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.
In some embodiments, the activity manager is used to manage the lifecycle of the various applications and the usual navigation fallback functions, such as controlling exit, opening, fallback, etc. of the applications. The window manager is used for managing all window programs, such as obtaining the size of the display screen, judging whether a status bar exists, locking the screen, intercepting the screen, controlling the change of the display window (for example, reducing the display window, shaking the display, distorting and deforming the display, and the like).
In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer, and when the framework layer is used, the android operating system runs the C/C + + library included in the system runtime layer to implement the functions to be implemented by the framework layer.
In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..
The hardware or software architecture in some embodiments may be based on the description in the above embodiments, and in some embodiments may be based on other hardware or software architectures that are similar to the above embodiments, and it is sufficient to implement the technical solution of the present application.
In some embodiments, the display device may directly enter an interface of a preset video-on-demand program after being started, and the interface of the video-on-demand program may include at least a navigation bar and a content display area located below the navigation bar as shown in fig. 5, where content displayed in the content display area may change with a change of a selected control in the navigation bar. The programs in the application program layer can be integrated in the video-on-demand program and displayed through one control of the navigation bar, and can also be further displayed after the application control in the navigation bar is selected.
In some embodiments, the display device may directly enter a display interface of a signal source selected last time after being started, or a signal source selection interface, where the signal source may be a preset video-on-demand program, or may be at least one of an HDMI interface, a live tv interface, and the like, and after a user selects different signal sources, the display may display contents obtained from different signal sources.
In some embodiments, as shown in fig. 5, the navigation bar may be provided with a plurality of controls, such as "my", "channel", "movie", "fitness", "VIP", "education", "mall", "game", and application, different navigation bar controls correspond to different channel interfaces, if the user wants to perform fitness, the "fitness" control may be selected, the interface shown in fig. 5 is the interface after the "fitness" control is selected, and the user may select a fitness video on the interface to perform fitness following the fitness video.
Referring to fig. 6, after the user clicks one fitness video on the interface shown in fig. 5, the display device requests the server to issue corresponding detail page data according to the configuration parameters corresponding to the selected video control, and then enters the media resource detail interface shown in fig. 6 according to the received detail page data. As shown in fig. 6, the media resource detail interface may display a plurality of course bar controls of the fitness video, or may not include the course bar controls, and after the user clicks one of the course bar controls or starts training, the display device acquires the fitness video corresponding to the course bar control/detail page, and then enters the play mode selection interface. In the following description, the played fitness video is also referred to as a target video.
Referring to fig. 7, the play mode selection interface may show three mode controls, where a play mode corresponding to a first mode control is a normal mode, which may also be referred to as a first mode, a play mode corresponding to a second mode control is a follow-through mode, which may also be referred to as a second mode, and a play mode corresponding to a third mode control is a view mode, which may also be referred to as a third mode. Each mode control can display an explanation of the play mode, and for example, the explanation of the normal mode can be: "the whole teaching video is watched by shielding the camera to be familiar with the training action", the explanation of the following training mode can be: "turn on the lens to obtain the real-time comparison of the movement and make the movement more standard", the explanation of the film viewing mode can be: the exercise effect is not folded when the camera is shielded and the user looks at the camera.
As can be seen from the above explanation, in some embodiments, in the normal mode, the display device does not start the camera, and only sets one playing window on a new interface to play the fitness video, in the follow-up exercise mode, the display device starts the camera, and sets two playing windows on a new interface of the display to simultaneously play the image collected by the camera and the fitness video, respectively, in the movie watching mode, the display device does not start the camera, and sets two playing windows on a new interface of the display to simultaneously play the fitness video and a movie, respectively.
In some embodiments, the display device may be provided with a camera, the camera may include a lifting camera or a non-lifting camera, the camera may capture an image of the user to obtain local camera data, and the controller of the display device may display the local camera data captured by the camera on a display of the display device, so that the user can see his/her own actions on the display.
In some embodiments, the display device is not provided with a camera, but may be connected with a camera, for example, an external camera connected via USB, and the camera is used to capture images of a user, and the controller of the display device may display local data captured by the camera on the display of the display device.
The user can select a play mode to watch the fitness video according to the explanation.
In some embodiments, if the user clicks the common mode control on the play mode selection interface shown in fig. 7, the display device generates a media asset play instruction, where the media asset play instruction includes information of a play mode and a target video, and at this time, the play mode is the common mode, and the information of the target video includes a play address of the target video. And the display equipment acquires the video data stream of the target video from the playing address of the target video according to the media asset playing instruction, and generates a first playing window for playing the target video on a new interface according to the fact that the playing mode is a common mode. In some embodiments, the first playback window may be a full screen window with a display ratio of 16: 9.
In some embodiments, the proportion of the fitness video corresponds to the proportion of a full-screen window, since the proportion of the fitness video is typically 16:9, and the proportion of a full-screen window is also 16: 9. In the normal mode, the display device only generates one first playing window, does not generate other windows, and does not shield the display content of the first playing window by other windows, so that the display device can directly play the fitness video in the first playing window in a full screen mode according to the fact that the playing mode of the media asset playing instruction is the normal mode after the first playing window is generated.
In some embodiments, to implement full-screen playing of the fitness video in the first playing window, the display device may scale the image of the target video to make the image size of the scaled target video consistent with the size of the full-screen window.
In some embodiments, the method for the display device to zoom the target video may be: analyzing a video data stream of a target video to obtain a video frame sequence of the target video, taking a first frame image in the video frame sequence, obtaining a scaling ratio according to the ratio of the image height to the height of the target display area, and then scaling the video frame sequence of the target video according to the scaling ratio. Illustratively, the image height of the target video is 100, and the height of the full-screen window of the display device is 1000, where the height may be the number of pixel points in the vertical direction, and then the scaling ratio is: when the video frame sequence of the target video is enlarged by 10 times according to the scaling ratio, the enlarged image of the target video can fill the whole full-screen window.
In some embodiments, the display device scales the target video to obtain a video frame sequence of the scaled target video, and sends the video frame sequence to the first play window, so that the first play window can continuously play the video frame sequence.
Referring to fig. 8, which is a schematic diagram of a full screen playing interface in a normal playing mode according to some embodiments, as shown in fig. 8, in the normal playing mode, a target video may be played in a full screen, a character in fig. 8 may be a fitness trainer, and a line may represent a background of the character, where in an image of the target video, the character is displayed in the middle, and both the left side and the right side behind the character are background images.
In some embodiments, if the user clicks the follow-up mode control on the play mode selection interface shown in fig. 7, the display device generates a media asset play instruction, where the media asset play instruction includes information of a play mode and a target video, and at this time, the play mode is the follow-up mode, and the information of the target video includes a play address of the target video. And the display equipment acquires the video data stream of the target video from the playing address of the target video according to the media asset playing instruction, and generates a first playing window for playing the target video and a second playing window for playing the local camera data on a new interface according to the fact that the playing mode is the follow-training mode.
In some embodiments, a second playback window is superimposed over the first playback window.
In some embodiments, the second playback window is at the same height as the first playback window, and the left boundary of the second playback window coincides with the left boundary of the first playback window, or the right boundary of the second playback window coincides with the right boundary of the first playback window.
In some embodiments, the location of the window may be achieved by setting a coordinate parameter of the window in the interface.
In some embodiments, referring to fig. 9, in the follow-up mode, the first playing window may be a full-screen window with a display ratio of 16:9, and the second playing window may be a window higher than the display, and the display ratio may be determined according to the shooting parameters of the camera. The second playing window may be displayed on one side of the first playing window in a form of a map in an overlapping manner, for example, the second playing window may be displayed on the right side of the first playing window and coincide with the right side edge of the first playing window, so as to shield the right side display area of the first playing window. If the display device zooms the target video to the size same as that of the full-screen window, and then directly displays the zoomed image in the full-screen window, due to the sheltering of the second playing window, if partial image of the target video cannot be watched by the user according to the normal window display logic, the user can only watch the image which is not sheltered by the second playing window in the target video. When the target video is the fitness video, the user needs to move along with the movement of the fitness coach in the fitness video, the fitness coach is a person in the target video and is usually located in the middle of an image of the fitness video, and the second playing window may block part of the body of the fitness coach, so that the watching effect of the fitness video is influenced.
In some embodiments, to reduce the probability that the body of the fitness trainer is blocked, the display device may determine, in the follow-up mode, a target display area in the first play window, where the target display area is an area that is not blocked by the second play window, and the display device may display an image of the target video offset to the left in the target display area, so that the user can see a more complete fitness activity in the target display area.
In some embodiments, the target display area is determined according to the position coordinates of the first playing window and the position coordinates of the second playing window. The position coordinates of the target display area can be obtained by subtracting the position coordinates of the second play window from the position coordinates of the first play window.
It should be noted that the target display area refers to a preferred display area in the first playing window, content displayed in the target display area is not blocked by other images, in the follow-up mode, the display device has a second playing window in addition to the first playing window, and the second playing window partially blocks the first playing window, so that the display device can determine an area, which is located on the left side of the second playing window in the first playing window and is not blocked by the second playing window, as the target display area. Referring to fig. 10, the second playing window is displayed above and superposed on the right side of the first playing window, and an area on the left side of the first playing window that is not covered by the second playing window may be determined as a target display area of the first playing window.
It should be noted that, in the follow-up mode, the first play window is blocked by the second play window, and the display device determines the target display area according to the position of the second play window on the first play window. In some video playing scenes, the first playing window for playing the video may not be blocked by the second playing window for playing the local data of the camera, but may be blocked by other images, for example, a non-transparent control for displaying a picture. At this time, if the position of the control for shielding the first playing window is the same as the position of the second playing window for shielding the first playing window, namely, the control is shielded on one side of the first playing window, and one width side of the control is overlapped with one width side of the first playing window, the target display area can be determined as a rectangular area which is not shielded by the control in the first playing window. If all edges of the control are not overlapped with the first playing window, no matter which side of the control the target display area is arranged on, the size of the target display area is smaller, so that all the display areas of the first playing window can be determined as the target display area, namely, the target video is played in the first playing window in a full screen mode.
In some embodiments, in the follow-up mode, since the target display area is only a partial display area of the first playing window, the size ratio of the target display area may not be 16:9, and to obtain a better playing effect, the target video may be scaled first, and then the image of the scaled target video may be shifted to the left, so that the center line of the shifted image is close to the center line of the target display area, or the center line of the shifted image is overlapped with the center line of the target display area, so that the user may see a more complete image of the person in the target display area.
In some embodiments, in the software execution process, the target display area may not be determined, and the first moving distance of the target video may be directly determined according to the position parameters of the first playing window and the second playing window in the playing interface. An exemplary target video is zoomed during playing of a player, in order to ensure that display content is not deformed, images are generally scaled in a height direction and a width direction in an equal proportion, a general scaling rule is to scale the images after confirming scaling factors according to the height (width), the zoomed images fill the height (width) of a playing window in the height (width), and black insertion can be performed in the other dimension. The height direction may be used as a reference, and the width direction may be used as a reference. And determining a first distance that the image of the target video needs to move in the display process according to the width parameter of the first player and the width parameter of the second player. So that the intermediate position of the target video image frame is displayed in the unobstructed area of the first video window as much as possible.
Referring to fig. 11, after the image of the target video is shifted to the left by the first movement distance D, it can be seen that the image of the person in the target video is closer to the left side of the screen than before the shift.
Referring to fig. 12, after the image of the target video is shifted to the left by the first moving distance D, the background image on the right side of the character in the target video can be shielded through the second playing window, and at this time, the second playing window does not shield the character in the first playing window, so that a good display effect is achieved.
In order to calculate the first moving distance D, in some embodiments, the image of the target video may be scaled to obtain an image width of the target video after being scaled to the size of the first playing window, where the image width may be referred to as a width to be displayed; then obtaining the width of a second playing window; the two widths are differentiated to obtain the width of the target display area; and taking a half of the difference between the width to be displayed and the width of the target display area as a first moving distance. According to the calculation method, the first moving distance D of the left offset of the target video is the same as the distance of the right side of the target video, which is shielded by the second playing window, so that the center line of the target video is superposed with the center line of the target display area. The calculation method can be called as an averaging method, has the advantages of simple calculation and high calculation speed, and can quickly determine the size of the first moving distance D.
In some embodiments, the first movement distance may be any distance less than the difference in the widths of the two playing windows.
In some embodiments, the first movement distance is not greater than the width of the second playback window.
In some embodiments, the first moving distance may be determined directly according to the width of the second playing window, and for example, half of the width of the second playing window is taken as the distance to be moved, and the first moving distance is not greater than the distance to be moved.
In some embodiments, the first moving distance may be obtained by taking a difference between the width of the scaled movie and the width of the second playing window, for example, half of the difference may be used as the first moving distance.
In some embodiments, the determination of the first movement distance is made according to a position parameter of the playing window.
In some embodiments, the fitness trainer in the target video may not be located in the middle of the image, and at this time, if a method of setting the first moving distance D offset on the left side of the target video to be the same as the distance at which the right side of the target video is blocked by the second playing window is adopted, the fitness trainer in the target video may be deviated to the left or right, and the display effect is poor. For example, human body recognition can be performed on the image frames of the target video, and after the human body is recognized, namely the fitness trainer, symmetrically extending along the central axis of the human body to two sides until the width of the display area containing the human body is the same as that of the target display area, at this time, taking the difference value between the width starting point of the display area containing the human body and the width starting point of the first playing window as a first moving distance, the first moving distance obtained by the calculation method may be different from the first moving distance obtained by the averaging method, and if the fitness coach is on the left in the media image of the target video, if the first moving distance obtained by the calculation method is smaller than the first moving distance obtained by the average method, if the fitness coach inclines to the right in the media asset image of the target video, the first movement distance obtained by the calculation method is larger than the first movement distance obtained by the averaging method.
After obtaining the first movement distance D, in some embodiments, the display device may implement image offset display of the target video by dynamically setting presentation of the surfaceView. The offset output function for surfaceView may be: layout param. setmarsins (0-D,0,0, 0). As shown in fig. 12, the offset output function indicates that the left offset amount is D, so that the left starting point of the asset image is (0-D), the left starting point of the asset image in the first playing window is 0, and since the first playing window needs to display the image from the position of the starting point of 0 when displaying the image. Therefore, according to the above-mentioned offset output function, when the first playing window shows each frame of image of the target video, the media resource images are displayed in the first playing window from the pixel points of the target video on the right side of the first moving distance D, the images in the first moving distance D exceed the display range of the first playing window, the partial images cannot be displayed in the first playing window, the display effect of displaying the images of the target video in a leftward offset manner is realized, on the right side of the image of the target video, the first playing window still has a part of the display area which can display black edges, and by placing the second playing window on the top for display, the second playing window can cover part of the background image on the right side of the character in the image of the target video and the black edge, so that the user can not see the part of the background image and the black edge, and the watching experience of the user is not influenced. The second playing window may be set to top by setting setzorderontop (true).
According to the method for dynamically setting surfaceView, the playing interface of the display device in the follow-up mode is as shown in FIG. 13, the middle image of the target video is displayed in the target display area of the first playing window, and the user image is displayed in the second playing window.
In some embodiments, after receiving a target video, a display device decodes the target video, performs scaling according to a parameter of a first playing window, and then displays a position parameter of an image frame after moving the image frame leftwards by a first distance in an image frame display process.
In some embodiments, the second playing window plays the acquired video data of the camera.
It can be seen from the above embodiments that, in the embodiments of the present application, a display area where the target video is not blocked is detected on the display device, and the display area is determined as the target display area, and then after the target video is zoomed, the image of the target video is controlled to perform offset display in the target display area, so that a problem of a poor display effect caused by the fact that the target video is blocked by the second play window during playing in the follow-up mode is solved, and the viewing experience of a user is improved.
Since the above embodiments are all described by referring to and combining with other embodiments, the same portions are provided between different embodiments, and the same and similar portions between the various embodiments in this specification may be referred to each other. And will not be described in detail herein.
It is noted that, in this specification, relational terms such as "first" and "second," and the like, are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a circuit structure, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such circuit structure, article, or apparatus. Without further limitation, the presence of an element identified by the phrase "comprising an … …" does not exclude the presence of other like elements in a circuit structure, article, or device comprising the element.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
The above embodiments of the present application do not limit the scope of the present application.

Claims (9)

1. A display device, comprising:
a display;
a controller connected with the display, the controller configured to:
receiving a media asset playing instruction input by a user;
responding to the media asset playing instruction, and acquiring a target video corresponding to the media asset playing instruction, wherein the target video is used for enabling a user to perform action following;
when a second playing window is not arranged on the upper layer of a first playing window for playing the target video, playing the target video in the first playing window, wherein the second playing window is used for playing a local video received by the controller and collected by a camera;
when the second playing window is arranged on the upper layer of a first playing window for playing the target video, setting one longitudinal boundary of the second playing window to be overlapped with the longitudinal boundary of the first playing window, moving the display position of the target video in the first playing window to a direction far away from the second playing window by a first moving distance, wherein the longitudinal boundary comprises a left boundary or a right boundary, the first moving distance is half of the width of the second playing window, so that the central position of the picture of the target video is overlapped with the central position of the target display area of the first playing window, and the edge of the image frame in the first playing window, which is close to the second playing window, is shielded by the second playing window, wherein the second playing window is opaque and shields the area on one side of the first playing window, the target display area is an area which is not shielded by the second playing window.
2. The display device of claim 1, wherein the second playback window comprises a window generated by the controller in response to the asset playback instruction.
3. The display device according to claim 1, wherein moving the display position of the target video in the first playing window in a direction away from the second playing window further comprises:
determining the width to be displayed of the target video when the target video is completely displayed in the first playing window in the height direction;
and determining a first moving distance according to the width to be displayed and the width of the target display area, wherein the first moving distance is a distance in the first playing window, which is required to move the display position of the target video to a direction away from the second playing window.
4. The display device according to claim 3, wherein determining the to-be-displayed width of the target video when the target video is completely displayed in the first playing window in the height direction comprises:
obtaining a scaling according to the ratio of the image height of the target video to the height of the target display area;
and obtaining the width to be displayed of the target video according to the image width of the target video and the scaling.
5. The display device according to claim 1, wherein the target display area is determined based on position coordinates of the first playback window and position coordinates of the second playback window.
6. The display device of claim 1, wherein the height of the second playback window is the same as the height of the first playback window.
7. The display device of claim 1, wherein a right side of the second playback window coincides with a right side of the first playback window.
8. The display device according to claim 1, wherein after the target video corresponding to the asset playing instruction is acquired in response to the asset playing instruction, the method further comprises:
responding to that the play mode corresponding to the media asset play instruction is a first mode, and loading a first play page, wherein the first play page comprises a first play window and does not comprise a second play window, and the first play window is used for playing the target video;
and responding to that the playing mode corresponding to the media asset playing instruction is a second mode, and loading a second playing page, wherein the first playing page comprises a first playing window and a second playing window positioned above the first playing window, the first playing window is used for playing the target video, and the second playing window is used for playing the received local camera data.
9. A method for playing media assets, comprising:
receiving a media asset playing instruction input by a user;
responding to the media asset playing instruction, and acquiring a target video corresponding to the media asset playing instruction, wherein the target video is used for enabling a user to perform action following;
when a second playing window is not arranged on the upper layer of a first playing window for playing the target video, playing the target video in the first playing window, wherein the second playing window is used for playing a local video which is received by a controller and is collected by a camera;
when a second playing window is arranged on the upper layer of a first playing window for playing the target video, setting one longitudinal boundary of the second playing window to be overlapped with the longitudinal boundary of the first playing window, moving the display position of the target video in the first playing window to a direction far away from the second playing window by a first moving distance, wherein the longitudinal boundary comprises a left boundary or a right boundary, the first moving distance is half of the width of the second playing window, so that the central position of the picture of the target video is overlapped with the central position of the target display area of the first playing window, and the edge of the image frame in the first playing window, which is close to the second playing window, is shielded by the second playing window, wherein the second playing window is opaque and shields the area on one side of the first playing window, the target display area is an area which is not shielded by the second playing window.
CN202110448074.1A 2020-10-15 2021-04-25 Display device and media asset playing method Active CN113051432B (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CN202110448074.1A CN113051432B (en) 2021-04-25 2021-04-25 Display device and media asset playing method
PCT/CN2021/119052 WO2022078154A1 (en) 2020-10-15 2021-09-17 Display device and media asset playing method
CN202180068337.4A CN116324700A (en) 2020-10-15 2021-09-17 Display equipment and media asset playing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110448074.1A CN113051432B (en) 2021-04-25 2021-04-25 Display device and media asset playing method

Publications (2)

Publication Number Publication Date
CN113051432A CN113051432A (en) 2021-06-29
CN113051432B true CN113051432B (en) 2022-07-19

Family

ID=76520351

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110448074.1A Active CN113051432B (en) 2020-10-15 2021-04-25 Display device and media asset playing method

Country Status (1)

Country Link
CN (1) CN113051432B (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022078154A1 (en) * 2020-10-15 2022-04-21 聚好看科技股份有限公司 Display device and media asset playing method
CN114281284B (en) * 2021-07-14 2024-04-26 海信视像科技股份有限公司 Display apparatus and image display method
CN113760140B (en) * 2021-08-31 2023-12-08 Oook(北京)教育科技有限责任公司 Content display method, device, medium and electronic equipment
CN113794917A (en) * 2021-09-15 2021-12-14 海信视像科技股份有限公司 Display device and display control method
WO2023185129A1 (en) * 2022-03-30 2023-10-05 聚好看科技股份有限公司 Display device, server, media resource continuous playback method, and screen mirroring method
WO2024087814A1 (en) * 2022-10-25 2024-05-02 聚好看科技股份有限公司 Method for implementing range communication in virtual conference, and display device and mobile terminal

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102032449B1 (en) * 2013-01-07 2019-10-15 삼성전자주식회사 Method for displaying image and mobile terminal
US20140279731A1 (en) * 2013-03-13 2014-09-18 Ivan Bezdomny Inc. System and Method for Automated Text Coverage of a Live Event Using Structured and Unstructured Data Sources
CN109062486B (en) * 2014-05-19 2022-03-25 联想(北京)有限公司 Display window adjusting method and electronic equipment
CN110237545A (en) * 2018-03-08 2019-09-17 徐志强 A kind of video frequency remote-control method, remote controler and remote-control toy
CN116074564A (en) * 2019-08-18 2023-05-05 聚好看科技股份有限公司 Interface display method and display device
CN111953924B (en) * 2020-08-21 2022-03-25 杨文龙 Video window adjusting method, device, medium and system based on image processing
CN112162672A (en) * 2020-10-19 2021-01-01 腾讯科技(深圳)有限公司 Information flow display processing method and device, electronic equipment and storage medium
CN112199005A (en) * 2020-10-22 2021-01-08 Tcl通讯(宁波)有限公司 Content display method, content display device, storage medium and mobile terminal

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
基于DLP大屏技术的视频会商系统改造与应用;罗红艳;《信息与电脑(理论版)》;20160923(第18期);全文 *

Also Published As

Publication number Publication date
CN113051432A (en) 2021-06-29

Similar Documents

Publication Publication Date Title
CN113051432B (en) Display device and media asset playing method
KR102575230B1 (en) Remote controlling apparatus, and method for operating the same
CN113259741B (en) Demonstration method and display device for classical viewpoint of episode
CN112073788B (en) Video data processing method and device and display equipment
CN112073798B (en) Data transmission method and equipment
CN115278325A (en) Display device, mobile terminal and body-building follow-up training method
CN111836115B (en) Screen saver display method, screen saver skipping method and display device
CN111526415A (en) Double-screen display equipment and HDMI switching method thereof
CN112672199B (en) Display device and multi-layer overlapping method
CN113014939A (en) Display device and playing method
CN113395556A (en) Display device and method for displaying detail page
CN115836528A (en) Display device and screen projection method
CN112783380A (en) Display apparatus and method
CN116801027A (en) Display device and screen projection method
CN112367550A (en) Method for realizing multi-title dynamic display of media asset list and display equipment
CN115119067A (en) Display device and channel list display method
CN113485613A (en) Display equipment and method for realizing free-drawing screen edge painting
CN115314757B (en) Display device and guide window display method
CN113438528A (en) Method for realizing combined key and display equipment
CN113076031A (en) Display device, touch positioning method and device
CN111939561A (en) Display device and interaction method
CN115086722B (en) Display method and display device for secondary screen content
CN113766164B (en) Display equipment and signal source interface display method
CN113645502B (en) Method for dynamically adjusting control and display device
CN114302206A (en) Content display method, display equipment and server

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant