CN112822547B - Screen-throwing play control method for interface global adaptation - Google Patents

Screen-throwing play control method for interface global adaptation Download PDF

Info

Publication number
CN112822547B
CN112822547B CN202011615546.XA CN202011615546A CN112822547B CN 112822547 B CN112822547 B CN 112822547B CN 202011615546 A CN202011615546 A CN 202011615546A CN 112822547 B CN112822547 B CN 112822547B
Authority
CN
China
Prior art keywords
screen
resolution
player
oscillator
frequency domain
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202011615546.XA
Other languages
Chinese (zh)
Other versions
CN112822547A (en
Inventor
申鹏
吴刚
王犇逸
张光龙
王振中
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Bijie Network Co ltd
Original Assignee
Suzhou Bijie Network Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Bijie Network Co ltd filed Critical Suzhou Bijie Network Co ltd
Priority to CN202011615546.XA priority Critical patent/CN112822547B/en
Publication of CN112822547A publication Critical patent/CN112822547A/en
Application granted granted Critical
Publication of CN112822547B publication Critical patent/CN112822547B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/4104Peripherals receiving signals from specially adapted client devices
    • H04N21/4122Peripherals receiving signals from specially adapted client devices additional display device, e.g. video projector
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/414Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
    • H04N21/41415Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance involving a public display, viewable by several users in a public space outside their home, e.g. movie theatre, information kiosk
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/436Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
    • H04N21/4363Adapting the video stream to a specific local network, e.g. a Bluetooth® network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440263Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA
    • H04N21/440272Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by altering the spatial resolution, e.g. for displaying on a connected PDA for performing aspect ratio conversion

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

The invention discloses a screen-throwing play control method for interface global adaptation, which comprises the following steps: s1, carrying out self-defined resolution configuration on a main interface and a playing picture in a screen when the screen is not thrown; s2, when the main interface resumes to display, reading the self-defined resolution and the current resolution of the system, configuring the width and the height of all the controls in the main interface, and waiting for screen throwing; s3, calculating a ratio value of the self-defined resolution to the current resolution of the system before the player draws the image according to the screen-throwing trigger signal, and sending the ratio value to the player; and S4, the player scales the initial picture to be drawn according to the received scale value and presents the scaled picture. The invention carries out global design of special resolution, is convenient for operation experience of users, and meets the configuration requirement of the special resolution of the users and the intelligent horizontal and vertical screen zoom requirement.

Description

Screen-throwing play control method for interface global adaptation
Technical Field
The invention relates to the field of projection equipment, in particular to a projection screen playing control method for interface global adaptation.
Background
In this digital age now, more and more information needs to be projected onto a screen of a size. There is a lot of information to meet various special needs, a non-standard scale display is adopted, and some screens must only display a part of the system interface to achieve the distinction between the console and the actual presentation. When a user uses the screen-throwing software, the display screen cannot meet the requirements of part of players with special resolutions, so that in some displays with special resolutions, the actual screen does not cover the whole system interface area, but only displays part of the whole screen.
The current solution for dealing with special resolution screens or for common screens but only displaying a small area on the market is to fix the relative position of the player or interface on the interface file during the development project, and develop a specific scheme, which needs to make the following settings:
1) Calculating and fixing his position in the interface file according to the customer's requirements;
2) The size of the screen throwing player is designed to be the size required by a customer;
3) The player is set to a fixed size.
However, the width and height of the player cannot be customized through the setting, and the player cannot be perfectly matched with a specific display screen, so that the screen throwing procedure is increased, and time and labor are wasted.
Disclosure of Invention
In order to solve the problems in the prior art, the invention provides a screen-throwing play control method for interface global adaptation, which can customize the proportion of play pictures in screen throwing so as to achieve perfect adaptation to various demonstration schemes on any equipment, and the technical scheme is as follows:
the invention provides a screen-throwing play control method for interface global adaptation, which comprises the following steps:
s1, carrying out self-defined resolution configuration on a main interface and a playing picture in a screen when the screen is not thrown;
s2, when the main interface resumes to display, reading the self-defined resolution and the current resolution of the system, configuring the width and the height of all the controls in the main interface, and waiting for screen throwing;
s3, calculating a ratio value of the self-defined resolution to the current resolution of the system before the player draws the image according to the screen-throwing trigger signal, and sending the ratio value to the player;
and S4, the player scales the initial picture to be drawn according to the received scale value and presents the scaled picture.
Further, the step S4 further includes receiving an image signal before scaling the initial frame to be drawn according to the following steps:
s41, a player receives a time domain signal stream and creates a windowed data set according to the time domain signal stream;
s42, the processor converts the windowed data set into a frequency domain data set, and stores the obtained data into frequency domain data with basic transformation resolution;
s43, performing complex frequency spectrum phase evolution on frequency domain data, and estimating component frequencies of the frequency domain data with resolution larger than the basic transformation resolution;
s44, sampling a group of pre-stored frequency domain windows by using the component frequencies estimated in the complex spectrum phase evolution to select one frequency domain window from the group of pre-stored frequency domain windows so as to match at least one of amplitude, phase, amplitude modulation and frequency modulation of the basic signal oscillator;
s45, using a tracking algorithm to identify a tracker composed of one or more oscillator peaks, wherein the peak is emitted by an oscillation source of the base signal oscillator matched in the step S44;
s46, grouping tracks from a single source and providing signals to the player.
Further, step S44 further includes: parameters required for at least one of FM creation and AM creation are stored in the frequency domain, wherein the parameters for FM creation include amplitude, phase, reference frequency, and modulation rate, and the parameters for AM creation include amplitude, phase, frequency, and amplitude envelope information.
Further, step S44 further includes: a spectrum of at least one of the FM modulated oscillator peak and the AM modulated oscillator peak is recreated, the spectrum including any transient effects that the oscillator is able to turn on or off at some point within the data sampling window.
Further, step S43 further includes: a unified domain representation of data from the complex spectral phase evolution is provided to enable fitting of constituent components of the signal using direction estimates in the unified domain.
Further, the oscillator peak value in step S45 further includes oscillator peak signal expansion information to represent the signal element to a desired accuracy.
Further, a continuous wrapping effect and/or a plurality of wrapping effects are included in the spectrum of the oscillator peak signal spread information.
The technical scheme provided by the invention has the following beneficial effects:
a. the proportion of the playing pictures in screen projection is customized, so that various demonstration schemes can be perfectly adapted to any equipment;
b. the screen can be applied to a series of special display screens such as a large screen mobile screen of a school playground, a special display screen of a hospital, a railway station publishing screen and the like, and can also be applied to display screens with various non-traditional display proportions;
c. the operation experience of the user is facilitated, the special resolution configuration requirement of the user is met, and the intelligent horizontal and vertical screen zoom requirement is met.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments will be briefly described below, and it is apparent that the drawings in the following description are only some embodiments of the present invention, and other drawings may be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a flowchart of a method for controlling on-screen display of interface global adaptation according to an embodiment of the present invention;
fig. 2 is a flowchart of a screen-projection control method for a time domain signal stream according to an embodiment of the present invention.
Detailed Description
In order that those skilled in the art will better understand the present invention, a technical solution in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in which it is apparent that the described embodiments are only some embodiments of the present invention, not all embodiments. All other embodiments, which can be made by those skilled in the art based on the embodiments of the present invention without making any inventive effort, shall fall within the scope of the present invention.
It should be noted that the terms "first," "second," and the like in the description and the claims of the present invention and the above figures are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged where appropriate such that the embodiments of the invention described herein may be implemented in sequences other than those illustrated or otherwise described herein. Furthermore, the terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, apparatus, article, or device that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or device.
The screen projection technology is aimed at a specific area with specific resolution or standard resolution, is inconvenient to develop in many scenes and inflexible, and can be compatible with the screen size in different environments and implemented in various screen projection schemes. In one embodiment of the present invention, a method for controlling on-screen playback of interface global adaptation is provided, referring to fig. 1, the method for controlling on-screen playback of interface global adaptation includes the following steps:
s1, carrying out self-defined resolution configuration on a main interface and a playing picture in a screen when the screen is not thrown;
s2, when the main interface resumes to display, reading the self-defined resolution and the current resolution of the system, configuring the width and the height of all the controls in the main interface, and waiting for screen throwing;
s3, calculating a ratio value of the self-defined resolution to the current resolution of the system before the player draws the image according to the screen-throwing trigger signal, and sending the ratio value to the player;
and S4, the player scales the initial picture to be drawn according to the received scale value and presents the scaled picture.
According to the flowchart shown in fig. 1, the solution of the embodiment of the present invention needs to configure the self-defined resolution of the main interface and the play image in the screen without screen throwing. Firstly, after the user-defined resolution is configured on a setting page, when the main interface resumes display, the user-defined resolution is read and a proper proportion is calculated through a function, the calculating method is to acquire the width and the height of a system, and all the controls in the main interface are configured with the width and the height, so that the function of the user-defined main interface resolution can be realized and screen throwing is waited. After the screen projection starts, when the player is started to initialize the player picture, the proper proportion of the self-defined resolution can be calculated before the player draws the picture, and the self-defined resolution is displayed in the picture (surfaceview) drawn by the player. Thus the custom resolution implementation of the whole procedure is completed.
After the resolution is set, the system saves to the local and reconfigures the layout of the main interface by the onResume method when returning to the main interface to achieve the resolution update of the main interface, which mainly relies on re-drawing each displayed control by calculation through px, dx conversion of the existing resolution. For example, the control is generally set in dp, and in actual display, the control is displayed in px (pixel), and the conversion relationship between the two is px=0.5+dp. For example, if the default resolution of the system is 1920x1080, and if the client wants to obtain the actual screen with 300x200 resolution (i.e. the set resolution), then a control with the width of 30dp (45 px) should be displayed needs to be divided by 1920 and multiplied by 300 to calculate that the actual display width of the control is 4.7dp (7.47 px);
after receiving a screen throwing request, after creating a channel, when receiving a stream and starting to create a surfaceview, configuring the surfaceview into the size required by a user to draw after acquiring the user-defined resolution of the user and the full-screen resolution of the computing device, and distinguishing the display of a horizontal screen and a vertical screen according to different screen throwing modes to display different calculation proportions.
The embodiment carries out global design of special resolution, is convenient for the operation experience of a user, can carry out global special resolution setting by modifying the setting once, can be modified at any time, and meets the configuration requirement of the special resolution of the user and the intelligent horizontal and vertical screen zoom requirement.
In this embodiment, a solution for the projection of the time-domain signal stream, especially the time-domain audio/video data, is proposed, and referring to fig. 2, the step S4 is further comprised of receiving the image signal according to the following steps before scaling the initial picture to be drawn:
s41, the player receives the time domain signal stream and creates a windowed data set according to the time domain signal stream.
S42, the processor converts the windowed data set into a frequency domain data set, and stores the obtained data into frequency domain data with basic transformation resolution.
S43, performing complex frequency spectrum phase evolution on the frequency domain data, and estimating component frequencies of the frequency domain data with resolution larger than the basic transformation resolution.
In particular, a unified domain representation of data from complex spectral phase evolution is provided to enable fitting of constituent components of a signal using direction estimates in the unified domain.
S44, sampling a set of pre-stored frequency domain windows by using the component frequencies estimated in the complex spectrum phase evolution to select one frequency domain window from the set of pre-stored frequency domain windows so as to match at least one of amplitude, phase, amplitude modulation and frequency modulation of the base signal oscillator.
Specifically, parameters required for at least one of FM creation and AM creation are stored in the frequency domain, wherein the parameters for FM creation include amplitude, phase, reference frequency, and modulation rate, and the parameters for AM creation include amplitude, phase, frequency, and amplitude envelope information. A spectrum of at least one of the FM modulated oscillator peak and the AM modulated oscillator peak is recreated, the spectrum including any transient effects that the oscillator is able to turn on or off at some point within the data sampling window.
S45, identifying a tracker composed of one or more oscillator peaks, which are emitted by the oscillation sources of the base signal oscillators matched in step S44, using a tracking algorithm.
Specifically, the oscillator peak also includes oscillator peak signal expansion information to represent the signal element to a desired accuracy. Further, a continuous wrapping effect and/or a plurality of wrapping effects are included in the spectrum of the oscillator peak signal spread information.
S46, grouping tracks from a single source and providing signals to the player.
The processing of the time domain signal stream in the embodiment can enable the time domain signal stream to play the flow in the screen throwing process, no jamming point exists in the whole process, and the viewing experience of a user is improved.
The foregoing description of the preferred embodiments of the invention is not intended to limit the invention to the precise form disclosed, and any such modifications, equivalents, and alternatives falling within the spirit and scope of the invention are intended to be included within the scope of the invention.

Claims (5)

1. The screen projection playing control method for interface global adaptation is characterized by comprising the following steps:
s1, carrying out self-defined resolution configuration on a main interface and a playing picture in a screen when the screen is not thrown;
s2, when the main interface resumes to display, reading the self-defined resolution and the current resolution of the system, configuring the width and the height of all the controls in the main interface, and waiting for screen throwing;
s3, calculating a ratio value of the self-defined resolution to the current resolution of the system before the player draws the image according to the screen-throwing trigger signal, and sending the ratio value to the player;
s4, the player scales the initial picture to be drawn according to the received scale value and presents the scaled picture, wherein before scaling the initial picture to be drawn, the player further comprises the steps of receiving image signals according to the following steps: s41, a player receives a time domain signal stream and creates a windowed data set according to the time domain signal stream; s42, the processor converts the windowed data set into a frequency domain data set, and stores the obtained data into frequency domain data with basic transformation resolution; s43, performing complex frequency spectrum phase evolution on frequency domain data, and estimating component frequencies of the frequency domain data with resolution larger than the basic transformation resolution; s44, sampling a group of pre-stored frequency domain windows by using the component frequencies estimated in the complex spectrum phase evolution to select one frequency domain window from the group of pre-stored frequency domain windows so as to match at least one of amplitude, phase, amplitude modulation and frequency modulation of the basic signal oscillator; recreating a spectrum of at least one of FM modulated oscillator peaks and AM modulated oscillator peaks, the spectrum including any transient effects that the oscillator is capable of turning on or off at some point within the data sampling window; s45, using a tracking algorithm to identify a tracker composed of one or more oscillator peaks, wherein the peak is emitted by an oscillation source of the base signal oscillator matched in the step S44; s46, grouping tracks from a single source and providing signals to the player.
2. The method of claim 1, wherein step S44 further comprises: parameters required for at least one of FM creation and AM creation are stored in the frequency domain, wherein the parameters for FM creation include amplitude, phase, reference frequency, and modulation rate, and the parameters for AM creation include amplitude, phase, frequency, and amplitude envelope information.
3. The method of claim 1, wherein step S43 further comprises: a unified domain representation of data from the complex spectral phase evolution is provided to enable fitting of constituent components of the signal using direction estimates in the unified domain.
4. The method according to claim 2, wherein the peak oscillator value in step S45 further includes peak oscillator signal expansion information to represent the signal element to a desired accuracy.
5. The method of claim 4, further comprising including a continuous wrapping effect and/or a plurality of wrapping effects in the frequency spectrum of the oscillator peak signal spread information.
CN202011615546.XA 2020-12-30 2020-12-30 Screen-throwing play control method for interface global adaptation Active CN112822547B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011615546.XA CN112822547B (en) 2020-12-30 2020-12-30 Screen-throwing play control method for interface global adaptation

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011615546.XA CN112822547B (en) 2020-12-30 2020-12-30 Screen-throwing play control method for interface global adaptation

Publications (2)

Publication Number Publication Date
CN112822547A CN112822547A (en) 2021-05-18
CN112822547B true CN112822547B (en) 2023-05-05

Family

ID=75855035

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011615546.XA Active CN112822547B (en) 2020-12-30 2020-12-30 Screen-throwing play control method for interface global adaptation

Country Status (1)

Country Link
CN (1) CN112822547B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113253959B (en) * 2021-05-26 2023-04-07 济南浪潮智投智能科技有限公司 Front-end screen projection method adaptive to different large screen resolutions

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108279894A (en) * 2016-12-30 2018-07-13 乐视汽车(北京)有限公司 Throw screen resolution conversion method and conversion equipment
CN112019898A (en) * 2020-08-27 2020-12-01 北京字节跳动网络技术有限公司 Screen projection method and device, electronic equipment and computer readable medium
CN112019897B (en) * 2020-08-27 2022-11-08 北京字节跳动网络技术有限公司 Screen projection method and device, electronic equipment and computer readable medium

Also Published As

Publication number Publication date
CN112822547A (en) 2021-05-18

Similar Documents

Publication Publication Date Title
CN108989691B (en) Video shooting method and device, electronic equipment and computer readable storage medium
JP7139515B2 (en) Video imaging method, video imaging device, electronic device, and computer-readable storage medium
JP7387890B2 (en) Video file generation method, device, terminal, and storage medium
CN113051432B (en) Display device and media asset playing method
US20050253966A1 (en) System for processing video signals
CN111491174A (en) Virtual gift acquisition and display method, device, equipment and storage medium
CN108111903A (en) Record screen document play-back method, device and terminal
WO2023104102A1 (en) Live broadcasting comment presentation method and apparatus, and device, program product and medium
US9514718B2 (en) Information processing system, information processing apparatus, and information processing method
US20120301030A1 (en) Image processing apparatus, image processing method and recording medium
CN112822547B (en) Screen-throwing play control method for interface global adaptation
CN110971847B (en) Screen display content superposition method and device, electronic equipment and storage medium
CN104126197A (en) Information processing device, information processing method and program
CN112616078A (en) Screen projection processing method and device, electronic equipment and storage medium
CN105872677A (en) Multichannel video information displaying method and device
JP6058257B2 (en) Image output apparatus, image output method, and program
JP2000138872A (en) Information processor, its method and supplying medium
CN113485613A (en) Display equipment and method for realizing free-drawing screen edge painting
CN108156512B (en) Video playing control method and device
CN107995538B (en) Video annotation method and system
CN116233561A (en) Virtual gift generation method, device, equipment and medium
CN109814802A (en) Window display method, device, equipment and storage medium in a kind of interface
CN114666648A (en) Video playing method and electronic equipment
CN111263178A (en) Live broadcast method, device, user side and storage medium
CN111818357A (en) Network live broadcast control method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant