CN113766305A - Display device and mirror image screen projection audio output control method - Google Patents
Display device and mirror image screen projection audio output control method Download PDFInfo
- Publication number
- CN113766305A CN113766305A CN202111133007.7A CN202111133007A CN113766305A CN 113766305 A CN113766305 A CN 113766305A CN 202111133007 A CN202111133007 A CN 202111133007A CN 113766305 A CN113766305 A CN 113766305A
- Authority
- CN
- China
- Prior art keywords
- mobile device
- display
- mobile
- display device
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/436—Interfacing a local distribution network, e.g. communicating with another STB or one or more peripheral devices inside the home
- H04N21/4363—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network
- H04N21/43637—Adapting the video or multiplex stream to a specific local network, e.g. a IEEE 1394 or Bluetooth® network involving a wireless protocol, e.g. Bluetooth, RF or wireless LAN [IEEE 802.11]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72409—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories
- H04M1/72412—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality by interfacing with external accessories using two-way short-range wireless interfaces
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72433—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for voice messaging, e.g. dictaphones
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/7243—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
- H04M1/72439—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for image or video messaging
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M1/00—Substation equipment, e.g. for use by subscribers
- H04M1/72—Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
- H04M1/724—User interfaces specially adapted for cordless or mobile telephones
- H04M1/72403—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
- H04M1/72442—User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for playing music files
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/02—Details of telephonic subscriber devices including a Bluetooth interface
Abstract
The embodiment of the application provides a display device and a mirror image screen projection audio output control method, which comprise the following steps: a communicatively coupled display, a speaker, and a controller, the controller configured to: responding to a screen projection request sent by the mobile equipment, controlling a display to display a playing interface, and controlling to start a Bluetooth protocol service of the display equipment, wherein the playing interface is used for displaying the screen projection interface of the mobile equipment; receiving an audio transmission request sent by mobile equipment, and establishing a Bluetooth transmission channel with the mobile equipment by using Bluetooth protocol service; and receiving audio data sent by the mobile equipment through the Bluetooth transmission channel, and controlling the loudspeaker to output the audio data. In this application, display device and mobile device are carrying out the mirror image and are throwing the screen when, and the mobile device will throw the screen interface and divide into two routes with corresponding audio data and transmit to display device, wherein, the audio data that has realized the mobile device through bluetooth transmission path passes through the output of display device, very big promotion user experience.
Description
Technical Field
The application relates to the technical field of intelligent televisions, in particular to a display device and a mirror image screen projection audio output control method.
Background
The display device is a television product which can realize the bidirectional man-machine interaction function and integrates a plurality of functions such as audio and video, entertainment, data and the like. In order to meet the diversified requirements of users, the display equipment is provided with various applications such as screen projection, audio and video, entertainment and the like, and interacts and exchanges information with the users through a user interface.
Currently, a mobile device may project a current display content image of a screen onto a user interface of a display device based on a certain screen projection protocol. Namely, the mobile device records the screen in real time through the screen recording application, records and compresses the current display content of the screen into a video stream and transmits the video stream to the display device. However, because the operating system installed in the mobile device is usually an android system, the screen recording application is an application developed by a third party, that is, the screen recording application does not belong to a system level application, so that the mobile device may only allow the third party application (screen recording application) to record the currently displayed content of the screen of the operating system, but not allow to record the currently played audio data and system audio. Therefore, when a user projects a screen to the display device through the mobile device mirror image, the sound of the mobile device cannot be output through the display device, and the experience effect is poor.
Disclosure of Invention
The application provides a display device and a mirror image screen projection audio output control method, and aims to solve the technical problem that in the prior art, when a mirror image screen is projected, sound of a mobile device cannot be output through the display device, and the experience effect is poor.
In a first aspect, the present application provides a display device comprising:
a display;
a speaker;
a controller communicatively coupled to the display, the speaker, the controller configured to:
responding to a screen projection request sent by mobile equipment, controlling the display to display a playing interface and controlling to start a Bluetooth protocol service of the display equipment, wherein the playing interface is used for displaying the screen projection interface of the mobile equipment;
receiving an audio transmission request sent by the mobile equipment, and establishing a Bluetooth transmission channel with the mobile equipment by using the Bluetooth protocol service;
and receiving audio data sent by the mobile equipment through the Bluetooth transmission channel, and controlling the loudspeaker to output the audio data.
In some embodiments, the mobile device comprises a first mobile device and a second mobile device, the controller is further configured to:
when receiving an audio transmission request of a second mobile device, controlling to stop receiving the audio data sent by the first mobile device, and receiving the audio data sent by the second mobile device, so that the loudspeaker stops outputting the audio data of the first mobile device, and controlling the loudspeaker to output the audio data of the second mobile device, wherein the time when the first mobile device sends the audio transmission request to a display device is earlier than the time when the second mobile device sends the audio transmission request to the display device.
In some embodiments, the mobile device comprises a first mobile device and a second mobile device, the controller is further configured to:
when a screen projection request of a second mobile device is received, controlling the display to simultaneously display a screen projection interface sent by the first mobile device and a screen projection interface sent by the first mobile device, wherein the time when the first mobile device sends the screen projection request to the display device is earlier than the time when the second mobile device sends the screen projection request to the display device.
In some embodiments, in the step of controlling to stop receiving the audio data transmitted by the first mobile device and to receive the audio data transmitted by the second mobile device upon receiving an audio transmission request of the second mobile device, the controller is further configured to:
receiving an audio transmission request sent by the second mobile device, and detecting the current Bluetooth connection state of the display device; if the display equipment establishes a Bluetooth transmission channel with the first mobile equipment, disconnecting the Bluetooth transmission channel with the first mobile equipment and feeding back an instruction representing that Bluetooth connection is allowed to the second mobile equipment; and receiving an audio transmission request which is retransmitted by the second mobile equipment according to a command for representing permission of Bluetooth connection, and establishing a Bluetooth transmission channel with the second mobile equipment.
In some embodiments, the controller is further configured to:
and when the current Bluetooth connection state of the display equipment is detected, if the display equipment does not establish a Bluetooth transmission channel with the first mobile equipment, responding to an audio transmission request sent by the second mobile equipment, and establishing the Bluetooth transmission channel with the second mobile equipment.
In some embodiments, in the step of controlling the display to simultaneously present the screen-casting interface transmitted by the first mobile device and the screen-casting interface transmitted by the first mobile device when a screen-casting request of a second mobile device is received, the controller is further configured to:
receiving screen projection requests sent by the first mobile equipment and the second mobile equipment, and creating play controls with the same number as the mobile equipment in the play interface, wherein the play controls belong to the same application; and controlling the playing control to respectively acquire screen projection interfaces of the corresponding mobile devices for displaying.
In some embodiments, in the step of controlling the display to simultaneously present the screen-casting interface transmitted by the first mobile device and the screen-casting interface transmitted by the first mobile device when a screen-casting request of a second mobile device is received, the controller is further configured to:
receiving screen projection requests sent by the first mobile equipment and the second mobile equipment, and controlling user interfaces displayed by the display to display windows with the same number as that of the mobile equipment, wherein the display windows respectively display playing interfaces and are respectively affiliated to different applications; and controlling the display windows to respectively acquire screen projection interfaces of the corresponding mobile devices for displaying.
In some embodiments, the controller is further configured to:
and when receiving an audio transmission request sent by the mobile equipment, pairing the mobile equipment with a default PIN code at the background so that a Bluetooth pairing dialog box does not pop up from the display equipment and the mobile equipment when the mobile equipment is connected for the first time.
In a second aspect, the present application provides a mirror projection audio output control method, including:
responding to a screen projection request sent by mobile equipment, controlling a display to display a playing interface and controlling to start a Bluetooth protocol service of the display equipment, wherein the playing interface is used for displaying the screen projection interface of the mobile equipment;
receiving an audio transmission request sent by the mobile equipment, and establishing a Bluetooth transmission channel with the mobile equipment by using the Bluetooth protocol service;
and receiving audio data sent by the mobile equipment through the Bluetooth transmission channel, and controlling a loudspeaker to output the audio data.
Compared with the prior art, the beneficial effect of this application is:
the application provides a display device and a mirror image screen projection audio output control method, when the display device receives a screen projection request of a mobile device, a display is controlled to display a screen projection interface of the mobile device through a playing interface, meanwhile, the display device starts a Bluetooth protocol service, and later subsequently responds to an audio transmission request of the mobile device. And when receiving an audio transmission request sent by the mobile equipment, establishing a Bluetooth transmission channel with the mobile equipment through a Bluetooth protocol service. The mobile device can send the audio data to the display device through the bluetooth transmission channel, so that the display device outputs the audio data of the mobile device through the loudspeaker. In this application, display device and mobile device are carrying out the mirror image and are throwing the screen when, and the mobile device will throw the screen interface and divide into two routes with corresponding audio data and transmit to display device, wherein, the audio data that has realized the mobile device through bluetooth transmission path passes through the output of display device, very big promotion user experience.
Drawings
In order to more clearly explain the technical solution of the present application, the drawings needed to be used in the embodiments will be briefly described below, and it is obvious to those skilled in the art that other drawings can be obtained according to the drawings without any creative effort.
Fig. 1 is a schematic diagram illustrating an operational scenario between a display device and a control apparatus according to some embodiments;
a block diagram of the hardware configuration of the control device 100 according to some embodiments is illustrated in fig. 2;
a block diagram of a hardware configuration of a display device 200 according to some embodiments is illustrated in fig. 3;
a schematic diagram of a software configuration in a display device 200 according to some embodiments is illustrated in fig. 4;
a display effect diagram of a mobile device mirror projected onto a display device 200 according to some embodiments is illustrated in fig. 5;
another display effect diagram of the mobile device mirror projected screen to the display device 200 according to some embodiments is illustrated in fig. 6;
FIG. 7 illustrates a flow diagram of a mirrored-screen-projection audio output control method according to some embodiments;
a display effect diagram of a multi-mobile device mirror screen-cast to a display device 200 according to some embodiments is illustrated in fig. 8;
a timing diagram of a mirrored-screen-projection audio output control method according to some embodiments is illustrated in fig. 9.
Detailed Description
To make the purpose and embodiments of the present application clearer, the following will clearly and completely describe the exemplary embodiments of the present application with reference to the attached drawings in the exemplary embodiments of the present application, and it is obvious that the described exemplary embodiments are only a part of the embodiments of the present application, and not all of the embodiments.
It should be noted that the brief descriptions of the terms in the present application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of the present application. These terms should be understood in their ordinary and customary meaning unless otherwise indicated.
The terms "first," "second," "third," and the like in the description and claims of this application and in the above-described drawings are used for distinguishing between similar or analogous objects or entities and not necessarily for describing a particular sequential or chronological order, unless otherwise indicated. It is to be understood that the terms so used are interchangeable under appropriate circumstances.
The terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a product or apparatus that comprises a list of elements is not necessarily limited to all elements expressly listed, but may include other elements not expressly listed or inherent to such product or apparatus.
The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and/or software code that is capable of performing the functionality associated with that element.
Fig. 1 is a schematic diagram of an operation scenario between a display device and a control apparatus according to an embodiment. As shown in fig. 1, a user may operate the display apparatus 200 through the smart device 300 or the control device 100.
In some embodiments, the control apparatus 100 may be a remote controller, and the communication between the remote controller and the display device includes an infrared protocol communication or a bluetooth protocol communication, and other short-distance communication methods, and controls the display device 200 in a wireless or wired manner. The user may input a user instruction through a key on a remote controller, voice input, control panel input, etc., to control the display apparatus 200.
In some embodiments, a smart device 300 (e.g., a mobile device, a tablet, a computer, a laptop, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application program running on the smart device.
In some embodiments, the display device 200 may also be controlled in a manner other than the control apparatus 100 and the smart device 300, for example, the voice command control of the user may be directly received by a module configured inside the display device 200 to obtain a voice command, or may be received by a voice control device provided outside the display device 200.
In some embodiments, the display device 200 is also in data communication with a server 400. The display device 200 may be allowed to be communicatively connected through a Local Area Network (LAN), a Wireless Local Area Network (WLAN), and other networks. The server 400 may provide various contents and interactions to the display apparatus 200. The server 400 may be a cluster or a plurality of clusters, and may include one or more types of servers.
Fig. 2 exemplarily shows a block diagram of a configuration of the control apparatus 100 according to an exemplary embodiment. As shown in fig. 2, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory, and a power supply. The control apparatus 100 may receive an input operation instruction from a user and convert the operation instruction into an instruction recognizable and responsive by the display device 200, serving as an interaction intermediary between the user and the display device 200.
Fig. 3 shows a hardware configuration block diagram of the display apparatus 200 according to an exemplary embodiment.
In some embodiments, the display apparatus 200 includes at least one of a tuner demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, a user interface.
In some embodiments, the display 260 includes a display screen component for presenting a picture, and a driving component for driving an image display, a component for receiving an image signal from the controller output, performing display of video content, image content, and a menu manipulation interface, and a user manipulation UI interface. The display 260 may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.
In some embodiments, the controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display apparatus 200. For example: in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 may perform an operation related to the object selected by the user command.
In some embodiments, the object may be any one of selectable objects, such as a hyperlink, an icon, or other actionable control. The operations related to the selected object are: displaying an operation connected to a hyperlink page, document, image, or the like, or performing an operation of a program corresponding to the icon.
In some embodiments, a user may enter user commands on a Graphical User Interface (GUI) displayed on display 260, and the user input interface receives the user input commands through the Graphical User Interface (GUI). Alternatively, the user may input the user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through the sensor.
In some embodiments, a "user interface" is a media interface for interaction and information exchange between an application or operating system and a user that enables conversion between an internal form of information and a form that is acceptable to the user. A commonly used presentation form of the User Interface is a Graphical User Interface (GUI), which refers to a User Interface related to computer operations and displayed in a graphical manner. It may be an interface element such as an icon, a window, a control, etc. displayed in the display screen of the electronic device, where the control may include a visual interface element such as an icon, a button, a menu, a tab, a text box, a dialog box, a status bar, a navigation bar, a Widget, etc.
Referring to fig. 4, in some embodiments, the system is divided into four layers, which are an Application (Applications) layer (abbreviated as "Application layer"), an Application Framework (Application Framework) layer (abbreviated as "Framework layer"), an Android runtime (Android runtime) and system library layer (abbreviated as "system runtime library layer"), and a kernel layer from top to bottom.
In some embodiments, at least one application program runs in the application program layer, and the application programs may be windows (windows) programs carried by an operating system, system setting programs, clock programs or the like; or an application developed by a third party developer. In particular implementations, the application packages in the application layer are not limited to the above examples.
The framework layer provides an Application Programming Interface (API) and a programming framework for the application. The application framework layer includes a number of predefined functions. The application framework layer acts as a processing center that decides to let the applications in the application layer act. The application program can access the resources in the system and obtain the services of the system in execution through the API interface.
As shown in fig. 4, in the embodiment of the present application, the application framework layer includes a manager (Managers), a Content Provider (Content Provider), and the like, where the manager includes at least one of the following modules: an Activity Manager (Activity Manager) is used for interacting with all activities running in the system; the Location Manager (Location Manager) is used for providing the system service or application with the access of the system Location service; a Package Manager (Package Manager) for retrieving various information related to an application Package currently installed on the device; a Notification Manager (Notification Manager) for controlling display and clearing of Notification messages; a Window Manager (Window Manager) is used to manage the icons, windows, toolbars, wallpapers, and desktop components on a user interface.
In some embodiments, the kernel layer is a layer between hardware and software. As shown in fig. 4, the core layer includes at least one of the following drivers: audio drive, display driver, bluetooth drive, camera drive, WIFI drive, USB drive, HDMI drive, sensor drive (like fingerprint sensor, temperature sensor, pressure sensor etc.) and power drive etc..
The hardware or software architecture in some embodiments may be based on the description in the above embodiments, and in some embodiments may be based on other hardware or software architectures that are similar to the above embodiments, and it is sufficient to implement the technical solution of the present application.
Based on the display device 200, the user can project the mobile device to the display device 200 through the mirror image, and the screen content of the mobile device is displayed through the display device. The mirror image screen projection is to project screen content of a mobile device to the display device 200 in real time, fig. 5 and fig. 6 respectively exemplarily show a display effect schematic diagram of the mobile device mirror image screen projection to the display device 200 according to some embodiments, fig. 5 is a display effect schematic diagram of an operation interface of the mobile device, and fig. 6 is a display effect schematic diagram of the mobile device viewing media resources, such as videos in a mobile phone album.
At present, an operating system installed on a mobile device is generally an android system, and the mobile device records a screen in real time through a screen recording application and transmits a recorded video stream to a display device to realize mirror image screen projection. However, the screen recording application is an application developed by a third party, that is, the screen recording application does not belong to a system level application, and only allows the current display content of the screen of the operating system to be recorded, but does not allow the operating system to record the currently played audio data and system audio. Therefore, when the user projects the screen to the display device through the mobile device image, the sound of the mobile device cannot be output through the display device, for example, the user projects the video in the mobile phone album to the display device 200 for watching, only the video content can be seen, the corresponding audio cannot be played through the display device 200, and the experience effect is poor. In order to improve the experience effect of a user, some embodiments of the present application provide a display device and a mirror image screen projection audio output control method.
The following describes a process of controlling a mirror projection audio output according to some embodiments of the present application with reference to the accompanying drawings.
A flow diagram of a mirrored-screen-projection audio output control method according to some embodiments is illustrated in fig. 7. The present application provides, in some embodiments, a display device 200, the display device 200 including a display 260, a speaker, and a controller 250, the controller 250 communicatively coupled to the display 260 and the speaker, the controller 250 configured to perform the process of mirror projection audio output control of fig. 7. With reference to fig. 7, the process of the mirror projection audio output control is as follows:
s701: and responding to a screen projection request sent by the mobile equipment, controlling the display to display a playing interface and controlling to start the Bluetooth protocol service of the display equipment, wherein the playing interface is used for displaying the screen projection interface of the mobile equipment.
In some embodiments, when the user needs to screen-cast the screen content image presented on the mobile device to the display device 200, a screen-casting request may be sent to the display device 200 through the mobile device. The display device 200 receives and responds to the screen projection request sent by the mobile device, and establishes connection with the mobile device based on a network connection protocol. After the connection is established, the mobile device may record the screen in real time, record and compress the currently displayed content of the screen into a video stream, and transmit the video stream to the display device 200, where the video stream is a screen projection interface of the mobile device. The display device 200 controls the display 260 to display a playing interface, and displays a screen projection interface of the mobile device on the playing interface.
In some embodiments, both the mobile device and the display device 200 may download the same screen-casting application, and the mobile device and the display device 200 establish a connection relationship based on the screen-casting application, and the mobile device sends the video stream to the display device 200 through the screen-casting application. Here, in the screen projection application of the mobile device, a "start screen projection" control may be set, and when the transfer device receives a click of the "start screen projection" control from the user, the transfer device triggers the function of recording the screen, and compresses and transmits the recorded screen to the display device 200 while recording the screen in real time.
In some embodiments, when the display device 200 and the mobile device establish a connection through a network protocol, the display device 200 simultaneously needs to detect whether a bluetooth protocol service of the display device is started, and if it is detected that the bluetooth protocol service is not started, the display device 200 needs to immediately control the start of the bluetooth protocol service, so that the display device 200 responds to an audio transmission request of the mobile device based on the bluetooth protocol service.
In some embodiments, the display device controls the bluetooth protocol service to connect with the mobile device via bluetooth A2DP (bluetooth Audio Distribution Profile) protocol.
In some embodiments, the display device 200 may respond to screen-cast requests of multiple mobile devices, i.e., may receive screen-cast connections of multiple mobile devices. If the mobile device includes a first mobile device and a second mobile device, when receiving a screen-casting request of the second mobile device, the display device 200 controls the display to simultaneously display a screen-casting interface sent by the first mobile device and a screen-casting interface sent by the first mobile device, wherein the time when the first mobile device sends the screen-casting request to the display device is earlier than the time when the second mobile device sends the screen-casting request to the display device. A display effect diagram of a multi-mobile device mirror screen-cast to a display device 200 according to some embodiments is illustrated in fig. 8. As shown in fig. 8, taking three mobile devices as an example, the first mobile device, the second mobile device, and the third mobile device are all projected on the display device 200, and the display device 200 displays the projection interfaces of the three mobile devices on the same screen on the display 260.
In some embodiments, when there are multiple mobile devices sending screen projection requests, for example, a first mobile device and a second mobile device both send screen projection requests to the display device 200, the display device 200 receives the screen projection requests sent by the first mobile device and the second mobile device, and creates the same number of play controls as the mobile devices in the play interface, where multiple play controls belong to the same application. For example, a plurality of mobile devices are installed with the same screen projection application as the display device 200, and the display device 200 receives screen projection requests of the plurality of mobile devices based on one application. When the first mobile device establishes a connection with the display device 200, the display device 200 creates a first play control on the play interface, and controls the display 260 to display the first play control in a full screen manner. When the display device 200 establishes a connection with a second mobile device, the display device 200 creates a second play control on the play interface, and when the display device 200 establishes a connection with a third mobile device, the display device 200 creates a third play control on the play interface. The playing control is used for displaying a screen projection interface of the mobile equipment. The display effect of the three play controls may be as shown in fig. 8. The display device 200 controls the play control to respectively obtain the screen-projecting interfaces of the corresponding mobile devices for displaying.
In some embodiments, when there are multiple mobile devices sending screen projection requests, for example, a first mobile device and a second mobile device both send screen projection requests to the display device 200, the display device 200 receives the screen projection requests sent by the first mobile device and the second mobile device, and controls a user interface displayed by the display to display windows in the same number as the mobile devices, where the display windows respectively display a playing interface, and the display windows respectively belong to different applications. For example, the plurality of mobile devices are respectively installed with different screen-casting applications, for example, three mobile devices are respectively installed with screen-casting applications supporting three screen-casting protocols of NFC (Near Field Communication), airport (wireless screen casting technology), and DLNA (DIGITAL LIVING NETWORK ALLIANCE), and the display device 200 also establishes NETWORK connection with each mobile device based on the screen-casting applications supporting the three screen-casting protocols. The display device 200 receives screen-casting requests of the corresponding mobile devices based on different applications, respectively. When the first mobile device is connected to the display device 200, the display device 200 starts a corresponding application, and controls the display 260 to display a first display window in a full screen mode, where a screen-projecting interface of the first mobile device is displayed in the first display window. When the display device 200 establishes a connection with a second mobile device, the display device 200 starts an application corresponding to the display device 200, controls the first display window to be placed on one side of the display 260, displays a second display window on the other side of the display 260, and displays a screen projection interface of the second mobile device in the second display window. The display device 200 controls the display windows to respectively obtain screen projection interfaces of the corresponding mobile devices for displaying.
S702: and receiving an audio transmission request sent by the mobile equipment, and establishing a Bluetooth transmission channel with the mobile equipment by using the Bluetooth protocol service.
In some embodiments, after the display device 200 establishes a connection with the mobile device based on the network connection protocol, the mobile device may send an audio transmission request to the display device 200, through which the display device 200 is informed that the mobile device is to perform sound transmission. The audio transmission request content may be as follows: MP _ bluetooth A2DP _ CONNECT _ REQUEST (based on bluetooth A2DP connection REQUEST).
In some embodiments, a "transmit sound" control may be provided in the screen-casting application of the mobile device, and when the mobile device receives a user click on the "transmit sound" control, the mobile device is triggered to send an audio transmission request to the display device 200, and the display device 200 establishes a connection with the mobile device using a bluetooth protocol service in response to the audio transmission request.
In some embodiments, if the mobile device includes a first mobile device and a second mobile device, when receiving an audio transmission request from the second mobile device, the display device 200 controls to stop receiving the audio data sent by the first mobile device and receive the audio data sent by the second mobile device, so that the speaker stops outputting the audio data of the first mobile device and controls the speaker to output the audio data of the second mobile device, where a time when the first mobile device sends the audio transmission request to the display device is earlier than a time when the second mobile device sends the audio transmission request to the display device. That is, when there are a plurality of mobile devices that transmit a screen-casting request, the display device 200 establishes a bluetooth transmission channel with the last mobile device that transmitted an audio transmission request in response to the last mobile device that transmitted an audio transmission request.
In some embodiments, the mobile device comprises a first mobile device and a second mobile device, the first mobile device sending the audio transfer request to the display device at a time earlier than the second mobile device sending the audio transfer request to the display device. The display device 200 receives the audio transmission request sent by the second mobile device, and detects the current bluetooth connection state of the display device 200. If the display device 200 has established a bluetooth transmission channel with the first mobile device, the bluetooth transmission channel with the first mobile device is disconnected. That is, when the display apparatus 200 has established the bluetooth connection with the first mobile apparatus, it is required that the display apparatus 200 transmits a bluetooth connection disconnection instruction to the first mobile apparatus, and first DISCONNECTs the direct connection with the first mobile apparatus, for example, the display apparatus 200 transmits MP _ bluetooth A2DP _ DISCONNECT to the first mobile apparatus (DISCONNECTs bluetooth A2 DP).
In some embodiments, after the first mobile device receives the instruction sent by the display device 200 and representing the disconnection of the bluetooth connection, the bluetooth connection state of the mobile device is updated.
In some embodiments, after the display device 200 disconnects bluetooth from the first mobile device, the second mobile device that sent the audio transmission REQUEST backward feeds back instructions characterizing the permission of the bluetooth connection, e.g., the display device 200 sends an MP _ bluetooth A2DP _ CONNECT _ REQUEST _ ACK (based on the bluetooth A2DP connection REQUEST acknowledgement) to the second mobile device. The second mobile device retransmits the audio transmission request to the display device 200 after receiving the instruction to operate the bluetooth connection transmitted by the display device 200.
In some embodiments, the display device 200 receives an audio transmission request from the second mobile device to re-transmit according to a command characterizing a bluetooth connection is allowed, and establishes a bluetooth transmission channel with the second mobile device.
In some embodiments, when the current bluetooth connection state of the display device 200 is detected, if the display device 200 does not establish a bluetooth transmission channel with the first mobile device, the display device 200 directly establishes a bluetooth transmission channel with the second mobile device in response to an audio transmission request sent by the second mobile device.
In some embodiments, upon receiving an audio transmission request sent by the mobile device, the display device 200 pairs with the mobile device in the background using a default PIN code, so that when the mobile device is connected for the first time, neither the display device 200 nor the mobile device pops up a bluetooth pairing dialog box. That is, when the mobile device and the display device 200 are connected via bluetooth, they are paired by the default PIN code in the background, and a bluetooth transmission channel is established after the pairing is completed. Like this, if mobile device and display device 200 carry out the bluetooth for the first time and connect, mobile device and display device 200 can not pop out the bluetooth and pair the dialog box, need not user operation bluetooth and pair the process, avoid disturbing the user and watch and throw the screen interface, promote user experience.
S703: and receiving audio data sent by the mobile equipment through the Bluetooth transmission channel, and controlling the loudspeaker to output the audio data.
In some embodiments, after the display apparatus 200 establishes a bluetooth transmission channel with the mobile apparatus, the mobile apparatus 200 may transmit audio data to the display apparatus 200 through the bluetooth transmission channel to cause the display apparatus 200 to output corresponding audio data through a speaker.
In some embodiments, after the display device 200 and the mobile device are connected via the network connection protocol, the screen content may be projected first, and after the display device 200 and the mobile device establish the bluetooth connection channel, the audio data may be transmitted. For example, if the user displays the screen-casting interface of the mobile device and then displays the display device 200, the user may find the content to be screen-cast, for example, find a certain self-recorded video in an album, and when the user clicks the video to play, trigger the mobile device to establish a bluetooth connection channel with the display device 200, and then send the audio data corresponding to the video to the display device 200 to play. Of course, the user may also trigger the mobile device to establish a bluetooth connection channel with the display device 200 before playing the video.
The process of controlling the mirror projection audio output in some embodiments of the present application is further described below with reference to the accompanying drawings.
A timing diagram of a mirrored-screen-projection audio output control method according to some embodiments is illustrated in fig. 9. As shown in fig. 9, the display device 200 is connected to the first mobile device and the second mobile device in a screen-casting manner, and the screen contents of the first mobile device and the second mobile device are displayed on the display 260 of the display device 200. The method comprises the steps that first mobile equipment sends an audio transmission request to display equipment 200, the display equipment 200 feeds back an instruction representing permission of Bluetooth connection to the first mobile equipment after receiving the audio transmission request sent by the first mobile equipment, after the first mobile equipment receives the instruction, the first mobile equipment and the display equipment are paired through a default PIN code, after pairing is successful, a Bluetooth connection channel is established between the first mobile equipment and the display equipment 200, the first mobile equipment sends audio data to the display equipment 200, and the display equipment 200 controls a loudspeaker to play after receiving the audio data. At this time, the second mobile device sends an audio transmission request to the display device 200, the display device 200 detects the current bluetooth connection state of the mobile device, and after detecting that the bluetooth connection with the first mobile device is completed, the display device sends an instruction representing the disconnection of the bluetooth connection to the first mobile device, disconnects the bluetooth connection with the first mobile device, and stops playing of audio data of the first mobile device. The first mobile device updates its own bluetooth connection state after receiving an instruction indicating disconnection of the bluetooth connection from the display device 200. After the display device 200 and the first mobile device are disconnected from the bluetooth connection, an instruction representing that the bluetooth connection is allowed is sent to the second mobile device, after the second mobile device receives the instruction, the second mobile device and the display device are paired through a default PIN code, after the pairing is successful, a bluetooth connection channel is established between the second mobile device and the display device 200, the second mobile device sends audio data to the display device 200, and the display device 200 controls a loudspeaker to play after receiving the audio data.
In this application, display device and mobile device are carrying out the mirror image and are throwing the screen when, and the mobile device will throw the screen interface and divide into two routes with corresponding audio data and transmit to display device, wherein, the audio data that has realized the mobile device through bluetooth transmission path passes through the output of display device, very big promotion user experience.
Based on the same inventive concept as the display device, some embodiments of the present application further provide a mirror image projection audio output control method, including: the display device 200 responds to a screen projection request sent by a mobile device, controls the display 260 to display a playing interface and controls to start a bluetooth protocol service of the display device, wherein the playing interface is used for displaying the screen projection interface of the mobile device. The display device 200 receives the audio transmission request sent by the mobile device, and establishes a bluetooth transmission channel with the mobile device by using the bluetooth protocol service. The display device 200 receives the audio data sent by the mobile device through the bluetooth transmission channel, and controls the speaker to output the audio data.
In some embodiments, when there are multiple mobile devices sending screen projection requests, the display device 200 receives the screen projection requests sent by the multiple mobile devices, and creates a play control with the same data as the mobile device in the play interface, where the multiple play controls belong to the same application. The display device 200 controls the play control to respectively obtain the screen-projecting interfaces of the corresponding mobile devices for displaying.
In some embodiments, when there are a plurality of mobile devices that transmit the screen-casting request, the display device 200 establishes a bluetooth transmission channel with the last mobile device that transmitted the audio transmission request in response to the last mobile device that transmitted the audio transmission request.
Since the above embodiments are all described by referring to and combining with other embodiments, the same portions are provided between different embodiments, and the same and similar portions between the various embodiments in this specification may be referred to each other. And will not be described in detail herein.
It is noted that, in this specification, relational terms such as "first" and "second," and the like, are used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a circuit structure, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such circuit structure, article, or apparatus. Without further limitation, the presence of an element identified by the phrase "comprising an … …" does not exclude the presence of other like elements in a circuit structure, article, or device comprising the element.
Other embodiments of the present application will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the invention following, in general, the principles of the application and including such departures from the present disclosure as come within known or customary practice within the art to which the invention pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the application being indicated by the following claims.
The above embodiments of the present application do not limit the scope of the present application.
Claims (10)
1. A display device, comprising:
a display;
a speaker;
a controller communicatively coupled to the display, the speaker, the controller configured to:
responding to a screen projection request sent by mobile equipment, controlling the display to display a playing interface and controlling to start a Bluetooth protocol service of the display equipment, wherein the playing interface is used for displaying the screen projection interface of the mobile equipment;
receiving an audio transmission request sent by the mobile equipment, and establishing a Bluetooth transmission channel with the mobile equipment by using the Bluetooth protocol service;
and receiving audio data sent by the mobile equipment through the Bluetooth transmission channel, and controlling the loudspeaker to output the audio data.
2. The display device of claim 1, wherein the mobile device comprises a first mobile device and a second mobile device, and wherein the controller is further configured to:
when receiving an audio transmission request of a second mobile device, controlling to stop receiving the audio data sent by the first mobile device, and receiving the audio data sent by the second mobile device, so that the loudspeaker stops outputting the audio data of the first mobile device, and controlling the loudspeaker to output the audio data of the second mobile device, wherein the time when the first mobile device sends the audio transmission request to a display device is earlier than the time when the second mobile device sends the audio transmission request to the display device.
3. The display device of claim 1, wherein the mobile device comprises a first mobile device and a second mobile device, and wherein the controller is further configured to:
when a screen projection request of a second mobile device is received, controlling the display to simultaneously display a screen projection interface sent by the first mobile device and a screen projection interface sent by the first mobile device, wherein the time when the first mobile device sends the screen projection request to the display device is earlier than the time when the second mobile device sends the screen projection request to the display device.
4. The display device according to claim 2, wherein in the step of controlling to stop receiving the audio data transmitted by the first mobile device and to receive the audio data transmitted by the second mobile device when receiving an audio transmission request of the second mobile device, the controller is further configured to:
receiving an audio transmission request sent by the second mobile device, and detecting the current Bluetooth connection state of the display device;
if the display equipment establishes a Bluetooth transmission channel with the first mobile equipment, disconnecting the Bluetooth transmission channel with the first mobile equipment and feeding back an instruction representing that Bluetooth connection is allowed to the second mobile equipment;
and receiving an audio transmission request which is retransmitted by the second mobile equipment according to a command for representing permission of Bluetooth connection, and establishing a Bluetooth transmission channel with the second mobile equipment.
5. The display device of claim 4, wherein the controller is further configured to:
and when the current Bluetooth connection state of the display equipment is detected, if the display equipment does not establish a Bluetooth transmission channel with the first mobile equipment, responding to an audio transmission request sent by the second mobile equipment, and establishing the Bluetooth transmission channel with the second mobile equipment.
6. The display device according to claim 3, wherein in the step of controlling the display to simultaneously show the screen-casting interface transmitted by the first mobile device and the screen-casting interface transmitted by the first mobile device when receiving a screen-casting request of a second mobile device, the controller is further configured to:
receiving screen projection requests sent by the first mobile equipment and the second mobile equipment, and creating play controls with the same number as the mobile equipment in the play interface, wherein the play controls belong to the same application;
and controlling the playing control to respectively acquire screen projection interfaces of the corresponding mobile devices for displaying.
7. The display device according to claim 3, wherein in the step of controlling the display to simultaneously show the screen-casting interface transmitted by the first mobile device and the screen-casting interface transmitted by the first mobile device when receiving a screen-casting request of a second mobile device, the controller is further configured to:
receiving screen projection requests sent by the first mobile equipment and the second mobile equipment, and controlling user interfaces displayed by the display to display windows with the same number as that of the mobile equipment, wherein the display windows respectively display playing interfaces and are respectively affiliated to different applications;
and controlling the display windows to respectively acquire screen projection interfaces of the corresponding mobile devices for displaying.
8. The display device of claim 1, wherein the controller is further configured to:
and when receiving an audio transmission request sent by the mobile equipment, pairing the mobile equipment with a default PIN code at the background so that a Bluetooth pairing dialog box does not pop up from the display equipment and the mobile equipment when the mobile equipment is connected for the first time.
9. A mirror projection audio output control method, the method comprising:
responding to a screen projection request sent by mobile equipment, controlling a display to display a playing interface and controlling to start a Bluetooth protocol service of the display equipment, wherein the playing interface is used for displaying the screen projection interface of the mobile equipment;
receiving an audio transmission request sent by the mobile equipment, and establishing a Bluetooth transmission channel with the mobile equipment by using the Bluetooth protocol service;
and receiving audio data sent by the mobile equipment through the Bluetooth transmission channel, and controlling a loudspeaker to output the audio data.
10. The mirror screen audio output control method of claim 9, wherein the mobile device comprises a first mobile device and a second mobile device, the method further comprising:
when receiving an audio transmission request of a second mobile device, controlling to stop receiving the audio data sent by the first mobile device, and receiving the audio data sent by the second mobile device, so that the loudspeaker stops outputting the audio data of the first mobile device, and controlling the loudspeaker to output the audio data of the second mobile device, wherein the time when the first mobile device sends the audio transmission request to a display device is earlier than the time when the second mobile device sends the audio transmission request to the display device.
Priority Applications (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111133007.7A CN113766305A (en) | 2021-09-27 | 2021-09-27 | Display device and mirror image screen projection audio output control method |
| PCT/CN2022/096383 WO2023024630A1 (en) | 2021-08-27 | 2022-05-31 | Display device, terminal device, and content display method |
| CN202280057404.7A CN117859331A (en) | 2021-08-27 | 2022-05-31 | Display device, terminal device and content display method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111133007.7A CN113766305A (en) | 2021-09-27 | 2021-09-27 | Display device and mirror image screen projection audio output control method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113766305A true CN113766305A (en) | 2021-12-07 |
Family
ID=78797582
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111133007.7A Pending CN113766305A (en) | 2021-08-27 | 2021-09-27 | Display device and mirror image screen projection audio output control method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113766305A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115278324A (en) * | 2022-06-30 | 2022-11-01 | 海信视像科技股份有限公司 | Display device, bluetooth device and BIS audio transmission method |
| CN115442643A (en) * | 2021-06-03 | 2022-12-06 | Oppo广东移动通信有限公司 | Screen projection method and device, wireless terminal, screen projection equipment and storage medium |
| WO2024001362A1 (en) * | 2022-06-30 | 2024-01-04 | 海信视像科技股份有限公司 | Display device, bluetooth device, and data processing method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109275130A (en) * | 2018-09-13 | 2019-01-25 | 锐捷网络股份有限公司 | A kind of throwing screen method, apparatus and storage medium |
| CN109508162A (en) * | 2018-10-12 | 2019-03-22 | 福建星网视易信息系统有限公司 | A kind of throwing screen display methods, system and storage medium |
| CN110381197A (en) * | 2019-06-27 | 2019-10-25 | 华为技术有限公司 | Many-one throws the processing method of screen sound intermediate frequency data, apparatus and system |
| CN111552450A (en) * | 2020-04-30 | 2020-08-18 | 深圳市鸿合创新信息技术有限责任公司 | Screen projection method and device |
| CN112511598A (en) * | 2020-11-09 | 2021-03-16 | 深圳康佳电子科技有限公司 | Screen projection display method, intelligent terminal and storage medium |
-
2021
- 2021-09-27 CN CN202111133007.7A patent/CN113766305A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109275130A (en) * | 2018-09-13 | 2019-01-25 | 锐捷网络股份有限公司 | A kind of throwing screen method, apparatus and storage medium |
| CN109508162A (en) * | 2018-10-12 | 2019-03-22 | 福建星网视易信息系统有限公司 | A kind of throwing screen display methods, system and storage medium |
| CN110381197A (en) * | 2019-06-27 | 2019-10-25 | 华为技术有限公司 | Many-one throws the processing method of screen sound intermediate frequency data, apparatus and system |
| CN111552450A (en) * | 2020-04-30 | 2020-08-18 | 深圳市鸿合创新信息技术有限责任公司 | Screen projection method and device |
| CN112511598A (en) * | 2020-11-09 | 2021-03-16 | 深圳康佳电子科技有限公司 | Screen projection display method, intelligent terminal and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115442643A (en) * | 2021-06-03 | 2022-12-06 | Oppo广东移动通信有限公司 | Screen projection method and device, wireless terminal, screen projection equipment and storage medium |
| CN115278324A (en) * | 2022-06-30 | 2022-11-01 | 海信视像科技股份有限公司 | Display device, bluetooth device and BIS audio transmission method |
| WO2024001362A1 (en) * | 2022-06-30 | 2024-01-04 | 海信视像科技股份有限公司 | Display device, bluetooth device, and data processing method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111741372B (en) | Screen projection method for video call, display device and terminal device | |
| CN113766305A (en) | Display device and mirror image screen projection audio output control method | |
| CN114286143B (en) | Display device and automatic switching method of transmission protocol | |
| CN114296670B (en) | Display device and control method for same-screen display of multi-device screen throwing | |
| CN114286165A (en) | Display device, mobile terminal and screen projection data transmission method | |
| WO2022105409A1 (en) | Fault diagnosis method, terminal device, and display device | |
| CN113489700A (en) | Method, server and terminal equipment for acquiring media asset data | |
| WO2024022306A1 (en) | Interaction method and apparatus, and electronic device and computer-readable medium | |
| CN113507638A (en) | Display device and screen projection method | |
| CN113784200A (en) | Communication terminal, display device and screen projection connection method | |
| CN112351334B (en) | File transmission progress display method and display equipment | |
| CN111885665B (en) | Wireless network connection control method and display device | |
| CN113573135A (en) | Screen projection method of display equipment, display equipment and client | |
| CN115396708A (en) | Display device, control apparatus, and device name update method | |
| WO2022042592A1 (en) | Screen projection method and apparatus, electronic device, and computer-readable medium | |
| EP4315017A1 (en) | Multi-screen management | |
| CN113784186A (en) | Terminal device, server, and communication control method | |
| CN112087651B (en) | Method for displaying inquiry information and smart television | |
| CN115835348A (en) | Display device and control method of external device | |
| WO2022033153A1 (en) | Display method and display device | |
| CN113992963A (en) | Display device and screen projection method | |
| CN115643438A (en) | Display device, terminal device and mirror image screen projection method | |
| CN117896565A (en) | Display apparatus and display control method | |
| CN117609652A (en) | Display equipment and webpage screen projection method | |
| CN114968150A (en) | Screen projection control method and terminal equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |