WO2015062337A1 - Displaying lyrics of a song on a mobile computing device in a lock screen state - Google Patents

Displaying lyrics of a song on a mobile computing device in a lock screen state Download PDF

Info

Publication number
WO2015062337A1
WO2015062337A1 PCT/CN2014/084279 CN2014084279W WO2015062337A1 WO 2015062337 A1 WO2015062337 A1 WO 2015062337A1 CN 2014084279 W CN2014084279 W CN 2014084279W WO 2015062337 A1 WO2015062337 A1 WO 2015062337A1
Authority
WO
WIPO (PCT)
Prior art keywords
song
computing device
lyrics
image
composite
Prior art date
Application number
PCT/CN2014/084279
Other languages
French (fr)
Inventor
Qing Zhang
Huande Zheng
Xiaoting LAN
Yilan Liu
Original Assignee
Tencent Technology (Shenzhen) Company Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology (Shenzhen) Company Limited filed Critical Tencent Technology (Shenzhen) Company Limited
Publication of WO2015062337A1 publication Critical patent/WO2015062337A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/60Editing figures and text; Combining figures or text

Definitions

  • the disclosure relates generally to the field of data processing, and specifically to displaying lyrics of a song on a mobile computing device in a lock screen state.
  • a lock screen state of a computing device is a state when the computer is not actively used, e.g., when a user locks his/her computer.
  • a computing device is in a lock screen state, normal input to the computing device is limited and the user is often required to enter some code, (e.g., password) to unlock the computing device.
  • a lock screen is a display screen of a computing device in a lock screen state.
  • Embodiments of the invention provide enhanced user experience with playing songs on a mobile computing device in a lock screen state by generating composite images for the song and displaying the composite images on the computing device.
  • Each of the composite images for the song comprises an image associated with the song and text of a part of the lyrics of the song.
  • a computer-implemented method for displaying lyrics of a song on a computing device in a lock screen state comprises generating multiple composite images for the song, where each composite image has text for lyrics of the song and an image associated with the song, e.g., a cover image of the song.
  • the composite images for the song are sequentially displayed on the computing device in a lock screen state, where each composite image is displayed while the lyrics corresponding to the composite image are being played on the computing device.
  • a computing device e.g., a mobile phone
  • a computing device for displaying lyrics of a song on a computing device in a lock screen state.
  • One embodiment of the computing device has a computer processor for executing computer program modules, such as a lyrics module, a synthesis module and a display module, and a non- transitory computer readable storage device storing computer program modules.
  • the computer program modules are executable to perform steps comprising generating multiple composite images for the song and sequentially displaying the multiple composite images on the computing device.
  • Each composite image has text for lyrics of the song and an image associated with the song, and each composite image is displayed while the lyrics corresponding to the composite image are being played on the computing device.
  • the multiple composite images of the song are displayed and the lyrics of the song are played while the computing device is in a lock screen state.
  • Another aspect provides a non-transitory computer-readable storage medium storing executable computer program instructions for sharing digital data resources among multiple clients.
  • the computer-readable storage medium stores computer program instructions for generating multiple composite images for the song and sequentially displaying the multiple composite images on the computing device while the computing device is in a lock screen state.
  • FIG. 1 is a block diagram illustrating an example of a computing device for displaying lyrics of a songaccording to one embodiment.
  • FIG. 2 is a block diagram illustrating a computing device for displaying lyrics of a song on the computing device in a lock screen stateaccording to one embodiment.
  • FIG. 3 is a flowchart illustrating a process for generating a composite imagefor a song to be played on a computing deviceaccording to one embodiment.
  • FIG. 4 is an exemplary composite image without lyrics of a song displayed on a computing device in a lock screen state according to one embodiment.
  • FIG. 5 an exemplary composite imagewith lyrics of a songdisplayed on a computing device in a lock screen state according to one embodiment.
  • FIG. 6 is a flowchart illustrating aprocess for generating multiple composite imagesfor a song according to one embodiment.
  • FIG. 7 is an exemplary composite image generated according tothe process illustrated in FIG. 6.
  • FIG. 8 is aflowchart illustrating a process for generating composite images comprising comments associated with a song according to one embodiment.
  • FIG. 9 is an exemplary composite image generated according to the process illustrated in FIG. 8.
  • FIG. 10 is an exemplary display of a composite image of a song being played on a computing device in a lock screen state according to one embodiment.
  • a solution is provided to enhance user experience with playing songs on a mobile computing device in a lock screen state by generating one or more composite images for the song and displaying the composite images on the computing device.
  • Each of the composite images for the song comprises an image associated with the song and text of a part of the lyrics of the song.
  • Each composite image is displayed while the corresponding lyrics of the composite image are being played on the computing device.
  • the multiple composite images for the song are displayed in a sequence according to the order of the lyrics being played on the computing device. At the end of the duration for displaying a current composite image for the song, the next composite image in the sequence is displayed while the corresponding lyrics of the next composite image are being played on the computing device.
  • FIG. 1 is a block diagram illustrating an example of a computing device 100 for displaying lyrics of a song according to one embodiment.
  • the computing device 100 includes a radio frequency (RF) circuit 110, a memory 120 comprising one or more computer readable storage medium, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a wireless fidelity (WiFi)module 170, a processor 180 and a power supply 190.
  • RF radio frequency
  • Other embodiments of the computing device lOOcan have different and/or additional components such as a camera and a Bluetooth module.
  • the functions performed by the various entities of FIG.1 may differ in different embodiments.
  • the RF circuit 110 is configured to receive and send a signal of downlink or uplink information. For example, after receiving downlink information of a base station, the RF circuit 110 sends the downlink information to one or more processors 180 for processing. In addition, the RF circuit 110 sends uplink information to the base station.
  • the RF circuit 110 includes, but not limited to, an antenna, an amplifier, a tuner, one or more oscillators, a subscriber identity module (SIM) card, a transceiver, a coupler, a low noise amplifier and a duplexer.
  • SIM subscriber identity module
  • the RF circuit 110 may further communicate with other devices through wireless communications networks using any wireless communication protocols.
  • the memory 120 is configured to store software programs and modules, and the processor 180 executes the software programs and modules stored in the memory 120.
  • the input unit 130 is configured to receive input information related to user settings and function control.
  • the input unit 130 includes a touch sensitive surface 131 and another input device 132.
  • the touch sensitive surface 131 is also referred to as a touch screen or touch panel, which can collect a touch operation on or near the touch sensitive surface 131 by a user using a finger and a stylus.
  • the touch sensitive surface 131 may include a touch detection apparatus and a touch controller.
  • the touch detection apparatus detects a touch direction of the user, detects a signal caused by the touch operation, and transmits the signal to the touch controller.
  • the touch controller receives touch information from the touch detection apparatus, converts the touch information into touch point coordinates, and transmits the touch point coordinates to the processor 180; moreover, the touch controller can further receive a command sent by the processor 180 and execute the command.
  • the another input device 132 may include, but not limited to, one or more of a physical keyboard, function keys (such as a volume control button and a switch button), a trackball and a mouse.
  • the display unit 140 is configured to display information input by the user or information provided for the user and various graphical user interfaces (GUI) of the computing device 100.
  • GUI graphical user interfaces
  • the GUIs may be formed by a graphic, a text, an icon, a video, or any combination thereof.
  • the display unit 140 may include a display panel 141.
  • the display panel 141 may be implemented by using a liquid crystal display (LCD), an organic light-emitting diode (OLED) and other forms.
  • the display unit 140 may also create a virtual display, such as head mounted displays, virtual reality displays and augmented reality displays.
  • the display panel 141 receives visual input generated by the processor 180.
  • the touch sensitive surface 131 detects the touch operation on or near the touch sensitive surface 131 and transmits the touch operation to the processor 180 to determine a type of the touch event.
  • the processor 180 provides, according to the type of the touch event, a corresponding visual output to the display panel 141 for display.
  • the computing device 100 may further include a sensor 150, such as an optical sensor and a motion sensor.
  • the audio circuit 160, a loudspeaker 161, and a microphone 162 can provide audio interfaces between a user and the computing device 100.
  • the audio circuit 160 can convert received audio data into electric signals, and transmit the electric signals to the loudspeaker 161for outputting the sound signals.
  • the microphone 162 converts a sound signal to an electric signal and transmits the electrical signal to the audio circuit 160 for outputting the audio data to the processor 180 for further processing.
  • the WiFi module 170 is configured to provide wireless Internet access for the user, who can send or receive emails, browse webpages and access streaming media.
  • the processor 180 is connected to different parts of the computing device 100 and executes the software program and/or module stored in the memory 120, various functions and processing data of the computing device 100. For example, the processor 180 performs overall monitoring on a mobile phone.
  • the power supply 190 e.g., a battery
  • the power supply management system provides electrical power to the modules of the computing device 100 through a power supply management system, thereby implementing functions such as charging management, discharging management, and power consumption management through the power supply management system.
  • a computing device 100 can have different and/or other components than those shown in FIG. 1.
  • the computing device 100 can lack certain illustrated components.
  • the computing device 100 acting as a computer server can be formed of multiple blade servers linked together into one or more distributed systems and lack components such as keyboards and displays.
  • the memory 120 can be local and/or remote from the computing device 100 (such as embodied within a storage area network (SAN)).
  • SAN storage area network
  • FIG. 2 is a block diagram illustrating a computing device 100 for displaying lyrics of a song on the computing device 100 while the computing device 100 is in a lock screen state according to one embodiment.
  • the computing device 100 is an electronic device used by a user to perform functions such as playing a song stored in the computing device 100, executing software applications, and browsing websites hosted by web servers on a computer network.
  • the computing device 100 may include computing devices that have a wide range of processing capabilities such as a personal computer (PC), a personal digital assistant (PDA), a smart phone, a laptop computer, a notebook computer, a tablet device or any machine capable of executing a set of computer program instructions that specify actions to be taken by the machine.
  • PC personal computer
  • PDA personal digital assistant
  • smart phone a laptop computer
  • notebook computer a notebook computer
  • tablet device any machine capable of executing a set of computer program instructions that specify actions to be taken by the machine.
  • the computing device 100 includes and/or interfaces with a display device on which the user may view lyrics of a song, video files and other digital content.
  • the computing device 100 provides a user interface (UI), such as physical and/or on-screen buttons, with which the user may interact with the computing device 100 to perform functions such as viewing lyrics of a song and consuming digital content.
  • UI user interface
  • the computing device 100 has a computer memory 210, a computer processor 220 and a resource database 230.
  • the memory 210 stores data and/or instructions that may be executed by the processor 220.
  • the instructions may comprise computer program code for performing any and/or all of the techniques described herein.
  • the memory 210 may be a DRAM device, a static random access memory (SRAM), Flash RAM (non-volatile storage), combinations of the above, or some other memory device known in the art.
  • the memory 210 comprises a lyrics module 202, a synthesis module 204 and a display module 206. Other embodiments may contain different functional modules and different number of modules.
  • the lyrics module 202 is configured to obtain lyrics of a song being played on a computing device 100 in a lock screen state.
  • the lyrics module 202 detects a user action in selecting a song and playing the song. Responsive to the detection of a selected song being played, the lyrics module 202 searches for the lyrics associated with the song locally, such as the resource database 230 or remotely, such as the Internet.
  • a song may last for a certain period of time, e.g., a few minutes, and a song can have timing information, such as starting time and ending time, for each word of the lyrics of the song.
  • the lyrics module 202 monitors the timing information associated with the song and its corresponding lyrics.
  • the lyrics module 202 monitors present time periods associated with a song.
  • a present time period refers to a pre-specified period of timebetween time for acurrent event of playing a song on the computing device 100 and time for a subsequent event of playing the song on the computing device lOO.Responsive to the end of the present time period associated with the song, the lyrics module 202 interacts with the display module 206 to display images associated with the subsequent event.
  • the current event of playing the song is displaying a cover image of the song without any lyrics of the song and the subsequent event is displaying a first character of the lyrics of the song.
  • the pre-specified time period associated with the song is the period of time between the time for the current event and the time for the subsequent event of playing the song on the computing device 100.
  • the lyrics module 202 interacts with the display module 206 for displaying the first character of the lyrics of the song with the cover image of the song.
  • the lyrics module 202 obtains only a portion of the lyrics of a song associated with the present time period of playing the song. In other embodiments, the lyrics module 202 may pre-fetch one or more subsequent portions of the lyrics of the song to be subsequently played. The lyrics module 202 may store the pre-fetched portions of the lyrics of the song in a local storage for fast retrieving and processing.
  • Thesynthesis module 204 is configured to generate one or more composite images for a song being played on the computing device 100 while the computing device 100 is in a lock screen state.
  • a composite image is a digital image combining two or more visual elements, such as a video frame, a still image and text, into a single image.
  • the synthesis module 204 generates a composite image though digital image manipulation including digital graphics overlay.
  • the digital graphics overlay techniques can be used to combine a digital graphics element, e.g., a digital picture of the singer of a song, with another digital graphics element, e.g., text of the lyrics of the song, to generate a composite image.
  • a part of the digital graphics element may be replaced by a part of another digital graphics element.
  • the composite image of a song comprising a cover image of the song and text of the lyrics of the song may have a part of the cover image being replaced by the text of the lyrics of the song.
  • the synthesis module 204 receives images associated with a song being played on the computing device 100 in a lock screen state and also receivesthe lyrics of the song.
  • the synthesis module 204 generates composite imagesfor the song based on the images associated with the song and on the lyrics of the song.
  • Each composite image of the song comprises an image associated with the song, e.g., a cover image of the song, text of the lyrics of the song and/or comments on the song or the lyrics of the song.
  • the composite images of the song are displayed in a sequence according to an order that the song lyrics are played on the computing device.
  • the synthesis module 204 determines whether the pixels of the image at the selected location are transparent. If the pixels of the image are transparent, the pixels of the selected location in the composite image are left unchanged; otherwise, the pixels of the image at the selected location are replaced with the pixels representing the text of the lyrics of the song.
  • a song may have long lyrics and the text of the lyrics of the song can be displayed in multiple lines within a limited display area, such as the display screen of a mobile phone.
  • the synthesis module 206 of the computing device 100 generates multiple composite images for the song to be played on the computing device 100 while the computing device 100 is in a lock screen state.
  • Each of the composite images for the song comprises an image associated with the song and text of a part of the lyrics of the song.
  • Each composite image is displayed while the corresponding lyrics of the composite image are being played on the computing device 100.
  • the multiple composite images for the song are displayed in a sequence according to the order of the lyrics being played on the computing device 100. At the end of the duration for displaying a current composite image for the song, the next composite image in the sequence is displayed while the corresponding lyrics of the next composite image are being played on the computing device 100.
  • the synthesis module 204 generates one or more composite images associates with a song being played on the on the computing device 100 in a lock screen state by combining the images associated with the song, text of the lyrics of the song and/or comments on the song and/or the lyrics of the song.
  • the comments of the song can be in a form of text or graphics.
  • the synthesis module 204 selects a location on the image associated with the song to overlay the text elements representing the lyrics of the song and selects another location on the image to overlay the comments of the song.
  • the display module 206 is configured to display composite images of a song being played on the on the computing device 100 in a lock screen state.In an embodiment, the display module 206 may adjust the original dimensions of a composite image of the song to be suitable for the display on a display screen of the computing device 100.
  • the display module 206 may adjust visual features associated with the composite images of the song, such as adjusting the brightness of a composite image and displaying different shades, different colors and/or different fonts for different portions of the lyrics of the song.
  • the adjustments may also include image format conversion, e.g., converting a Joint Photographic Experts Group (JPEG) image into a Portable Network Graphics (PNG) image, before the display.
  • JPEG Joint Photographic Experts Group
  • PNG Portable Network Graphics
  • the resource database 230 stores songs and digital images associated with the songs to be played by the computing device 100.
  • a user of the computing device 100 downloads songs from a music supplying store online, such as iTune stores.
  • the downloaded songs are stored in the resource database 230.
  • a song may have one or more images associated with the song, such as a cover image of an artist (singer, composer) associated the song, an animation of the subject of the song and other digital graphics associated with the song.
  • the resource database 230 may also store indexing information for identifying the songs and images stored in the resource database 230.
  • FIG. 10 is an exemplary display of a composite image of a song being played on a computing device in a lock screen state according to one embodiment.
  • the computing device illustrated in FIG. 10 is a mobile phone 1000.
  • the mobile phone 1000 is in a lock screen state as indicated by an arrow symbol 1002, which reminds a user of the mobile phone 1000 to slide the arrow 1002 to unlock the mobile phone 1000.
  • a song is currently being played by the mobile phone 1000, which displays a composite image 1010 associated the song.
  • the composite image 1010 comprises a cover image 1004 showing the singer of the song and a text element 1006 representing the lyrics of the song.
  • the text element 1006 is circled by a text box that has three lines of the lyrics of the song, where the line being highlighted 1008 corresponds to the lyrics of the song being currently played.
  • the line above the highlighted line 1008 presents the lyrics precedent to the lyrics currently being played and the line below the highlighted line 1008 presents the lyrics subsequent to the lyrics currently being played.
  • FIG. 3 is a flowchart illustrating a process for generating a composite image associated with a song to be played on a computing device 100 according to one embodiment.
  • the lyrics module 202 of the computing device 100 detects 301 a song being played on the computing device 100, e.g., detecting a user selection of a song from a playlist and starting a media player embedded in the computing device 100.
  • the display module 206 of the computing device displays 302 a cover image associated with the song on a display screen of the computing device 100.
  • the lyrics module 202 obtains 303 the lyrics of the song.
  • the synthesis module 204 generates 304 a composite image comprising the cover image of the song and text of the lyrics of the song, where the lyrics of the song are to be played after the display of the cover image of the song.
  • the text of the lyrics of the song and the cover image associated with the song are combined through digital graphics overlay to generate the composite image.
  • the display module 206 replaces 305 the cover image with the composite image responsive to the end of the present time period associated with the displaying of the cover image.
  • FIG. 4 is an exemplary composite image without the lyrics of a song displayed on a computing device 100 in a lock screen state according to one embodiment.
  • the computing device 100 is currently in a lock screen state as indicated by a sliding bar 408, which instructs a user of the computing device 100 to slide the bar to unlock the screen.
  • the computing device 100 has a camera 412, a display screen 402 and a push button 410 to receive user input.
  • the computing device 100 displays a cover image 406 associated with the song on the display screen 402.
  • the cover image 406 has an associated present time period, which indicates the duration of the cover image 406 to be displayed on the display screen 402.
  • the cover image 406 functions as a composite image without the lyrics of the song.
  • the computing device 100 displays next composite image associated with the song as illustrated in FIG. 5.
  • FIG. 5 an exemplary composite image comprising lyrics of a song displayed on a computing device 100 in a lock screen state according to one embodiment.
  • the composite image 502 displayed on the display screen comprises a cover image 504 and text 506 of the lyrics of the song.
  • the text 506 of the lyrics of the song is shown in a text box 508 laid over the cover image 504 based on a pixel-to-pixel overlay scheme, where the pixels representing the text of the lyrics replace the pixels of the cover image 504 located within the text box 508.
  • the computing device 100 displays the composite image for the duration of the lyrics of the song being played.
  • a song may have long lyrics and the text of the lyrics of the song can be displayed in multiple lines within a limited display area, such as the display screen of a mobile phone.
  • FIG. 6 is a flowchart illustrating a process for generating multiple composite images for a song according to one embodiment.
  • the computing device 100 obtains 601 the lyrics of a song to be played on the computing device 100 and one or more cover images associated with the song.
  • the computing device 100 generates 602 multiple composite images for the song.
  • Each of the composite images comprises a cover image of the song and the text of a part of the lyrics of the song and two composite images may have the same cover image of the song, but with different texts of the lyrics of the song.
  • the multiple composite images are to be displayed according the order of the lyrics of the song to be played on the computing device 100.
  • the computing device 100 displays 602 the first composite image as a current picture of the song on a display screen of the computing device 100 for a duration defined by the present time period associated with the first composite image.
  • the computing device 100 checks 604 whether the display of the first composite image of the song has reached the end of its duration based on the present time period associated with the first composite image. If it is the time for displaying the next composite image, the computing device 100 displays 605 the next composite image by replacing the current picture of the song with the next composite image and the next composite image becomes the current picture of the song.
  • the computing device 100 also checks 606 whether a composite image of the song to be displayed is the last composite image to be displayed. If the composite image is the last one to be displayed, the computing device 100 displays 607 the current picture until the end of its duration. If the composite image is not the last composite image, the computing device 100 repeats the steps of 605-607 for displaying the remaining composite images of the song.
  • FIG. 7 is an exemplary composite image generated according to the process illustrated in FIG. 6.
  • the exemplary composite image 702 is one of the multiple composite images of a song being played on the computing device 100 while the computing device 100 is in a lock screen state.
  • the composite image 702 comprises an image 704 associated with the song and three lines of the text of the lyrics of the song shown in a text box 706 laid over the image 704.
  • the middle line 701 shows the text of the lyrics, where the lyrics are currently played on the computing device 100.
  • the first line of the text of the lyrics 708 corresponds to the text of the lyrics of the song being displayed prior to the display of the current text of the lyrics 710.
  • the third line 712 corresponds to the text of the lyrics of the song to be displayed subsequent to the display of the current text of the lyrics 710.
  • the computing device 100 displays the text of the lyrics in different shades of a color, in different colors or in different fonts.
  • FIG. 8 is aflowchart illustrating a process for generating composite images of a song comprising comments associated with the song according to one embodiment.
  • the computing device 100 obtains 801 the lyrics of a song and images associated with the song. In response to comments on the lyrics of the song, on the song or on both the lyrics and the song, the computing device 100 obtains 802 the comments and generates one or more composite images for the song as described above. Each of the composite images comprises an image associated with the song, text of the lyrics of the song and some comments on the song/lyrics.
  • the computing device 100 displays 804 the first composite image as a current picture of the song on a display screen of the computing device 100 for a duration defined by the present time period associated with the first composite image.
  • the computing device 100 checks 805 whether the display of the first composite image of the song has reached the end of its duration based on the present time period associated with the first composite image. Responsive to the time for displaying the next composite image, the computing device 100 displays 806 the next composite image by replacing the current picture of the song with the next composite image and the next composite image becomes the current picture of the song.
  • the computing device 100 also checks 807 whether a composite image of the song to be displayed is the last composite image to be displayed. If the composite image is the last one to be displayed, the computing device 100 displays 808 the current picture until the end of its duration. If the composite image is not the last composite image, the computing device 100 repeats the steps of 805-808 for displaying the remaining composite images of the song.
  • FIG. 9 is an exemplary composite image generated according to the process illustrated in FIG. 8.
  • the exemplary composite image 902 is one of the multiple composite images of a song being played on the computing device 100 while the computing device 100 is in a lock screen state.
  • the composite image 902 comprises an image 904 associated with the song, three lines of the text of the lyrics of the song shown in a text box 906 laid over the image 904 and a comment on the song 914, "Nice Song!.”
  • the comment 914 in the illustration is located at the bottom of the display screen of the computing device 100.
  • the comment 914 can be laid over the image 804 similar as the lyrics of the song in another embodiment.
  • the comment can be provided by the user of the computing device 100 and/or from other listeners in an online community, who have listened to the song before.
  • the third line 912 shows the text of the lyrics, where the lyrics are currently played on the computing device 100.
  • the first line of the text of the lyrics 908 and the second line of the text of the lyrics 910 correspond to the text of the lyrics of the song being displayed in a sequence prior to the display of the current text of the lyrics 912.
  • the three lines of the text of the lyrics are displayed in two different shades of a color.
  • User experience with playing songs on a mobile computing device in a lock screen state is enhanced by having composite images for a song and displaying the composite images on the computing device.
  • Each of the composite images for the song comprises an image associated with the song and text of a part of the lyrics of the song.
  • Each composite image is displayed while the corresponding lyrics of the composite image are being played on the computing device.
  • the multiple composite images for the song are displayed in a sequence according to the order of the lyrics being played on the computing device.
  • a software module is implemented with a computer program product comprising a computer-readable medium containing computer program code, which can be executed by a computer processor for performing any or all of the steps, operations, or processes described.
  • Embodiments of the invention may also relate to an apparatus for performing the operations herein.
  • This apparatus may be specially constructed for the required purposes, and/or it may comprise a general-purpose computing device selectively activated or reconfigured by a computer program stored in the computer.
  • a computer program may be stored in a tangible computer readable storage medium or any type of media suitable for storing electronic instructions, and coupled to a computer system bus.
  • any computing systems referred to in the specification may include a single processor or may be architectures employing multiple processor designs for increased computing capability.

Abstract

A solution is provided to enhance user experience with playing songs on a mobile computing device in a lock screen state by generating one or more composite images for the song and displaying the composite images on the computing device. The computing device has a computer processor for executing computer program modules, such as a lyrics module, a synthesis module and a display module, and a non-transitory computer readable storage device storing computer program modules. Each composite image has text for lyrics of the song and an image associated with the song and each composite image is displayed while the lyrics corresponding to the composite image are being played on the computing device. The multiple composite images of the song are displayed and the lyrics of the song are played while the computing device is in a lock screen state.

Description

DISPLAYING LYRICS OF A SONG ON A MOBILE COMPUTING DEVICE IN A LOCK SCREEN STATE
TECHNICAL FIELD
[0001] The disclosure relates generally to the field of data processing, and specifically to displaying lyrics of a song on a mobile computing device in a lock screen state.
BACKGROUND
[0002] The development of digital media content consumption and sharing has enabled many features to enhance the user experience. However, the proliferation of digital media consumption and sharing has highlighted a number of challengesincluding providing better computing power reservation and longer battery life of computing devices while enhancing the user experience. For example, when a user uses a computing device such as a mobile phone or a tablet computer to play songs only, e.g., the user does not access other computer applications executable by the computing device, the computing device can enter a lock screen state to save computing power of the computing device.
[0003] A lock screen state of a computing device is a state when the computer is not actively used, e.g., when a user locks his/her computer. When a computing device is in a lock screen state, normal input to the computing device is limited and the user is often required to enter some code, (e.g., password) to unlock the computing device. A lock screen is a display screen of a computing device in a lock screen state. SUMMARY
[0004] Embodiments of the invention provide enhanced user experience with playing songs on a mobile computing device in a lock screen state by generating composite images for the song and displaying the composite images on the computing device. Each of the composite images for the song comprises an image associated with the song and text of a part of the lyrics of the song. When playing songs on a computing device in a lock screen state, a user not only can view images of the song but also text of the lyrics of the song and/or comments on the song/lyrics while the song lyrics are being played.
[0005] A computer-implemented method for displaying lyrics of a song on a computing device in a lock screen stateis disclosed. Embodiments of the method comprise generating multiple composite images for the song, where each composite image has text for lyrics of the song and an image associated with the song, e.g., a cover image of the song. The composite images for the song are sequentially displayed on the computing device in a lock screen state, where each composite image is displayed while the lyrics corresponding to the composite image are being played on the computing device.
[0006] Another aspect provides a computing device, e.g., a mobile phone, for displaying lyrics of a song on a computing device in a lock screen state. One embodiment of the computing device has a computer processor for executing computer program modules, such as a lyrics module, a synthesis module and a display module, and a non- transitory computer readable storage device storing computer program modules. The computer program modules are executable to perform steps comprising generating multiple composite images for the song and sequentially displaying the multiple composite images on the computing device. Each composite image has text for lyrics of the song and an image associated with the song, and each composite image is displayed while the lyrics corresponding to the composite image are being played on the computing device. The multiple composite images of the song are displayed and the lyrics of the song are played while the computing device is in a lock screen state.
[0007] Another aspect provides a non-transitory computer-readable storage medium storing executable computer program instructions for sharing digital data resources among multiple clients. The computer-readable storage medium stores computer program instructions for generating multiple composite images for the song and sequentially displaying the multiple composite images on the computing device while the computing device is in a lock screen state.
[0008] The features and advantages described in the specification are not all inclusive and, in particular, many additional features and advantages will be apparent to one of ordinary skill in the art in view of the drawings, specification, and claims. Moreover, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the disclosed subject matter.
BRIEF DESCRIPTION OF THE DRAWINGS
[0009] FIG. 1 is a block diagram illustrating an example of a computing device for displaying lyrics of a songaccording to one embodiment.
[0010] FIG. 2 is a block diagram illustrating a computing device for displaying lyrics of a song on the computing device in a lock screen stateaccording to one embodiment. [0011] FIG. 3 is a flowchart illustrating a process for generating a composite imagefor a song to be played on a computing deviceaccording to one embodiment.
[0012] FIG. 4 is an exemplary composite image without lyrics of a song displayed on a computing device in a lock screen state according to one embodiment.
[0013] FIG. 5an exemplary composite imagewith lyrics of a songdisplayed on a computing device in a lock screen state according to one embodiment.
[0014] FIG. 6 is a flowchart illustrating aprocess for generating multiple composite imagesfor a song according to one embodiment.
[0015] FIG. 7 is an exemplary composite image generated according tothe process illustrated in FIG. 6.
[0016] FIG. 8 is aflowchart illustrating a process for generating composite images comprising comments associated with a song according to one embodiment.
[0017] FIG. 9 is an exemplary composite image generated according to the process illustrated in FIG. 8.
[0018] FIG. 10 is an exemplary display of a composite image of a song being played on a computing device in a lock screen state according to one embodiment.
DETAILED DESCRIPTION
[0019] The figures (FIGS.) and the following description describe certain embodiments by way of illustration only. One skilled in the art will readily recognize from the following description that alternative embodiments of the structures and methods illustrated herein may be employed without departing from the principles described herein. Reference will now be made in detail to several embodiments, examples of which are illustrated in the accompanying figures. It is noted that wherever practicable similar or like reference numbers may be used in the figures to indicate similar or like functionality.
COMPUTING SYSTEM ARCHITECTURE
[0020] A solution is provided to enhance user experience with playing songs on a mobile computing device in a lock screen state by generating one or more composite images for the song and displaying the composite images on the computing device. Each of the composite images for the song comprises an image associated with the song and text of a part of the lyrics of the song. Each composite image is displayed while the corresponding lyrics of the composite image are being played on the computing device. The multiple composite images for the song are displayed in a sequence according to the order of the lyrics being played on the computing device. At the end of the duration for displaying a current composite image for the song, the next composite image in the sequence is displayed while the corresponding lyrics of the next composite image are being played on the computing device.
[0021] FIG. 1 is a block diagram illustrating an example of a computing device 100 for displaying lyrics of a song according to one embodiment. In the embodiment illustrated in FIG. 1 , the computing device 100 includes a radio frequency (RF) circuit 110, a memory 120 comprising one or more computer readable storage medium, an input unit 130, a display unit 140, a sensor 150, an audio circuit 160, a wireless fidelity (WiFi)module 170, a processor 180 and a power supply 190. Other embodiments of the computing device lOOcan have different and/or additional components such as a camera and a Bluetooth module. Likewise, the functions performed by the various entities of FIG.1 may differ in different embodiments. [0022] The RF circuit 110 is configured to receive and send a signal of downlink or uplink information. For example, after receiving downlink information of a base station, the RF circuit 110 sends the downlink information to one or more processors 180 for processing. In addition, the RF circuit 110 sends uplink information to the base station. Generally, the RF circuit 110 includes, but not limited to, an antenna, an amplifier, a tuner, one or more oscillators, a subscriber identity module (SIM) card, a transceiver, a coupler, a low noise amplifier and a duplexer. The RF circuit 110 may further communicate with other devices through wireless communications networks using any wireless communication protocols.
[0023] The memory 120 is configured to store software programs and modules, and the processor 180 executes the software programs and modules stored in the memory 120. The input unit 130 is configured to receive input information related to user settings and function control. In one embodiment, the input unit 130 includes a touch sensitive surface 131 and another input device 132. The touch sensitive surface 131 is also referred to as a touch screen or touch panel, which can collect a touch operation on or near the touch sensitive surface 131 by a user using a finger and a stylus. The touch sensitive surface 131 may include a touch detection apparatus and a touch controller. The touch detection apparatus detects a touch direction of the user, detects a signal caused by the touch operation, and transmits the signal to the touch controller. The touch controller receives touch information from the touch detection apparatus, converts the touch information into touch point coordinates, and transmits the touch point coordinates to the processor 180; moreover, the touch controller can further receive a command sent by the processor 180 and execute the command. The another input device 132 may include, but not limited to, one or more of a physical keyboard, function keys (such as a volume control button and a switch button), a trackball and a mouse.
[0024] The display unit 140 is configured to display information input by the user or information provided for the user and various graphical user interfaces (GUI) of the computing device 100. The GUIs may be formed by a graphic, a text, an icon, a video, or any combination thereof. The display unit 140 may include a display panel 141. The display panel 141 may be implemented by usinga liquid crystal display (LCD), an organic light-emitting diode (OLED) and other forms. The display unit 140 may also create a virtual display, such as head mounted displays, virtual reality displays and augmented reality displays.
[0025] In one embodiment, the display panel 141 receives visual input generated by the processor 180. For example, the touch sensitive surface 131 detects the touch operation on or near the touch sensitive surface 131 and transmits the touch operation to the processor 180 to determine a type of the touch event. The processor 180 provides, according to the type of the touch event, a corresponding visual output to the display panel 141 for display.
[0026] The computing device 100 may further include a sensor 150, such as an optical sensor and a motion sensor. The audio circuit 160, a loudspeaker 161, and a microphone 162 can provide audio interfaces between a user and the computing device 100. The audio circuit 160 can convert received audio data into electric signals, and transmit the electric signals to the loudspeaker 161for outputting the sound signals. The microphone 162 converts a sound signal to an electric signal and transmits the electrical signal to the audio circuit 160 for outputting the audio data to the processor 180 for further processing. [0027] The WiFi module 170 is configured to provide wireless Internet access for the user, who can send or receive emails, browse webpages and access streaming media. The processor 180 is connected to different parts of the computing device 100 and executes the software program and/or module stored in the memory 120, various functions and processing data of the computing device 100. For example, the processor 180 performs overall monitoring on a mobile phone. The power supply 190 (e.g., a battery) provides electrical power to the modules of the computing device 100 through a power supply management system, thereby implementing functions such as charging management, discharging management, and power consumption management through the power supply management system.
[0028] As is known in the art, a computing device 100 can have different and/or other components than those shown in FIG. 1. In addition, the computing device 100 can lack certain illustrated components. For example, the computing device 100 acting as a computer server can be formed of multiple blade servers linked together into one or more distributed systems and lack components such as keyboards and displays. Moreover, the memory 120 can be local and/or remote from the computing device 100 (such as embodied within a storage area network (SAN)).
[0029] As is known in the art, the computing device 100 is adapted to execute computer program modules for providing functionality described herein. As used herein, the term "module" refers to computer program logic utilized to provide the specified functionality. Thus, a module can be implemented in hardware, firmware, and/or software. In one embodiment, program modules are loaded into the memory 120and executed by the processor 180. [0030] FIG. 2 is a block diagram illustrating a computing device 100 for displaying lyrics of a song on the computing device 100 while the computing device 100 is in a lock screen state according to one embodiment.The computing device 100 is an electronic device used by a user to perform functions such as playing a song stored in the computing device 100, executing software applications, and browsing websites hosted by web servers on a computer network. The computing device 100 may include computing devices that have a wide range of processing capabilities such as a personal computer (PC), a personal digital assistant (PDA), a smart phone, a laptop computer, a notebook computer, a tablet device or any machine capable of executing a set of computer program instructions that specify actions to be taken by the machine.
[0031] The computing device 100 includes and/or interfaces with a display device on which the user may view lyrics of a song, video files and other digital content. In addition, the computing device 100 provides a user interface (UI), such as physical and/or on-screen buttons, with which the user may interact with the computing device 100 to perform functions such as viewing lyrics of a song and consuming digital content.
[0032] In the embodiment shown in FIG. 2, the computing device 100 has a computer memory 210, a computer processor 220 and a resource database 230. The memory 210 stores data and/or instructions that may be executed by the processor 220. The instructions may comprise computer program code for performing any and/or all of the techniques described herein. The memory 210 may be a DRAM device, a static random access memory (SRAM), Flash RAM (non-volatile storage), combinations of the above, or some other memory device known in the art. In one embodiment, the memory 210 comprises a lyrics module 202, a synthesis module 204 and a display module 206. Other embodiments may contain different functional modules and different number of modules.
[0033] The lyrics module 202 is configured to obtain lyrics of a song being played on a computing device 100 in a lock screen state. In one embodiment, the lyrics module 202 detects a user action in selecting a song and playing the song. Responsive to the detection of a selected song being played, the lyrics module 202 searches for the lyrics associated with the song locally, such as the resource database 230 or remotely, such as the Internet.
[0034] A song may last for a certain period of time, e.g., a few minutes, and a song can have timing information, such as starting time and ending time, for each word of the lyrics of the song. The lyrics module 202 monitors the timing information associated with the song and its corresponding lyrics. In one embodiment, the lyrics module 202 monitors present time periods associated with a song. A present time period refers to a pre-specified period of timebetween time for acurrent event of playing a song on the computing device 100 and time for a subsequent event of playing the song on the computing device lOO.Responsive to the end of the present time period associated with the song, the lyrics module 202 interacts with the display module 206 to display images associated with the subsequent event.
[0035] For example, when the computing device 100 loads a song to a media player of the computing device 100, the current event of playing the song is displaying a cover image of the song without any lyrics of the song and the subsequent event is displaying a first character of the lyrics of the song. The pre-specified time period associated with the song is the period of time between the time for the current event and the time for the subsequent event of playing the song on the computing device 100. Responsive to the end of the present time period associated with a song, i.e. time for displaying the cover image without any lyrics of the song, the lyrics module 202 interacts with the display module 206 for displaying the first character of the lyrics of the song with the cover image of the song.
[0036] In one embodiment, the lyrics module 202 obtains only a portion of the lyrics of a song associated with the present time period of playing the song. In other embodiments, the lyrics module 202 may pre-fetch one or more subsequent portions of the lyrics of the song to be subsequently played. The lyrics module 202 may store the pre-fetched portions of the lyrics of the song in a local storage for fast retrieving and processing.
[0037] Thesynthesis module 204 is configured to generate one or more composite images for a song being played on the computing device 100 while the computing device 100 is in a lock screen state. A composite image is a digital image combining two or more visual elements, such as a video frame, a still image and text, into a single image. In one embodiment, the synthesis module 204 generates a composite image though digital image manipulation including digital graphics overlay. The digital graphics overlay techniques can be used to combine a digital graphics element, e.g., a digital picture of the singer of a song, with another digital graphics element, e.g., text of the lyrics of the song, to generate a composite image. In the composite image, a part of the digital graphics element may be replaced by a part of another digital graphics element. For example, the composite image of a song comprising a cover image of the song and text of the lyrics of the song may have a part of the cover image being replaced by the text of the lyrics of the song. Any
existingdigital graphics overlay technique known to those of ordinary skills in the art can be used by the synthesis module 204 to generate composite images. [0038] In one embodiment, the synthesis module 204 receives images associated with a song being played on the computing device 100 in a lock screen state and also receivesthe lyrics of the song. The synthesis module 204 generates composite imagesfor the song based on the images associated with the song and on the lyrics of the song. Each composite image of the song comprises an image associated with the song, e.g., a cover image of the song, text of the lyrics of the song and/or comments on the song or the lyrics of the song. The composite images of the song are displayed in a sequence according to an order that the song lyrics are played on the computing device.
[0039] In one embodiment, to overlay the text of the lyrics of a song over an image associated with the song, the synthesis module 204 determines whether the pixels of the image at the selected location are transparent. If the pixels of the image are transparent, the pixels of the selected location in the composite image are left unchanged; otherwise, the pixels of the image at the selected location are replaced with the pixels representing the text of the lyrics of the song.
[0040] A song may have long lyrics and the text of the lyrics of the song can be displayed in multiple lines within a limited display area, such as the display screen of a mobile phone. In one embodiment, the synthesis module 206 of the computing device 100 generates multiple composite images for the song to be played on the computing device 100 while the computing device 100 is in a lock screen state. Each of the composite images for the song comprises an image associated with the song and text of a part of the lyrics of the song. Each composite image is displayed while the corresponding lyrics of the composite image are being played on the computing device 100. The multiple composite images for the song are displayed in a sequence according to the order of the lyrics being played on the computing device 100. At the end of the duration for displaying a current composite image for the song, the next composite image in the sequence is displayed while the corresponding lyrics of the next composite image are being played on the computing device 100.
[0041] In another embodiment, the synthesis module 204 generates one or more composite images associates with a song being played on the on the computing device 100 in a lock screen state by combining the images associated with the song, text of the lyrics of the song and/or comments on the song and/or the lyrics of the song. The comments of the song can be in a form of text or graphics. In one embodiment, the synthesis module 204 selects a location on the image associated with the song to overlay the text elements representing the lyrics of the song and selects another location on the image to overlay the comments of the song.
[0042] The display module 206 is configured to display composite images of a song being played on the on the computing device 100 in a lock screen state.In an embodiment, the display module 206 may adjust the original dimensions of a composite image of the song to be suitable for the display on a display screen of the computing device 100.
[0043] In another embodiment, the display module 206 may adjust visual features associated with the composite images of the song, such as adjusting the brightness of a composite image and displaying different shades, different colors and/or different fonts for different portions of the lyrics of the song. The adjustments may also include image format conversion, e.g., converting a Joint Photographic Experts Group (JPEG) image into a Portable Network Graphics (PNG) image, before the display. [0044] The resource database 230 stores songs and digital images associated with the songs to be played by the computing device 100. In one embodiment, a user of the computing device 100 downloads songs from a music supplying store online, such as iTune stores. The downloaded songs are stored in the resource database 230. A song may have one or more images associated with the song, such as a cover image of an artist (singer, songwriter) associated the song, an animation of the subject of the song and other digital graphics associated with the song. The resource database 230 may also store indexing information for identifying the songs and images stored in the resource database 230.
[0045] FIG. 10 is an exemplary display of a composite image of a song being played on a computing device in a lock screen state according to one embodiment. The computing device illustrated in FIG. 10 is a mobile phone 1000. The mobile phone 1000 is in a lock screen state as indicated by an arrow symbol 1002, which reminds a user of the mobile phone 1000 to slide the arrow 1002 to unlock the mobile phone 1000.
[0046] A song is currently being played by the mobile phone 1000, which displays a composite image 1010 associated the song. The composite image 1010 comprises a cover image 1004 showing the singer of the song and a text element 1006 representing the lyrics of the song. The text element 1006 is circled by a text box that has three lines of the lyrics of the song, where the line being highlighted 1008 corresponds to the lyrics of the song being currently played. The line above the highlighted line 1008 presents the lyrics precedent to the lyrics currently being played and the line below the highlighted line 1008 presents the lyrics subsequent to the lyrics currently being played. DISPLAYING LYRICS OF A SONG ON A MOBILE COMPUTING DEVICE IN A LOCK SCREEN STATE
[0047] FIG. 3 is a flowchart illustrating a process for generating a composite image associated with a song to be played on a computing device 100 according to one embodiment. Initially, the lyrics module 202 of the computing device 100 detects 301 a song being played on the computing device 100, e.g., detecting a user selection of a song from a playlist and starting a media player embedded in the computing device 100. The display module 206 of the computing device displays 302 a cover image associated with the song on a display screen of the computing device 100. The lyrics module 202 obtains 303 the lyrics of the song. The synthesis module 204 generates 304 a composite image comprising the cover image of the song and text of the lyrics of the song, where the lyrics of the song are to be played after the display of the cover image of the song. In one embodiment, the text of the lyrics of the song and the cover image associated with the song are combined through digital graphics overlay to generate the composite image. The display module 206 replaces 305 the cover image with the composite image responsive to the end of the present time period associated with the displaying of the cover image.
[0048] FIG. 4 is an exemplary composite image without the lyrics of a song displayed on a computing device 100 in a lock screen state according to one embodiment. The computing device 100 is currently in a lock screen state as indicated by a sliding bar 408, which instructs a user of the computing device 100 to slide the bar to unlock the screen.
The computing device 100 has a camera 412, a display screen 402 and a push button 410 to receive user input. [0049] Responsive to user selecting a song to be played on a media player embedded with the computing device 100, the computing device 100 displays a cover image 406 associated with the song on the display screen 402. The cover image 406 has an associated present time period, which indicates the duration of the cover image 406 to be displayed on the display screen 402. In a scenario like this, e.g., at the start-up of playing a song on the computing device 100, the cover image 406 functions as a composite image without the lyrics of the song. Responsive to the end of the present time period associated with displaying the cover image 406, the computing device 100 displays next composite image associated with the song as illustrated in FIG. 5.
[0050] FIG. 5 an exemplary composite image comprising lyrics of a song displayed on a computing device 100 in a lock screen state according to one embodiment.The composite image 502 displayed on the display screen comprises a cover image 504 and text 506 of the lyrics of the song. In the example illustrated in FIG. 5, the text 506 of the lyrics of the song is shown in a text box 508 laid over the cover image 504 based on a pixel-to-pixel overlay scheme, where the pixels representing the text of the lyrics replace the pixels of the cover image 504 located within the text box 508. The computing device 100 displays the composite image for the duration of the lyrics of the song being played.
[0051] A song may have long lyrics and the text of the lyrics of the song can be displayed in multiple lines within a limited display area, such as the display screen of a mobile phone. FIG. 6 is a flowchart illustrating a process for generating multiple composite images for a song according to one embodiment.Initially, the computing device 100 obtains 601 the lyrics of a song to be played on the computing device 100 and one or more cover images associated with the song. The computing device 100 generates 602 multiple composite images for the song. Each of the composite images comprises a cover image of the song and the text of a part of the lyrics of the song and two composite images may have the same cover image of the song, but with different texts of the lyrics of the song. The multiple composite images are to be displayed according the order of the lyrics of the song to be played on the computing device 100.
[0052] The computing device 100 displays 602 the first composite image as a current picture of the song on a display screen of the computing device 100 for a duration defined by the present time period associated with the first composite image. The computing device 100 checks 604 whether the display of the first composite image of the song has reached the end of its duration based on the present time period associated with the first composite image. If it is the time for displaying the next composite image, the computing device 100 displays 605 the next composite image by replacing the current picture of the song with the next composite image and the next composite image becomes the current picture of the song.
[0053] The computing device 100 also checks 606 whether a composite image of the song to be displayed is the last composite image to be displayed. If the composite image is the last one to be displayed, the computing device 100 displays 607 the current picture until the end of its duration. If the composite image is not the last composite image, the computing device 100 repeats the steps of 605-607 for displaying the remaining composite images of the song.
[0054] FIG. 7 is an exemplary composite image generated according to the process illustrated in FIG. 6. The exemplary composite image 702 is one of the multiple composite images of a song being played on the computing device 100 while the computing device 100 is in a lock screen state. The composite image 702 comprises an image 704 associated with the song and three lines of the text of the lyrics of the song shown in a text box 706 laid over the image 704. Among the three lines of the text of the lyrics of the song, the middle line 701 shows the text of the lyrics, where the lyrics are currently played on the computing device 100. The first line of the text of the lyrics 708 corresponds to the text of the lyrics of the song being displayed prior to the display of the current text of the lyrics 710. The third line 712corresponds to the text of the lyrics of the song to be displayed subsequent to the display of the current text of the lyrics 710. In one embodiment, to indicate the sequence of the text of the lyrics of the song, the computing device 100 displays the text of the lyrics in different shades of a color, in different colors or in different fonts.
[0055] FIG. 8 is aflowchart illustrating a process for generating composite images of a song comprising comments associated with the song according to one embodiment.
Initially, the computing device 100 obtains 801 the lyrics of a song and images associated with the song. In response to comments on the lyrics of the song, on the song or on both the lyrics and the song, the computing device 100 obtains 802 the comments and generates one or more composite images for the song as described above. Each of the composite images comprises an image associated with the song, text of the lyrics of the song and some comments on the song/lyrics. The computing device 100 displays 804 the first composite image as a current picture of the song on a display screen of the computing device 100 for a duration defined by the present time period associated with the first composite image.
[0056] The computing device 100 checks 805 whether the display of the first composite image of the song has reached the end of its duration based on the present time period associated with the first composite image. Responsive to the time for displaying the next composite image, the computing device 100 displays 806 the next composite image by replacing the current picture of the song with the next composite image and the next composite image becomes the current picture of the song.
[0057] The computing device 100 also checks 807 whether a composite image of the song to be displayed is the last composite image to be displayed. If the composite image is the last one to be displayed, the computing device 100 displays 808 the current picture until the end of its duration. If the composite image is not the last composite image, the computing device 100 repeats the steps of 805-808 for displaying the remaining composite images of the song.
[0058] FIG. 9 is an exemplary composite image generated according to the process illustrated in FIG. 8. The exemplary composite image 902 is one of the multiple composite images of a song being played on the computing device 100 while the computing device 100 is in a lock screen state. The composite image 902 comprises an image 904 associated with the song, three lines of the text of the lyrics of the song shown in a text box 906 laid over the image 904 and a comment on the song 914, "Nice Song!." The comment 914 in the illustration is located at the bottom of the display screen of the computing device 100. The comment 914 can be laid over the image 804 similar as the lyrics of the song in another embodiment. The comment can be provided by the user of the computing device 100 and/or from other listeners in an online community, who have listened to the song before.
[0059] Among the three lines of the text of the lyrics of the song, the third line 912 shows the text of the lyrics, where the lyrics are currently played on the computing device 100. The first line of the text of the lyrics 908 and the second line of the text of the lyrics 910 correspond to the text of the lyrics of the song being displayed in a sequence prior to the display of the current text of the lyrics 912. The three lines of the text of the lyrics are displayed in two different shades of a color.
[0060] User experience with playing songs on a mobile computing device in a lock screen state is enhanced by having composite images for a song and displaying the composite images on the computing device. Each of the composite images for the song comprises an image associated with the song and text of a part of the lyrics of the song. Each composite image is displayed while the corresponding lyrics of the composite image are being played on the computing device. The multiple composite images for the song are displayed in a sequence according to the order of the lyrics being played on the computing device.
GENERAL
[0061] The foregoing description of the embodiments of the invention has been presented for the purpose of illustration; it is not intended to be exhaustive or to limit the invention to the precise forms disclosed. Persons skilled in the relevant art can appreciate that many modifications and variations are possible in light of the above disclosure.
[0062] Some portions of this description describe the embodiments of the invention in terms of algorithms and symbolic representations of operations on information. These algorithmic descriptions and representations are commonly used by those skilled in the data processing arts to convey the substance of their work effectively to others skilled in the art. These operations, while described functionally, computationally, or logically, are understood to be implemented by computer programs or equivalent electrical circuits, microcode, or the like. Furthermore, it has also proven convenient at times, to refer to these arrangements of operations as modules, without loss of generality. The described operations and their associated modules may be embodied in software, firmware, hardware, or any combinations thereof
[0063] Any of the steps, operations, or processes described herein may be performed or implemented with one or more hardware or software modules, alone or in combination with other devices. In one embodiment, a software module is implemented with a computer program product comprising a computer-readable medium containing computer program code, which can be executed by a computer processor for performing any or all of the steps, operations, or processes described.
[0064] Embodiments of the invention may also relate to an apparatus for performing the operations herein. This apparatus may be specially constructed for the required purposes, and/or it may comprise a general-purpose computing device selectively activated or reconfigured by a computer program stored in the computer. Such a computer program may be stored in a tangible computer readable storage medium or any type of media suitable for storing electronic instructions, and coupled to a computer system bus. Furthermore, any computing systems referred to in the specification may include a single processor or may be architectures employing multiple processor designs for increased computing capability.
[0065] The above description is included to illustrate the operation of the preferred embodiments and is not meant to limit the scope of the invention. The scope of the invention is to be limited only by the following claims. From the above discussion, many variations will be apparent to one skilled in the relevant art that would yet be encompassed by the spirit and scope of the invention.

Claims

CLAIMS WHAT IS CLAIMED IS:
1. A computer-implemented method for displaying lyrics of a song on a computing device in a lock screen state, the method comprising:
generating a plurality of composite images for the song, each composite image
comprising text for lyrics of the song and an image associated with the song; and sequentially displaying the plurality of the composite images on the computing device, each composite image displayed while the lyrics corresponding to the composite image are being played on the computing device, wherein the plurality of the composite images of the song are displayed and the song lyrics are played while the computing device is in a lock screen state.
2. The method of claim 1 , wherein generating a composite image for the song comprises overlaying the text of the song lyrics over a part of the image associated with the song.
3. The method of claim 2, wherein overlaying the text of the song lyrics over a part of the image associated with the song comprises:
determining the part of the image for overlaying the text of the song lyrics;
determining whether pixels of the image within the determined part of the image are transparent; and
responsive to the pixels of the image being not transparent, replacing the pixels of the determined part of the image with pixels of the text of the song lyrics.
4. The method of claim 1 , wherein the text of lyrics from different portions of the song have different graphics representations in the composite image.
5. The method of claim 4, wherein the different graphics representations comprise at least one of the following:
different colors;
different shades of a color; and
different fonts.
6. The method of claim 1, wherein the computing device is a mobile computing device.
7. The method of claim 1, wherein the computing device includes a head-mounted virtual display.
8. The method of claim 1, wherein the images associated with the song comprise at least one of the following:
a cover image of the song showing an artist related to the song;
an image of the subject of the song;
an animation of an artist related to the song; and
an animation of the subject of the song.
9. The method of claim 1, wherein the images associated with the song comprise a video frame from a music video associated with the song.
10. The method of claim 1, wherein each composite image of the plurality of the composite images for the song has associated timing information, the timing information describing a duration to display the composite image on the computing device.
11. The method of claim 10, wherein the timing information for a composite image is determined by the amount of time to play on the computing device the lyrics of the song corresponding to the composite image.
12. The method of claim 10, further comprising:
monitoring the timing information associated with a composite image of the song being currently displayed on the computing device; and
responsive to the end of the duration for displaying the composite imageof the song being currently displayed, displaying the next composite image selected from the plurality of the composite images of the song, wherein the lyrics corresponding to the next composite image are the next lyrics to be played.
13. A computing device for displaying lyrics of a song on a computing device in a lock screen state, comprising:
a computer processor for executing computer program modules; and
a non-transitory computer readable storage device storing computer program modules executable to perform steps comprising:
generating a plurality of composite images for the song, each composite image comprising text for lyrics of the song and an image associated with the song; and
sequentially displaying the plurality of the composite images on the computing device, each composite image displayed while the lyrics corresponding to the composite image are being played on the computing device, wherein the plurality of the composite images of the song are displayed and the song lyrics are played while the computing device is in a lock screen state.
14. A non-transitory computer readable medium storing executable computer program instructions for displaying lyrics of a song on a computing device in a lock screen state, the computer program instructions comprising instructions for:
generating a plurality of composite images for the song, each composite image
comprising text for lyrics of the song and an image associated with the song; and
sequentially displaying the plurality of the composite images on the computing device, each composite image displayed while the lyrics corresponding to the composite image are being played on the computing device, wherein the plurality of the composite images of the song are displayed and the song lyrics are played while the computing device is in a lock screen state.
PCT/CN2014/084279 2013-10-29 2014-08-13 Displaying lyrics of a song on a mobile computing device in a lock screen state WO2015062337A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201310522242.2 2013-10-29
CN201310522242.2A CN103559731B (en) 2013-10-29 2013-10-29 Method and terminal for displaying lyrics under screen locking state

Publications (1)

Publication Number Publication Date
WO2015062337A1 true WO2015062337A1 (en) 2015-05-07

Family

ID=50013970

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2014/084279 WO2015062337A1 (en) 2013-10-29 2014-08-13 Displaying lyrics of a song on a mobile computing device in a lock screen state

Country Status (2)

Country Link
CN (1) CN103559731B (en)
WO (1) WO2015062337A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114385108A (en) * 2021-12-23 2022-04-22 咪咕音乐有限公司 Comment display method, device and storage medium in music playing process

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103559731B (en) * 2013-10-29 2015-05-13 腾讯科技(深圳)有限公司 Method and terminal for displaying lyrics under screen locking state
CN108319415B (en) * 2014-03-12 2020-02-21 华为终端有限公司 Screen locking method and mobile terminal
CN106598996B (en) 2015-10-19 2021-01-01 广州酷狗计算机科技有限公司 Multimedia poster generation method and device
CN106210853B (en) * 2016-07-08 2019-04-09 上海幻电信息科技有限公司 Barrage display system and its CPU consumption controlling method
CN107528965B (en) * 2016-09-29 2020-03-31 维沃移动通信有限公司 Lyric poster generation method and mobile terminal
CN107203597A (en) * 2017-05-05 2017-09-26 青岛海信移动通信技术股份有限公司 The display methods and device of the lyrics under a kind of screen lock state
CN113762243A (en) * 2021-09-10 2021-12-07 网易(杭州)网络有限公司 Singing list processing method and device and electronic equipment
CN116048685B (en) * 2022-08-25 2024-04-02 荣耀终端有限公司 Display method of magazine lock screen, graphical interface and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1717008A (en) * 1998-10-19 2006-01-04 Lg电子株式会社 Multifunctional network karaoke (sing-along music) device
CN1825428A (en) * 2005-02-25 2006-08-30 雅马哈株式会社 Wireless terminal installation and karaoke system
US20070256545A1 (en) * 2004-10-20 2007-11-08 Ki-Un Lee Portable Moving-Picture Multimedia Player and Microphone-type Apparatus for Accompanying Music Video
CN103024166A (en) * 2012-12-03 2013-04-03 广东欧珀移动通信有限公司 Mobile phone capable of displaying lyrics on turn-off screen and method thereof
CN103559731A (en) * 2013-10-29 2014-02-05 腾讯科技(深圳)有限公司 Method and terminal for displaying lyrics under screen locking state

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2012226023A (en) * 2011-04-17 2012-11-15 Takashi Yoshino Synchronous display system for synchronizing lyrics and advertisement images with music

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1717008A (en) * 1998-10-19 2006-01-04 Lg电子株式会社 Multifunctional network karaoke (sing-along music) device
US20070256545A1 (en) * 2004-10-20 2007-11-08 Ki-Un Lee Portable Moving-Picture Multimedia Player and Microphone-type Apparatus for Accompanying Music Video
CN1825428A (en) * 2005-02-25 2006-08-30 雅马哈株式会社 Wireless terminal installation and karaoke system
CN103024166A (en) * 2012-12-03 2013-04-03 广东欧珀移动通信有限公司 Mobile phone capable of displaying lyrics on turn-off screen and method thereof
CN103559731A (en) * 2013-10-29 2014-02-05 腾讯科技(深圳)有限公司 Method and terminal for displaying lyrics under screen locking state

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114385108A (en) * 2021-12-23 2022-04-22 咪咕音乐有限公司 Comment display method, device and storage medium in music playing process
CN114385108B (en) * 2021-12-23 2024-03-22 咪咕音乐有限公司 Comment display method, comment display equipment and storage medium in music playing process

Also Published As

Publication number Publication date
CN103559731B (en) 2015-05-13
CN103559731A (en) 2014-02-05

Similar Documents

Publication Publication Date Title
US10635379B2 (en) Method for sharing screen between devices and device using the same
WO2015062337A1 (en) Displaying lyrics of a song on a mobile computing device in a lock screen state
US11112942B2 (en) Providing content via multiple display devices
US10659200B2 (en) Companion application for activity cooperation
US10956008B2 (en) Automatic home screen determination based on display device
WO2020007012A1 (en) Method and device for displaying search page, terminal, and storage medium
WO2018157812A1 (en) Method and apparatus for implementing video branch selection and playback
CN105740263B (en) Page display method and device
KR102462516B1 (en) Display apparatus and Method for providing a content thereof
KR101832394B1 (en) Terminal apparatus, server and contol method thereof
WO2015043203A1 (en) Method,apparatus and terminal for processing documents
WO2018120169A1 (en) Method for automatically setting wallpaper, terminal device and graphical user interface
US20140359533A1 (en) Display apparatus and control method thereof
US20160179766A1 (en) Electronic device and method for displaying webpage using the same
KR20160019693A (en) User terminal apparatus, display apparatus, system and control method thereof
KR20140141026A (en) display apparatus and search result displaying method thereof
CN112291412B (en) Application program control method and device and electronic equipment
CN112596646B (en) Information display method and device and electronic equipment
CN113286038A (en) Information interaction method and device and electronic equipment
CN115103054A (en) Information processing method, information processing apparatus, electronic device, and medium
CN114297435A (en) Communication terminal and multi-screen interactive video browsing method
KR20150081471A (en) Operating Method For Screen Data and Electronic Device Supporting The Same
KR20140089475A (en) Display apparatus and Method for providing User Interface thereof

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 14858751

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 22.09.2016)

122 Ep: pct application non-entry in european phase

Ref document number: 14858751

Country of ref document: EP

Kind code of ref document: A1