CN102132548B - Method and apparatus for scrolling text display of voice call or message during video display session - Google Patents

Method and apparatus for scrolling text display of voice call or message during video display session Download PDF

Info

Publication number
CN102132548B
CN102132548B CN200980133548.0A CN200980133548A CN102132548B CN 102132548 B CN102132548 B CN 102132548B CN 200980133548 A CN200980133548 A CN 200980133548A CN 102132548 B CN102132548 B CN 102132548B
Authority
CN
China
Prior art keywords
message
display
text
audio
video
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN200980133548.0A
Other languages
Chinese (zh)
Other versions
CN102132548A (en
Inventor
迪内希·库马尔·加尔加
马尼什·波达尔
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Qualcomm Inc
Original Assignee
Qualcomm Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to IN2108CH2008 priority Critical
Priority to IN2108/CHE/2008 priority
Priority to US12/211,973 priority patent/US8180644B2/en
Priority to US12/211,973 priority
Application filed by Qualcomm Inc filed Critical Qualcomm Inc
Priority to PCT/US2009/055347 priority patent/WO2010025355A1/en
Publication of CN102132548A publication Critical patent/CN102132548A/en
Application granted granted Critical
Publication of CN102132548B publication Critical patent/CN102132548B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/72427User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality for supporting games or graphical animations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/725Cordless telephones
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/42203Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS] sound input device, e.g. microphone
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41Structure of client; Structure of client peripherals
    • H04N21/422Input-only peripherals, i.e. input devices connected to specially adapted client devices, e.g. global positioning system [GPS]
    • H04N21/4223Cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
    • H04N21/4402Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
    • H04N21/440236Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by media transcoding, e.g. video is transformed into a slideshow of still pictures, audio is converted into text
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • H04N21/4788Supplemental services, e.g. displaying phone caller identification, shopping application communicating with other users, e.g. chatting
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/147Communication arrangements, e.g. identifying the communication as a video-communication, intermediate storage of the signals
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2250/00Details of telephonic subscriber devices
    • H04M2250/74Details of telephonic subscriber devices with voice recognition means
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/478Supplemental services, e.g. displaying phone caller identification, shopping application
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47End-user applications
    • H04N21/488Data services, e.g. news ticker
    • H04N21/4884Data services, e.g. news ticker for displaying subtitles
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/44Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/60Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
    • H04N5/602Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals for digital sound signals

Abstract

A method and communication device disclosed includes displaying a video on a display, converting voice audio data to textual data by applying voice-to-text conversion, and displaying the textual data as scrolling text displayed along with the video on the display and either above, below or across the video. The method may further include receiving a voice call indication from a network, providing the voice call indication to a user interface where the voice call indication corresponds to an incoming voice call; and receiving a user input for receiving the voice call and displaying the voice call as scrolling text. In another embodiment, a method includes displaying application related data on a display; converting voice audio data to textual data by applying voice-to-text conversion; converting the textual data to a video format; and displaying the textual data as scrolling text over the application related data on said display.

Description

The method and apparatus of text display for roll during video display session audio call or message
Technical field
The present invention relates to mobile communications device, it has video reception and display capabilities, speech-to-text processing and display video and for the out of Memory of such device.
Background technology
Global communication device can comprise video capability or the multimedia capabilities that allows device to show the real-time video from receiving such as video broadcast systems such as digital video broadcasting (" DVB ") networks now.Also exist for for example play the various video applications that download movies of MPEG (MP4, etc.) or similar video format with the display of mobile communications device.Yet various other application programs of mobile communications device are also used display to show information to user.For instance, the common display case of voice mail message sending and receiving application program is as icons such as closed envelopes, for example, so that indication () is through the voice mail message of storage.Voice mail message can be stored in such as on the remote servers such as voice mail message sending and receiving server, or under some situations, voice mail message can local be stored in the memory of mobile communications device.
The user that operating mobile communication device for example, inspects with () real-time video of launching via DVB network may make video inspect to be moved the Another Application program (for example, voice mail message sending and receiving or incoming call) of communicator to be interrupted.Other application program of mobile communications device (such as Short Message Service (SMS) application program, instant messaging (IM) application program etc.) also may cause user during inspecting real-time video or during store video files, receive short message service message inspecting.Under this situation, for in response to SMS message or listen to voice mail message, user closes needs or temporarily stops video application, for example, so that the application program corresponding to another (, voicemail application, short message receiving and transmitting application program or a certain other similar application program) taken action.
Summary of the invention
Method disclosed herein comprises: by the conversion of voice data application speech-to-text is converted to text data by voice data; And text data is shown as to the rolling text being shown on display together with video.Rolling text can be shown near the part bottom of display and roll on video.Or rolling text can be shown in the independent rolling text display section of display above or below video.
Described method can comprise: from network, receive audio call indication, and audio call indication is provided to user interface; And receive for receiving audio call and audio call being shown as to user's input of rolling text.
Other method comprises: from the indication of network received communication message, and communication information indication is provided to user interface, wherein communication information indication is corresponding to the communication information importing into; Receive the user's input that is used for received communication message and communication information is shown as to rolling text on display; And in response to user's input, communication information is shown as to rolling text, wherein rolling text is shown on display together with other application related data.
Communication information comprises voice data, and described method can further be comprised: by the conversion of voice data application speech-to-text is converted to text data by voice data; And text data is shown as to described rolling text.
Communication information also can comprise video section, and described method is further comprised: from video section, peel off audio-frequency unit, to obtain voice data before voice data is converted to text data via speech-to-text conversion; And in picture-in-picture (picture-in-picture) part of display display video part.
Other method comprises: the information receiving data through receiving are converted to video format to set up video format information receiving data, and wherein video format information receiving data comprise the text data corresponding at least a portion of information receiving data; And at other, above application related data, video format information receiving data are shown as to rolling text on display.Described method also can comprise: from information receiving data, peel off voice data; Voice data is transferred to speech-to-text transducer logic from audio logic; And obtain text data from speech-to-text transducer logic.
Described embodiment also comprises the communicator with rolling text logic, and rolling text logic can operate with audio reception data; By the conversion of application speech-to-text, voice data is converted to text data; Text data is converted to video format; And on application related data, text data is shown as to rolling text on display.Communicator can further comprise the speech-to-text transducer logic that is functionally coupled to rolling text logic, and wherein rolling text logic further operation with the application related data on detection display device; And in response to the application related data on display being detected, voice data is transferred to speech-to-text transducer logic from audio logic.
One embodiment comprises the computer-readable media with the executable instruction of carrying out at least one processor, and described executable instruction causes described at least one processor when being performed: display video on display; By the conversion of application speech-to-text, voice data is converted to text data; And described text data is shown as to the rolling text being shown on display together with video.
Accompanying drawing explanation
Fig. 1 is according to the block diagram of the communicator 100 with display 101 and rolling text part 103 of an embodiment.
Fig. 2 is having display 201 and cross over the block diagram of the communicator 200 of display 201 display scrolling texts 203 in middle position a little according to an embodiment.
Fig. 3 is for according to the block diagram of crossing over the communicator 300 of picture-in-picture display 305 display scrolling texts 307 in display 301 and the rolling text part 309 in middle position a little or at picture-in-picture display 305 that has of an embodiment.
Fig. 4 is for according to the having display 401 and cross over the block diagram of the communicator 400 of display 401 display scrolling texts 403 in middle position a little an of embodiment, and wherein rolling text 403 is associated with the audio frequency for picture-in-picture display 405.
Fig. 5 is according to the block diagram of the communicator 500 of an embodiment.
Fig. 6 is for explanation is according to the flow chart of the operation of the communicator of described embodiment and the various message of disposal.
Fig. 7, for explanation is according to the flow chart of the other details of the piece 611 of described embodiment, in piece 611, obtained Message-text data before text data is shown as to rolling text.
Fig. 8 is for explanation is according to the flow chart of the operation about audio call and voice mail message of an embodiment.
Fig. 9 is for explanation is according to the flow chart of the operation about video media content and disposal audio file of an embodiment.
Figure 10 is for explanation is according to the flow chart of the other details of the operation about disposal voice mail message of an embodiment.
Figure 11 is for explanation is according to the flow chart of the operation about video media content and disposal voice data of an embodiment.
Figure 12 for explanation according to an embodiment about disposing the flow chart import audio call or voice mail message indication and the operation of display scrolling text in the rolling text part of display into.
Figure 13 for explanation according to an embodiment about by audio file or be converted to the flow chart of the operation of text data through audio reception data.
Figure 14 is for illustrating the signal flow graph that imports the communicator of audio call according to the disposal of an embodiment into.
Figure 15 is for explanation is according to the signal flow graph of the communicator of the disposal voice mail message of an embodiment.
Embodiment
Now turn to graphic (wherein same numbers represents same components), Fig. 1 illustrates communicator 100, for example, have the ability of receiver, video (for example (but being not limited to) digital video broadcasting (" DVB ")) and also can receive the radio communication device of various multimedia files (for example Multimedia Message sending and receiving service (MMS) message).Communicator 100 has display 101, and according to described embodiment, graphic alphanumeric display also comprises text rolling portion 103, and text rolling portion 103 can be independent video section or can be the cut section of whole graphic alphanumeric display 101.The alternate embodiment of embodiment shown in Fig. 2 key diagram 1.In Fig. 2, communicator 200 comprises display 201, and each position display scrolling text 203 that can be on the display 201 as by user configured.Video also can comprise that (for example) is stored in device from video with it.For instance, install 100 and can comprise the video (for example, video data file) that for example, is sent to device via the wireless or wire communication with host/server (, when wirelessly or being through a cable connected to another calculation element of user).
Fig. 3 illustrates communicator 300, and it has display 301, and according to described embodiment, it shows picture-in-picture (PiP) part 305.According to described embodiment, PiP part 305 can comprise rolling text part 309, or can have rolling text 307 in each position on PiP display 305.The alternate embodiment of the embodiment that Fig. 4 key diagram 3 is illustrated.In Fig. 4, rolling text 403 is corresponding to video shown in PiP part 405, but rolling text 403 is shown in basic display unit 401 interior (with similar by the illustrated demonstration of Fig. 2), but not is shown in the video of PiP part 405.In other words, rolling text 403 is compared and be can be larger text with the text in can being shown in PiP part 405, and therefore more readable.
Other alternate embodiment can be included in vertical (but not level) orientation, transverse to main video display, transverse to the PiP part of display or vertically cross over arbitrary display and display scrolling text.Equally, rolling text can be directed with various angles with respect to display, the PiP part of for example crossing over diagonally basic display unit or crossing over display.In addition, speech-to-text transducer logic 505 can be suitable for various language and speech-to-text conversion can be provided, wherein gained text is various language and uses various text characters, such as (but being not limited to) English text, Cyrillic literary composition (Cyrillic), Greek, Chinese, Korean, Arabic etc.
Fig. 5 explanation is according to the communicator with application program 501 500 of described embodiment.Application program 501 for example can be incorporated into, in radio communication device (radio communication device 500).Radio communication device 500 can be any suitable communicator that can display video, such as (but being not limited to) mobile phone, laptop computer, desktop computer, personal digital assistant etc., it has the ability of received communication message (such as audio call, SMS message, Multimedia Message sending and receiving service (MMS) message, instant message etc.) and/or retrieval and demonstration or playback communication information (for example, voice mail message, SMS message, MMS message, IM message etc.).
Radio communication device 500 comprises voice mail retrieval device logic 503, speech-to-text transducer logic 505, display driver 507, protocol stack 509 and at least one transceiver 511.Terminological logic used herein is included in one or more programmable processors, ASIC, firmware hardwired logic or upper software and/or the firmware of carrying out of its combination.Term protocol stack used herein refers to software and/or the firmware of carrying out in one or more programmable processors and/or application specific processor or its combination.Therefore, application program 501 comprises herein by the rolling text logic of describing.
Application program 501 is functionally coupled to voice mail retrieval device logic 503 via communication link 502, make application program 501 order can be sent to voice mail retrieval device logic 503, described order causes voice mail retrieval device logic 503 retrieve voicemail message files, as described in further detail in this article.Similarly, application program 501 is functionally coupled to speech-to-text transducer logic 505 via communication link 504, makes application program 501 speech data can be sent to speech-to-text transducer logic 505 for being converted to text data.Application program 501 is also functionally coupled to display driver 507 via communication link 520.Can realize via the data/address bus in radio communication device 500 such as the coupling of the various operability such as communication link 502,504 and 520, wherein data/address bus provides data communication path between contained various logic therein.Therefore, operability coupling can comprise can be in order to realize the object of communication path other logic of needs.Equally, protocol stack 509 is functionally coupled to application program 501 via live voice call link (live voicecall link) 508, makes speech data to be provided to application program 501.Protocol stack 509 is also functionally coupled to voice mail retrieval device logic 503 via retrieve voice mail link 506, and making can be from remote speech mail server retrieve voicemail message file, as being described in this article.Application program 501 is functionally coupled to the user interface 523 of communicator 500 via communication link 525.User interface 523 can comprise that keypad, touch-sensitive display, mouse, free gyroscope maybe can receive user's input and this user be inputted to any other device that is provided to application program 501.User interface 523 also comprises the audio logic for audio call, and it is for providing audio frequency output and going back audio reception input.
Protocol stack 509 is coupled to one or more transceivers 511 via communication link 510.Transceiver 511 can be via transmitting chain 513 by the data transmission that comprises order or request to network, and can from network, receive the data that comprise order or request via receiver 515.
Radio communication device 500 also can comprise for receiving and send the various clients 527 of message.For instance, client 527 can comprise email client 531, instant messaging (IM) client 533, Short Message Service (SMS) client 535, multimedia information service (MMS) client 537 and multimedia client 517.Multimedia client 517 can be and/or comprises various broadcast medium clients (such as (but being not limited to) DVB, MMBS etc.), makes the communicator 500 can receiving multimedia broadcast.
All clients (for example multimedia client 517) are all functionally coupled to protocol stack 509 and transceiver 511 via communication link 541.Client (for example (but being not limited to) multimedia client 517) is also functionally coupled to application program 501 via communication link 529, and via communication link 519, is functionally coupled to display driver 507.Multimedia client 517 and all other clients 527 can be with other assembly of communicator 500 or logic alternately with sending and receiving message.Multimedia client 517 can be with other assembly or logic alternately with for example, for example, from the broadcast of () video broadcast system ((but being not limited to) DVB) receiver, video, and can therefore in conjunction with display driver 507, cause display video on display 521.Multimedia client 517 also can provide video from various other application programs (such as (but being not limited to) game application, internet browsing program, movie player application etc.).Therefore, multimedia client 517 is mode or provide video from various broadcast via internet in the air, or through store video files, provides video from various.
Fig. 6 explanation is according to the operation of the communicator 500 of an embodiment.In 601, for example, on () transmitting chain 513 and receiver 515, via transceiver 511, communicator is connected to network.As shown in 603, can on receiver 515, from network, receive audio call.For example, yet as shown in 605, user may be busy with an application program, is occupied in Multimedia session, and multimedia client 517 may just be provided to display 521 by video or out of Memory.As shown in 607, the indication of importing message into will be provided to user.Described indication can be visual indicator, or can be such as audio tones such as bell sound tones.If user determines accept and inspect message (as in 609), application program 501 will take action to obtain Message-text data (as shown in 611) so.As described in further detail, can obtain in every way Message-text data herein.As shown in 613, application program 501 will provide text data to display driver 507.As shown in 615, then the information for example, showing with the Another Application program (, video application) of being engaged in from user is shown to the rolling text that represents Message-text data together on display 521.
The other details of Fig. 7 illustrated block 611 and can how to obtain Message-text data in various embodiments.In 701, from process illustrated in fig. 6, receive given type of message.If message is not Multimedia Message (in 703) and message be not speech message or audio call (in 705), so for example, using message as () plaintext message and IM message, SMS message or email message dispose.As shown in 707, application program 501 obtains Message-text by the suitable client from client 527.As shown in 717, application program 501 will be followed and text data will be provided to display driver 507 on communication link 520 to be shown as rolling text.
Yet, if message be Multimedia Message (for example, MMS message) (in 703), application program 501 will for example, check that by () one group in user option 539 is set to check text/the Video Option (as in 709) through storage user option so.In described embodiment, can apply various users and set, for example user can select only receiver, video (for example PiP display), or optionally connected rating is frequently with corresponding to the rolling text of described video.Also can set via user option 539 rolling text position, and therefore, can be as previously carried out display scrolling text by Fig. 1 to Fig. 4 is illustrated.
Therefore,, in 709, check the setting of text/the Video Option.If select only the Video Option, application program 501 sends video (as 717) by the display driver to for PiP display so.Under this situation, optionally, user can select PiP display, causes whereby audio-frequency unit (if existence) in PiP display, to be play together with video.Otherwise video may voicelessly move in PiP display, and user is from application program or the video reception audio frequency of another current operation.
Yet if video and the text option setting detected in 709, application program 501 can be peeled off audio-frequency unit (as in 711) from message so.Can then will be provided to speech-to-text transducer 505 (as shown in 713) through peeling off audio-frequency unit, and add display to and using as rolling text (as shown in 715).PiP for video or MMS message shows, can be according to any one and the display scrolling text in Fig. 3 and the illustrated example of Fig. 4, and can set and rolling text is positioned to any the wanted position on display according to the user who is stored in user option 539.Therefore application program 501 provides user interface, makes user can select option for being stored in user option 539.In described embodiment, the default value of user option 539 can be provided, make (for example) video and text can be the acquiescence display setting for MMS message or video.Various other default settings can be suitable for various embodiment equally.
Fig. 8 explanation is according to the operation of the communicator 500 of an embodiment.In 801, for example, on () transmitting chain 513 and receiver 515, via transceiver 511, communicator is connected to network.As shown in 803, can on receiver 515, from network, receive audio call.For example, yet as shown in 805, user may be busy with an application program, is occupied in Multimedia session, and multimedia client 517 may just be provided to display 521 by video or out of Memory.As shown in 807, the indication of incoming call will be provided to user.Described indication can be visual indicator, or can be such as audio tones such as bell sound tones.If user determines call accepted (as in 809), application program 501 will be established to the live voice call link 508 of protocol stack 509 so, to receive speech data from network.Yet application program 501 shifts speech data by audio logic from communicator 500, and will change into and speech data be sent to speech-to-text transducer logic 505 on communication link 504.Therefore speech-to-text transducer logic 505 will be converted to text (as shown in 811) by voice data, and will text data be provided to display driver 507 (as shown in 813) via application program 501.As shown in 815, then will on display 521, by representing, through receiving the rolling text of audio call, for example, show that with the Another Application program (, video application) of being engaged in from user the information of coming shows together.
According to described embodiment, application program 501 also can retrieve voicemail message file and is shown as rolling text.Therefore, user can ignore the calling in 803, under this situation, can in 807, provide voice mail indication.Therefore user can determine receiving voicemail messages in 809, and application program 501 can then order voice mail retrieval device logic 503 from remote speech mail server or from for directly on communicator 500 memory of storaged voice mail obtain voicemail file.Then will in 811, will be converted to text and correspondingly show through retrieve voice mail file.
About Fig. 9, further illustrate this embodiment.As shown in 901, displayable video media content or any out of Memory.As in 903, audio speech file can be converted to text data.As in 905, can then cross over display and rolling text data together with video media content or out of Memory simultaneously.That is, when crossing over display, during the text of rolling voice mail message, video application can continue displaying video.Figure 10 illustrates the other details of described embodiment.In 1001, receiver, video information.For instance, can receive DVB data from digital video radio network.In 1003, display video information on display 521.In 1005, receiving voicemail messages indication, for example, indicate from the voice mail message of wireless network.In 1007, user can provide via user interface 523 activation signal.For instance, user can press the button on keypad, makes application program 501 on display 521, voice mail message to be converted to rolling text in response to user's input.Or, in 1007, can detect voice mail message by application program 501 and indicate, wherein application program 501 is as responding automatically retrieve voicemail message (as shown in 1009).In 1011, voice mail message is converted to text, and in 1013, crosses over display 521 and rolling text (as described previously).
Figure 11 application program 501 is about the operation of audio call.In 1101, can be on display 521 display video.Can receive by communicator 500 the audio speech data of audio call, and in live voice call link 508, audio speech data be sent to application program.Application program management speech data is from the transfer of the audio logic of communicator 500, and speech data can be sent to speech-to-text transducer logic 505 (as shown in 1103).In 1105, together with video on display 521 rolling text data.
Figure 12 illustrates communicator 500 and the operation of application program 501 about activating.For instance, in 1201, application program 501 can receive user's activation signal from user interface 523.User's activation signal can be in response to importing audio call into, or can be in response to the voice mail indication receiving from network.Or application program 501 can provide the configurable user who is stored in user option 539 to set.For instance, user can set the option of user option 539, makes when video application just moves, and any incoming call is all automatically directed to application program 501.In another example, user can set option, makes when receiving voicemail is indicated, and application program 501 is automatically retrieved corresponding voicemail message file.According to described embodiment, can use various other user's configurations.
In 1203, as described to Fig. 4 about Fig. 1, display 521 can be split into video section and text rolling portion.Shown in Fig. 2, in certain embodiments, can be on video rolling text.Application program 501 also can provide the configurable setting of the user who is stored in user option 539 for configuring rolling text with respect to the position of display 521.For instance, user can set option, makes to cross over the centre of display 521 and rolling text, or at top or place, the bottom rolling text of display 521.Also can provide other user option, for example color and the size of (but being not limited to) rolling text.Therefore, in 1205, according to user option 539 or according to default setting and display scrolling text.
Figure 13 explanation corresponding to as the example embodiment that configures of Fig. 1 and Fig. 3 demonstration of showing and describe for PiP display.Displayable video in 1301, and voice data or audio file can be converted to text in 1303.In 1305, application program 501 can cause display to be split into (for example) video section 101 and textual portions 103 (as illustrated in Figure 1) in conjunction with display driver 507.By display driver 507, text data is converted to video format (as shown in 1307), and described text data is shown as to rolling text (as shown in 1309) in textual portions 103.
Figure 14 and Figure 15 are for providing the signal flow graph of other details of the operation of communicator 500.In Figure 14, signal flow graph 1400 explanations are disposed audio call by application program 501.For instance, network 1402 can send to communicator 500 by audio call indication or beep-page message 1405.Due to user's setting as discussed above, or because user is just operating the application program of using display 521, so application program 501 receives audio calls indication 1405.User can accept via 1407 audio call.This may input via the user of user interface 523, or may configure setting based on user.Application program 501 can then receive speech data 1409 from network 1402.For example, if user continues to run application 1411 (video, or such as other application programs such as game application), application program 501 will send speech bits 1413 to speech-to-text transducer logic 505 so.Application program 501 will receive corresponding to the text position 1415 through conversion audio frequency, and will send text position and cover details 1417 to display 1401.
Figure 15 is for illustrating the signal flow graph 1500 of disposing voice mail message by application program 501.According to described embodiment, although can carry out processed voice email message by application program 501 at any time, explanation calling procedure for the purpose of integrality.For instance, with similar by the illustrated situation of Figure 14, can receive audio call indication 1505 by application program 501.Yet user can ignore audio call 1507.Under this situation, network 1502 will reboot 1509 and calling order (caller) is rebooted to voice mail via voice mail.If calling order utilizes voice-mail server 1503 to carry out voicemail messages, network 1502 will send voice mail message indication 1511 to application program 501 so.If display 1501 is just being moved and used to application program 1513, application program 501 can obtain via voice mail retrieval device logic 503 voice document 1515 so.Voice mail retrieval device logic 503 will be communicated by letter with voice-mail server 1503 with 1519 via message 1517 via network 1502, and will obtain voice document 1521.
Application program 501 will provide voice document 1523 to speech-to-text transducer logic 505, and by the returned text position 1525 receiving corresponding to voice document.Application program 501 then will provide text position and cover details 1527 to display 1501.
Therefore, the present invention discloses the method and apparatus for display scrolling text, wherein rolling text represents the audio frequency of voice mail message or MMS message or video, and display scrolling text simultaneously together with video broadcasting data or together with the video from video file on being shown in display or application data wherein.One of ordinary skill in the art will understand the various advantages of embodiment disclosed herein.

Claims (11)

1. for a method for the text display of roll during video display session audio call or message, it comprises:
In radio communication device place receiver, video information;
By described radio communication device operation video application, described video application is shown in described video information on the display of described radio communication device;
By described radio communication device, to user, provide importing the indication of message into, described message has video section and audio-frequency unit;
By application program, obtain Message-text data, wherein, obtain described Message-text data and comprise:
Peel off the audio-frequency unit of described message;
Described audio-frequency unit is provided to the speech-to-text transducer at described radio communication device place, described speech-to-text transducer is by being converted to described Message-text data to described audio-frequency unit application speech-to-text conversion by the audio-frequency unit of described message; And
When a part for the described display while showing the video section of described message in the picture-in-picture PiP part at described display and outside the PiP part of crossing over described display is rolled described Message-text data, continue to show described video information on described display.
2. method according to claim 1, it further comprises:
Receive the user's input that is used for receiving described audio-frequency unit and described audio-frequency unit is shown as to rolling text; In response to receiving described user's input, obtain described Message-text data.
3. method according to claim 2, it further comprises:
Detection is just showing described video information on described display;
Described audio-frequency unit is transferred to speech-to-text transducer for described audio-frequency unit being converted to described Message-text data from audio logic.
4. method according to claim 1, it further comprises:
One from remote storage or memory is retrieved described audio-frequency unit.
5. method according to claim 1, wherein provides described indication of importing message into is comprised to described user:
Produce audio frequency indication or show visual indicator on described display.
6. for a method for the text display of roll during video display session audio call or message, it comprises:
In radio communication device place receiver, video information;
By described radio communication device operation video application, described video application is shown in described video information on the display of described radio communication device;
From network received communication message, indicate;
The indication of described communication information is provided to the user interface of described radio communication device, what described communication information indication corresponded to described radio communication device imports multimedia communication message into, and wherein said communication information comprises audio-frequency unit and video section;
Receiving user inputs to receive described communication information and on described display, the audio-frequency unit of described communication information is shown as to rolling text;
By application program, obtain Message-text data, wherein, obtain described Message-text data and comprise:
Peel off the audio-frequency unit of described message;
Described audio-frequency unit is provided to the speech-to-text transducer at described radio communication device place, described speech-to-text transducer is by being converted to described Message-text data to described audio-frequency unit application speech-to-text conversion by the audio-frequency unit of described message;
In response to described user's input, when a part for the described display while showing the video section of described communication information in the picture-in-picture PiP part at described display and outside the PiP part of crossing over described display is rolled described Message-text data, continue to show described video information on described display.
7. for a method for the text display of roll during video display session audio call or message, it comprises:
In radio communication device place receiver, video information;
By described radio communication device operation video application, described video application is shown in described video information on the display of described radio communication device;
By described radio communication device, to user, provide importing the indication of message into, described message has video section and audio-frequency unit;
By application program, obtain Message-text data, wherein, obtain described Message-text data and comprise:
Peel off the audio-frequency unit of described message;
Described audio-frequency unit is provided to the speech-to-text transducer at described radio communication device place, described speech-to-text transducer is converted to text data by described audio-frequency unit;
Described text data is converted to video format to set up video format information receiving data; And while showing the video section of described message in the picture-in-picture PiP part at described display and when a part for the described display outside the PiP part of crossing over described display rolls described video format information receiving data, continue to show described video information on described display.
8. method according to claim 7, it further comprises:
Described audio-frequency unit is transferred to speech-to-text transducer from audio logic; And obtain described Message-text data from described speech-to-text transducer.
9. for an equipment for the text display of roll during video display session audio call or message, it comprises:
For the device in radio communication device place receiver, video information;
For move the device of video application by described radio communication device, described video application is shown in described video information on the display of described radio communication device;
For providing importing the device of the indication of message into user by described radio communication device, described message has video section and audio-frequency unit;
For obtain the device of Message-text data by application program, wherein, for obtaining the device of described Message-text data, comprise:
For peeling off the device of the audio-frequency unit of described message;
For described audio-frequency unit being provided to the device of the speech-to-text transducer at described radio communication device place, described speech-to-text transducer is by being converted to described Message-text data to described audio-frequency unit application speech-to-text conversion by the audio-frequency unit of described message; And
While rolling described Message-text data for a part for the described display when the picture-in-picture PiP part at described display shows the video section of described message and outside the PiP part of crossing over described display, continue to show the device of described video information on described display.
10. equipment according to claim 9, described equipment also comprises:
Device for detection of the described video information on described display; And
For described audio-frequency unit being transferred to the device of described speech-to-text transducer from audio logic in response to the described video information on described display being detected.
11. equipment according to claim 10, described equipment also comprises:
For receiving for receiving described audio-frequency unit and described audio-frequency unit being shown as to the device of the user input of rolling text;
For in response to receiving described user's input, obtain the device of described Message-text data.
CN200980133548.0A 2008-08-28 2009-08-28 Method and apparatus for scrolling text display of voice call or message during video display session Active CN102132548B (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
IN2108CH2008 2008-08-28
IN2108/CHE/2008 2008-08-28
US12/211,973 US8180644B2 (en) 2008-08-28 2008-09-17 Method and apparatus for scrolling text display of voice call or message during video display session
US12/211,973 2008-09-17
PCT/US2009/055347 WO2010025355A1 (en) 2008-08-28 2009-08-28 Method and apparatus for scrolling text display of voice call or message during video display session

Publications (2)

Publication Number Publication Date
CN102132548A CN102132548A (en) 2011-07-20
CN102132548B true CN102132548B (en) 2014-02-12

Family

ID=41726657

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200980133548.0A Active CN102132548B (en) 2008-08-28 2009-08-28 Method and apparatus for scrolling text display of voice call or message during video display session

Country Status (7)

Country Link
US (2) US8180644B2 (en)
EP (1) EP2342890B1 (en)
JP (2) JP2012506075A (en)
KR (2) KR20110050539A (en)
CN (1) CN102132548B (en)
TW (1) TW201023607A (en)
WO (1) WO2010025355A1 (en)

Families Citing this family (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8180644B2 (en) 2008-08-28 2012-05-15 Qualcomm Incorporated Method and apparatus for scrolling text display of voice call or message during video display session
US8667125B2 (en) * 2010-06-24 2014-03-04 Dish Network L.L.C. Monitoring user activity on a mobile device
JP2012088969A (en) * 2010-10-20 2012-05-10 Sharp Corp Input display apparatus, input display method, computer program, and recording medium
KR20130005321A (en) * 2011-07-05 2013-01-16 엘지전자 주식회사 Mobile terminal and method for controlling thereof
US9699632B2 (en) 2011-09-28 2017-07-04 Elwha Llc Multi-modality communication with interceptive conversion
US9788349B2 (en) * 2011-09-28 2017-10-10 Elwha Llc Multi-modality communication auto-activation
US20130079029A1 (en) * 2011-09-28 2013-03-28 Royce A. Levien Multi-modality communication network auto-activation
US9503550B2 (en) 2011-09-28 2016-11-22 Elwha Llc Multi-modality communication modification
US9794209B2 (en) 2011-09-28 2017-10-17 Elwha Llc User interface for multi-modality communication
US9002937B2 (en) 2011-09-28 2015-04-07 Elwha Llc Multi-party multi-modality communication
US9477943B2 (en) 2011-09-28 2016-10-25 Elwha Llc Multi-modality communication
US9906927B2 (en) 2011-09-28 2018-02-27 Elwha Llc Multi-modality communication initiation
KR101833825B1 (en) * 2011-11-11 2018-03-02 엘지전자 주식회사 Mobile terminal and method for controlling thereof
KR101977072B1 (en) * 2012-05-07 2019-05-10 엘지전자 주식회사 Method for displaying text associated with audio file and electronic device
KR102056461B1 (en) * 2012-06-15 2019-12-16 삼성전자주식회사 Display apparatus and method for controlling the display apparatus
US8698900B1 (en) 2012-12-31 2014-04-15 Echostar Technologies L.L.C. Display button key presses on display device
US9620144B2 (en) * 2013-01-04 2017-04-11 Kopin Corporation Confirmation of speech commands for control of headset computers
US10712936B2 (en) * 2013-03-18 2020-07-14 Lenovo (Beijing) Co., Ltd. First electronic device and information processing method applicable to first or second electronic device comprising a first application
JP5953588B1 (en) 2013-05-06 2016-07-20 ヴィーバ システムズ インコーポレイテッド System and method for controlling electronic communication
US10902081B1 (en) 2013-05-06 2021-01-26 Veeva Systems Inc. System and method for controlling electronic communications
US10140382B2 (en) 2013-05-06 2018-11-27 Veeva Systems Inc. System and method for controlling electronic communications
CN105228070A (en) * 2014-06-16 2016-01-06 施耐德电气工业公司 On-site speaker device, field speech broadcast system and method thereof
US9853926B2 (en) 2014-06-19 2017-12-26 Kevin Alan Tussy Methods and systems for exchanging private messages
KR102281341B1 (en) * 2015-01-26 2021-07-23 엘지전자 주식회사 Method for controlling source device at sink device and apparatus for the same
US20160309033A1 (en) 2015-04-14 2016-10-20 Microsoft Technology Licensing, Llc Call Pickup with Seemail
CN105791713A (en) * 2016-03-21 2016-07-20 安徽声讯信息技术有限公司 Intelligent device for playing voices and captions synchronously
US10187512B2 (en) 2016-09-27 2019-01-22 Apple Inc. Voice-to text mode based on ambient noise measurement
CN108776542A (en) * 2018-05-31 2018-11-09 上海爱优威软件开发有限公司 One kind being based on multimedia information interacting method and system
US11341172B2 (en) * 2020-08-14 2022-05-24 Firmscribe, Llc Capturing messages from a phone message exchange
US11109199B1 (en) 2020-08-14 2021-08-31 U.S. Financial Compliance, LLC Capturing messages from a phone message exchange with matter association

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1190840A (en) * 1996-11-15 1998-08-19 摩托罗拉公司 Device used in phonetic communication visual display, its method and system
CN1112072C (en) * 1998-12-26 2003-06-18 三星电子株式会社 Method for display received information from portable TV. telephone
US6775651B1 (en) * 2000-05-26 2004-08-10 International Business Machines Corporation Method of transcribing text from computer voice mail
EP1650937A1 (en) * 2004-10-19 2006-04-26 Nokia Corporation Notifying a user
CN101292509A (en) * 2005-11-22 2008-10-22 夏普株式会社 Mobile telephone

Family Cites Families (30)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3262133B2 (en) * 1992-01-07 2002-03-04 キヤノン株式会社 Image communication telephone and image processing method
DE4331710A1 (en) 1993-09-17 1995-03-23 Sel Alcatel Ag Method and device for creating and editing text documents
US5953392A (en) 1996-03-01 1999-09-14 Netphonic Communications, Inc. Method and apparatus for telephonically accessing and navigating the internet
JP3402100B2 (en) 1996-12-27 2003-04-28 カシオ計算機株式会社 Voice control host device
US6173259B1 (en) 1997-03-27 2001-01-09 Speech Machines Plc Speech to text conversion
JP3544152B2 (en) * 1999-09-16 2004-07-21 株式会社メガチップス Image display device and control device
US7000018B1 (en) 1999-12-22 2006-02-14 Intel Corporation Voice data streaming control in a network
US7293279B1 (en) * 2000-03-09 2007-11-06 Sedna Patent Services, Llc Advanced set top terminal having a program pause feature with voice-to-text conversion
US7565680B1 (en) * 2000-06-30 2009-07-21 Comcast Ip Holdings I, Llc Advanced set top terminal having a video call feature
US6713259B2 (en) * 2000-09-13 2004-03-30 Monsanto Technology Llc Corn event MON810 and compositions and methods for detection thereof
JP2002185943A (en) * 2000-12-12 2002-06-28 Nec Corp Broadcasting viewing method, broadcasting transmission server, portable terminal and multi-spot speaking and broadcasting control viewing equipment
US20030043260A1 (en) * 2001-08-29 2003-03-06 Adrian Yap Videophone answering device
US6763095B1 (en) * 2002-09-24 2004-07-13 Verizon Laboratories Inc. Unified messaging system and method
JP3962820B2 (en) * 2003-06-30 2007-08-22 カシオ計算機株式会社 Mobile phone, document display method with voice, call voice display method, and mobile phone display method
JP2005130133A (en) * 2003-10-22 2005-05-19 Sanyo Electric Co Ltd Mobile phone
JP4600643B2 (en) * 2004-06-02 2010-12-15 日本電気株式会社 Videophone device having character display function and voice character conversion display method in videophone device
US7561677B2 (en) * 2005-02-25 2009-07-14 Microsoft Corporation Communication conversion between text and audio
US7917178B2 (en) * 2005-03-22 2011-03-29 Sony Ericsson Mobile Communications Ab Wireless communications device with voice-to-text conversion
US7627349B2 (en) * 2005-07-11 2009-12-01 Nokia Corporation Alternative notifier for multimedia use
US20070039036A1 (en) * 2005-08-12 2007-02-15 Sbc Knowledge Ventures, L.P. System, method and user interface to deliver message content
EP1932153A2 (en) * 2005-09-07 2008-06-18 Portalvideo, Inc. Time approximation for text location in video editing method and apparatus
US9083564B2 (en) * 2005-10-13 2015-07-14 At&T Intellectual Property I, L.P. System and method of delivering notifications
JP4869728B2 (en) * 2006-02-16 2012-02-08 Necカシオモバイルコミュニケーションズ株式会社 Communication terminal, service providing apparatus, and program
JP4212600B2 (en) * 2006-04-13 2009-01-21 株式会社東芝 Wireless communication terminal device
US20080120285A1 (en) * 2006-11-16 2008-05-22 Bellsouth Intellectual Property Corporation Systems, methods, and computer readable mediums for displaying customized information in a ticker gui on a video display device
US8019271B1 (en) * 2006-12-29 2011-09-13 Nextel Communications, Inc. Methods and systems for presenting information on mobile devices
JP2008176681A (en) * 2007-01-22 2008-07-31 Fujifilm Corp Glasses-type communication support device
US8266664B2 (en) * 2007-01-31 2012-09-11 At&T Intellectual Property I, Lp Methods and apparatus to provide messages to television users
CN101682670A (en) * 2007-05-29 2010-03-24 日本电气株式会社 Mobile terminal apparatus, its television display method and program
US8180644B2 (en) 2008-08-28 2012-05-15 Qualcomm Incorporated Method and apparatus for scrolling text display of voice call or message during video display session

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1190840A (en) * 1996-11-15 1998-08-19 摩托罗拉公司 Device used in phonetic communication visual display, its method and system
CN1112072C (en) * 1998-12-26 2003-06-18 三星电子株式会社 Method for display received information from portable TV. telephone
US6775651B1 (en) * 2000-05-26 2004-08-10 International Business Machines Corporation Method of transcribing text from computer voice mail
EP1650937A1 (en) * 2004-10-19 2006-04-26 Nokia Corporation Notifying a user
CN101292509A (en) * 2005-11-22 2008-10-22 夏普株式会社 Mobile telephone

Also Published As

Publication number Publication date
US8380515B2 (en) 2013-02-19
JP2012506075A (en) 2012-03-08
US8180644B2 (en) 2012-05-15
KR101354262B1 (en) 2014-01-22
JP5960234B2 (en) 2016-08-02
US20100057466A1 (en) 2010-03-04
EP2342890B1 (en) 2018-04-25
KR20110050539A (en) 2011-05-13
CN102132548A (en) 2011-07-20
EP2342890A1 (en) 2011-07-13
WO2010025355A1 (en) 2010-03-04
JP2015092690A (en) 2015-05-14
TW201023607A (en) 2010-06-16
US20120209607A1 (en) 2012-08-16
KR20130045408A (en) 2013-05-03

Similar Documents

Publication Publication Date Title
CN102132548B (en) Method and apparatus for scrolling text display of voice call or message during video display session
EP1986432B1 (en) Mobile communication device capable of storing video chatting log and operating method thereof
US7899442B2 (en) Multimedia data transfer for a personal communication device
US8077838B2 (en) Method and voice communicator to provide a voice communication
JP2012506075A5 (en)
US20100205538A1 (en) Method of providing a user interface for a mobile terminal
US20100151888A1 (en) Method and system for transmitting and receiving multimedia message
CN109743246B (en) Message emergency reminding method and device and electronic equipment
KR20050101099A (en) Wireless telecommunication terminal and method for unified messaging service
EP1821553B1 (en) Method and system for converting a voice message into a text message
KR100667864B1 (en) Method for Transmitting and Receiving Message by Using Bluetooth Protocol at Multimedia Equipment
TWI396094B (en) Message display and reply system and method thereof
CN114731493A (en) Method for sending or receiving short message through internet message application program under condition of not using internet
CN111756769A (en) Method, system and streaming media for multimedia interaction in IMS voice network
KR20070002468A (en) Cross media information integration system
KR100879685B1 (en) Message processing method of multimedia processing apparatus
KR100814216B1 (en) Method of implementing mms service including voice description
KR100782508B1 (en) Message transmission method for mobile communication terminal
KR100744298B1 (en) Apparatus and method for generating sound effect of literal message
KR20050121385A (en) Apparatus and method for providing a short message service by inputting the voice signals on mobile phone
KR20090001466A (en) Method for transmitting message capable of reply to e-mail in a mobile communication terminal and the mobile communication terminal implementing thereof
KR20100043583A (en) Method for providing communication service by using internet protocol television
KR20080052958A (en) Method of multimedia contents service using interactive short message service in mobile terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant