JP4806871B2 - Client terminal and client side information processing method, program storage medium, program, and information providing system, - Google Patents

Client terminal and client side information processing method, program storage medium, program, and information providing system, Download PDF

Info

Publication number
JP4806871B2
JP4806871B2 JP2001239689A JP2001239689A JP4806871B2 JP 4806871 B2 JP4806871 B2 JP 4806871B2 JP 2001239689 A JP2001239689 A JP 2001239689A JP 2001239689 A JP2001239689 A JP 2001239689A JP 4806871 B2 JP4806871 B2 JP 4806871B2
Authority
JP
Japan
Prior art keywords
information
time information
providing server
communication quality
step
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2001239689A
Other languages
Japanese (ja)
Other versions
JP2003050761A (en
Inventor
巨成 高橋
Original Assignee
ソニー株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニー株式会社 filed Critical ソニー株式会社
Priority to JP2001239689A priority Critical patent/JP4806871B2/en
Publication of JP2003050761A publication Critical patent/JP2003050761A/en
Application granted granted Critical
Publication of JP4806871B2 publication Critical patent/JP4806871B2/en
Application status is Expired - Fee Related legal-status Critical
Anticipated expiration legal-status Critical

Links

Images

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a client terminal, a client-side information processing method, a program storage medium, and a program that receive distributed display information and display and / or output audio by establishing a session with an information providing server via a network. The present invention also relates to an information providing system in which an information providing server transmits providing information to a client terminal via a network.
[0002]
[Prior art]
Currently, streaming services such as music and moving images have started in mobile devices (client terminals) having a high-speed communication function as shown in FIG. That is, a session with the information providing server is established on the condition of billing and charge collection, and the streaming video data from the information providing server is a mobile phone device 50 having a high-speed communication function shown in FIG. In (b), a mobile information terminal (Personal Digital Assistant: PDA) 60 receives and receives the video on the liquid crystal display (LCD) 51 in the mobile phone device 50, and on the LCD 61 in the mobile information terminal 60. Can be displayed. Similarly, music data is also distributed as streaming data from the server to the portable audio receiving device 70 as shown in FIG. 12C, and is output as music via a built-in speaker and headphones 71. Of course, the mobile phone device 50 and the PDA 60 can also receive streaming audio data and output music as sound through a built-in speaker or headphones.
[0003]
[Problems to be solved by the invention]
By the way, in the streaming service such as music and moving images using the mobile device (client terminal), the communication may be cut off depending on the use environment, particularly the communication environment.
[0004]
At this time, usually, if the session with the information providing server is interrupted, such as when the radio wave does not reach, and the next session is established (such as making a call again), the information providing server side Then, it is regarded as a new session, and playback starts from the beginning.
[0005]
Also, even if the communication is not interrupted, packet drops may occur in part due to communication quality, and the frame rate may drop extremely or the resolution may drop partially in the case of video. As for the sound, noise may be mixed with the sound, or the sound may be interrupted at portions.
[0006]
Content such as video or music that generates copyrights and is charged, this is dissatisfied with the user.
[0007]
In order to avoid this, after adding a function to the information providing server side and reestablishing the session, it is possible to send video and audio streaming data from the middle of the disconnection. For each device, there is a need to learn where the quality has deteriorated and where communication has been cut off, which can be a burden on the server side.
[0008]
The present invention has been made in view of the above circumstances, and even when communication is disconnected, it is possible to enjoy video and music from the disconnected portion when the connection is established next time. The purpose is to provide a client terminal. In addition, even when communication disconnection occurs on the client terminal side, when a connection is established next time, it is possible to enjoy video and music from the part where the disconnection occurred, It is an object of the present invention to provide a program for executing the client-side information processing, and a program storage medium storing the client-side information processing program.
[0009]
The present invention has been made in view of the above circumstances, and evaluates communication quality, and based on the result, causes the information providing server to perform a process such as discounting charges, thereby causing the user to resolve some dissatisfaction. An object is to provide a client terminal, a client-side information processing method, a program, and a program storage medium.
[0010]
The present invention has been made in view of the above circumstances, and evaluates the communication quality, remembers the time stamp of the point where the communication quality has deteriorated, etc., and determines whether or not to view again to the user based on it. An object is to provide a client terminal, a client-side information processing method, a program, and a program storage medium that can be inquired.
[0011]
The present invention has been made in view of the above circumstances, and even when communication is disconnected, it is possible to enjoy video and music from the disconnected portion when the connection is established next time. The purpose is to provide an information provision system.
[0012]
The present invention has been made in view of the above circumstances, and the communication quality is evaluated at the client terminal, and based on the result, the information providing server performs processing such as discounting the charge, and the user is dissatisfied to some extent. The purpose is to provide an information provision system that can be resolved.
[0013]
The present invention has been made in view of the above circumstances, and evaluates the communication quality at the client terminal, remembers the time stamp of the point where the communication quality has deteriorated, and re-views the user based on it. It is an object of the present invention to provide an information providing system capable of asking whether or not to transmit the corresponding provided information from the information providing server.
[0014]
[Means for Solving the Problems]
In order to solve the above problems, the client terminal according to the present invention is a client terminal that receives distributed display information and displays and / or outputs audio by establishing a session with an information providing server via a network. When the session with the information providing server is interrupted and the provided information that has been distributed is disconnected, the time information storage means for storing time information and the time at the time of establishing a new session with the information providing server A distribution request unit that reads time information when the provided information is disconnected from the information storage unit and requests the information providing server to distribute the information that has been advanced to the time information;
[0015]
Thus, the client terminal stores the time information at the time of disconnection of the provision information due to the interruption of the session and reproduces the provision information from the point (the time information) when the session is restored next time.
[0016]
In order to solve the above-described problem, the client-side information processing method according to the present invention provides the client terminal with the provided information distributed from the information providing server by establishing a session between the information providing server and the client terminal via the network. The information processing method on the client side for processing at the time, when the session with the information providing server is interrupted and the provided information that has been distributed is disconnected, the time information is stored in the time information storage means Read time information when the time information storage step and the provision information stored in the time information storage means by the time information storage step are disconnected, and provide information up to the time information when a new session is established with the information provision server A distribution requesting step for requesting the information providing server to distribute the advanced information.
[0017]
In order to solve the above problems, the program storage medium according to the present invention processes the provided information distributed from the information providing server by the client terminal by establishing a session between the information providing server and the client terminal via the network. A program storage medium storing a client-side information processing program for performing time information when a session with the information providing server is interrupted and the provided information that has been distributed is disconnected A time information storage step stored in the information storage means, and time information when the provision information stored in the time information storage means is disconnected by the time information storage step, and when a new session is established with the information provision server, A distribution request that requests the information providing server to distribute the information provided up to the time information. It comprises a step stores a program to be executed on the client terminal.
[0018]
In order to solve the above problems, a program according to the present invention causes a client terminal to process provided information distributed from an information providing server by establishing a session between the information providing server and the client terminal via a network. A time information storage step of storing time information in a time information storage means when interruption of a session with the information providing server occurs and the provided information that has been distributed is disconnected, and the time The information storage step reads the time information when the provision information stored in the time information storage means is disconnected, and when the new session with the information provision server is established, the distribution of the provision information is advanced to the time information. A distribution requesting process for requesting the server, and executed by the client terminal.
[0019]
In order to solve the above problem, the client terminal according to the present invention is a client terminal that receives distributed display information and displays and / or outputs audio by establishing a session with an information providing server via a network. And an evaluation means for evaluating the communication quality related to the provided information distributed from the information providing server, and an evaluation notifying means for notifying the information providing server of the communication quality evaluated by the evaluation means.
[0020]
Thus, even if the session is not interrupted, the client terminal can notify the information providing server of the communication deterioration when the communication quality deteriorates. Upon receiving this notification, the information providing server performs processing such as lowering billing.
[0021]
In order to solve the above-described problem, the client-side information processing method according to the present invention provides the client terminal with the provided information distributed from the information providing server by establishing a session between the information providing server and the client terminal via the network. Information processing method for processing by the client, an evaluation process for evaluating communication quality related to the provided information distributed from the information providing server, and a communication quality evaluated by the evaluation process to the information providing server An evaluation notification step of notifying.
[0022]
In order to solve the above problems, the program storage medium according to the present invention processes the provided information distributed from the information providing server by the client terminal by establishing a session between the information providing server and the client terminal via the network. A program storage medium storing a client side information processing program for evaluating the communication quality related to the provided information distributed from the information providing server, and the communication quality evaluated by the evaluation step Is stored in the information providing server, and stores a program to be executed by the client terminal.
[0023]
In order to solve the above problems, a program according to the present invention causes a client terminal to process provided information distributed from an information providing server by establishing a session between the information providing server and the client terminal via a network. An evaluation step of evaluating communication quality related to the provided information distributed from the information providing server, and an evaluation notifying step of notifying the information providing server of the communication quality evaluated by the evaluation step. And executed on the client terminal.
[0024]
In order to solve the above problem, the client terminal according to the present invention is a client terminal that receives distributed display information and displays and / or outputs audio by establishing a session with an information providing server via a network. Evaluation means for evaluating communication quality related to the provided information distributed from the information providing server; time information storage means for storing time information when the evaluation means detects a deterioration in communication quality; and the time Time information notifying means for reading time information when communication quality deteriorates from the information storage means and notifying the information providing server of the time information.
[0025]
As described above, when the communication quality deteriorates even if the session is not interrupted, the client terminal stores the time information at that time, notifies the information providing server side of the time information, and requests for re-viewing from the user. In response, the information is sent from the information providing server.
[0026]
In order to solve the above-described problem, the client-side information processing method according to the present invention provides the client terminal with the provided information distributed from the information providing server by establishing a session between the information providing server and the client terminal via the network. A client-side information processing method for processing at an evaluation step of evaluating communication quality related to the provided information distributed from the information providing server, and when the evaluation step detects deterioration of communication quality, A time information storage step for storing time information in the time information storage means, and when the communication quality deteriorates in the time information storage step, the time information stored in the time information storage means is read, and the time information is provided as the information A time information notification step of notifying the server.
[0027]
In order to solve the above problems, the program storage medium according to the present invention processes the provided information distributed from the information providing server by the client terminal by establishing a session between the information providing server and the client terminal via the network. A program storage medium storing a client-side information processing program for evaluating the communication quality related to the provided information distributed from the information providing server, and the evaluation step deteriorates the communication quality Time information storage step for storing time information in the time information storage means, and when the communication quality deteriorates in the time information storage step, the time information stored in the time information storage means is read, A time information notifying step for notifying the information providing server of time information. Stores programs to be executed in the terminal.
[0028]
In order to solve the above problems, the program according to the present invention processes the provided information distributed from the information providing server by the client terminal by establishing a session between the information providing server and the client terminal via the network. An evaluation step for evaluating communication quality related to the provided information distributed from the information providing server, and time information when the evaluation step detects a deterioration in communication quality in the time information storage means A time information storing step for storing, and a time information notifying step for reading time information stored in the time information storing means when communication quality deteriorates in the time information storing step and notifying the information providing server of the time information. And is executed by the client terminal.
[0029]
In order to solve the above problem, the information providing system according to the present invention is an information providing system in which an information providing server transmits providing information to a client terminal via a network. The client terminal provides information via the network. The time information storage means for storing the time information when the provided information distributed by the session establishment with the server is disconnected due to the interruption of the session, and the time information at the time of establishing a new session with the information providing server A distribution request unit that reads out time information when the provision information is disconnected from the storage unit and requests the information provision server to deliver the provision information up to the time information, and the information provision server includes the distribution unit; In response to the delivery request advanced to the time information transmitted from the request means Transmitting the test information to the client terminal.
[0030]
The client terminal stores time information at the time of disconnection of provision information due to session interruption, and sends the time information to the information providing server side when the session is restored next time. The information providing server transmits the provision information from the time information to the client terminal.
[0031]
In order to solve the above problem, the information providing system according to the present invention is an information providing system in which an information providing server transmits providing information to a client terminal via a network. The client terminal provides information via the network. Evaluation means for evaluating communication quality of provided information distributed from the information providing server by establishing a session with the server, and evaluation notification means for notifying the information providing server of the communication quality evaluated by the evaluating means Thus, the information providing server changes the billing process of the provided information according to the communication quality evaluation result notified from the evaluation notification means.
[0032]
Even if the session is not interrupted, the client terminal can notify the information providing server of the communication deterioration when the communication quality deteriorates. Upon receiving this notification, the information providing server performs processing such as lowering billing.
[0033]
In order to solve the above problem, the information providing system according to the present invention is an information providing system in which an information providing server transmits providing information to a client terminal via a network. The client terminal provides information via the network. Evaluation means for evaluating communication quality of provided information distributed from the information providing server by establishing a session with the server, and time information storage means for storing time information when the evaluation means detects a deterioration in communication quality And time information notification means for reading time information when communication quality deteriorates from the time information storage means, and notifying the time information to the information providing server, the information providing server comprising the time information Provided information to which the time information transmitted from the notification means is added is sent to the client terminal New to send.
[0034]
Even when the session is not interrupted, the client terminal stores time information at that time and notifies the information providing server side of the time information when the communication quality deteriorates. The information providing server transmits provided information whose communication quality has deteriorated in response to a re-viewing request from the user to the client terminal.
[0035]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, several embodiments of the client terminal according to the present invention will be described. The first embodiment is a personal digital assistant (PDA) 7 or 11, a portable audio playback device 8 or 10, or a mobile phone device 9 incorporated in the information providing system shown in FIG.
[0036]
These client terminals are mobile devices that are carried by the user and move, and streaming data of provided information transmitted as RF signals from the plurality of content servers 1, 2, 3, 4 through the window server 3 and the antenna 6. Is displayed on a built-in liquid crystal display (LCD) or output through a speaker or headphones.
[0037]
The information providing system shown in FIG. 1 distributes streaming data such as provided information to the mobile device having a high-speed communication function. The communication protocol employed in this system is based on UDP (User Datagram Protocol). UDP is an Internet transport protocol that supports connectionless IP datagram communication. Does not have a retransmission function in the transport layer. Therefore, the packet loss affects the video and audio as it is.
[0038]
Next, a specific example of the client terminal will be described with reference to FIG. For example, as shown in FIG. 2, the PDA 7 includes a RAM 23, a ROM 24, a decoder 25, a touch panel controller 26, a graphic control 28, a VRAM 29, and a communication interface 31 in the semiconductor integrated circuit 20 via the internal bus 21. Connected. The k PDA 7 connects the CPU 22 via the internal bus 21 to an audio codec including an audio data decoder and an audio data encoder (not shown). Audio data decoded by the audio codec under the control of the CPU 22 is converted into an analog signal by the audio D / A and supplied to the output terminal.
[0039]
Outside the semiconductor integrated circuit 20, a touch panel 27 is connected to the touch panel controller 26, and a display device 30 such as an LCD is connected to the graphic controller 28.
[0040]
The RAM 23 stores a time stamp, which is time information when the session with the content server is interrupted and the distributed provided information is disconnected. This time stamp is added to the provision information. The progress of the provided information is managed based on this time stamp.
[0041]
When establishing a new session with the content server, the CPU 22 reads time stamp information when the provided information is disconnected from the RAM 23 and requests the content server to distribute the advanced information to the type stamp.
[0042]
The ROM 24 stores an information processing program based on the client side information processing method according to the present invention. This information processing program will be described later.
[0043]
Communication interface 31 is Bluetooth Bluetooth, W-CDMA (Wideband Code Division Multiple Access), CDMA2000 capable of high-speed data transmission of 2 Mbps, HDR, PIAFS (PHS Interner Access Forum Standard), wireless LAN standard protocol 2 Mbps, improved IEEE802.11 for high-speed data transmission of 11 Mbps, IrDA (Infrared Data Associaton), USB (Universal Serial Bus), IEEE1394, analog modem (Analog Modem), cable modem (Cable Modem), This is an interface that enables streaming data communication via an optical fiber.
[0044]
The data packet entered from the communication interface 31 is analyzed by the CPU 22 or the like, and the compressed stream data is extracted and sent to the decoder 25.
[0045]
The decoder 25 decodes the video signal from the compressed stream data and sends it to the graphic controller 28. The graphic controller 28 sends an image based on the video signal to the LCD 30 via the video RAM 29.
[0046]
A user's operation input with a pen or a finger is performed via a touch panel operator displayed on the touch panel 27, and a control signal is generated by the touch panel controller 26 and sent to the CPU 22.
[0047]
The CPU 22 decodes the control signal from the touch panel controller 26 and controls the function of each unit as necessary. For example, the operating system and various application programs are extracted from the ROM 24 and executed.
[0048]
Next, the window server 5 will be described.
The window server 5 is a server that performs connection authentication processing with a client terminal, selects an information providing server based on a distribution request from the client terminal, and relays provided information from the information providing server.
[0049]
The window server 5 first performs connection processing, performs authentication processing based on authentication information transmitted from the client terminal, etc., selects an information providing server, and establishes a session between the client terminal and the information providing server.
[0050]
As shown in FIG. 3, the window server 5 performs the connection authentication process and the delivery request process from the client terminal according to the application program to the CPU 43 via the internal bus 41, the memory 43, the external storage device 44, and the video input. A device 45 and a network interface 46 are connected. The CPU 42 sequentially executes the application program stored in the memory 43 or the external storage device 44.
[0051]
Provided information from the content server is supplied to the video input device 45. The network interface 46 communicates with the communication interface 31 of the client terminal via Bluetooth Bluetooth, W-CDMA, CDMA2000, HDR, PIAFS, IEEE802.11, IrDA, USB, IEEE1394, Analog Modem, Cable Modem, and optical fiber. All streaming data communication.
[0052]
Next, a content server that is an information providing server will be described.
Each content server also has substantially the same configuration as that shown in FIG. Video providing information is supplied to the video input device 45 from a database storing video providing information. The network interface 46 is connected to a network that connects the window server 5.
[0053]
Next, an outline of the operation of the information providing system will be described.
The feature of this information provision system is that when the session between the client terminal and the content server is disconnected due to communication disconnection or interruption due to communication conditions, etc., the client terminal becomes the main, and after the session recovery The processing is performed.
[0054]
Specifically, the client terminal periodically records in the RAM 23 a time stamp or the like of the location where the session has been interrupted during streaming playback. Then, when the communication conditions are recovered again and the session is recovered, connection to the content server is attempted again through the window server 5, and when the connection is made, the time previously recorded in the RAM 23 is obtained. Instruct the content server to advance the content up to the stamp.
[0055]
FIG. 4 is a transition diagram showing an outline of the operation of the information providing system.
First, a session is established between any content server and a client terminal via the window server 5 (step S1).
[0056]
Content is transmitted from the content server to the client terminal via the window server (step S2), and the client terminal performs packet acquisition processing (step S3).
[0057]
The client terminal assembles data from the acquired packet (step S4), and performs data reproduction processing in step S5. At this time, a time stamp is stored in the RAM 23 (step S6). Time stamps relating to normally reproduced data are updated one after another.
[0058]
Here, when the session is interrupted due to deterioration of communication conditions or the like (step S7), the time stamp of the location where the session is interrupted remains in the RAM 23.
[0059]
When the communication condition is restored again, connection to the window server is attempted. When the connection is established (step S8), the time stamp previously recorded in the RAM 23 is read (step S9), and the type The stamp is transmitted to the content server (step S10). At this time, the content server is instructed to advance the content by fast-forwarding to the time stamp. With regard to fast-forwarding of content, it is possible to issue a control instruction through a protocol such as RTSP (Real Time Streaming Protocol), for example, for a server that normally performs streaming. The client terminal side may perform it uniquely.
[0060]
When receiving the time stamp and the instruction (step S11), the content server fast-forwards the content by the time stamp and sends it to the client terminal (step S12).
[0061]
The client terminal performs a packet acquisition process in step S13, assembles data from the packet in step S14, and reproduces the data in step S15. At this time, the time stamp is stored in the RAM 23 (step S16).
[0062]
An information processing program executed by the client terminal in the information providing system will be described with reference to FIG. This information processing program is stored in the ROM 24. The CPU 22 takes out from the ROM 24 and executes it using the RAM 23.
[0063]
First, in step S21, it is determined whether there is resume information. The resume information is work information immediately before the power is turned off or the session is interrupted. Therefore, when there is resume information, one of them has occurred.
[0064]
The resume information includes information immediately before the session break in step S7 shown in FIG. 4, here, the time stamp information stored in the RAM 23 in step S6.
[0065]
If NO in step S21, that is, if it is determined that no resume information remains, reproduction processing is performed from the top data (step S22). If YES, the process proceeds to step S30, and time stamp information is transmitted to the content server.
[0066]
In step S22, the client terminal performs the reproduction process from the top data because the session remains established. In step S23, a packet is acquired, and data is assembled from the packet in step S24.
[0067]
In step S25, necessary information and data are obtained (YES), and if it is end of data (YES in step S26), the reproduction process is terminated.
[0068]
If necessary information and data are not obtained in step S25 (NO), the processing from step S23 is repeated. If NO in step S26, the data reproduction is continued in step S27.
[0069]
Step S28 following step S27 is a process for determining whether or not the information acquisition interval for resuming has been reached. If the predetermined information acquisition interval has been reached (YES), the process proceeds to step S29, where the time stamp information Is stored in the RAM 23. If the predetermined information acquisition interval has not been reached (NO), the processing from step S23 is repeated.
[0070]
If it is determined in step S21 that there is resume information (YES), since the session interruption shown in step S7 of FIG. 4 has occurred, the client terminal reads the time stamp from the RAM 23 (FIG. 4). In step S9), this is transmitted to the content server in step S30. As a whole system, the time stamp shown in step S10 of FIG. 4 is transmitted.
[0071]
Then, the processing of the entire system shifts to the server side, and the time stamp is received in step S11 in FIG. 4, and the content on the time stamp is fast-forwarded on the server side in step S12.
[0072]
Thus, the information processing program is a program for causing the client terminal to process the content of the provided information distributed from the information providing server side by establishing a session between the information providing server and the client terminal, When the session with the server is interrupted and the distributed content is disconnected, the time stamp storage step for storing the time stamp in the RAM 23 (step S29, and the provided information stored in the RAM 23 by the time stamp storage step) A time stamp for disconnection is read (step S9 in FIG. 4), and at the time of establishing a new session with the server side, a delivery requesting step for requesting the server side to deliver the content advanced to the time stamp is provided. Executed on the client terminal. Request process is intended to include step S30 in step S9 and step S10 in FIG. 4, or FIG.
[0073]
As described above, the client terminals such as the PDA 7 and the mobile phone device 9 incorporated in the information providing system shown in FIG. Without placing a burden on the server side, it is possible to display the video and audio from the part where the disconnection has occurred, centering on its own processing, on the LCD, and to output the audio from the speaker or headphones.
[0074]
Next, a second embodiment will be described. This second embodiment is also the PDA 7 or 11, the portable audio playback device 8 or 10, or the mobile phone device 9 incorporated in the information providing system shown in FIG.
[0075]
The configuration of these client terminals is the same as that of the PDA 7 shown in FIG. However, since the provided information is transmitted in real time using the RTP (Real Time Transport Protocol) on the UDP from the server side, the content of the information processing program stored in the ROM 23 is changed to RTCP RTCP (RTP Control Protocol). I have used it. RTCP is a control protocol for performing delivery confirmation and monitoring. The information processing program evaluates communication quality using RTCP. Details of the information processing program will be described later.
[0076]
The information providing system incorporating the portable client terminal according to the second embodiment reflects the deterioration of communication quality in the billing. Even if the communication is not cut off, packet changes may occur partially due to changes in the call status, and the frame rate may drop drastically or the resolution may partially drop. As for the sound, noise may be mixed with the sound, or the sound may be interrupted at portions. In particular, this is dissatisfied with the user for content such as video and music that is charged with copyrights.
[0077]
Therefore, in this information providing system, the client terminal has a function for evaluating the communication quality, and after using this to finish viewing the content, the overall communication quality is measured to determine the communication quality. By doing so, processing that reduces billing is performed.
[0078]
FIG. 6 is a transition diagram showing an outline of the operation of the information providing system including the client terminal according to the second embodiment.
First, a session is established between any content server and a client terminal via the window server 5 (step S41).
[0079]
The content is transmitted from the content server to the client terminal via the window server (step S42), and the client terminal performs packet acquisition processing (step S43).
[0080]
The client terminal assembles data from the acquired packet (step S44), and performs data reproduction processing in step S45.
[0081]
At this time, the client terminal evaluates the communication quality in step S46. In streaming based on RTP, the communication quality can be measured by using RTCP that controls the communication quality. The number of received packets in the total number of packets can be known by RTSC, and packet loss can be counted. If the packet loss is large, it can be determined that the communication quality has deteriorated. By using this, it is possible to measure the overall communication quality after watching music or video. Then, the client terminal sends the communication quality evaluation result to the server side.
[0082]
Then, the content server reflects the communication quality evaluation result in the billing (step S47). Thereby, in the information providing system, it is possible to reduce the charge according to the quality of communication.
[0083]
An information processing program in the information providing system and executed by the client terminal according to the second embodiment will be described with reference to FIG. This information processing program is also stored in the ROM 24. The CPU 22 takes out from the ROM 24 and executes it using the RAM 23.
[0084]
In step S51, a packet is acquired, and data is assembled from the packet in step S52.
[0085]
Then, necessary information and data are obtained in step S53 (YES), and if it is end of data (End fo Data) (YES in step S54), the reproduction process is terminated, and communication quality is improved in step S55. evaluate. The method of evaluating the communication quality has already been described in step S46 in the operation of the entire system shown in FIG.
[0086]
After step S55, the client terminal transmits the evaluation result to the server side in step S56. In response to this, the server side reflects the communication quality in the billing at step S47 shown in FIG.
[0087]
If it is not end-of-data (NO) in step S54, data reproduction is continued in step S57.
[0088]
As described above, the information processing program is a program for causing the client terminal to process the provided information distributed from the server side by establishing a session between the server side and the client terminal, and is distributed from the server side. An evaluation step (step S55) for evaluating the communication quality related to the provided information, and an evaluation notification step (step s56) for notifying the information providing server of the communication quality evaluated by the evaluation step. To be executed.
[0089]
FIG. 8 shows a specific example of display on the LCD 30 in the client terminal (PDA 7) after the entire system is processed. Since the communication quality is not sufficient, a guide to discount the viewing fee is displayed. Further, the total number of packets and the number of received packets obtained from RTSC may be displayed. Furthermore, a video when communication quality deteriorates may be played in the small area 31.
[0090]
As described above, the client terminal such as the PDA 7 or the mobile phone device 9 incorporated in the information providing system shown in FIG. 1 evaluates the communication quality, and the evaluation result Is notified to the server side, the system as a whole can perform appropriate processing such as discounting the charge depending on the communication quality, and the user can resolve some dissatisfaction.
[0091]
Next, a third embodiment will be described. The third embodiment is also the PDA 7 or 11, the portable audio playback device 8 or 10, or the mobile phone device 9 incorporated in the information providing system shown in FIG.
[0092]
The configuration of these client terminals is the same as that of the PDA 7 shown in FIG. However, since the provided information is transmitted in real time using the RTP (Real Time Transport Protocol) on the UDP from the server side, the content of the information processing program stored in the ROM 23 is changed to RTCP RTCP (RTP Control Protocol). I have used it. RTCP is a control protocol for performing delivery confirmation and monitoring. The information processing program evaluates communication quality using RTCP. Details of the information processing program will be described later.
[0093]
In the third embodiment, the portable client terminal stores the time stamp of the point where the communication quality deteriorates in the built-in information providing system in the RAM 23, and after the viewing is completed, the user can view again. A function for displaying or outputting a video and / or audio following a time stamp point with deteriorated communication quality is provided.
[0094]
FIG. 9 is a transition diagram showing an outline of the operation of the information providing system including the client terminal according to the third embodiment.
First, a session is established between any content server and a client terminal via the window server 5 (step S61).
[0095]
The content is transmitted from the content server to the client terminal via the window server (step S62), and the client terminal performs packet acquisition processing (step S63).
[0096]
The client terminal assembles data from the acquired packet (step S64), and performs data reproduction processing in step S65. At this time, the time stamp is stored in the RAM 23 (step S66). Time stamps relating to normally reproduced data are updated one after another.
[0097]
Further, the client terminal evaluates the communication quality in step S67. Here, when communication quality deteriorates due to deterioration of communication conditions (step S68), a time stamp of a place where the communication quality has deteriorated remains in the RAM 23.
[0098]
After the output of music, video, etc., the time stamp recorded in the RAM 23 is read (step S69). At this time, in step S70, based on the type stamp, there is a point on the LCD 30 where the communication quality has deteriorated as shown in FIG.
[0099]
When re-viewing is desired by the user in step S70, a request signal and a time stamp indicating that are transmitted to the content server side, and the content server side receives them (step S71). On the content server side, the content from the time stamp is transmitted to the client side terminal (step S72).
[0100]
The client terminal performs a packet acquisition process in step S73, assembles data from the packet in step S74, and reproduces the data in step S75. At this time, of course, the time stamp is stored in the RAM 23.
[0101]
A specific example of display on the LCD 30 in the client terminal (PDA 7) shown in FIG. 10 will be described. The type stamp of the section where the communication quality was not sufficient is shown, and guidance is provided as to whether re-viewing is desired. Furthermore, a video when communication quality deteriorates may be played in the small area 31.
[0102]
As described above, the client terminal such as the PDA 7 or the mobile phone device 9 incorporated in the information providing system illustrated in FIG. 1 evaluates the communication quality, and the communication quality is It has a function that remembers the time stamp of the bad point, etc., and asks the user whether or not to view it again based on it. As a result, some dissatisfaction on the user side due to the deterioration of the communication quality can be solved as a whole system.
[0103]
Next, a fourth embodiment will be described. The fourth embodiment is also the PDA 7 or 11, the portable audio playback device 8 or 10, or the mobile phone device 9 incorporated in the information providing system shown in FIG.
[0104]
The configuration of these client terminals is the same as that of the PDA 7 shown in FIG. What is different is an information processing program executed by the CPU 22. This information processing program is a program that combines both the information processing program executed in the first embodiment and the information processing program executed in the second embodiment.
[0105]
That is, as shown in FIG. 11, it is determined in step S81 whether there is resume information. If it is determined in step S81 that no resume information remains, reproduction processing is performed from the top data (step S82). If YES, the process proceeds to step S92, and time stamp information is transmitted to the content server.
[0106]
In step S82, since the session remains established, the client terminal performs reproduction processing from the top data. In step S83, a packet is acquired, and in step S84, data is assembled from the packet.
[0107]
If necessary information and data are obtained in step S85 (YES), and if it is end of data (YES in step S86), the process proceeds to step S89.
[0108]
In step S89, the communication quality is evaluated using the RTCP. If the evaluation result is Good, the process is terminated. If the evaluation result is NG, the server side is notified of the evaluation result that the quality is deteriorated in Step S90. At this time, as shown in FIG. 8, since the communication quality is not sufficient, a guidance for discounting the viewing fee is displayed.
[0109]
If the necessary information and data are not obtained in step S85 (NO), the processing from step S83 is repeated. If it is not end-of-data (NO) in step S86, data reproduction is continued in step S87.
[0110]
Subsequent to step S87, step S88 is a process for determining whether or not the information acquisition interval for resuming has been reached. If the predetermined information acquisition interval has been reached (YES), the process proceeds to step S91, and the time stamp information The communication quality is stored in the RAM 23. If the predetermined information acquisition interval has not been reached (NO), the processing from step S83 is repeated.
[0111]
If it is determined in step S81 that there is resume information (YES), since the session interruption shown in step S7 of FIG. 4 has occurred, the client terminal reads the time stamp from the RAM 23 (FIG. 4). In step S9), this is transmitted to the content server in step S92. As a whole system, the time stamp shown in step S10 of FIG. 4 is transmitted.
[0112]
As described above, the client terminals such as the PDA 7 and the mobile phone device 9 incorporated in the information providing system shown in FIG. Without placing a burden on the server side, it is possible to display the video and audio from the part where the disconnection has occurred, centering on its own processing, on the LCD, and to output the audio from the speaker or headphones.
[0113]
In addition, although communication is not interrupted, when communication quality deteriorates, it is evaluated and transmitted to the server side. Therefore, the entire system can perform appropriate processing such as discounting the charge depending on the communication quality. Can eliminate some dissatisfaction.
[0114]
In the client terminals of the above-described embodiments, the ROM 24 is a specific example of the program storage medium. However, the RAM 23 may be a RAM 23, another semiconductor memory that can be connected to the internal bus 21, HDD, FD, or the like. It may be a storage device.
[0115]
【The invention's effect】
According to the client terminal, the client-side information processing method, the program providing medium, and the program according to the present invention, even when the communication is disconnected, when the connection is established next, the video and music from the portion where the disconnection has occurred Can be enjoyed.
[0116]
According to the client terminal, the client side information processing method, the program providing medium, and the program according to the present invention, the communication quality is evaluated, and based on the result, the information providing server performs a process such as discounting the charge, and the user To some degree of dissatisfaction.
[0117]
According to the client terminal, the client-side information processing method, the program providing medium, and the program according to the present invention, the communication quality is evaluated, the time stamp of the point where the communication quality is deteriorated, etc., and the user is based on the time stamp. You can ask again if you want to watch.
[0118]
According to the information providing system of the present invention, it is possible to enjoy video and music from the part where the disconnection occurs when the connection is established next time even when the communication is disconnected.
[0119]
According to the information providing system according to the present invention, the communication quality is evaluated at the client terminal, and based on the result, the information providing server performs a process such as discounting the charge, so that the user can solve some dissatisfaction. it can.
[0120]
According to the information providing system according to the present invention, the communication quality is evaluated at the client terminal, the time stamp of the point where the communication quality has deteriorated is remembered, and whether or not to view again to the user based on it is determined. The corresponding provision information can be transmitted from the information provision server.
[Brief description of the drawings]
FIG. 1 is a diagram showing a configuration of an information providing system incorporating a specific example of a client terminal according to the present invention.
FIG. 2 is a block diagram showing a configuration of a portable information terminal which is an example of a client terminal.
FIG. 3 is a block diagram of a window server constituting the information providing system.
4 is a transition diagram showing an outline of the operation of the information providing system shown in FIG. 1. FIG.
FIG. 5 is a flowchart for explaining an information processing program executed by a client terminal in the information providing system.
FIG. 6 is a transition diagram showing an outline of an operation of an information providing system including a client terminal according to the second embodiment of this invention.
FIG. 7 is a flowchart for explaining an information processing program executed by the client terminal according to the second embodiment in the information providing system.
FIG. 8 is a diagram illustrating a specific example of display on the LCD in the client terminal according to the second embodiment.
FIG. 9 is a transition diagram showing an outline of the operation of the information providing system including the client terminal according to the third embodiment of this invention.
FIG. 10 is a diagram illustrating a specific example of display on the LCD in the client terminal according to the third embodiment.
FIG. 11 is a flowchart for explaining an information processing program executed by a client terminal according to a fourth embodiment in the information providing system.
FIG. 12 is a diagram illustrating a specific example of a mobile device (client terminal) having a high-speed function.
[Explanation of symbols]
1, 2, 3, 4 Content server, 5 window server, 7 Mobile information terminal (example of client terminal), 22 Central processing unit, 23 RAM (time information storage means), 24 ROM (example of program storage medium), 25 Decoder, 30 display device (LCD)

Claims (10)

  1. In a client terminal that receives distribution information provided and displays and / or outputs sound by establishing a session with an information providing server via a network.
    An evaluation means for evaluating communication quality related to the provision information distributed from the information provision server;
    A time information storage unit that stores time information when the evaluation unit detects a deterioration in communication quality within a range where communication is not disconnected ;
    A client terminal comprising: time information notification means for reading time information when communication quality deteriorates from the time information storage means and notifying the information providing server of the time information.
  2. The time information notifying unit asks whether or not the evaluation unit desires to redistribute the provision information of the section in which the deterioration of the communication quality is detected, and from the time information storage unit in response to an instruction to the effect The client terminal according to claim 1 , wherein the read time information is notified to the information providing server, and the information providing server is requested to redistribute the provided information in the section in which the deterioration of the communication quality is detected.
  3. A client-side information processing method for processing provided information distributed from an information providing server by a client terminal by establishing a session between the information providing server and the client terminal via a network,
    An evaluation step of evaluating communication quality related to the provided information distributed from the information providing server;
    A time information storage step of storing time information in the time information storage means when the evaluation step detects a deterioration in communication quality within a range where communication is not disconnected ;
    A time information notifying step of reading the time information stored in the time information storing means when the communication quality deteriorates in the time information storing step, and notifying the information providing server of the time information. .
  4. In the time information notifying step, the time information storing means is inquired as to whether or not the delivery information of the section in which the deterioration of the communication quality is detected in the evaluation step is desired, and in response to an instruction to the effect. 4. The client-side information processing method according to claim 3 , wherein the information providing server is notified of the time information read from the information providing service, and the information providing server is requested to redistribute the information provided in the section in which the deterioration of the communication quality is detected.
  5. A program storage medium storing a client-side information processing program for processing provided information distributed from the information providing server by the client terminal by establishing a session between the information providing server and the client terminal via the network There,
    An evaluation step of evaluating communication quality related to the provided information distributed from the information providing server;
    A time information storage step of storing time information in the time information storage means when the evaluation step detects a deterioration in communication quality within a range where communication is not disconnected ;
    A client terminal comprising: a time information notification step of reading time information stored in a time information storage means when communication quality deteriorates in the time information storage step, and notifying the information providing server of the time information. A program storage medium that stores a program to be executed.
  6. In the time information notifying step, the time information storing means is inquired as to whether or not the delivery information of the section in which the deterioration of the communication quality is detected in the evaluation step is desired, and in response to an instruction to the effect. 6. The program storage medium according to claim 5 , wherein the information providing server is notified of the time information read out from the information providing server, and the information providing server is requested to redistribute the provided information in the section in which the communication quality deterioration is detected.
  7. A program for processing the provided information distributed from the information providing server by the client terminal by establishing a session between the information providing server and the client terminal via the network,
    An evaluation step of evaluating communication quality related to the provided information distributed from the information providing server;
    A time information storage step of storing time information in the time information storage means when the evaluation step detects a deterioration in communication quality within a range where communication is not disconnected ;
    A time information notification step of reading the time information stored in the time information storage means when the communication quality deteriorates in the time information storage step, and notifying the information providing server of the time information. Program to be executed.
  8. In the time information notifying step, the time information storing means is inquired as to whether or not the delivery information of the section in which the deterioration of the communication quality is detected in the evaluation step is desired, and in response to an instruction to the effect. 8. The program according to claim 7 , wherein the information providing server is notified of the time information read from the information requesting server and requests the information providing server to redistribute the provision information of the section in which the deterioration of the communication quality is detected.
  9. In an information providing system in which an information providing server transmits providing information to a client terminal via a network,
    The client terminal is an evaluation unit for evaluating communication quality of provided information distributed from the information providing server by establishing a session with the information providing server via a network;
    A time information storage unit that stores time information when the evaluation unit detects a deterioration in communication quality within a range where communication is not disconnected ;
    Time information notifying means for reading time information when communication quality deteriorates from the time information storage means and notifying the information providing server of the time information;
    The information provision server newly transmits provision information to which the time information transmitted from the time information notification unit is added to the client terminal.
  10. The time information notifying unit asks whether or not the evaluation unit desires to redistribute the provision information of the section in which the deterioration of the communication quality is detected, and from the time information storage unit in response to an instruction to the effect Notifying the information providing server of the read time information and requesting the information providing server to redistribute the provision information of the section in which the deterioration of the communication quality is detected,
    The information providing system according to claim 9, wherein the information providing server transmits the provision information of the section in which the deterioration of the communication quality is detected to the client terminal in response to a second distribution request from the time information notification unit.
JP2001239689A 2001-08-07 2001-08-07 Client terminal and client side information processing method, program storage medium, program, and information providing system, Expired - Fee Related JP4806871B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2001239689A JP4806871B2 (en) 2001-08-07 2001-08-07 Client terminal and client side information processing method, program storage medium, program, and information providing system,

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2001239689A JP4806871B2 (en) 2001-08-07 2001-08-07 Client terminal and client side information processing method, program storage medium, program, and information providing system,

Publications (2)

Publication Number Publication Date
JP2003050761A JP2003050761A (en) 2003-02-21
JP4806871B2 true JP4806871B2 (en) 2011-11-02

Family

ID=19070395

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2001239689A Expired - Fee Related JP4806871B2 (en) 2001-08-07 2001-08-07 Client terminal and client side information processing method, program storage medium, program, and information providing system,

Country Status (1)

Country Link
JP (1) JP4806871B2 (en)

Families Citing this family (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2005100344A (en) 2003-08-18 2005-04-14 Ricoh Co Ltd Information processor, session restoration method, session restoration program, and recording medium
AU2004317111B2 (en) * 2004-02-13 2009-01-08 Nokia Corporation Timing of quality of experience metrics
JP4251207B2 (en) 2006-04-28 2009-04-08 ソニー株式会社 Server, reconnection control method, equipment devices, reconnection method, program, and recording medium
US9198084B2 (en) 2006-05-26 2015-11-24 Qualcomm Incorporated Wireless architecture for a traditional wire-based protocol
FR2907992A1 (en) * 2006-10-30 2008-05-02 Thomson Licensing Sas Interrupted content downloading session i.e. video-on demand session, recovering method, for set-top box, involves recovering session when all channels are available, in response to session recovery request from remote server
JP5228779B2 (en) 2008-10-10 2013-07-03 富士通株式会社 Information system, server, service providing method, and program
US9398089B2 (en) 2008-12-11 2016-07-19 Qualcomm Incorporated Dynamic resource sharing among multiple wireless devices
US9264248B2 (en) 2009-07-02 2016-02-16 Qualcomm Incorporated System and method for avoiding and resolving conflicts in a wireless mobile display digital interface multicast environment
US9582238B2 (en) 2009-12-14 2017-02-28 Qualcomm Incorporated Decomposed multi-stream (DMS) techniques for video display systems
US20130003624A1 (en) * 2011-01-21 2013-01-03 Qualcomm Incorporated User input back channel for wireless displays
US9582239B2 (en) 2011-01-21 2017-02-28 Qualcomm Incorporated User input back channel for wireless displays
US10135900B2 (en) 2011-01-21 2018-11-20 Qualcomm Incorporated User input back channel for wireless displays
US8964783B2 (en) 2011-01-21 2015-02-24 Qualcomm Incorporated User input back channel for wireless displays
US9065876B2 (en) 2011-01-21 2015-06-23 Qualcomm Incorporated User input back channel from a wireless sink device to a wireless source device for multi-touch gesture wireless displays
US9787725B2 (en) 2011-01-21 2017-10-10 Qualcomm Incorporated User input back channel for wireless displays
US9413803B2 (en) 2011-01-21 2016-08-09 Qualcomm Incorporated User input back channel for wireless displays
US9503771B2 (en) 2011-02-04 2016-11-22 Qualcomm Incorporated Low latency wireless display for graphics
US10108386B2 (en) 2011-02-04 2018-10-23 Qualcomm Incorporated Content provisioning for wireless back channel
US9525998B2 (en) 2012-01-06 2016-12-20 Qualcomm Incorporated Wireless display with multiscreen service

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08130517A (en) * 1994-11-01 1996-05-21 Toshiba Ave Corp Video-on demanding device
JP2002330381A (en) * 2000-12-07 2002-11-15 Matsushita Electric Ind Co Ltd Data reproduction method, data receiving terminal and data receiving method

Also Published As

Publication number Publication date
JP2003050761A (en) 2003-02-21

Similar Documents

Publication Publication Date Title
US7280711B2 (en) Information processing apparatus, information processing method, information processing system and program thereof
US7516203B2 (en) Network control verification system, control communication terminal, server apparatus, and network control verification method
US8892688B2 (en) Portable terminal, information processing apparatus, content display system and content display method
US7818368B2 (en) System and method for downloading content
US8688053B2 (en) Methods and apparatus to identify wireless carrier performance effects
US20140009559A1 (en) Method of audio-visual communication using a television and television using the same
JP4282201B2 (en) Encoded data recorder
US7681225B2 (en) Content distribution system, content distribution control apparatus, content distribution control method, content distribution control program and content distribution control program storage medium
KR101236541B1 (en) Mobile terminal, contents delivery system, and contents reproduction program
US20060026302A1 (en) Server architecture supporting adaptive delivery to a variety of media players
JP4752093B2 (en) Information processing apparatus and information processing method
US8577953B2 (en) System and method for providing multimedia services
JP4346969B2 (en) Control method for a digital television broadcast receiver and a digital television broadcasting receiving device
KR100795258B1 (en) Communication system, apparatus and methods employing multiple communication networks
US20040043770A1 (en) Broadcast content over cellular telephones
US7599987B2 (en) Information processing device for obtaining high-quality content
US20040203374A1 (en) Graphical indication of a proximately located device
US20050125819A1 (en) Broadcast receiving apparatus, control method and program therefor
EP1667454A1 (en) Content distribution system, content distribution method, content distribution server, content reproduction apparatus, content distribution program, and content reproduction program
JP4495821B2 (en) Data transmission system and the communication device
JP4403966B2 (en) The information processing system, information processing apparatus and information processing method
US20020156660A1 (en) Content distribution method, reservation management device, and program storage medium
US9106801B2 (en) Terminals, servers, and methods that find a media server to replace a sensed broadcast program/movie
KR101403747B1 (en) Real-time hd tv/video ip streaming to a game console
US20180248864A1 (en) Method of using server, server reservation control apparatus and program storage medium

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20080704

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20110128

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20110208

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20110324

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20110607

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20110624

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20110719

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20110801

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140826

Year of fee payment: 3

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees