CN102843334A - Interactive method of online application, server, client device and system - Google Patents

Interactive method of online application, server, client device and system Download PDF

Info

Publication number
CN102843334A
CN102843334A CN201110165706XA CN201110165706A CN102843334A CN 102843334 A CN102843334 A CN 102843334A CN 201110165706X A CN201110165706X A CN 201110165706XA CN 201110165706 A CN201110165706 A CN 201110165706A CN 102843334 A CN102843334 A CN 102843334A
Authority
CN
China
Prior art keywords
data
experience
enhanced
client device
server
Prior art date
Application number
CN201110165706XA
Other languages
Chinese (zh)
Inventor
秦晋
党沛
张楚雄
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to CN201110165706XA priority Critical patent/CN102843334A/en
Publication of CN102843334A publication Critical patent/CN102843334A/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network-specific arrangements or communication protocols supporting networked applications
    • H04L67/34Network-specific arrangements or communication protocols supporting networked applications involving the movement of software or configuration parameters
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/10Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals
    • A63F2300/1037Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by input arrangements for converting player-generated signals into game device control signals being specially adapted for converting control signals received from the game device into a haptic signal, e.g. using force feedback
    • AHUMAN NECESSITIES
    • A63SPORTS; GAMES; AMUSEMENTS
    • A63FCARD, BOARD, OR ROULETTE GAMES; INDOOR GAMES USING SMALL MOVING PLAYING BODIES; VIDEO GAMES; GAMES NOT OTHERWISE PROVIDED FOR
    • A63F2300/00Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game
    • A63F2300/50Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers
    • A63F2300/53Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing
    • A63F2300/538Features of games using an electronically generated display having two or more dimensions, e.g. on a television screen, showing representations related to the game characterized by details of game servers details of basic data processing for performing operations on behalf of the game client, e.g. rendering

Abstract

The embodiment of the invention provides an interactive method of an online application, a server, a client device and a system, so that a user can carry out enhanced experience on the client and improve the interaction with the application. The method comprises the following steps: a server generates enhanced experience data and corresponding instruction; the server transmits the enhanced experience data and corresponding instruction to the client device, so that the client device carries out the corresponding instruction of the enhanced data experience data. Compared with the prior art, according to the method, on one hand, the cost required for enhanced experience on the client is reduced, and the performance requirement on the client device is also greatly reduced; on the other hand, the interaction of the user and the application of the server is improved, and the experience of the user on special effects can be obviously enhanced.

Description

在线应用的交互方法、服务器、客户端设备和系统 Interactive online method of application, server, client devices and systems

技术领域 FIELD

[0001] 本发明涉及在线应用领域,尤其涉及在线应用的交互方法、服务器、客户端设备和系统。 [0001] The present invention relates to online applications, and in particular relates to a method of online interactive application, server, client device and system.

背景技术 Background technique

[0002] 在线应用的服务器(Server) —般可以称为在线应用平台,其上可以部署各种各样第三方开发的应用,而·在线应用的客户端(Client),例如,个人电脑(PC,PersonalComputer)、手机、个人数字助理(PDA, Personal Digital Assistant)、连接遥控器(或游戏手柄)的电视机等,可以远程连接到在线应用平台上体验这些应用。 [0002] Online application server (Server) - generally can be called online application platform, which can be deployed on a wide variety of applications developed by third parties, and · Online application client (Client), for example, a personal computer (PC , PersonalComputer), cell phones, personal digital assistants (PDA, personal digital Assistant), connect the remote control (or gamepad) TV, etc., you can remotely connect to the online application platform experience these applications. Server与Client的交互过程一般为:Client将用户操作产生的输入事件消息上传到Server ;Server收到输入事件消息后进行计算和处理,并将运行过程中的画面实时发送到Client ;Client可实时观察到应用的运行过程。 Server and Client interaction generally: Client generates the user operates the input event messages upload Server; calculated and processed Server receives an input event message and transmits during operation screen in real time Client; Client time observation to run the application process. 在以上交互过程中,用户操作的输入事件具体可以指键盘和鼠标事件(Client端为PC)、按键或触摸屏事件(Client端为手机或PDA)、遥控器或者游戏手柄的操作事件(Client端为电视机)等,Server发送音视频数据和Client端接收音视频数据后显示一般采取的方式是=Server采用诸如视频压缩技术将画面图像和声音数据进行高效压缩,然后将压缩后的数据发送到Client端,Client端收到压缩后的数据后在本地先解码再展示画面图像和播放声音。 In the above interaction, the user input event operations may specifically refer to the keyboard and mouse events (Client side of PC), key or touch screen event (Client terminal is a mobile phone or PDA), a remote controller or joystick operation event (Client terminal is television), etc., the Server sends audio and video data and video data Client terminating radio display is generally taken = Server using data compression techniques such as video and audio data to the screen image for efficient compression, the compression is then sent to the Client the rear end, Client terminal receives the compressed data and then decoding the first image and the presentation play sounds locally.

[0003] 上述在线应用场景的特点是:所有应用的运行和处理都在Server端进行,Client只负责将用户操作的输入事件消息上传至Server端和接收压缩数据进行解码显示。 [0003] Characteristics of the above-described online scenarios are: processing and all applications running in end proceeds Server, Client only responsible for uploading a user operation input event messages to the Server and receiving the compressed data is decoded and then displayed. 尽管如此,从用户侧来看,用户的感受如同在操作本地应用一祥。 Nevertheless, from the view of the user side, the user experience as in the operation of the local application of a Cheung.

[0004]目前,个人用户在单机上的使用的能够增强用户体验的增强型体验输出设备(例如,常见的游戏カ反馈手柄、可给人带来触摸实物感觉的カ反馈触摸屏幕和根据指令散发不同香味的香味散发芯片等)可以为用户提供一些增强型体验。 [0004] At present, can enhance the user experience and enhanced user experience output devices for personal use on stand-alone (for example, a common game ka feedback handle, can bring real sense of touch feedback touch screen and grades according to the instructions circulated different flavor scent chips, etc.) can provide an enhanced experience for the user.

[0005] 然而,现有技术提供的在线应用中,在线应用的客户端还无法体验由体验输出设备输出的体验,导致在线应用中用户体验不高。 [0005] However, the application of existing technology to provide online, the online application client can not experience experience experience by the output device, leading to the online application user experience is not high.

发明内容 SUMMARY

[0006] 本发明实施例提供在线应用的交互方法、服务器、客户端设备和系统,以使用户能在客户端进行增强型体验,提升与应用的交互。 Example embodiments provide a method of online interactive application, server, client device and system [0006] of the present invention to enable a user to perform enhanced client experience, improve interaction with an application.

[0007] 本发明实施例提供一种在线应用的交互方法,所述方法包括:服务器生成增强型体验数据及与所述增强型体验数据对应的指令;所述服务器将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备,以使所述客户端设备利用所述增强型体验数据执行与所述增强型体验数据对应的指令。 Example embodiments provide an online interactive application method [0007] of the present invention, the method comprising: generating an enhanced experience data server and data corresponding to the instruction and the enhanced experience; the server, the enhanced experience data and data corresponding to the enhanced experience instruction to the client device, so that the client device using the enhanced experience data performed with the enhanced experience data corresponding to the instruction.

[0008] 本发明实施例提供一种在线应用的交互方法,所述方法包括:客户端设备接收服务器生成的增强型体验数据及与所述增强型体验数据对应的指令;所述客户端设备利用所述增强型体验数据执行与所述增强型体验数据对应的指令以生成增强型体验效果。 [0008] Example embodiments provide an online interactive application method of the present invention, the method comprising: a client device receives a server-generated data and enhanced experience enhanced experience data corresponding to said instruction; client device using the the enhanced experience data performed with the enhanced experience data corresponding to the instruction to produce an enhanced experience effect. [0009] 本发明实施例提供一种服务器,包括:数据指令生成模块,用于生成增强型体验数据及与所述增强型体验数据对应的指令;发送模块,用于将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备,以使所述客户端设备利用所述增强型体验数据执行与所述增强型体验数据对应的指令。 [0009] Example embodiments of the present invention provides a server, comprising: a data command generation module for generating an enhanced experience data and enhanced experience data corresponding to said instruction; sending module, configured to experience the enhanced data and an enhanced experience data corresponding to the instruction to the client device, so that the client device using the enhanced experience data performed with the enhanced experience data corresponding to the instruction.

[0010] 本发明实施例提供一种客户端设备,所述客户端设备包括:数据指令接收模块,用于接收服务器生成的增强型体验数据及与所述增强型体验数据对应的指令;执行模块,用于利用所述增强型体验数据执行与所述增强型体验数据对应的指令以生成增强型体验效果。 Embodiment [0010] The present invention provides a client device, the client device comprising: an instruction data receiving means for receiving an enhanced experience data generated by the server and the instruction and the data corresponding to an enhanced experience; execution module , utilizing the enhanced experience for performing the enhanced data experience data corresponding to the instruction to produce an enhanced experience effect.

[0011] 本发明实施例提供ー种在线应用系统,所述在线应用系统包括:服务器和客户端设备; Embodiment [0011] The present invention provides online applications ー species, the online application system comprising: a server and a client device;

[0012] 所述服务器,用于生成增强型体验数据及与所述增强型体验数据对应的指令,将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备,以使所述客户端设备利用所述增强型体验数据执行与所述增强型体验数据对应的指令;所述客户端设备,用于接收所述服务器生成的增强型体验数据及与所述增强型体验数据对应的指令,利用所述增强型体验数据执行与所述增强型体验数据对应的指令以生成增强型体验效果。 [0012] The server, for generating an enhanced experience data and instruction data corresponding to the enhanced experience, transmitting the enhanced data and experience enhanced experience data corresponding to the instruction to the client apparatus, so that the client device using the enhanced experience data performed with the enhanced experience data corresponding to the instruction; the client device, the server is configured to receive the generated data and enhanced experience with the enhanced experience data corresponding to the instruction data by using the enhanced experience performing enhanced experience data corresponding to said instructions to generate an enhanced experience effect.

[0013] 从上述本发明实施例可知,客户端设备执行的增强型体验数据的对应指令来自于服务器。 [0013] From the above embodiment of the present invention, corresponding to the enhanced instruction executed by the client device from the server experience data. 由于服务器能够根据用户在客户端设备进行增强型体验时的操作产生的消息生成增强型体验数据及其对应指令发送至客户端设备,客户端设备只需要执行指令就可输出增强型体验效果,让用户在客户端进行体验,使得在线应用的用户可以通过客户端体验这些増加型体验,增强在线应用的用户体验效果。 Since the server can generate a message generation and an enhanced experience data corresponding to a user operation instruction enhanced experience apparatus according to the client transmits to the client device, the client device can execute instructions only needs to output an enhanced experience effects, the user experience on the client side, so that the user can apply online by clients to experience these type of increase in experience, enhance the user experience online applications.

附图说明 BRIEF DESCRIPTION

[0014] 为了更清楚地说明本发明实施例的技术方案,下面将对现有技术或实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本发明的ー些实施例,对于本领域技术人员来讲,还可以如这些附图获得其他的附图。 [0014] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following prior art will be required, or the accompanying drawings used in the embodiments described briefly described embodiment, be apparent in the following description of the drawings are merely presentー some embodiments of the invention, in terms of ordinary skill in the art, as can derive other drawings from such accompanying drawings.

[0015] 图I是本发明实施例提供的在线应用的交互方法流程示意图; [0015] Figure I is a process flow line interactive application according to an embodiment of the present invention, a schematic view;

[0016] 图2是本发明实施例提供的在线应用的交互方法流程示意图; [0016] FIG. 2 is a schematic process flow online interactive application according to an embodiment of the present invention;

[0017] 图3-1是本发明实施例提供的服务器架构示意图; [0017] FIG. 3-1 is a schematic view of a server architecture according to an embodiment of the present invention;

[0018] 图3-2是本发明实施例提供的客户端架构示意图; [0018] FIG. 3-2 is a client according to an embodiment of the present invention, an end architecture diagram;

[0019] 图4-1是本发明实施例提供的服务器与客户端连接示意图; [0019] FIG. 4-1 is provided in the server and the client connection diagram embodiment of the present invention;

[0020] 图4-2是本发明另ー实施例提供的服务器与客户端连接示意图; [0020] FIG ー 4-2 is another embodiment of the present invention provide a server and a client connected to a schematic embodiment;

[0021] 图5-1是本发明实施例提供的服务器和客户端交互示意图; [0021] FIG. 5-1 is provided in the server and client interaction schematic embodiment of the present invention;

[0022] 图5-2是本发明另ー实施例提供的服务器和客户端交互示意图; [0022] FIG. 5-2 of the present invention is to provide another embodiment ー server and client interaction schematic embodiment;

[0023] 图6是本发明实施例提供的在线应用交互方法中服务器和客户端设备的カ反馈交互流程示意图; [0023] FIG. 6 is a schematic flow diagram of interactive feedback ka online interactive application server provided by a method and a client device of the embodiment of the present invention;

[0024] 图7-1是本发明实施例提供的通过钩子程序捕获对API函数的调用时服务器的执行流程示意图; [0024] FIG. 7-1 is a schematic diagram of embodiments of the present invention to provide a process for the capture performing calling an API function server by hooks;

[0025] 图7-2是本发明另ー实施例提供的通过钩子程序捕获对API函数的调用时服务器的执行流程示意图; [0025] FIG. 7-2 is a schematic view of embodiments of the present invention further provides ー capturing process performed on the server when calling API functions by hooks;

[0026] 图8-1是本发明实施例提供的通过修改服务器系统提供的API函数对API函数的调用时服务器的执行流程示意图; [0026] FIG. 8-1 is a process performed for calling an API function server schematic API functions provided by modifying the server system according to an embodiment of the present invention;

[0027] 图8-2是本发明另ー实施例提供的通过修改服务器系统提供的API函数对API函数的调用时服务器的执行流程示意图; [0027] FIG. 8-2 of the present invention is a process to execute another ー calling an API function server schematic API functions provided by modifying the server system according to an embodiment;

[0028] 图9是本发明实施例提供的服务器逻辑结构示意图; [0028] FIG. 9 is a diagram showing the logical structure of the server according to an embodiment of the present invention;

[0029] 图10是本发明另ー实施例提供的服务器逻辑结构示意图; [0029] FIG. 10 is a schematic view of the present invention further ー logical structure of the server according to an embodiment;

[0030] 图11是本发明另ー实施例提供的服务器逻辑结构示意图; [0030] FIG. 11 is a schematic view of the present invention further ー logical structure of the server according to an embodiment;

[0031] 图12是本发明另ー实施例提供的服务器逻辑结构示意图; [0031] FIG. 12 is a schematic view of the present invention further ー logical structure of the server according to an embodiment;

[0032] 图13是本发明另ー实施例提供的服务器逻辑结构示意图; [0032] FIG. 13 is a schematic view of the present invention further ー logical structure of the server according to an embodiment;

[0033] 图14是本发明实施例提供的客户端逻辑结构示意图; [0033] FIG. 14 is a side schematic view of the logical structure of the client according to an embodiment of the present invention;

[0034] 图15是本发明另ー实施例提供的客户端逻辑结构示意图; [0034] FIG. 15 is a schematic view of the present invention, the client-side logic ー another structural diagram of the embodiment;

[0035] 图16是本发明实施例提供的在线应用系统逻辑结构示意图。 [0035] FIG. 16 is a diagram showing the logical structure of the online application system according to an embodiment of the present invention.

具体实施方式 Detailed ways

[0036] 下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例仅仅是本发明一部分实施例,而不是全部的实施例。 [0036] below in conjunction with the present invention in the accompanying drawings, technical solutions of embodiments of the present invention are clearly and completely described, obviously, the described embodiments are merely part of embodiments of the present invention, but not all embodiments example. 基于本发明中的实施例,本领域技术人员所获得的所有其他实施例,都属于本发明保护的范围。 All other embodiments based on the embodiments of the present invention, those skilled in the obtained are within the scope of protection of the present invention.

[0037] 请參阅附图1,是本发明实施例提供的在线应用的交互方法流程示意图,主要包括步骤: [0037] Please refer to FIG. 1, a schematic process flow online interactive application according to an embodiment of the present invention, includes the following steps:

[0038] S101,服务器生成增强型体验数据及与所述增强型体验数据对应指令。 [0038] S101, the server generates an enhanced experience data and enhanced experience data corresponding to the instruction.

[0039] 具体地,在本发明ー个实施例中,服务器可以根据事件消息生成增强型体验数据及与所述增强型体验数据对应指令,即服务器可以根据事件消息生成增强型体验数据以及所述增强型体验数据的对应指令,而事件消息可以是用户在客户端设备击键、移动鼠标和语音输入等事件发生时产生的消息,包括用户在客户端设备进行增强型体验时的操作产生的消息。 [0039] Specifically, in the embodiment of the present invention ー embodiment, the enhanced server may generate an event message in accordance with experience data and command data corresponding to the enhanced experience, i.e., the server may generate an enhanced experience data according to the event message and enhanced experience data corresponding to the instruction, and the event message may be a message generated by the user at the client device keystroke, moving the mouse, and voice input events, when the user performs an operation including enhanced experience message generated by the client device . 这些事件消息从客户端设备传送至服务器,服务器开启相应的应用后,根据这些事件消息生成增强型体验数据及与增强型体验数据对应指令,例如,赛车游戏中的“震动”以及“震动持续时间(例如,持续3秒)”等增强型体验数据,其对应指令可以是这些增强型体验数据对应效果的开始、结束、暂停、继续、重置和效果变化等。 After the corresponding application of these event messages open from the client device to the server, the server generates an enhanced experience data according to these event messages and to an enhanced experience data corresponding to the instruction, e.g., a racing game "shake" and "shock duration (e.g., 3 seconds) "and an enhanced experience data, which corresponds to the start instruction may be enhanced experience data corresponding to these effects, ending, pause, resume, and reset change effects. 在本发明另一实施例中,月艮务器生成增强型体验数据及与所述增强型体验数据对应的指令也可以是所述服务器上的应用运行时服务器生成的增强型体验数据及所述增强型体验数据对应的指令。 In another embodiment of the present invention, month that works to generate an enhanced experience data and data corresponding to the instruction and the experience may be enhanced application on the server runtime server-generated data and the enhanced experience enhanced experience data corresponding to the instruction. 例如,在赛车游戏这ー应用运行时,车子运行过程中,用户不对它进行任何控制时,车子可能就会碰到不平的路面而产生震动,这就是服务器上的应用运行时自身生成增强型体验数据及其对应指令的过程。 For example, in a racing game that ー application is running, the process of the car is running, the user does not have any control over it, the car might hit uneven pavement and vibration generated, which is the application running on the server itself to generate an enhanced experience and data corresponding to the process instruction. 一旦增强型体验数据的对应指令被执行,则相关执行体可以由增强型体验数据输出对应的增强型体验效果。 Once an enhanced experience data corresponding to the instruction is executed, the associated executable data can experience an enhanced effect corresponding to the output from an enhanced experience.

[0040] 所谓增强型体验,在本发明实施例中是指不同于传统音视频给客户带来的视听享受,而是能够极大地丰富用户感知(包括触觉、味觉等等)的特殊体验,例如,赛车游戏中的震动、可给人带来触摸实物感觉的カ反馈和香味散发芯片散发的不同香味等,而本发明实施例中的增强型体验数据是指在服务器产生、在客户端执行其对应的指令时能够产生上述增强型体验的数据,例如,对于赛车游戏中的震动,其增强型体验数据可以是车子“震动”、“震动持续时间(例如,持续3秒)”和“震动频率”等等,而与此对应的指令(例如,“震动开始”)一旦执行,则输出“震动3秒”的效果;又如,对于カ反馈设备(例如,常见的游戏カ反馈手柄),其增强型体验数据可以是“常力(即在某一方向上持续保持固定大小的力)”、“斜坡力(在某一方向上持 [0040] The so-called enhanced experience, in the present invention refers to embodiments different from the conventional audio and video viewing enjoyment to customers, but can greatly enrich the user perceives (including touch, taste, etc.) a special experience, e.g. , racing games vibrations, can bring a different flavor and other physical sensation of touch feedback ka scent chip and distributed, and an enhanced experience data in the embodiment of the present invention refers to the production server, the implementation of its client capable of generating data in the enhanced experience when the corresponding instruction, for example, for a racing game vibration, which enhanced experience data may be a car "shock," "shock duration (e.g., 3 seconds)" and "vibration frequency "etc., corresponding to this command (e.g.," start shock "), if implemented, the output" 3 seconds shock "effect; another example, for grades feedback device (e.g., a common game handle feedback ka), which enhanced data may experience a "constant force (i.e., continued to maintain an upward force in a certain fixed size)", "slope force (held in a certain direction 增加或減少的力)”以及“弾性”等,对应的增强型体验可以是強烈的阻力感或振荡感;再如,对于カ反馈触摸屏幕,其增强型体验数据可以是“光滑”或“粗糙”等,对应的增强型体验可以是如冰面或木头ー样的触摸感。 Increased or decreased force) "and" Tan "of the like, corresponding to an enhanced experience may be a strong sense of resistance or oscillating sense; Again, for grades feedback touch screen that enhanced experience data may be" smooth "or" rough "etc., corresponding to experience may be enhanced ice surface ー or wood-like touch feeling.

[0041] S102,服务器将增强型体验数据及与所述增强型体验数据对应的指令发送至客户端设备,以使客户端设备利用所述增强型体验数据执行与所述增强型体验数据对应的指令。 [0041] S102, the server will experience enhanced data and transmission to the enhanced experience data corresponding to the instruction client device, so that the client device using the enhanced experience data and performing the data corresponding to the enhanced experience instruction.

[0042] 在本发明实施例中,服务器上的应用生成的增强型体验数据对应的指令可以不在本地执行,而是连同增强型体验数据一起发送至客户端设备,由客户端设备执行所述增强型体验数据的对应指令。 [0042] In an embodiment of the present invention, the enhanced experience data generated by an application on the server corresponding instructions may not be performed locally, but sent to the client device along with an enhanced experience data, by the client device to perform the enhancement experience data corresponding to the command type.

·[0043] 作为本发明一个实施例,服务器可以通过如下方式将增强型体验数据及与所述增强型体验数据对应的指令发送至客户端设备。 * [0043] As an embodiment of the present invention, the server can be enhanced by way of the data and experience enhanced experience data corresponding to the command is transmitted to the client device. 服务器在应用调用服务器的操作系统提供的应用程序接ロ(Application Programming Interface,API)函数,例如,增强型体验输出设备的API时,捕获对所述API函数的调用,通过所述API函数将所述增强型体验数据及其对应指令发送至所述客户端设备,即,由于所述捕获的API函数包含增强型体验数据及与所述含增强型体验数据对应的指令,服务器将所述捕获的API函数发送至所述客户端设备,客户端设备便可以与运行捕获的API函数。 The application server in the server application calls the operating system to provide access ro (Application Programming Interface, API) functions, for example, experience enhanced output device API, captures the API function calls by the API function The and said enhanced experience data corresponding to the instruction to the client device, i.e., because the captured API functions comprising an enhanced experience enhanced experience data and data corresponding to the command containing the server captured API function API function to send the client device, the client device and can capture operation.

[0044] 由于服务器的应用在执行后,默认会调用增强型体验输出设备的API以在增强型体验输出设备上产生增强型体验,而此API包含了增强型体验数据及与所述增强型体验数据对应的指令,进ー步地,由于每当API函数被调用,钩子(Hook)程序可以先捕获该API函数。 [0044] Since the application server after the execution, call the default output device experience enhanced API to produce an enhanced experience an enhanced experience on the output device, and this API includes enhanced data and experience with the experience enhanced data corresponding to the instruction into ー steps, since whenever the API function is called, the hook (hook), the application could capture the API function. 因此,在本实施例中,可以通过钩子程序捕获对增强型体验输出设备的API函数的调用,将此API封装为增强体验消息发送至客户端设备,由客户端设备执行此API,进而使用所述API将所述增强型体验数据及与所述增强型体验数据对应的指令发送至客户端设备,从而达到在客户端设备的增强型体验输出设备上产生增强型体验,增强了用户在客户端设备的的用户体验。 Accordingly, in the present embodiment, may be captured by hooks experience enhanced call API functions of the output device, sends this message API package to enhance the experience to the client device, the API executed by the client device, further using the the API said enhanced data and experience enhanced experience data corresponding to the command is transmitted to the client device, so as to achieve an enhanced experience to produce an enhanced experience on the output device of the client device, to enhance the user on the client user equipment experience.

[0045] 作为本发明另ー个实施例,服务器也可以通过修改服务器的操作系统提供的API函数的具体实现,然后,调用修改过的API函数。 [0045] The present invention further ー concrete implementation of the API functions embodiment, the server may also be provided by modifying the server's operating system, then the API function calls modified. 例如,对于服务器的操作系统提供的应用程序接ロ函数CreateEffect,可以通过修改CreateEffect原始的效果參数,添加想让用户在客户端体验的增强型体验效果參数(例如,增强型体验数据及与所述增强型体验数据对应的指令等等)。 For example, for an application server operating system to provide access ro createEffect function, can modify the original createEffect effect parameters, a user wants to add an enhanced experience client experience the effect parameters (e.g., enhanced data and experience with the enhanced experience data corresponding to instructions, etc.). 所述修改过的API的功能变为将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备,而修改后的API的形式不发生变化(即名称和參数不发生变化),所述修改过的API函数包含所述增强型体验数据及与所述增强型体验数据对应的指令,服务器通过调用修改后的API函数将包含所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备。 The modified function becomes the API transmitting the enhanced data and experience enhanced experience data corresponding to the instruction to the client device, and a modified form of the API is not changed (i.e., the name and parameter does not change), the modified API functions comprising the enhanced experience data and data corresponding to the instruction and the enhanced experience server through the API function calls comprising modifying the enhanced data and experience and transmitting the enhanced experience data corresponding to a command to the client device.

[0046] 为了可以在本地进行增强型体验效果的体验,在本发明实施例中,服务器也可以通过调用服务器的操作系统提供的API函数在本地产生增强型体验数据对应的增强型体验效果,以供相关用户在本地进行增强型体验效果的体验。 [0046] To be able to experience an enhanced experience effect locally, in the embodiment of the present invention, the server may generate an enhanced experience data corresponding to an enhanced experience effect locally by API functions by the operating system call to the server to for relevant users to experience an enhanced experience effect locally.

[0047] 在本发明实施例中,服务器还可以将生成的音频数据和/或图像数据发送至所述客户端设备,让用户在客户端进行增强型体验效果的体验的同时,可以让用户得到视听享受,例如,在进行增强型体验效果的体验时,可以感受这些增强型体验效果的背景画面和声音等,从而进行增强型体验效果的体验的同时感受ー些震撼的画面和声音。 [0047] In an embodiment of the present invention, the server can also generate audio data and / or image data to the client device, allowing users to experience an enhanced effect in a client experience while allowing the user to give audio-visual enjoyment, for example, during an enhanced experience of the effect of experience, you can feel the background picture and sound experience enhanced these effects, so as to experience an enhanced experience effect while some feel ー shocking picture and sound.

[0048] 在客户端设备与服务器进行连接时,可只建立一个通道用于数据的接收和发送。 [0048] When a client device and a server connection may be established only one channel for receiving and transmitting data. 通过这一通道,服务器向客户端设备发送音视频数据、绘图原语、增强型体验数据及与所述增强型体验数据对应的指令,即,在本发明实施例中,服务器可以将音频数据与前述实施例中的增强型体验数据及与所述增强型体验数据对应的指令通过同一通道发送至客户端设备;或者,服务器将所述图像数据与前述实施例中增强型体验数据及与所述增强型体验数据对应的指令通过同一通道发送至所述客户端设备;或者,服务器将所述音频数据、图像数据与前述实施例中增强型体验数据及与所述增强型体验数据对应的指令通过同一通道发送至所述客户端设备。 Through this channel, the server to the client device transmits audio and video data, graphics primitives, enhanced data and experience enhanced experience data corresponding to the command, i.e., in the embodiment of the invention, the server may be audio data Examples enhanced experience data and enhanced experience data corresponding to the instruction is transmitted to the embodiments of the same channel by the client device; or an enhanced experience embodiment embodiment the data server and with the image data and the enhanced experience data corresponding to a command sent over the same channel to the client device; or an enhanced embodiment experience data server embodiment the audio data, the image data and the enhanced data corresponding to the instruction by experience the same channel is transmitted to the client device. 在同一通道的传输过程中,可以将音频数据、图像数据以及增强型体验数据及与所述增强型体验数据对应的指令作为三种不同类型的消息(增强型体验数据···及与所述增强型体验数据对应的指令作为ー种消息)进行封装,在封装时分别为这三种不同类型的消息添加对应的消息头,以便客户端根据消息头来识别这三种不同类型的消息及其传输的内容,如下表I给出的ー种消息头定义方式。 In the same transmission channel, audio data, image data and the enhanced data and experience enhanced experience data corresponding to said instructions as may be three different types of messages (enhanced experience and the data ????? enhanced experience data corresponding to the instruction as a seed message ー) encapsulates the header added at the time corresponding to the package are three different types of messages, according to the client identification information up these three different types of messages and content transmission, the following table I gives the message header types ー defined manner. 当然,随着消息类型的増加,可以对消息头的定义进行扩充,以支持更多种类的消息。 Of course, with the message type to increase in, it can be expanded to define the message header to support a wider variety of messages.

[0049] 在本发明另一实施例中,服务器的每个应用对应的ー个profile文件可包括此应用是否支持增强型体验的输出。 [0049] In another embodiment of the present invention, each application profile corresponding ー a file server may include whether the application supports this output enhanced experience. 在客户端设备与服务器建立连接的初始化阶段,服务器通过应用标识(ID)映射到此应用对应的profile文件,根据profile文件判断应用是否支持增强型体验的输出,若应用支持,则可根据服务器的IP地址和端ロ号建立新的通道用于传输增强型体验数据及与所述增强型体验数据对应的指令。 The client device and the server to establish the initialization phase of the connection, the application server mapped to the corresponding profile file by application identification (ID), is determined according to whether the application supports the profile file output an enhanced experience, if the application supports, depending on the server's ro IP address and port number to establish a new channel to transmit data and enhanced experience enhanced experience data corresponding to the instructions for. 換言之,在本发明实施例中,也可以在服务器和客户端设备之间建立不同通道用于数据的接收和发送。 In other words, this embodiment may also create different channels for transmitting and receiving data between the server and the client device according to the present invention. 通过这些不同通道,服务器可以将音频数据与前述实施例中的增强型体验数据及与所述增强型体验数据对应的指 Through these different channels, and the audio data server may experience the enhanced data and experience in the embodiment of the enhanced data referring to the corresponding

[0050] [0050]

Figure CN102843334AD00101

[0051]表 I [0051] TABLE I

[0052] 令发送至客户端设备,即,服务器将音频数据通过ー个通道发送至客户端设备,将前述实施例中的增强型体验数据及与所述增强型体验数据对应的指令通过另一通道发送至客户端设备;或者,服务器将所述图像数据与前述实施例中的增强型体验数据及与所述增强型体验数据对应的指令通过不同通道发送至所述客户端设备,即,服务器将图像数据通过ー个通道发送至客户端设备,将前述实施例中的增强型体验数据及与所述增强型体验数据对应的指令通过另一通道发送至客户端设备;或者,服务器将所述音频数据和图像数据与前述实施例中的增强型体验数据及与所述增强型体验数据对应的指令通过不同通道发送至所述客户端设备,即,服务器将音频数据和图像数据通过一个通道发送至客户端设备,将前述实施例中的增强型体验数据及与所述增强型 [0052] The order is sent to the client device, i.e., the audio data transmitted by the server ー channels to the client device, an enhanced embodiment of experience data and enhanced experience data corresponding to the instruction through another embodiment of the aforementioned channel to send to the client device; or an enhanced experience data examples and experience data corresponding to the enhanced instruction embodiment of the image data server and transmitted through the different channels to the client device, i.e., the server the image data is sent via ー channels to the client device, an enhanced embodiment of data and experience with the enhanced experience data corresponding to the aforementioned embodiment transmits instructions to the client device via another channel; or the server audio data and image data with the data presented in an enhanced experience and enhanced experience data corresponding to the instruction to the client device via different channels embodiments, i.e., the server will send audio data and image data through a channel to the client device, an enhanced embodiment of data and experience with the aforementioned embodiments of the enhanced 体验数据对应的指令通过另一通道发送至客户端设备。 Experience data corresponding to the command is transmitted to the client device via another channel.

[0053] 在上述本发明实施例中,图像数据包括视频数据和/或绘图原语。 [0053] embodiment, the image data including video data and / or drawing primitive in the embodiment of the present invention. [0054] 需要说明的是,在上述本发明实施例中,“服务器”既可以是实际服务器设备,即物理的服务器设备,如计算机,基站等,也可以是物理的服务器设备上运行的虚拟机,虚拟机中安装了多个应用,而客户端连接到实际服务器设备上的虚拟机,接收虚拟机上的应用的音频数据和/或图像数据并上传控制指令,或者,一台实际服务器设备上存在多个虚拟应用,每个虚拟应用可以提供给不同的用户。 [0054] Incidentally, in the present invention in embodiments, "server" can be either the actual server device, i.e., a physical server device, such as a computer, a base station, etc., may be run on a physical server device VM virtual machine installed in a plurality of applications, and the client is connected to the virtual machine on an actual server device, receiving an application on a virtual machine audio data and / or image data and upload control instructions, or, on a single real server device there are multiple virtual applications, each virtual application can be provided to different users.

[0055] 从上述本发明实施例可知,客户端设备执行的增强型体验数据的对应指令来自于服务器。 [0055] From the above embodiment of the present invention, corresponding to the enhanced instruction executed by the client device from the server experience data. 由于服务器能够生成增强型体验数据及与所述增强型体验数据对应的指令,并将这些增强型体验数据及与所述增强型体验数据对应的指令发送至客户端设备,客户端设备只需要按照增强型体验数据执行增强型体验数据对应的指令就可输出增强型体验效果,让用户在客户端进行体验,因此,这种增强型体验是面向所有客户端而不仅是面对个人用户,一方面减小了在客户端进行增强型体验所需的成本,对客户端设备性能要求也大为降低,另ー方面,提升了用户与服务器的应用的交互,可以明显增强用户对ー些特殊效果的体验。 Since the server is able to generate an enhanced experience data and instruction data corresponding to the enhanced experience, and transmits these data and an enhanced experience enhanced experience data corresponding to the instruction to the client device, the client device only in accordance with enhanced experience data to perform an enhanced experience data corresponding instruction can output an enhanced experience effect, allowing users to experience on the client side, so this is an enhanced experience for all clients, not just the face of individual users, on the one hand the client is reduced in cost required for enhanced experience, client device performance requirements are greatly reduced, ー another aspect, improved user interaction with the server application, the user can significantly enhance some special effects ーexperience.

[0056] 请參阅附图2,是本发明实施例提供的在线应用的交互方法流程示意图,主要包括步骤: [0056] Please refer to FIG. 2, online interactive application process flow according to an embodiment of the present invention, a schematic diagram, primarily comprising the steps of:

[0057] S201,客户端设备接收服务器生成的增强型体验数据及与所述增强型体验数据对应的指令。 [0057] S201, the enhanced experience data receiving client device and the server generates an enhanced experience data corresponding to the instruction.

[0058] 客户端设备接收的增强型体验数据及与所述增强型体验数据对应的指令是服务器根据用户在客户端设备进行增强型体验时的操作产生的消息而生成,例如,对于ー些赛车游戏,用户在客户端设备点按了键盘中的左转键,让车子进入凸凹不平的路面以体验一下由此带来的震动效果,用户的“点按左转键”就是ー个操作,这些操作最终以消息的方式传送至服务器,服务器据此生成“震动”的相关数据及其指令。 [0058] enhanced experience data received by the client device and an enhanced experience data corresponding to the command is a user generated message server operation experience enhanced client device produced according to, for example, for some racing ーgames, user client devices click the left button of the keyboard, so the car into the uneven road surface in order to experience the resulting shock effect, the user's "click left key" is ー operations, these operation finally transferred to the server by way of the message, whereby the server generates a "shock" related data and instruction.

[0059] 客户端设备接收的增强型体验数据也可以是服务器上的应用运行时自身生成的增强型体验数据。 Enhanced experience data [0059] received by the client device may be self-generated application on the server running an enhanced experience data. 例如,在赛车游戏这ー应用运行时,车子运行过程中,用户不对它进行任何控制时,车子可能就会碰到不平的路面而产生震动,这就是服务器上的应用运行时自身生成增强型体验数据(例如,“震动”)的过程。 For example, in a racing game that ー application is running, the process of the car is running, the user does not have any control over it, the car might hit uneven pavement and vibration generated, which is the application running on the server itself to generate an enhanced experience data (for example, "shock") process.

[0060] 在本发明实施例中,客户端设备还可以接收服务器生成的音频数据和/或图像数据,让用户在客户端进行增强型体验效果的体验的同时,使用户得到视听享受,例如,在进行增强型体验效果的体验时,可以感受这些增强型体验效果的背景画面和声音等。 [0060] In the embodiment of the present invention, the client device may also receive audio data and / or image data generated by the server, allowing users to experience an enhanced experience the effect of the client, while allowing users to obtain audio-visual experience, for example, during an enhanced experience of the effect of experience, you can feel the background picture and sound experience enhanced effects and so on. 音视频数据和/或图像数据可以是与增强型体验数据及其对应指令通过不同通道发送至客户端设备,例如,音频数据通过ー个通道发送至客户端设备,增强型体验数据及其对应指令通过另一通道发送至客户端设备;或者,图像数据通过ー个通道发送至客户端设备,增强型体验数据及其对应指令通过另一通道发送至客户端设备;或者,音频数据和图像数据通过ー个通道发送至客户端设备,增强型体验数据及其对应指令通过另一通道发送至客户端设备,客户端设备通过这些不同通道接收这些音视频数据和/或图像数据与所述增强型体验数据及其对应指令。 Audio and video data and / or image data may be enhanced experience data and the corresponding instruction to the client device via different channels, for example, audio data transmitted via ー channels to the client device, and an enhanced experience data corresponding to instructions through another transmission channel to the client device; Alternatively, the image data is sent via ー channels to the client device, and an enhanced experience data corresponding to the command is transmitted to the client device via another channel; Alternatively, audio data and image dataー channels transmitted to the client device, and an enhanced experience data corresponding to the command is transmitted to the client device via another channel, the client device receives the audio and video data and / or image data with the enhanced experience by these different channels and the corresponding instruction data. 音视频数据和/或图像数据也可以是与所述增强型体验数据及其对应指令通过同一通道发送至所述客户端设备,例如,音频数据与增强型体验数据及其对应指令通过同一通道发送至客户端设备;或者,图像数据与增强型体验数据及其对应指令通过同一通道发送至所述客户端设备;或者,音频数据、图像数据与增强型体验数据及其对应指令通过同一通道发送至所述客户端设备。 Audio and video data and / or image data may be the client device with the enhanced experience data corresponding to the instruction and sending to the same channel, for example, audio data corresponding to an enhanced experience data and instructions sent by the same channel to the client device; Alternatively, the image data corresponding to an enhanced experience data and commands sent over the same channel to the client device; Alternatively, audio data, image data corresponding to an enhanced experience data and commands sent to the same channel the client device. 客户端设备通过同一通道接收这些音视频数据和/或图像数据与所述增强型体验数据及其对应指令后,通过所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令携帯的消息头识别所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令,对这些数据及指令进行解析,执行增强型体验数据的对应指令,从而进行增强型体验效果的体验的同时感受ー些震撼的画面和声音。 After the client device receives the audio and video data and / or image data with the enhanced experience data and instructions corresponding to the same channel, through the audio data, image data and the enhanced data and experience with the enhanced experience data carrying Bands corresponding instruction message header identifying the audio data, image data and the enhanced data experience and experience data corresponding to the instruction type and the enhancement of the data and instruction parsing performed enhanced experience data At the same time the corresponding instruction so as to perform an enhanced experience to experience the feeling of the effect of these shock ー picture and sound. 在本实施例中,图像数据包括视频数据和/或绘图原语。 In the present embodiment, the image data including video data and / or drawing primitives.

[0061] S202,客户端设备按照增强型体验数据执行与所述增强型体验数据对应的指令以生成增强型体验效果。 [0061] S202, the client device performs data in accordance with an enhanced experience enhanced experience data corresponding to said instructions to generate an enhanced experience effect.

[0062] 所谓增强型体验数据,是指在服务器产生、在客户端执行其对应的指令时能够产生增强型体验的数据,而增强型体验,在本发明实施例中是指不同于传统音视频给客户带来的视听享受,而是能够极大地丰富用户感知(包括触觉、味觉等等)的特殊体验,例如,赛车游戏中的震动、可给人带来触摸实物感觉的カ反馈和香味散发芯片散发的不同香味等。 [0062] Enhanced called experience data, refers to the production server, the data capable of producing an enhanced experience when its corresponding client instruction execution, and enhanced experience, in the embodiment of the present invention is different from the conventional audio and video means audio-visual enjoyment to customers, but can greatly enrich the user perceives a special experience (including touch, taste, etc.), for example, a racing game vibration, can bring real sense of touch and scent grades feedback different flavor chips, etc. distributed.

[0063] 具体地,对于上述步骤S201提供的赛车“震动”实施例中,其增强型体验数据可以是车子“震动”、“震动持续时间”和“震动频率”等等,而与此对应的指令可以是“震动开始”、“震动暂停”、“震动停止”和“震动重启”等等。 [0063] In particular, the above-mentioned step S201 for the car to provide the "shock" embodiments, which may be enhanced experience data car "shock," "shock duration" and "vibration frequency" and the like, and corresponding thereto instruction may be "shock start", "shock pause", "stop shaking" and "shock restart" and so on. 客户端设备收到这些增强型体验数据及其对应的指令后,按照增强型体验数据(例如,“震动”和“震动持续3秒”),执行对应的指令(例如,“震动开始”),输出“震动3秒”的效果。 After the client device receives the enhanced experience data and the corresponding instruction data in accordance with an enhanced experience (e.g., "shake" and "shock for 3 seconds"), executes a corresponding instruction (e.g., "start shock"), output "shock three seconds" effect.

[0064] 从上述实施例可知,客户端设备执行的增强型体验数据的对应指令来自于服务器。 [0064] From the above embodiments, the instruction corresponding to the enhanced client device executing experience data from the server. 由于服务器能够生成增强型体验数据及与所述增强型体验数据对应的指令,并将这些增强型体验数据及与所述增强型体验数据对应的指令发送至客户端设备,客户端设备只需要执行指令就可输出增强型体验效果,让用户在客户端进行体验,因此,这种增强型体验是面向所有客户端而不仅是面对个人用户,一方面减小了在客户端进行增强型体验所需的成本,对客户端设备性能要求也大为降低,另ー方面,提升了用户与服务器的应用的交互,可以明显增强用户对ー些特殊效果的体验。 Since the server is able to generate an enhanced experience data and instruction data corresponding to the enhanced experience, and transmits these data and an enhanced experience enhanced experience data corresponding to the instruction to the client device, the client device only needs to perform command can output an enhanced experience effect, allowing users to experience on the client side, so this is an enhanced experience for all clients, not just the face of individual users, while reducing the conduct enhanced client experience in the the cost required for the client device performance requirements are greatly reduced, the other aspects ー, interactive applications to enhance the user and the server, it can significantly enhance the user experience ー some special effects.

[0065] 以下可以结合上述附图I和附图2示例的在线应用的交互方法,给出在线应用系统中服务器和客户端设备的ー种架构实施例。 [0065] The following methods may be combined with the above-described interactive exemplary figures I and 2 of the accompanying drawings online application, kind of architecture is given ー online application server and the client device embodiment. 如附图3-1所示,服务器包括应用程序模块301、输出体验模块302、音视频模块303和消息通讯模块304,其中: As shown in the drawings, the server 301 includes an application program module, the output module 302 experiences, audio and video communication module 303 and a message module 304 3-1 wherein:

[0066] 应用程序模块301,用于运行在线应用平台上的应用程序;[0067] 输出体验虚拟模块302,用于接收应用程序模块301产生的增强型体验数据及与所述增强型体验数据对应的指令,并将其发送至消息通讯模块304 ; [0066] Application module 301, an application program running on the internet online application; [0067] Experience virtual output module 302, 301 for generating an enhanced experience data receiving application module and experience data corresponding to the enhanced instruction message and sends it to the communication module 304;

[0068] 消息通讯模块304,用于接收客户端发送的事件消息,包括用户在客户端设备中击键、移动鼠标和语音输入等事件产生的消息,也包括用户在客户端进行增强型体验时的操作产生的消息,并将输出体验虚拟模块302发送过来的增强型体验数据及与所述增强型体验数据对应的指令以及音视频模块303发送过来的音频数据和/或图像数据发送至客户端; [0068] message communication module 304, for receiving event messages sent by the client, a message including the user keystrokes at the client device, and move the mouse event generated voice input, including an enhanced user experience when the client a message generating operation, and outputs a virtual experience module 302 sent from the enhanced data and experience enhanced experience data corresponding to the command module 303 and the audio and video data sent from the audio and / or image data to the client ;

[0069] 音视频模块303,用于接收应用程序模块301产生的音频数据和/或图像数据,并将其发送给发送至消息通讯模块304。 [0069] audio and video module 303, audio data and / or receiving image data generated by application module 301, and sends it to a message sent to the communication module 304.

[0070] 在上述附图3-1示例中,图像数据包括视频数据和/或绘图原语。 [0070] In the example of the above figures 3-1, the image data including video data and / or drawing primitives.

[0071] 如附图3-2所示,是本发明客户端设备的ー种架构实施例,包括输入模块305、输出体验设备306、音视频设备307和消息通讯模块308,其中: [0071] As shown in figures 3-2 is an embodiment ー species client device architecture of the present invention includes an input module 305, an output device 306 experience, audio and video equipment 307 and the message communication module 308, wherein:

[0072] 输入模块305,用于用户进行数据及指令的输入,包括击键、移动鼠标和语音输入等事件,也包括用户在客户端进行增强型体验时的操作; [0072] The input module 305, a user input data and instructions, including keystroke, moving the mouse, and voice input events, when the user performs an operation including enhanced experience client;

[0073] 输出体验设备306,用于执行在线应用的服务器通过消息通讯模块404发送过来的增强型体验数据的对应指令; Instruction corresponding to the server [0073] Output device 306 experiences, for performing online application messages sent by the communication module 404 via an enhanced experience data;

[0074] 音视频设备307,用于接收消息通讯模块308发送过来的音频数据和/或图像数据,向用户展示声音和/或图像; [0074] The AV apparatus 307, the communication module 308 for receiving a message sent from the audio data and / or image data, display the sound and / or image to a user;

[0075] 消息通讯模块308,用于接收在线应用的服务器发送过来的消息,包括以消息形式发送过来的增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据等等,井向在线应用的服务器发送输入模块305接收的输入。 [0075] message communication module 308, the online server for receiving a message sent from the application, including the form of messages sent from the enhanced data and experience enhanced experience data corresponding to the instruction data and the audio and / or image data etc., transmission input shaft to the online application server module 305 receives the input.

[0076] 在上述附图3-2示例中,图像数据包括视频数据和/或绘图原语。 [0076] In the example of the above figures 3-2, the image data including video data and / or drawing primitives.

[0077] 服务器上的应用程序模块301产生的增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据可以通过消息通讯模块304由同一通道发送至客户端设备的消息通讯模块308,即,服务器上的消息通讯模块304将音频数据与增强型体验数据及与所述增强型体验数据对应的指令通过同一通道发送至客户端设备的消息通讯模块308 ;或者,服务器上的消息通讯模块304将图像数据与增强型体验数据及与所述增强型体验数据对应的指令通过同一通道发送至客户端设备的消息通讯模块308 ;或者,服务器上的消息通讯模块304将音频数据、图像数据与增强型体验数据及与所述增强型体验数据对应的指令通过同一通道发送至所述客户端设备的消息通讯模块308。 [0077] Application module 301 to generate a server on the enhanced data and experience with the enhanced experience data corresponding to the audio data and instructions and / or image data may be sent via a message communication module 304 by the same channel to the client devices message communication module 308, i.e., the message on the server communication module 304 and the audio data and the enhanced data experience an enhanced experience data corresponding to the command is transmitted to the client device through the same channel message communication module 308; alternatively, the server message on the communication module 304 and the image data and the enhanced data experience an enhanced experience data corresponding to the same channel by transmitting a command to the client device the message communication module 308; or message on the server communication module 304 to the audio data, image data and the enhanced data and experience enhanced experience data corresponding to the same channel by transmitting a command to the client device the communication module 308 message. 附图4-1给出了此时附图3-1和附图3-2示例的服务器与客户端连接的实施例示意图。 In this case the schematic figures 4-1 3-1 3-2 drawings and exemplary embodiments of the server connected with the client drawings.

[0078] 服务器上的应用程序模块301产生的增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据也可以通过消息通讯模块304由不同通道(例如,两条通道)发送至客户端设备的消息通讯模块308,即,服务器上的消息通讯模块304将音频数据通过一个通道发送至客户端设备的消息通讯模块308,将增强型体验数据及与所述增强型体验数据对应的指令通过另一通道发送至客户端设备的消息通讯模块308 ;或者,服务器上的消息通讯模块304将图像数据通过一个通道发送至客户端设备的消息通讯模块308,将增强型体验数据及与所述增强型体验数据对应的指令通过另一通道发送至客户端设备的消息通讯模块308 ;或者,服务器上的消息通讯模块304将音频数据和图像数据通过ー个通道发送至客户端设备的消息通讯模块308,将增强型体验数据及与所 [0078] 301 enhanced experience data generated on the server application module and an enhanced experience data corresponding to the instruction data and the audio and / or image data may be a message through the communication module 304 from different channels (e.g., two channel) transmits the message to the client device the communication module 308, i.e., the message on the server communication module 304 transmits the audio data to the client device via a communication channel message module 308, will experience enhanced and the enhanced data experience data corresponding to the instruction to the client device via another communication module 308 channel message; or the message communication module 304 transmits the image data from the server to the client via a channel message communication device module 308, will experience enhanced experience data and enhanced data corresponding to the instruction to the client device via another communication module 308 channel message; Alternatively, messages on the server communication module 304 to the audio data and image data to the client through the channels ーmessage communication device module 308, the data and enhanced experience with the 增强型体验数据对应的指令通过另一通道发送至客户端设备的消息通讯模块308。 Enhanced experience data corresponding to the instruction to the client device via another communication module 308 channel message. 附图4-2给出了此时附图3-1和附图3-2示例的服务器与客户端连接的实施例示意图。 In this case 4-2 shows schematic figures 3-1 and figures 3-2 exemplary embodiment of a server connected to the client drawings.

[0079] 以下结合附图3-1和附图3-2示例的服务器架构和客户端架构,给出服务器和客户端设备连接如附图4-2时它们之间的交互过程,如附图5-1所示,包括: [0079] conjunction with the drawings and 3-1 server architecture and exemplary client architecture 3-2 of the drawings, which are given interaction between a client and a server 4-2 connected devices in the drawing, as indicated by reference 5-1, comprising:

[0080] S501,客户端设备的输入模块接收用户输入的数据及指令; [0081] 假设用户在客户端进行增强型体验,因此进行了某种操作。 [0080] The input module S501, the client device receives data and instructions input by a user; [0081] Suppose an enhanced user experience client, perform a certain operation. 服务器的相应应用开启O Open the appropriate application server O

[0082] 具体地,一方面,应用执行请求由用户点击了客户端上的应用的快捷方式或点击应用的链接后发送,应用执行请求可以包括请求执行应用的相关信息,例如,应用的名称、应用的标识、应用的统ー资源标识以及应用执行过程中可能会用到的增强型体验输出设备的标识等;该应用执行请求通过客户端与服务器已经建立的传输通道发送。 After [0082] Specifically, in one aspect, the application execution request click or click on a link shortcut application on the client application sent by the user, the application execution request may include a request to execute an application related information, e.g., name of the application, identifying the application, identifying an enhanced experience during conventional output apparatus and an application execution ー resource identifier might be used in the application, and the like; the application execution request sent by the client and the server established a transmission channel. 另ー方面,用户可以点击客户端上的在线应用平台的快捷方式登陆在线应用平台,在线应用平台可以提供的在线应用的图标;同时服务器对虚拟机的执行情况进行截取,并将截取的数据发送给客户端,因此可以在客户端设备呈现服务器能够提供的在线应用的图标,此时用户可以通过在客户端呈现的图片点击相应的应用程序发送传感器应用执行请求,此时,该传感器应用请求可以包括操作系统输入控制事件,在线应用平台可以根据当前展示的应用程序以及该操作系统输入控制事件确定客户端请求执行的应用程序,其中,操作系统输入控制事件可以是鼠标输入控制事件、键盘输入控制事件、遥控器输入控制事件、触摸屏输入控制事件、游戏手柄输入控制事件等;服务器可以根据该操作系统输入控制事件确定用户所点击的位置坐标,进而根据该位置坐标 Another ー, users can click on a shortcut to the online application platform on the client to access an online application platform, icon online applications can provide online application platform; at the same time the implementation of the server virtual machine interception, and sends the intercepted data to the client, it can be rendered icon server can provide online application on the client device, then the user can be rendered on the client pictures click on the appropriate application sends a request for sensor application execution, this time, the sensor application may request including the operating system input control events, online application platform can determine the application client request execution based on the current display applications and the operating system input control events, in which the operating system input control event can be a mouse input control events, keyboard input control event, event remote control input, touch screen input control events, game pad input control events; server may determine the position coordinates clicked by the user according to the operation control system input event, and further based on the position coordinates 定用户所点击的应用。 Application of the given user clicked.

[0083] S502,客户端设备的输入模块将用户在客户端进行增强型体验时的操作转化的消息发送至服务器; [0083] S502, the input module to the client device user message conversion operation enhanced experience when sent to the server at the client;

[0084] 具体地,客户端设备的输入模块是通过本端的消息通讯模块将用户在客户端进行增强型体验时的操作转化为消息,以消息的形式发送至服务器的消息通讯模块,服务器的消息通讯模块再将该消息发送至服务器的应用程序模块。 Operation into a message when [0084] Specifically, the input module of the client device is a user an enhanced experience client through this end message communication module, to the server in the form of messages of message communication module, the server message communication module then sends the message to the server application module.

[0085] S503,服务器的应用程序模块生成增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据; [0085] S503, the server application module generates an enhanced experience data and audio data corresponding to the instructions and data and / or image data with the enhanced experience;

[0086] 服务器的应用程序模块根据用户在客户端设备中进行增强型体验时的操作转化的消息,生成增强型体验数据及与所述增强型体验数据对应的指令,或者,服务器上的应用运行时自身生成增强型体验数据及与所述增强型体验数据对应的指令;服务器的应用程序模块根据用户在客户端设备的输入生成音频数据和/或图像数据。 [0086] The server application module the user message conversion operation experience enhanced when the client device, generating an enhanced experience data and enhanced experience data corresponding to the command, or an application running on the server when enhanced experience self-generated data and data corresponding to the enhanced instruction experience; server application module generates audio data and / or image data input according to a user client device.

[0087] S504,服务器的应用程序模块将增强型体验数据及与所述增强型体验数据对应的指令发送至服务器的输出体验虚拟模块; [0087] S504, the server application module will experience enhanced data and data corresponding to the command sent to the server experience enhanced experience virtual output module;

[0088] S504',服务器的应用程序模块将音频数据和/或图像数据发送至服务器的音视频模块; [0088] S504 ', the server application modules audio data and / or image data sent to the server module audio and video;

[0089] S505,服务器的输出体验虚拟模块将增强型体验数据及与所述增强型体验数据对应的指令发送至客户端; [0089] S505, the server module output virtual experience enhanced experience data and the enhanced experience data corresponding instruction is sent to the client;

[0090] 具体地,服务器的输出体验虚拟模块将增强型体验数据及与所述增强型体验数据对应的指令发送至本端的消息通讯模块,由本端的消息通讯模块将增强型体验数据及与所述增强型体验数据对应的指令发送至客户端设备的消息通讯模块,最終由客户端设备的消息通讯模块转发至客户端设备的输出体验设备。 [0090] Specifically, the server output virtual experience module enhanced experience data and experience data and the enhancement type corresponding to the instruction to this end the message communication module, by the end of the message communication module enhanced experience data and the enhanced experience data corresponding to the instruction to the client device a message communication module, finally forwarded to the client device by the output device experiences the client device message communication module.

[0091] S505',服务器的音视频模块将音频数据和/或图像数据发送至客户端; [0091] S505 ', the server module audio and video data to audio and / or image data to the client;

[0092] 具体地,服务器的音视频模块将音频数据和/或图像数据送至本端的消息通讯模块,由本端的消息通讯模块将音视频数据或绘图原语发送至客户端设备的消息通讯模块,最終由客户端设备的消息通讯模块转发至客户端设备的音视频设备。 [0092] Specifically, the server's audio and video modules audio data and / or image data to the local message communication module to send by the end of the message communication module audio and video data or drawing primitives to the client device the message communication module, finally forwarded a message from the client device to the client device communication module of audio and video equipment.

[0093] 在上述S505和S505'中,增强型体验数据及与所述增强型体验数据对应的指令通过ー个通道发送至客户端,而音频数据和/或图像数据通过另ー个通道发送至客户端。 [0093] In the above-described S505 and S505 ', the enhanced data and experience enhanced experience data corresponding to the instruction by ー channels transmitted to the client, and the audio data and / or image data is transmitted to the other channels ーclients.

[0094] S506,客户端设备的输出体验设备执行增强型体验数据的对应指令; [0095] 客户端设备的输出体验设备执行增强型体验数据的对应指令,产生与增强型体验数据对应的增强型体验效果,用户在客户端进行体验。 [0094] S506, a corresponding command of the client device outputting experience apparatus to perform an enhanced experience data; corresponding to the instruction [0095] The client device outputting experience apparatus to perform an enhanced experience data, generating an enhanced experience data corresponding to the enhanced experience effect, the client user experience.

[0096] S506 ',客户端设备的音视频设备向用户展示语音和画面。 [0096] S506 ', the client device presents the user with audio and video equipment voice and picture.

[0097] 客户端设备的输出体验设备接收服务器发送过来的音视频数据或绘图原语后向用户展示语音和画面。 Experience the output device receives the server [0097] The client device sent from the audio and video data or drawing primitives to the screen display and voice users.

[0098] 以下给出在线应用的服务器和客户端连接如附图4-1时它们之间的交互过程给出它们之间的交互过程,与附图5-1基本类似,不同之处主要在于服务器上的应用程序模块301产生的增强型体验数据及与所述增强型体验数据对应的指令和音视频数据或绘图原语可以通过消息通讯模块304由同一通道发送至客户端设备的消息通讯模块308,如附图5-2所示,包括步骤: [0098] The following gives the online application server and client connections as indicated by reference interaction between them during 4-1 interaction between them, with substantially similar figures 5-1, the main difference is that enhanced experience data 301 generated by the application module on a server and experience data and the enhancement-type command corresponding to audio and video data or drawing primitives may be sent to the client device by the same channel through the message communication module 304, a message communication module 308 , as shown in figures 5-2, comprising the steps of:

[0099] S501,客户端设备的输入模块接收用户输入的数据及指令; [0099] S501, the input module of the client device receives data and instructions input by a user;

[0100] 假设用户在客户端进行增强型体验,因此进行了某种操作。 [0100] Suppose the enhanced user experience client, perform a certain operation. 服务器的相应应用开 Open the appropriate application server

启O Kai O

[0101] S502,客户端设备的输入模块将消息发送至服务器; [0101] S502, the input module of the client device sends a message to the server;

[0102] 具体地,客户端设备的输入模块是通过本端的消息通讯模块将用户在客户端进行增强型体验时的操作转化为消息,以消息的形式发送至服务器的消息通讯模块,服务器的消息通讯模块再将该消息发送至服务器的应用程序模块。 Operation into a message when [0102] Specifically, the input module of the client device is a user an enhanced experience client through this end message communication module, to the server in the form of messages of message communication module, the server message communication module then sends the message to the server application module.

[0103] S503,服务器的应用程序模块生成增强型体验数据及与所述增强型体验数据对应的指令以及音视频数据及与所述增强型体验数据对应的指令; [0103] S503, the server application module generates an enhanced experience data and the enhanced experience data corresponding to audio and video data as well as command and data with the corresponding experience enhanced instruction;

[0104] 服务器的应用程序模块根据用户在客户端设备进行增强型体验时的操作转化的消息,生成增强型体验数据及与所述增强型体验数据对应的指令,或者,服务器上的应用运行时自身生成增强型体验数据及与所述增强型体验数据对应的指令;服务器的应用程序模块根据用户在客户端设备的输入生成音频数据和/或图像数据。 [0104] Server application module the user message conversion operation when the enhanced client device according to experience, data and generating an enhanced experience enhanced experience data corresponding to the instruction, or the application running on the server experience enhanced self-generated data and data corresponding to the instruction and the enhanced experience; server application module generates audio data and / or image data input according to a user client device.

[0105] S5031',服务器的消息通讯模块将应用程序模块生成的增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据由同一通道发送至客户端; [0105] S5031 ', the message server communication module enhanced experience data generated by the application module and the enhanced experience data corresponding to the instruction data and the audio and / or image data sent by the same path to the client;

[0106] 具体地,服务器的消息通讯模块将增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据由同一通道发送至客户端设备的消息通讯模块,最終由客户端设备的消息通讯模块转发至客户端设备的输出体验设备和音视频设备。 [0106] Specifically, the message server communication module with an enhanced experience data and the enhanced experience data corresponding to the audio data and instructions and / or image data transmitted from the client device to the same channel message communication module, the final message forwarding client device communication module to the client device's output device and experience audio and video equipment. 更为详细的说明可參阅前述附图I示例的步骤S102中的相关内容,此处不做赘述。 A more detailed description can be found in the aforementioned reference example I step S102 the content, it is not repeated here. [0107] 客户端解析由同一通道发送过来的增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据。 [0107] The client parses sent over the same channel by an enhanced experience data and enhanced experience data corresponding to the instruction data and the audio and / or image data.

[0108] S504,客户端设备的消息通讯模块将增强型体验数据及与所述增强型体验数据对应的指令转发至客户端设备的输出体验设备; [0108] S504, the client device the message communication module with an enhanced experience data and the enhanced experience data corresponding to the client device forwards the instruction output devices experience;

[0109] S504',客户端设备的消息通讯模块将音频数据和/或图像数据转发至客户端设备的首视频设备; [0109] S504 ', the client device message communication module audio data and / or image data to the client device forwards the first video equipment;

[0110] S505,客户端设备的输出体验设备执行增强型体验数据的对应指令; [0110] S505, the client device corresponding to an instruction output device to perform an enhanced experience experience data;

[0111] 客户端设备的输出体验设备执行与增强型体验数据对应的指令,产生与增强型体验数据对应的增强型体验效果,用户在客户端进行体验。 [0111] The client device executes an output device experiences an enhanced experience data corresponding to the instruction, to generate an enhanced experience data corresponding to an enhanced experience effect, the client user experience.

[0112] S505',客户端设备的音视频设备向用户展示语音和/或画面。 [0112] S505 ', the client device presents the user with audio and video equipment, voice and / or picture. [0113] 客户端设备的输出体验设备接收发送过来的音频数据和/或图像数据,向用户展示语音和/或画面。 [0113] The client device receives the output of the device sent from the experience of audio data and / or image data, display voice and / or picture to the user.

[0114] 由于カ反馈设备是目前比较常见的增强型输出体验设备,以下以カ反馈设备为例,结合前述给出的在线应用的交互方法实施例,说明更为具体的实施方式。 [0114] Since ka feedback device is more common experience enhanced output devices, to the following grades feedback device, for example, binding interaction method of the preceding line application examples given described a more specific embodiment. 虽然以下的实施方式是以カ反馈设备为例说明本发明提供的在线应用的交互方法,但本领域技术人员能够理解,以下给出的实施方式仍然可适用于增强型输出体验设备不是カ反馈设备的情形。 Although the following embodiments grades feedback device is an example of interactive online application method provided by the invention, those skilled in the art will appreciate that, given below is still applicable to the embodiment of the enhanced output device is not a ka experience feedback device situation.

[0115] 所谓カ反馈是指将动カ和阻力应用到输出设备的轴上。 [0115] Feedback refers to the so-called ka ka and resistance applied to the movable shaft of the output device. 力反馈的单个实例称为效果。 A single instance is called force feedback effect. 对カ反馈设备进行操控的方法可利用系统提供的API函数。 Methods grades feedback control device may use the API functions provided by the system. 例如,微软的DirectX提供的DirectInput是有关鼠标、键盘、游戏杆和カ反馈设备等的API。 For example, Microsoft's DirectInput DirectX API is provided about the mouse, keyboard, joystick and other equipment ka feedback. 为了使用力反馈设备,首先需要先获取IDirectInputDevice接ロ,然后就可以使用下述表2所列出的用于カ反馈设备的API。 In order to use a force feedback device, first need to obtain access IDirectInputDevice ro, then the following Table can be used for feedback device API 2 grades listed.

[0116] [0116]

Figure CN102843334AD00161

[0117] [0117]

[0118]表 2 [0118] TABLE 2

[0119] 在上述表2中,应用程序接ロ函数CreateEffect就是创建某种增强型体验的接ロ函数,EnumCreatedEffectObjects 以及EnumEffects 中列举的效果可以作为CreateEffect的參数(也即增强型体验数据),而方法SendForceFeedbackCommand中的打开或关闭执行器、停止、暂停或继续执行所有效果以及重新设置カ反馈状态等等可以是增强型体验数据对应的指令。 [0119] In the above Table 2, then the application is to create some ro function CreateEffect experience an enhanced bonding function ro, EnumCreatedEffectObjects EnumEffects and effects as recited CreateEffect parameters (i.e. enhanced experience data), and SendForceFeedbackCommand method of opening or closing the actuator, stop, pause or resume all grades feedback effects, and resetting the state, etc. may be an enhanced experience data corresponding to the instruction.

[0120] 请參阅附图6,是本发明实施例提供的在线应用交互方法中服务器和客户端设备的カ反馈交互流程,具体说明如下: [0120] Please refer to FIG. 6, the interaction process is ka feedback provided online interactive application server process and a client device of the embodiment of the present invention, specifically as follows:

[0121] S601,用户在客户端点击并体验应用; [0121] S601, the user clicks and experience in the application of the client;

[0122] 例如,用户打算在客户端体验赛车游戏,即点击相关按键,开始体验。 [0122] For example, a user intends client experience racing game that click on the relevant button to start the experience.

[0123] S602,服务器的相关应用开启; [0123] S602, the relevant application server is turned on;

[0124] S603,用户在客户端输入相关操作; [0124] S603, the client user input related operations;

[0125] 例如,在赛车游戏中,用户点击了“左转键”。 [0125] For example, in a racing game, the user clicks on the "left button."

[0126] S604,服务器的力反馈类应用开始执行; [0126] S604, force feedback based application servers started;

[0127] S605,服务器生成力反馈数据及与所述增强型体验数据对应的指令; [0127] S605, the server generates a force feedback data and data corresponding to the instruction and the enhanced experience;

[0128] 力反馈数据可以是服务器的力反馈类应用根据用户输入的相关操作生成,也可以是カ反馈类应用的应用程序在运行过程中生成,例如,在赛车游戏中,客户点击了“左转键”,车子转至凸凹不平的路面,则生成“震动”的力反馈数据,或者,客户对车子没有进行任何控制,车子转至凸凹不平的路面,也生成“震动”的カ反馈数据。 [0128] force feedback data can be a force feedback class application server according to the relevant operation generated input by the user, may be ka application feedback type applications generated during operation, for example, in a racing game, a customer clicks on the "left turn key ", go to uneven road surface the car is generated" shake "force feedback data, or the client without any control of the car, the car go uneven road surface, but also generates a" bang "ka feedback data.

[0129] S606,在本地输出力反馈数据对应的效果; [0129] S606, the local output data corresponding to the effect of the force feedback;

[0130] 具体地,可以调用系统提供的应用程序接ロ函数CreateEffect (具体说明见前述表I),在服务器输出力反馈数据对应的效果,例如,震动持续时间、震动的频率大小等。 [0130] In particular, the system provides the calling application can access a function createEffect ro (see above table specifying the I), the effect of feedback data corresponding to the output force in the server, e.g., vibration duration, frequency of vibrations size.

[0131] S607,根据カ反馈数据对应指令调用系统提供的应用程序接ロ函数“SendForceFeedbackCommand” (具体说明见前述表I); [0131] S607, feedback data according to the grades corresponding to the application instructions calling system functions to provide access ro "SendForceFeedbackCommand" (see previous tables specify the I);

[0132] 调用系统提供的应用程序接ロ函数“SendForceFeedbackCommand”,其目的在于对客户端设备的力反馈设备进行カ反馈控制。 Application [0132] The system provides call connection function ro "SendForceFeedbackCommand", and its object is to force the client device ka feedback control feedback device.

[0133] S608,捕获对应用程序接ロ函数“SendForceFeedbackCommand”的调用; [0133] S608, capture calls "SendForceFeedbackCommand" ro access to the application function;

[0134] 具体地,可以通过钩子(Hook)程序检测对“SendForceFeedbackCommand”的调用,将其截获,然后,向客户端设备的カ反馈设备发送カ反馈数据及其对应控制指令,例如,产生震动及其震动效果,产生摩擦及其摩擦效果等等。 [0134] In particular, can be detected by a hook (Hook) program calls for "SendForceFeedbackCommand" of which was intercepted, then the client device sends a feedback device ka ka feedback data and corresponding control commands, e.g., generated vibration and its effect vibration, friction and frictional effects and the like.

[0135] S609,客户端解析反馈数据及其对应控制指令,发送至力反馈设备; [0135] S609, parsing the client feedback data and corresponding control commands, sent to the force feedback device;

[0136] 具体地,是客户设备端的输出数据处理模块将反馈数据及其对应控制指令解析后,发送至客户端设备的カ反馈设备; [0136] In particular, a client device side processing module output data and feedback data corresponding to the control command analyzing, sent to the client device ka feedback device;

[0137] S610,客户端设备的カ反馈设备执行カ反馈数据的对应控制指令; [0137] S610, feedback device ka client device performs ka feedback data corresponding to a control command;

[0138] 客户端设备的カ反馈设备执行反馈数据的对应控制指令,具体包括打开或关闭激励器;停止、暂停或继续执行效果;重新设置力反馈状态等。 Ka feedback device corresponds to [0138] the client device performs feedback control instruction data, including opening or closing actuator; stop, pause or resume the effect; resetting force feedback status. 输出反馈数据的对应效果,并将执行结果发送至服务器。 Corresponding to the output effect of the feedback data, and transmits the execution result to the server.

[0139] S611,服务器将执行结果反馈至本端力反馈类应用对“SendForceFeedbackCommand” 的调用; [0139] S611, the server execution result back to the local application of a force feedback type call "SendForceFeedbackCommand"; and

[0140] S612,结束对“SendForceFeedbackCommand” 的调用; [0140] S612, the end of the call to "SendForceFeedbackCommand" of;

[0141] 此后,服务器根据用户在客户端设备的新的输入或应用的运行,生成新的カ反馈数据,重新进行上述S604至S612的步骤。 [0141] Thereafter, a new server according to a user input operation in the client application or device, to generate a new feedback data ka, re S604 to S612 of the above-described step.

[0142] 请參阅附图7-1,本发明实施例提供的通过钩子程序捕获对API函数的调用时服务器的执行流程,在本实施例中,通过编写另外ー个Hook应用程序,用于截获对API函数的调用,并将API的名称和相应的数据传递给客户端,由客户端执行,说明如下: [0142] See figures 7-1, embodiments of the present invention provides a process for the capture performing calling an API function server by hooks, in the present embodiment, by writing a Hook ー additional applications, for intercepts calls to the API functions and corresponding data is transmitted and the name of the API to the client, the client is performed by, as follows:

[0143] S701,力反馈类应用调用系统提供的应用程序接ロ函数“SendForceFeedbackCommand,,; Application [0143] S701, a force feedback system based application calls a function provided by the connection ro "SendForceFeedbackCommand ,,;

[0144] S702,钩子(Hook)程序检测到该调用,将调用“SendForceFeedbackCommand”带来的力反馈数据及其控制指令传递至系统; [0144] S702, the hook (Hook) has detected the call, the call "SendForceFeedbackCommand" force brought feedback data and a control command is transmitted to the system;

[0145] 与此同时,阻断其原先调用的“SendForceFeedbackCommand”执行过程(步骤S702'),钩子(Hook)程序检测阻断其原先的“SendForceFeedbackCommand”的执行过程,可以使得不在本地输出力反馈数据对应的效果。 [0145] Meanwhile, block "SendForceFeedbackCommand" execution process (step S702 ') of their original call, the hook (Hook) detects blocking its original "SendForceFeedbackCommand" the process execution may be such that the output power is not local feedback data corresponding effect. [0146] S703,系统将调用“SendForceFeedbackCommand”带来的力反馈数据及其控制指令发送至客户端,由客户端执行カ反馈操作; [0146] S703, the system will call "SendForceFeedbackCommand" force brought feedback data and a control command to the client, a feedback operation performed by the client ka;

[0147] S704,服务器接收客户端执行カ反馈操作的结果; [0147] S704, the server receives the client ka feedback operation execution result;

[0148] 服务器的系统将客户端设备的カ反馈设备执行カ反馈操作的结果返回Hook程序; [0148] The server system performs feedback operation results ka ka feedback device return the client device Hook program;

[0149] S705, Hook程序将カ反馈操作的结果返回至力反馈类应用对“SendForceFeedbackCommand” 的调用; [0149] S705, Hook grades program operation returns results back to the calling application of a force feedback type "SendForceFeedbackCommand"; and

[0150] Hook程序将カ反馈操作的结果作为对“SendForceFeedbackCommand”调用的调用结果,结束其调用过程。 [0150] Hook program grades as a result of the feedback operation of the result of calling "SendForceFeedbackCommand" call, it invokes the process ends.

[0151] 在附图7-1的实施例中,服务器也可以不用等待客户端执行カ反馈操作的結果,而是直接默认客户端执行カ反馈操作成功,如附图7-2所示本发明另一实施例提供的通过钩子程序捕获对API函数的调用时服务器的执行流程,说明如下: [0151] In the embodiment 7-1 of the drawings, the server may be performed without waiting for the results of client ka feedback operation, but directly performs the default client ka feedback operation is successful, as shown in figures 7-2 of the present invention provided further embodiment of the process performed when the capture API function call to the server through the hooks, as follows:

[0152] S701,力反馈类应用调用系统提供的应用程序接ロ函数“SendForceFeedbackCommand,,; Application [0152] S701, a force feedback system based application calls a function provided by the connection ro "SendForceFeedbackCommand ,,;

[0153] S702,钩子(Hook)程序检测到该调用,将调用“SendForceFeedbackCommand”带来的力反馈数据及其控制指令传递至系统; [0153] S702, the hook (Hook) has detected the call, the call "SendForceFeedbackCommand" force brought feedback data and a control command is transmitted to the system;

[0154] 与此同时,阻断其之前调用的“SendForceFeedbackCommand”执行过程(步骤S702'),钩子(Hook)程序也可以检测阻断其原先的“SendForceFeedbackCommand”的执行过程,使得不在本地输出力反馈数据对应的效果。 [0154] Meanwhile, block "SendForceFeedbackCommand" execution process (step S702 ') prior to its call, the hook (Hook) block the program may detect the original "SendForceFeedbackCommand" during the execution, so that the output power is not local feedback data corresponding effect.

[0155] S703,系统将调用“SendForceFeedbackCommand”带来的力反馈数据及其控制指令发送至客户端,由客户端执行カ反馈操作; [0155] S703, the system will call "SendForceFeedbackCommand" force brought feedback data and a control command to the client, a feedback operation performed by the client ka;

[0156] S704,服务器的系统将执行成功的结果返回Hook程序; [0156] S704, the server system will perform a successful result is returned Hook program;

[0157] 服务器默认客户端成功执行カ反馈操作,直接将执行成功的结果返回Hook程序。 [0157] server default client successfully execute operations grades feedback directly to the successful implementation of the results returned Hook program.

[0158] S705, Hook程序将カ反馈操作执行成功的结果返回至力反馈类应用对“SendForceFeedbackCommand” 的调用; [0158] S705, Hook program grades feedback operation performed successful result is returned to the calling application of a force feedback type "SendForceFeedbackCommand"; and

[0159] Hook程序将カ反馈操作执行成功的结果作为对“SendForceFeedbackCommand”调用的调用结果,结束其调用过程。 [0159] Hook grades feedback program will perform a successful operation as a result of calling the results "SendForceFeedbackCommand" calls, calls to end its process.

[0160] 在本发明实施例中,也可以通过修改服务器系统提供的应用程序接ロAPI函数,使用所述修改过的API将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备。 [0160] In an embodiment of the present invention, may take ro API function by modifying the server system provides the application using the API of the modified data and the enhanced experience enhanced experience data corresponding to the instruction transmitting to the client device. 具体地,这种方式是指修改服务器系统的输出体验虚拟模块的驱动,修改后的驱动程序与服务器所在系统原先输出体验虚拟模块的驱动相比,API原型相同,但功能发生了变化,即,使原先对具体的体验硬件的调用变为将API的名称和相应的数据传递给客户端。 Specifically, this approach means that the drive to modify server systems experience virtual output modules, drivers and server system where the modified original experience virtual drive module output compared to the same API prototype, but the function has changed, that is, the original call to the specific experience of hardware changes to the name and corresponding data transfer API to the client.

[0161] 请參阅附图8-1,本发明实施例提供的通过修改服务器系统提供的API函数对API函数的调用时服务器的执行流程,说明如下: [0161] Please refer to figures 8-1, the API functions provided by the server system provided by modifying the execution flow of calling an API function in the server embodiment of the present invention is described as follows:

[0162] S801,力反馈类应用调用系统提供的应用程序接ロ函数“SendForceFeedbackCommand,,; Application [0162] S801, a force feedback system based application calls a function provided by the connection ro "SendForceFeedbackCommand ,,;

[0163] S802,驱动程序通知系统调用“SendForceFeedbackCommand” ; [0163] S802, the driver tells the system call "SendForceFeedbackCommand";

[0164] 与此同时,驱动程序等待客户端设备的カ反馈设备执行カ反馈操作的执行結果。 [0164] Meanwhile, the driver waits for the client device ka ka feedback device to perform an execution result of the feedback operation.

[0165] S803,系统将调用“SendForceFeedbackCommand”带来的力反馈数据及其控制指令发送至客户端,由客户端执行カ反馈操作; [0165] S803, the system will call "SendForceFeedbackCommand" force brought feedback data and a control command to the client, a feedback operation performed by the client ka;

[0166] S804,服务器接收客户端设备的力反馈设备执行カ反馈操作的结果; [0166] S804, the server receives the client device to perform a force feedback device ka feedback result of the operation;

[0167] 服务器的系统将客户端执行カ反馈操作的结果返回驱动程序; [0167] The client server systems execution result of the feedback operation returns ka driver;

[0168] S805,驱动程序将カ反馈操作的结果返回至力反馈类应用对“SendForceFeedbackCommand” 的调用; [0168] S805, ka driver feedback operation result is returned to the calling application of a force feedback type "SendForceFeedbackCommand"; and

[0169] 驱动程序将カ反馈操作的结果作为对“SendForceFeedbackCommand”调用的调用结果。 [0169] The driver grades as a result of the feedback operation of the result of calling "SendForceFeedbackCommand" call.

[0170] S806,结束对“SendForceFeedbackCommand” 的调用。 [0170] S806, the end of the call to "SendForceFeedbackCommand" of.

[0171] 在附图8-1的实施例中,服务器也可以不用等待客户端执行カ反馈操作的結果,而是直接默认客户端执行カ反馈操作成功,如附图8-2所示本发明另一实施例提供的通过修改服务器系统提供的API函数对API函数的调用时服务器的执行流程,说明如下: [0171] In the embodiment 8-1 of the drawings, the server may be performed without waiting for the results of client ka feedback operation, but directly performs the default client ka success feedback operation, as shown in figures 8-2 of the present invention API function provided by a server system provided by modifying the execution flow of calling an API function server according to another embodiment, described as follows:

[0172] S801,力反馈类应用调用系统提供的应用程序接ロ函数“SendForceFeedbackCommand,,; Application [0172] S801, a force feedback system based application calls a function provided by the connection ro "SendForceFeedbackCommand ,,;

[0173] S802,驱动程序通知系统调用“SendForceFeedbackCommand” ; [0173] S802, the driver tells the system call "SendForceFeedbackCommand";

[0174] 与此同时,驱动程序等待客户端设备的カ反馈设备执行カ反馈操作的执行結果。 [0174] Meanwhile, the driver waits for the client device ka ka feedback device to perform an execution result of the feedback operation.

[0175] S803,系统将调用“SendForceFeedbackCommand”带来的力反馈数据及其控制指令发送至客户端,由客户端执行カ反馈操作。 [0175] S803, the system will call "SendForceFeedbackCommand" force brought feedback data and a control command to the client, the client terminal performs a feedback operation ka.

[0176] S804,服务器的系统将执行成功的结果返回驱动程序; [0176] S804, the server system will perform a successful result is returned driver;

[0177] 服务器默认客户端成功执行カ反馈操作,直接将执行成功的结果返回驱动程序; [0177] The default server client successfully performed grades feedback operation, directly perform a successful result is returned driver;

[0178] S805,驱动程序将カ反馈操作的结果返回至力反馈类应用对“SendForceFeedbackCommand” 的调用; [0178] S805, ka driver feedback operation result is returned to the calling application of a force feedback type "SendForceFeedbackCommand"; and

[0179] 驱动程序将カ反馈操作的结果作为对“SendForceFeedbackCommand”调用的调用结果,结束其调用过程。 [0179] The driver grades as a result of the feedback operation of the result of calling "SendForceFeedbackCommand" call, it invokes the process ends.

[0180] 请參阅附图9,是本发明实施例提供的在线应用系统中服务器逻辑结构示意图。 [0180] Please refer to FIG. 9 is a schematic view of the logical structure of the server online application system provided in embodiments of the present invention. 为了便于说明,仅仅示出了与本发明实施例相关的部分。 For convenience of explanation, only a part related to the embodiment of the present invention. 附图9示例的服务器包括数据指令生成模块901和发送模块902,其中: 9 reference example server command generation module 901 includes a data module 902 and a transmission, wherein:

[0181] 数据指令生成模块901,用于生成增强型体验数据及与所述增强型体验数据对应的指令,具体地,数据指令生成模块901用于根据事件消息生成增强型体验数据及与所述增强型体验数据对应的指令,所述事件消息可以是用户在客户端设备击键、移动鼠标和语音输入等事件发生时产生的消息,包括用户在客户端设备进行增强型体验时的操作产生的消息。 [0181] Data command generation module 901, configured to generate an enhanced experience data and instruction data corresponding to the enhanced experience, specifically, the data command generation module 901 is configured to generate enhancement data according to the experience of the event message and enhanced experience data corresponding to the instruction, the event message may be a message generated by the user at the client device keystroke, moving the mouse, and voice input events, when the user performs an operation including enhanced experience generated by the client device messages. 这些事件消息从客户端设备传送至服务器,服务器开启相应的应用后,根据这些事件消息生成增强型体验数据及与所述增强型体验数据对应的指令,例如,“震动”、“カ反馈”、“触摸感”和“味觉输出”等增强型体验数据,其对应指令可以是这些增强型体验数据对应效果的开始、结束、暂停、继续、重置和效果变化等。 After application of the respective opening of these event messages from the client device to the server, the server generates an event message based on these data and experience enhanced instruction data corresponding to the enhanced experience, e.g., "shake", "ka Feedback", "sense of touch" and "taste outputs" such as enhanced experience data, which corresponds to the beginning of these instructions can be enhanced experience data corresponding to the effect of, end, pause, continue, reset and effect change. 在本发明另一实施例中,数据指令生成模块901生成的增强型体验数据及与所述增强型体验数据对应的指令也可以是所述服务器上的应用运行时自身生成增强型体验数据及与所述增强型体验数据对应的指令。 In another embodiment of the present invention, a data command generation module 901 generates an enhanced experience data and instruction data corresponding to the enhanced experience may be enhanced experience self-generated data application running on the server, and with the enhanced experience data corresponding to the instruction. 例如,在赛车游戏这ー应用运行时,车子运行过程中,用户不对它进行任何控制时,车子可能就会碰到不平的路面而产生震动,这就是服务器上的应用运行时自身生成增强型体验数据及与所述增强型体验数据对应的指令的过程。 For example, in a racing game that ー application is running, the process of the car is running, the user does not have any control over it, the car might hit uneven pavement and vibration generated, which is the application running on the server itself to generate an enhanced experience data and experience with the enhanced data corresponding instruction process. 一旦增强型体验数据的对应指令被执行,则相关执行体可以由增强型体验数据输出对应的增强型体验效果。 Once an enhanced experience data corresponding to the instruction is executed, the associated executable data can experience an enhanced effect corresponding to the output from an enhanced experience. 所谓增强型体验,在本发明实施例中是指不同于传统音视频给客户带来的视听享受,而是能够极大地丰富用户感知(包括触觉、味觉等等)的特殊体验,例如,赛车游戏中的震动、可给人带来触摸实物感觉的カ反馈和香味散发芯片散发的不同香味等,而本发明实施例中的增强型体验数据是指在服务器产生、在客户端执行其对应的指令时能够产生上述增强型体验的数据,例如,对于赛车游戏中的震动,其增强型体验数据可以是车子“震动”、“震动持续时间(例如,持续3秒)”和“震动频率”等等,而与此对应的指令(例如,“震动开始”)一旦执行,则输出“震动3秒”的效果;又如,对于カ反馈设备(例如,常见的游戏カ反馈手柄),其增强型体验数据可以是“常力(即在某一方向上持续保持固定大小的力)”、“斜坡カ(在某一方向上持续增加 The so-called enhanced experience, in the present embodiment is different from the traditional audio and video refers to customers of audio-visual enjoyment, but can greatly enrich the user perception (including touch, taste, etc.) of special experience, such as racing games the vibration can bring different grades such as flavor and sensory feedback touching is emitted scent chip, and an enhanced experience data in the embodiment of the present invention refers to the production server, the corresponding instruction execution client capable of generating an enhanced experience above data, e.g., for a racing game shock, which can be enhanced experience data car "shock," "shock duration (e.g., 3 seconds)" and "vibration frequency", etc. , and corresponding to this command (e.g., "start shock"), if implemented, the output "3 seconds shock" effect; another example, for grades feedback device (e.g., a common game handle feedback ka), which is an enhanced experience data may be "constant force (i.e., continued to maintain an upward force in a certain fixed size)", "slope ka (in either direction increases continuously 減少的力)”以及“弾性”等,对应的增强型体验可以是强烈的阻カ感或振荡感;再如,对于カ反馈触摸屏幕,其增强型体验数据可以是“光滑”或“粗糙”等,对应的增强型体验可以是如冰面或木头ー样的触摸感; Reducing force) "and" Tan "of the like, corresponding to an enhanced experience may be a strong barrier ka sense or oscillating sense; Again, for grades feedback touch screen that enhanced experience data may be" smooth "or" rough " and the like, the corresponding experience may be enhanced ice touch sensing surface or wood-like ー;

[0182] 发送模块902,用于将所述数据指令生成模块901生成的增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备,以使所述客户端设备利用所述增强型体验数据执行与所述增强型体验数据对应的指令。 [0182] sending module 902, the instruction data for generating an enhanced experience data module 901 to generate instructions and data corresponding to the enhanced experience with the client device to send to the client device using the enhanced experience data performed with the enhanced experience data corresponding to the instruction.

[0183] 需要说明的是,以上服务器的实施方式中,各功能模块的划分仅是举例说明,实际应用中可以根据需要,例如相应硬件的配置要求或者软件的实现的便利考虑,而将上述功能分配由不同的功能模块完成,即将所述服务器的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。 [0183] Incidentally, embodiments described above server, division of the functional modules is merely illustrative, practical applications may be needed, such as facilitating appropriate hardware configuration requirements or software implementations considered, the above functions assigned to different functional modules, i.e. the internal structure of the server is divided into different functional modules to complete all or part of the functions described above. 而且,实际应用中,本实施例中的相应的功能模块可以是由相应的硬件实现,也可以由相应的硬件执行相应的软件完成,例如,前述的数据指令生成模块,可以是具有执行前述生成增强型体验数据及与所述增强型体验数据对应的指令的硬件,例如数据指令生成器,也可以是能够执行相应计算机程序从而完成前述功能的一般处理器或者其他硬件设备;再如前述的发送模块,可以是具有执行前述将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备功能的硬件,如发送器,也可以是能够执行相应计算机程序从而完成前述功能的一般处理器或者其他硬件设备。 Moreover, the actual application, for example, the corresponding functional module of the present embodiment may be implemented by corresponding hardware, may be executed by the respective hardware corresponding software, for example, the data command generation module may have performed the generation experience enhanced experience data and data corresponding to the enhanced hardware instructions, e.g. instruction data generator may be capable of executing a corresponding computer program to implement the functions of a general processor or other hardware device; another example is the transmission module, may be performed with the data of the enhanced experience and experience with the enhanced data corresponding instruction to the client terminal device hardware features, such as the transmitter, may be capable of executing a corresponding computer program to complete the a general processor or other hardware devices of the aforementioned functions.

[0184] 在本发明ー个实施例中,发送模块902包括捕获单元1001,如附图10所示本发明另ー实施例提供的服务器,捕获单元1001,用于捕获应用对应用程序接ロAPI函数的调用,通过所述API函数将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备。 [0184] In ー embodiment of the present invention, the transmitting module 902 includes a capturing unit 1001, as illustrated in FIG. 10 the present invention further server provided ー embodiment, the capturing unit 1001, an application for capturing application to access API ro function call by the API function data and the enhanced experience enhanced experience data corresponding to the instruction to the client device. 由于每当API函数被调用,钩子(Hook)程序可以先捕获该该API函数,因此,在本实施例中,捕获单元1001可以通过钩子(Hook)程序捕获对增强型体验输出设备的API函数的调用,将此API封装为增强体验消息发送至客户端设备,由客户端设备执行此API,进而使用所述API将所述增强型体验数据及与所述增强型体验数据对应的指令发送至客户端设备,从而达到在客户端设备的增强型体验输出设备上产生增强型体验,增强了客户端设备的用户体验。 Since the API function is called whenever the hook (Hook) the program may be the first capture API function, therefore, in the present embodiment, the capturing unit 1001 can capture API function program experience enhanced output device by hook (Hook) of call, send this message API package to enhance the experience to the client device, the API executed by the client device, thereby transmitting the enhanced data and experience with the enhanced experience data corresponding to a command to the client using the API terminal equipment, so as to achieve an enhanced experience to produce an enhanced experience on the output device of the client device, enhancing the user experience of the client device.

[0185] 在本发明一个实施例中,发送模块902包括调用单元1101,如附图11所示本发明另一实施例提供的服务器。 [0185] In one embodiment of the present invention, transmission module 902 comprises a call unit 1101, such as a server according to another embodiment 11 shown in the drawings of the present invention. 调用单元1101用于调用修改过的应用程序接口API函数,使用所述修改过的API将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备。 1101 calling unit for calling the modified application program interface API function, transmitting the enhanced data and experience enhanced experience data corresponding to the instruction to the client device using the modified API. 修改后的API的形式不发生变化(即名称和参数不发生变化),所述修改过的API函数包含所述增强型体验数据及与所述增强型体验数据对应的指令,服务器通过修改后的API函数将包含所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备。 Experience with the type of data and data corresponding to an enhanced experience command, the server API function by modifying the API does not change the form of the modified (i.e., name and parameters do not change), the said reinforcement comprising modified API functions comprising the enhanced data and experience with the enhanced experience data corresponding instruction to the client device.

[0186] 附图9至附图11任一示例的服务器还可以包括本地增强型体验效果生成模块1201,如附图12所示本发明另一实施例提供的服务器。 [0186] Server either example 9 reference to Figure 11 may further include a local enhanced experience effect generation module 1201, a server according to another embodiment of the present invention 12 shown in the accompanying drawings. 本地增强型体验效果生成模块1201用于调用系统提供的应用程序接口API函数在本地产生所述增强型体验数据对应的增强型体验效果。 Local enhanced experience for the effect generator module 1201 calls application program interface (API) functions provided by the system to generate data corresponding to the enhanced experience enhanced experience effect locally.

[0187] 附图9至附图11任一示例的服务器还可以包括音视频数据生成模块1301,如附图13所示本发明另一实施例提供的服务器。 [0187] Server either example 9 reference to Figure 11 may also include audio and video data generating module 1301, such as the server according to another embodiment 13 shown in the drawings of the present invention. 音视频数据生成模块1301用于生成音频数据和/或图像数据,其中,所述图像数据包括视频数据和/或绘图原语。 Audio and video data generating module 1301 for generating audio data and / or image data, wherein said image data comprises video data and / or drawing primitives.

[0188] 在本发明一个实施例中,发送模块902还用于将所述音视频数据生成模块1301生成的音频数据和/或图像数据以及所述数据指令生成模块901生成的增强型体验数据及与所述增强型体验数据对应的指令通过同一通道发送至所述客户端设备,即,发送模块902可以将音视频数据生成模块1301生成的音频数据与数据指令生成模块901生成的增强型体验数据及与所述增强型体验数据对应的指令通过同一通道发送至客户端设备;或者,发送模块902可以将音视频数据生成模块1301生成的图像数据与数据指令生成模块901生成的增强型体验数据及与所述增强型体验数据对应的指令通过同一通道发送至所述客户端设备;或者,发送模块902将音视频数据生成模块1301生成的音频数据、图像数据与数据指令生成模块901生成的增强型体验数据及与所述增强型体验数据对应的指令通过 [0188] In one embodiment of the present invention, module 902 is further configured to transmit the audio-video data generating module 1301 generates audio data and / or image data and the enhanced experience data of the data generated by the instruction generating module 901 and experience with the enhanced data corresponding to the command transmitted via the same channel to the client device, i.e., transmission module 902 can be audio and video data generating module 1301 generates audio data and command data generating module 901 generates an enhanced experience data and an enhanced experience data corresponding to the command transmitted via the same channel to the client device; Alternatively, the image data transmitting module 902 can be audio and video data generated by the generating module 1301 generates command data enhancement module 901 experience data generated and experience with the enhanced data corresponding to the command transmitted via the same channel to the client device; Alternatively, module 902 transmits audio and video data generating module 1301 generates audio data, image data and the instruction data generation module 901 generates an enhanced experience data and instructions and data corresponding to the enhanced experience by 一通道发送至所述客户端设备。 A transmission channel to the client device. 具体的实现可以是:发送模块902将所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令分别添加对应的消息头,封装成不同类型的消息通过同一通道发送至所述客户端设备。 The specific implementation may be: sending module 902 to the audio data, image data and the enhanced data and experience enhanced experience data corresponding to the instruction respectively corresponding to the added message header, encapsulated in different types of messages through the same channel is transmitted to the client device.

[0189] 在本发明另一实施例中,发送模块902还用于将所述音视频数据生成模块1301生成的音频数据和/或图像数据以及所述数据指令生成模块901生成的增强型体验数据及与所述增强型体验数据对应的指令通过不同通道发送至所述客户端设备,例如,发送模块902用于将所述音视频数据生成模块1301生成的音视频数据和/或图像数据以及所述数据指令生成模块901生成的增强型体验数据及与所述增强型体验数据对应的指令通过两条不同通道发送至所述客户端设备,即,发送模块902将音视频数据生成模块1301生成的音频数据通过一个通道发送至客户端设备,将数据指令生成模块901生成的增强型体验数据及与所述增强型体验数据对应的指令通过另一通道发送至客户端设备;或者,发送模块902将音视频数据生成模块1301生成的图像数据通过一个通道发送至客户端设备,将 [0189] In another embodiment of the present invention, module 902 is further configured to transmit the audio-video data generating module 1301 generates audio data and / or image data and the instruction data generation module 901 generates an enhanced experience data and an enhanced experience data corresponding to the command transmitted via different channels to the client device, e.g., module 902 for transmitting the audio and video data generating module 1301 generates the audio and video data and / or image data as well as said command data generating module 901 generates an enhanced experience data and transmits to the client device with the enhanced experience data corresponding to the instruction through two different channels, i.e., transmission module 902 to the audio and video data generated by the generating module 1301 audio data transmitted through a channel to the client device, will experience enhanced data command generating module 901 generates the data and the instruction data corresponding to the enhanced experience to the client device via another channel; Alternatively, the transmitting module 902 audio and video data generating module 1301 generates image data transmitted via a channel to the client device, 数据指令生成模块901生成的增强型体验数据及与所述增强型体验数据对应的指令通过另一通道发送至客户端设备;或者,发送模块902将音视频数据生成模块1301生成的音频数据和图像数据通过一个通道发送至客户端设备,将数据指令生成模块901生成的增强型体验数据及与所述增强型体验数据对应的指令通过另一通道发送至客户端设备。 Data command generation module to generate an enhanced experience data 901 and the instructions with an enhanced experience data corresponding to another channel by transmitting to the client device; Alternatively, module 902 transmits audio and video data generating module 1301 generates audio data and image data sent to the client device via a channel, the data is enhanced experience data command generating module 901 generates the instruction and data corresponding to the enhanced experience to the client device via another channel.

[0190] 请参阅附图14,是本发明实施例提供的在线应用系统的客户端设备逻辑结构示意图。 [0190] Refer to FIG. 14, a schematic structure of the client device online application system according to an embodiment of the present invention. 为了便于说明,仅仅示出了与本发明实施例相关的部分。 For convenience of explanation, only a part related to the embodiment of the present invention. 附图14示例的客户端设备包括数据指令接收模块1401和执行模块1402,其中: The client device 14 includes a data reference instruction receiving module 1401 and exemplary execution module 1402, wherein:

[0191] 数据指令接收模块1401,用于接收服务器生成的增强型体验数据及与所述增强型体验数据对应的指令; [0191] Data command receiving module 1401, an enhanced experience for receiving data generated by the server and data corresponding to the instruction experience enhanced;

[0192] 执行模块1402,用于利用所述增强型体验数据执行所述数据指令接收模块1401接收的增强型体验数据对应的指令以生成增强型体验效果。 [0192] The execution module 1402, utilizing the enhanced experience data instructions perform the data receiving module 1401 enhanced experience data corresponding to the received command to generate an enhanced experience effect.

[0193] 需要说明的是,以上线应用客户端设备的实施方式中,各功能模块的划分仅是举例说明,实际应用中可以根据需要,例如相应硬件的配置要求或者软件的实现的便利考虑,而将上述功能分配由不同的功能模块完成,即将所述线应用客户端设备的内部结构划分成不同的功能模块,以完成以上描述的全部或者部分功能。 [0193] Incidentally, embodiments described above line application client devices, the division of the functional modules is merely illustrative, practical applications may be needed, such as facilitating appropriate hardware configuration requirements or software implementations considered, the foregoing functions may be assigned to different functional modules, i.e. the internal configuration of the client line application device is divided into different functional modules to complete all or part of the functions described above. 而且,实际应用中,本实施例中的相应的功能模块可以是由相应的硬件实现,也可以由相应的硬件执行相应的软件完成,例如,前述的数据指令接收模块,可以是具有执行前述接收服务器生成的增强型体验数据及与所述增强型体验数据对应的指令的硬件,例如数据指令接收器,也可以是能够执行相应计算机程序从而完成前述功能的一般处理器或者其他硬件设备;再如前述的执行模块,可以是具有执行前述利用所述增强型体验数据执行与所述增强型体验数据对应的指令以生成增强型体验效果功能的硬件,如执行器,也可以是能够执行相应计算机程序从而完成前述功能的一般处理器或者其他硬件设备。 Moreover, the practical application, the present embodiment corresponding functional modules may be implemented by corresponding hardware, may be executed by the respective hardware corresponding software, for example, the data instruction receiving module, may have performed the reception server generates enhanced data experience and experience data corresponding to the enhanced hardware instructions, e.g. instruction data receiver may be capable of executing a corresponding computer program to implement the functions of a general processor or other hardware device; Again the execution module may be performed with the use of the enhanced experience data and experience to execute instructions corresponding to the enhanced data to generate an enhanced experience effect hardware features, such as actuators, may be capable of executing a corresponding computer program thereby completing the general function processor or other hardware device.

[0194] 在本发明一个实施例中,客户端设备还可以包括音视频数据接收模块1501和展示模块1502,如附图15所示本发明另一实施例提供的客户端设备,其中: [0194] In one embodiment of the present invention, the client device may further comprise audio and video data receiving module 1501 and a display module 1502, the client device provided in another embodiment of the present invention as shown in figures 15, wherein:

[0195] 所述音视频数据接收模块1501,用于接收服务器生成的音频数据和/或图像数据,其中,所述图像数据包括视频数据和/或绘图原语; [0195] The audio and video data receiving module 1501, a server for receiving the generated audio data and / or image data, wherein said image data comprises video data and / or drawing primitives;

[0196] 在本实施例中,数据指令接收模块1401和音视频数据接收模块1501通过同一通道接收所述增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据;或者,数据指令接收模块1401和音视频数据接收模块1501通过不同通道接收所述增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据。 [0196] In the present embodiment, a data receiving module 1401 and instruction audio and video data receiving module 1501 receives the enhanced data and experience the same channel and the enhanced experience data corresponding to the instruction data and the audio and / or image data; Alternatively, the data receiving module 1401 receives the instruction enhanced experience video data and audio data receiving module 1501 and data through different channels and the audio data corresponding to the instruction and / or image data with the enhanced experience. 数据指令接收模块1401和音视频数据接收模块1501通过同一通道接收增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据时,通过所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令携带的消息头识别所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令。 Instruction data receiving module 1401 and module 1501 receives audio and video data received through the same channel and an enhanced experience data instruction and the data corresponding to the experience and enhanced audio data and / or image data, through the audio data, image data, and the experience said enhanced data and instructions header message identifying the audio data, image data, and carries the enhanced data and experience enhanced experience data corresponding to the instruction and the data corresponding to the enhanced experience.

[0197] 所述展示模块1502,用于将所述音视频数据接收模块1501接收到的音频数据和/或图像数据展示成应用程序运行过程中的声音和/或图像。 The [0197] Display module 1502, for the audio and video data receiving module 1501 receives audio data and / or image data into the display application is running in the sound and / or image. [0198] 需要说明的是,音视频数据或绘图原语和增强型体验数据及与所述增强型体验数据对应的指令可能是服务器通过同一通道发送至所述客户端设备,也可能是服务器通过不同通道(例如,两条通道)发送至所述客户端设备。 [0198] Incidentally, the audio and video data or drawing primitives and experience enhanced data and instructions with the enhanced experience data corresponding to the server may be sent to the client device over the same channel, it may be by the server different channels (e.g., channel two) is transmitted to the client device.

[0199] 请参阅附图16,是本发明实施例提供的在线应用系统。 [0199] Refer to figures 16, it is an online application system according to an embodiment of the present invention. 为了便于说明,仅仅示出了与本发明实施例相关的部分。 For convenience of explanation, only a part related to the embodiment of the present invention. 附图16示例的在线应用系统包括附图9至附图13任一示例的服务器1601和附图14至附图15任一示例的客户端设备1602,其中: Online application system 16 includes exemplary drawing figures 9 to 13 a reference to any example of the server 1601 and figures 14 to 15 of the drawings an example of any of the client device 1602, wherein:

[0200] 所述服务器1601,用于生成增强型体验数据及与所述增强型体验数据对应的指令,将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备1602,以使所述客户端设备1602利用所述增强型体验数据执行与所述增强型体验数据对应的指令; [0200] The server 1601, for generating an enhanced experience data and instruction data corresponding to the enhanced experience, transmitting the enhanced data and experience enhanced experience data corresponding to the instruction to the client client device 1602, so that the client device 1602 using the enhanced experience data performed with the enhanced experience data corresponding to the instruction;

[0201] 所述客户端设备1602,用于接收所述服务器1601生成的增强型体验数据及与所述增强型体验数据对应的指令,利用所述增强型体验数据执行与所述增强型体验数据对应的指令以生成增强型体验效果。 [0201] The client device 1602, an enhanced experience for receiving data generated by the server 1601 and the instruction and the data corresponding to experience enhanced by the enhanced experience data performed with the enhanced experience data corresponding to the instruction to produce an enhanced experience effect.

[0202] 需要说明的是,上述装置各模块/单元之间的信息交互、执行过程等内容,由于与本发明方法实施例基于同一构思,其带来的技术效果与本发明方法实施例相同,具体内容可参见本发明方法实施例中的叙述,此处不再赘述。 [0202] Incidentally, the information interaction between device modules / units, and an execution process, since the method of the present invention and embodiments based on the same concept, it brings the technical effect of the present invention the same method of Example reference may be made to the present invention, the method described in this embodiment, not further described herein.

[0203] 还应理解,在本发明实施例中,客户端设备也可称之为用户设备(UserEquipment,简称为“UE”)、移动台(Mobile Station,简称为“MS”)、移动终端(MobileTerminal)等,还可以是移动电话(或称为“蜂窝”电话)、具有移动终端的计算机等,还可以是便携式、袖珍式、手持式、计算机内置的或者车载的移动装置,它们与无线接入网交换语言和/或数据。 [0203] It should also be understood that, in embodiments of the present invention, the client device may also be called a user equipment (User Equipment, simply referred to as "UE"), the mobile station (Mobile Station, simply referred to as "MS"), the mobile terminal ( MobileTerminal) and the like, may also be a mobile phone (or "cellular" phone), a computer having a mobile terminal and the like, may also be a portable, pocket, handheld, computer-included, or car mobile device, which the radio access language switching network and / or data. 此外,本发明实施例中,音视频设备或输出体验设备(如力反馈设备)为客户端设备包含的硬件设备。 Further, in this embodiment, a video or audio output devices experience (e.g., force feedback device) to the client device comprising a hardware device of the present invention.

[0204] 本领域普通技术人员可以理解上述实施例的各种方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,该程序可以存储于一计算机可读存储介质中,存储介质可以包括:只读存储器(ROM,Read Only Memory)、随机存取存储器(RAM,RandomAccess Memory)、磁盘或光盘等。 [0204] Those of ordinary skill in the art can appreciate that various embodiments of the method of the above-described embodiments all or part of the steps may be relevant hardware instructed by a program, the program may be stored in a computer-readable storage medium, the storage medium It may include: a read only memory (ROM, Read Only memory), a random access memory (RAM, RandomAccess memory), a magnetic disk or optical disk.

[0205] 以上对本发明实施例提供的在线应用的交互方法、服务器、客户端设备和系统进行了详细介绍,本文中应用了具体个例对本发明的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本发明的方法及其核心思想;同时,对于本领域的一般技术人员,依据本发明的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本发明的限制。 [0205] described in detail interaction method online application provided by the server, client device and system above embodiments of the present invention described herein through specific examples of the principles and embodiments of the invention are set forth in the above embodiments description is used to help understanding the method and core ideas of the present invention; Meanwhile, those of ordinary skill in the art, according to the ideas of the present invention, there are changes in the specific embodiment and application place, summary , the specification shall not be construed as limiting the present invention.

Claims (21)

1. 一种在线应用的交互方法,其特征在于,所述方法包括: 服务器生成增强型体验数据及与所述增强型体验数据对应的指令; 所述服务器将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备,以使所述客户端设备利用所述增强性体验数据执行与所述增强型体验数据对应的指令。 CLAIMS 1. A method of online interactive application, wherein, said method comprising: generating an enhanced experience data server and data corresponding to the instruction and the enhanced experience; the server, the enhanced data and experience with the said enhanced experience data corresponding to the instruction to the client device, so that the client device using the enhanced sexual experience with the experience enhanced instruction data corresponding to execution.
2.如权利要求I所述的方法,其特征在于,所述服务器生成增强型体验数据及与所述增强型体验数据对应的指令为:所述服务器根据事件消息生成增强型体验数据及与所述增强型体验数据对应的指令,所述事件消息包括用户在客户端设备进行增强型体验时的操作产生的消息;或所述服务器生成增强型体验数据及与所述增强型体验数据对应的指令为:所述服务器运行所述服务器的应用时生成增强型体验数据及与所述增强型体验数据对应的指令。 2. The method of claim I, wherein said server generates an enhanced experience data and experience data corresponding to the enhanced instruction: the server generates an enhanced experience and data in accordance with the event message enhanced experience data corresponding to said instructions, said event message comprising user experience enhanced operation at the client device generating a message; or the server generates an enhanced experience data and data corresponding to the instruction and the enhanced experience as follows: the application server generates the server running an enhanced experience data and instruction data corresponding to the enhanced experience.
3.如权利要求I所述的方法,其特征在于,所述服务器将所述增强型体验数据及其对应指令发送至所述客户端设备包括: 服务器捕获应用对应用程序接ロAPI函数的调用,通过所述API函数将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备;或者所述服务器调用修改过的应用程序接ロAPI函数,使用所述修改后的API函数将所述增强型体验数据及其对应指令发送至所述客户端设备。 3. The method of claim I, wherein the server, the enhanced experience data and the corresponding instruction to the client device comprising: calling application servers to capture application API functions access ro , the enhanced data and experience enhanced experience data corresponding to the instruction to the device through the client API function; or the modified call server applications access ro API functions, using the the modified API function and the enhanced experience data corresponding to the instruction to the client device.
4.如权利要求I所述的方法,其特征在于,所述方法还包括: 所述服务器将生成的音频数据和/或图像数据发送至所述客户端设备,所述图像数据包括视频数据和/或绘图原语; 所述服务器将音频数据和/或图像数据发送至所述客户端设备包括: 所述服务器将所述音频数据与所述增强型体验数据及与所述增强型体验数据对应的指令通过同一通道发送至所述客户端设备;或者所述服务器将所述图像数据与所述增强型体验数据及与所述增强型体验数据对应的指令通过同一通道发送至所述客户端设备;或者所述服务器将所述音频数据、图像数据与所述增强型体验数据及其对应指令通过同一通道发送至所述客户端设备。 4. The method of claim I, wherein said method further comprises: the server sends the generated audio data and / or image data to the client device, the image data comprises video data and / or drawing primitives; said server transmits audio data and / or image data to the client device comprising: the server, the audio data and the enhanced data experience and experience data corresponding to the enhanced command sent over the same channel to the client device; or the server, the image data with the enhanced data and experience enhanced experience data corresponding to the instruction to the client device over the same channel ; the server or the audio data, image data with the enhanced experience data and the corresponding instruction to the client device over the same channel.
5.如权利要求4所述的方法,其特征在于,所述服务器通过同一通道将所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备包括: 将所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令分别添加对应的消息头,封装成不同类型的消息通过同一通道发送至所述客户端设备。 5. The method according to claim 4, characterized in that, the server sends the same channel to the audio data, image data and the enhanced data and experience with the enhanced experience data corresponding to the instruction said client device comprising: respectively adding the audio data, image data and the enhanced data and experience enhanced experience data corresponding to the instruction corresponding message header, encapsulated in different types of messages sent to the same channel the client device.
6.如权利要求I所述的方法,其特征在于,所述方法还包括: 所述服务器将生成的音频数据和/或图像数据发送至所述客户端设备,所述图像数据包括视频数据和/或绘图原语; 所述服务器将音频数据和/或图像数据发送至所述客户端设备包括: 所述服务器将所述音频数据与所述增强型体验数据及与所述增强型体验数据对应的指令通过不同通道发送至所述客户端设备;或者所述服务器将所述图像数据与所述增强型体验数据及与所述增强型体验数据对应的指令通过不同通道发送至所述客户端设备;或者所述服务器将所述音频数据和图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令通过不同通道发送至所述客户端设备。 6. The method of claim I, wherein said method further comprises: the server sends the generated audio data and / or image data to the client device, the image data comprises video data and / or drawing primitives; said server transmits audio data and / or image data to the client device comprising: the server, the audio data and the enhanced data experience and experience data corresponding to the enhanced instruction sent through different channels to the client device; or the server, the image data with the enhanced data and experience enhanced experience data corresponding to the instruction to the client device via different channels ; or the server, the image data and the audio data and the enhanced data and experience enhanced experience data corresponding to the instruction to the client device through different channels.
7. —种在线应用的交互方法,其特征在于,所述方法包括: 客户端设备接收服务器生成的增强型体验数据及与所述增强型体验数据对应的指令; 所述客户端设备利用所述增强型体验数据执行与所述增强型体验数据对应的指令以生成增强型体验效果。 7. - Method kinds of online interactive application, wherein, said method comprising: a client device receiving an enhanced experience data generated by the server and the instruction and the data corresponding to an enhanced experience; the client device using the enhanced experience data performed with the enhanced experience data corresponding to the instruction to produce an enhanced experience effect.
8.如权利要求7所述的方法,其特征在于,所述方法还包括: 所述客户端设备接收所述服务器生成的音频数据和/或图像数据,所述图像数据包括视频数据和/或绘图原语; 所述客户端设备接收所述音频数据和/或图像数据以展示应用程序运行过程中的声音和/或图像。 8. The method according to claim 7, wherein said method further comprises: the client device receives the audio data generated by the server and / or image data, the image data comprises video data and / or drawing primitives; the client terminal apparatus receiving the audio data and / or image data in a display process of an application running sound and / or image.
9.如权利要求8所述的方法,其特征在于,所述客户端设备接收所述服务器生成的音频数据和/或图像数据包括: 所述客户端设备通过同一通道接收所述增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据;或者所述客户端设备通过不同通道接收所述增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据。 9. The method according to claim 8, characterized in that, the client receives the server side apparatus generates audio data and / or image data comprising: the client device receives the data through an enhanced experience the same channel and an enhanced experience data corresponding to the instruction data and the audio and / or image data; or the client device receives the enhanced data through different channels and experience with the enhanced experience data and audio data corresponding to the instruction and / or image data.
10.如权利要求8所述的方法,其特征在于,所述客户端设备通过同一通道接收所述增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据时,通过所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令携带的消息头识别所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令。 10. The method according to claim 8, wherein said client device receives the enhanced experience data and audio data corresponding to the instructions and data and / or image data with the enhanced experience the same channel , message header identifying the audio data, image data obtained by the audio data, image data and the enhanced data and experience enhanced experience data corresponding to the command, and carries the enhanced data and experience with the enhanced experience data corresponding to the instruction.
11. 一种服务器,其特征在于,所述服务器包括: 数据指令生成模块,用于生成增强型体验数据及与所述增强型体验数据对应的指令; 发送模块,用于将所述增强型体验数据及与所述增强型体验数据对应的令发送至所述客户端设备,以使所述客户端设备利用所述增强型体验数据执行与所述增强型体验数据对应的指令。 11. A server, wherein the server comprises: a data command generation module for generating an enhanced experience data and instruction data corresponding to the enhanced experience; sending module, configured to experience the enhanced experience data and enhanced data corresponding to the command is sent to the client device, so that the client device using the enhanced experience with the experience enhanced instruction data corresponding to execution.
12.如权利要求11所述的服务器,其特征在于,所述数据指令生成模块具体用于根据事件消息生成增强型体验数据及与所述增强型体验数据对应的指令,所述事件消息包括用户在客户端设备进行增强型体验时的操作产生的消息;或所述数据指令生成模块生成的增强型体验数据及其对应指令包括所述服务器上的应用运行时自身生成的增强型体验数据及其对应指令。 12. The server according to claim 11, wherein said instruction data generating module configured to generate an enhanced experience data and data corresponding to the instruction and the experience enhanced by the event message, the event message comprises a user message operation is enhanced experience generated by client device; the data or command generation module generates an enhanced experience data and the corresponding instruction data including enhanced experience self-generated application running on the server and the corresponding instruction.
13.如权利要求11所述的服务器,其特征在于,所述发送模块包括: 捕获单元,用于捕获应用对应用程序接ロAPI函数的调用,通过所述API函数将所述增强型体验数据及其对应指令发送至所述客户端设备;或者调用单元,用于调用修改过的应用程序接ロAPI函数,使用所述修改后的API函数将所述增强型体验数据及其对应指令发送至所述客户端设备。 13. The server according to claim 11, wherein the transmitting module comprises: a capturing unit for capturing an application access to applications ro API function calls, the API function by the enhanced experience data and the corresponding instruction to the client device; or a calling unit for calling the modified application access ro API functions, after modification using the API function and the enhanced experience data corresponding to the instruction to the client device.
14.如权利要求11所述的服务器,其特征在于,所述服务器还包括音视频数据生成模块,用于生成音频数据和/或图像数据,所述图像数据包括视频数据和/或绘图原语; 所述发送模块还用于将所述音视频数据生成模块生成的音频数据和所述数据指令生成模块生成的增强型体验数据及其对应指令通过同一通道发送至所述客户端设备;或者所述发送模块还用于将所述音视频数据生成模块生成的图像数据和所述数据指令生成模块生成的增强型体验数据及其对应指令通过同一通道发送至所述客户端设备;或者所述发送模块还用于将所述音视频数据生成模块生成的音频数据、图像数据和所述数据指令生成模块生成的增强型体验数据及其对应指令通过同一通道发送至所述客户端设备。 14. The server according to claim 11, wherein said server further comprises audio and video data generating module for generating audio data and / or image data, the image data comprises video data and / or drawing primitives ; the sending module is further configured to generate the audio and video data and audio data module generates the command generation data and data corresponding to an enhanced experience module instructions generated by the client device sent to the same channel; or the said transmitting module is further used for the audio-video data to the image data generation module generates the data and command generation module generates an enhanced experience data and instructions corresponding to the same channel transmitted to the client device; or the transmission module is further used for the audio and video data generation module generates audio data, image data and the instruction data generation module generates an enhanced experience data and instructions corresponding to the same channel transmitted to the client device.
15.如权利要求14所述的服务器,其特征在于,所述发送模块用于将所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令分别添加对应的消息头,封装成不同类型的消息通过同一通道发送至所述客户端设备。 Were added to the audio data, image data and the enhanced data and experience enhanced experience data corresponding to the command 15. The server according to claim 14, wherein said means for transmitting a corresponding the message header, encapsulated in different types of messages sent via the same channel to the client device.
16.如权利要求11所述的服务器,其特征在于,所述服务器还包括音视频数据生成模块,用于生成音频数据和/或图像数据,所述图像数据包括视频数据和/或绘图原语; 所述发送模块还用于将所述音视频数据生成模块生成的音频数据和所述数据指令生成模块生成的增强型体验数据及其对应指令通过不同通道发送至所述客户端设备;或者所述发送模块还用于将所述音视频数据生成模块生成的图像数据和所述数据指令生成模块生成的增强型体验数据及其对应指令通过不同通道发送至所述客户端设备;或者所述发送模块还用于将所述音视频数据生成模块生成的音频数据、图像数据和所述数据指令生成模块生成的增强型体验数据及其对应指令通过不同通道发送至所述客户端设备。 16. The server according to claim 11, wherein said server further comprises audio and video data generating module for generating audio data and / or image data, the image data comprises video data and / or drawing primitives ; the sending module is further configured to generate the audio and video data and audio data module generates the command generation data and data corresponding to an enhanced experience module instructions generated by the client device sent to the different channels; or the said transmitting module is further used for the audio-video data to the image data generation module generates the data and command generation module generates an enhanced experience data and instructions over different channels correspond to the sending client device; or the transmission module is further used for the audio and video data generation module generates audio data, image data and the instruction data generation module generates an enhanced experience data and the corresponding instruction is sent to the different channels by the client device.
17. 一种客户端设备,其特征在于,所述客户端设备包括: 数据指令接收模块,用于接收服务器生成的增强型体验数据及与所述增强型体验数据对应的指令; 执行模块,用于利用所述增强型体验数据执行与所述增强型体验数据对应的指令以生成增强型体验效果。 17. A client device, wherein the client device comprising: an instruction data receiving means for receiving an enhanced experience data generated by the server and the enhanced experience data corresponding to the instruction; execution module, with experience in using the enhanced data is performed with the enhanced experience data corresponding to the instruction to produce an enhanced experience effect.
18.如权利要求17所述的客户端设备,其特征在于,所述客户端设备还包括音视频数据接收1吴块和展不I旲块; 所述音视频数据接收模块,用于接收所述服务器生成的音频数据和/或图像数据,所述图像数据包括视频数据和/或绘图原语; 所述展示模块,用于将所述音视频数据和/或图像数据展示成应用程序运行过程中的声音和/或图像。 18. The client device according to claim 17, wherein said apparatus further comprises a client 1 receives audio and video data block Wu and I do not show Dae block; the audio-video data receiving module, for receiving the server generates said audio data and / or image data, the image data comprises video data and / or drawing primitives; said display module, configured to display the audio and video data and / or image data to run the application process the sound and / or image.
19.如权利要求18所述的客户端设备,其特征在于,所述数据指令接收模块和所述音视频数据接收模块通过同一通道接收所述增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据;或者所述数据指令接收模块和所述音视频数据接收模块通过不同通道接收所述增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据。 19. The client device according to claim 18, wherein said instruction data receiving module and the audio-video data receiving module receiving the same channel and an enhanced experience data with experience data corresponding to the enhanced the instructions and audio data and / or image data; said data or instruction receiving module and the audio-video data receiving module receives the enhanced experience different channel type data and the enhanced experience data corresponding to the audio data and instructions and / or image data.
20.如权利要求19所述的客户端设备,其特征在于,所述数据指令接收模块和所述音视频数据接收模块通过同一通道接收所述增强型体验数据及与所述增强型体验数据对应的指令以及音频数据和/或图像数据时,通过所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令携帯的消息头识别所述音频数据、图像数据以及所述增强型体验数据及与所述增强型体验数据对应的指令。 20. The client device according to claim 19, wherein said instruction data receiving module and the audio-video data receiving module receiving the same channel and an enhanced experience data with experience data corresponding to the enhanced and / or image data, audio data and instructions, by identifying the head of the audio data, image data and the enhanced data and experience enhanced experience data corresponding to the instruction message carrying Bands of audio data, image data, experience and the enhanced data and instructions with the data corresponding to the enhanced experience.
21. ー种在线应用系统,所述在线应用系统包括服务器和客户端设备; 所述服务器,用于生成增强型体验数据及与所述增强型体验数据对应的指令,将所述增强型体验数据及与所述增强型体验数据对应的指令发送至所述客户端设备,以使所述客户端设备利用所述增强型体验数据执行与所述增强型体验数据对应的指令; 所述客户端设备,用于接收所述服务器生成的增强型体验数据及与所述增强型体验数据对应的指令,利用所述增强型体验数据执行与所述增强型体验数据对应的指令以生成増强型体验效果。 21. ー species online application system, the on-line application system includes a server and a client device; said server, for generating an enhanced experience data and instruction data corresponding to the enhanced experience, the enhanced experience data and an enhanced experience data corresponding to the instruction to the client device, so that the client device using the enhanced experience data performed with the enhanced experience data corresponding to the instruction; the client device , a server for receiving the generated data and the enhanced experience enhanced experience data corresponding to the instruction data by using the enhanced experience performing the enhanced experience data corresponding to the instruction type to generate a strong experience effect zo .
CN201110165706XA 2011-06-20 2011-06-20 Interactive method of online application, server, client device and system CN102843334A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201110165706XA CN102843334A (en) 2011-06-20 2011-06-20 Interactive method of online application, server, client device and system

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201110165706XA CN102843334A (en) 2011-06-20 2011-06-20 Interactive method of online application, server, client device and system
PCT/CN2012/072230 WO2012174891A1 (en) 2011-06-20 2012-03-13 Interaction method, server, client device and system for online application

Publications (1)

Publication Number Publication Date
CN102843334A true CN102843334A (en) 2012-12-26

Family

ID=47370399

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110165706XA CN102843334A (en) 2011-06-20 2011-06-20 Interactive method of online application, server, client device and system

Country Status (2)

Country Link
CN (1) CN102843334A (en)
WO (1) WO2012174891A1 (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1578964A (en) * 2001-10-30 2005-02-09 英默森公司 Methods and apparatus for providing haptic feedback in interacting with virtual pets
CN1599925A (en) * 2001-10-09 2005-03-23 伊默逊股份有限公司 Haptic feedback sensations based on audio output from computer devices
US20070077541A1 (en) * 2005-10-05 2007-04-05 Nintendo Co., Ltd. Driving game steering wheel simulation method and apparatus
US20090079690A1 (en) * 2007-09-21 2009-03-26 Sony Computer Entertainment America Inc. Method and apparatus for enhancing entertainment software through haptic insertion
US20090131171A1 (en) * 2007-11-16 2009-05-21 Sony Computer Entertainment Inc. Game System and Game Controller
US20090167509A1 (en) * 2007-12-31 2009-07-02 Apple Inc. Tactile feedback in an electronic device
CN101496954A (en) * 2008-01-28 2009-08-05 联想(北京)有限公司 Game controller and game processing method thereof
CN101788909A (en) * 2010-01-28 2010-07-28 北京天空堂科技有限公司 Solving method and device of network game server end walking system
CN101828161A (en) * 2007-10-18 2010-09-08 微软公司 Three-dimensional object simulation using audio, visual, and tactile feedback
CN101943997A (en) * 2010-09-13 2011-01-12 中兴通讯股份有限公司 Method and terminal for realizing operation prompt tone from touch-screen terminal
US20110053691A1 (en) * 2009-08-27 2011-03-03 Nintendo Of America Inc. Simulated Handlebar Twist-Grip Control of a Simulated Vehicle Using a Hand-Held Inertial Sensing Remote Controller

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101024123A (en) * 2006-02-20 2007-08-29 杨大勇 Method for realizing hand-set network interaction game using hand-set pick-up head
CN201179331Y (en) * 2007-12-29 2009-01-14 董海颖 Control system for game chair

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1599925A (en) * 2001-10-09 2005-03-23 伊默逊股份有限公司 Haptic feedback sensations based on audio output from computer devices
CN1578964A (en) * 2001-10-30 2005-02-09 英默森公司 Methods and apparatus for providing haptic feedback in interacting with virtual pets
US20070077541A1 (en) * 2005-10-05 2007-04-05 Nintendo Co., Ltd. Driving game steering wheel simulation method and apparatus
US20090079690A1 (en) * 2007-09-21 2009-03-26 Sony Computer Entertainment America Inc. Method and apparatus for enhancing entertainment software through haptic insertion
CN101828161A (en) * 2007-10-18 2010-09-08 微软公司 Three-dimensional object simulation using audio, visual, and tactile feedback
US20090131171A1 (en) * 2007-11-16 2009-05-21 Sony Computer Entertainment Inc. Game System and Game Controller
US20090167509A1 (en) * 2007-12-31 2009-07-02 Apple Inc. Tactile feedback in an electronic device
CN101496954A (en) * 2008-01-28 2009-08-05 联想(北京)有限公司 Game controller and game processing method thereof
US20110053691A1 (en) * 2009-08-27 2011-03-03 Nintendo Of America Inc. Simulated Handlebar Twist-Grip Control of a Simulated Vehicle Using a Hand-Held Inertial Sensing Remote Controller
CN101788909A (en) * 2010-01-28 2010-07-28 北京天空堂科技有限公司 Solving method and device of network game server end walking system
CN101943997A (en) * 2010-09-13 2011-01-12 中兴通讯股份有限公司 Method and terminal for realizing operation prompt tone from touch-screen terminal

Also Published As

Publication number Publication date
WO2012174891A1 (en) 2012-12-27

Similar Documents

Publication Publication Date Title
CN103348695B (en) For low-latency wireless display graphics
US7853648B1 (en) System and method for providing interactive images
CN102713848B (en) A method for using a lightweight client over the network to interface with the virtual computing services
CN102362269B (en) Real-Time Kernel
CN103582509B (en) Load balancing between general-purpose processors and graphics processors
CN104363519B (en) A display method, apparatus and system related information based on live online
US9800939B2 (en) Virtual desktop services with available applications customized according to user type
Jurgelionis et al. Platform for distributed 3D gaming
US9203685B1 (en) Qualified video delivery methods
US10298721B2 (en) Method and system to determine a work distribution model for an application deployed on a cloud
US20100332984A1 (en) System and method for providing a remote user interface for an application executing on a computing device
CN100544259C (en) Systems and methods for determining remote device media capabilities
DE112013005688T5 (en) Method and system for cloud-based virtualized graphics processing for remote displays
CA2825223C (en) Remotely emulating computing devices
CN103442774B (en) Dual-mode program execution and load
US8621069B1 (en) Provisioning a computing application executing on a cloud to a client device
EP2609520B1 (en) Add-on management
US8903897B2 (en) System and method for providing interactive content to non-native application environments
CN104253856B (en) Scalable Web real-time communication media engine and related methods, systems,
US10080966B2 (en) System and method for experiencing advertised interactive applications
WO2014070561A1 (en) Home cloud with virtualized input and output over home network
CN101981558A (en) Systems and methods for managing multimedia operations in remote sessions
US20150081764A1 (en) Remote Virtualization of Mobile Apps
CN104378683A (en) Program based interaction method and device
CN105850099A (en) Local management for intermediary graphics rendition

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
RJ01