CN102722250A - Method and system for interactive editing of image control points - Google Patents

Method and system for interactive editing of image control points Download PDF

Info

Publication number
CN102722250A
CN102722250A CN 201210185496 CN201210185496A CN102722250A CN 102722250 A CN102722250 A CN 102722250A CN 201210185496 CN201210185496 CN 201210185496 CN 201210185496 A CN201210185496 A CN 201210185496A CN 102722250 A CN102722250 A CN 102722250A
Authority
CN
Grant status
Application
Patent type
Prior art keywords
module
data
handle
processing module
instruction
Prior art date
Application number
CN 201210185496
Other languages
Chinese (zh)
Inventor
何潇
刘柳
Original Assignee
何潇
刘柳
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Abstract

The invention relates to a method and a system for interactive editing of image control points. The method comprises the following main steps of: detecting the system; loading data; displaying and refreshing data; detecting an input state; converting and transferring an instruction; modifying data; and the like. The involved hardware devices mainly comprise a computer and a universal force feedback handle; a software processing module is arranged in the computer; and thus, the method can be realized. The method and the system have the beneficial effects that the image control points can be browsed and edited and the data can be viewed simultaneously, continuous switching between an editing state and a view state can be realized, the universal force feedback handle is used for operation to guarantee low cost, meanwhile, images to be processed and reference data can be zoomed by moving the universal force feedback handle during editing of the image control points, an instruction emitted by application software can also be received as a response per se, and the probability of human error during editing is reduced.

Description

一种影像控制点交互编辑的方法及系统 An image control method and system for interactive editing of point

技术领域 FIELD

[0001] 本发明涉及摄影测量与遥感技术领域的影像控制,特别是关于影像控制点交互编辑的方法及系统。 [0001] The present invention relates to the field of Photogrammetry and Remote Sensing image control technology, in particular a method and system of control points on the image of the interactive editing.

背景技术 Background technique

[0002] 在摄影测量与遥感领域中,往往针对同一目标要使用不同拍摄器材或从不同角度进行拍摄,拍摄的这些影像包含有相同的物理目标,目标在真实坐标系中是同一个点,但在各影像内相对于影像像素的坐标位置却不同。 [0002] In Photogrammetry and Remote Sensing art, often for the same object to be using different imaging devices or imaging from different angles, these images captured with the same physical target, the target is the same point in the real coordinate system, but in each image with respect to the coordinate position of the pixel of the image is different. 处于不同影像内的这些目标点,就被为控制点或同名点。 These target points in the different images, it is the same name as the control point or points. [0003] 现有技术中,虽然可以通过自动算法搜索匹配图像控制点或立体像对同名点,但是其可靠性有限,人工检查与编辑仍然是目前实际生产中不可取代的重要环节。 [0003] In the prior art, although the control point or points stereoscopic pair of the same name, but its reliability is limited by an automatic image matching the search algorithm, manual inspection and editing is still an important part of the current actual production irreplaceable. 人工检查和调整、新增或删除某些控制点,以及给出相应的显示与提示,这些操作统称为对控制点的交互编辑。 Manual inspection and adjustment, add or delete control points, and given the appropriate prompt is displayed, these operations are collectively referred to as interactive editing control points.

[0004] 传统的人机交互编辑大多使用计算机的标准鼠标键盘,或专用的电子手轮与踏板作为操作设备,对影像对分别进行移动与缩放操作。 [0004] Most of the traditional computer interactive editing of the standard mouse and keyboard, or dedicated electronic hand wheel and the pedal device as the operation for moving and zooming operations of the image separately. 可是,鼠标键盘与专用的电子手轮、踏板设备都仅为输入设备,不能接受应用软件发出的指令后做出自身响应。 However, mouse and keyboard with dedicated electronic hand wheel, the pedal device are only input device can not accept an instruction to make their own application software in response to the issued. 且大部分面向遥感数据处理的软件直接使用通用鼠标键盘作为输入设备,而数据处理本身需要在编辑与查看状态间不停的切换,鼠标键盘在图像控制点编辑时,却不能在移动、缩放待处理影像的同时查看参考数据。 Most remote sensing and data processing software for the direct use of generic mouse and keyboard as an input device, the data processing itself needs kept switching between editing and viewing the status, control the mouse and keyboard when the image editing points, but can not move, the zoom be while processing the image to view the reference data. 所以鼠标的操控性差,并且工作效率低;而专用手轮与踏板则造价高,占用空间大,市场上没有标准产品,通用性不强。 So the mouse handling is poor, and low efficiency; and a dedicated hand wheel and pedals are high cost, large footprint, no standard products on the market, are not universal.

发明内容 SUMMARY

[0005] 因此,针对上述问题,本发明的目的是提供一种能够对影像控制点同时进行编辑和数据查看的影像控制点交互编辑方法及系统。 [0005] Thus, the above problems, an object of the present invention is to provide a control point for the video image control method and system for interactive editing point editing and viewing of data simultaneously. 输入设备不仅仅是输入信息和移动、缩放影像,还可接受应用软件发出的指令后做出自身响应。 The input device and the input information is not only moved, zoomed image, may make their response after accepting an instruction issued by the application software.

[0006] 为实现上述目的,本发明采取以下技术方案:一种影像控制点交互编辑的方法,其特征在于,主要包含如下操作步骤: [0006] To achieve the above object, the present invention adopts the following technical solution: An image editing method for interactive control points, characterized in that the main step comprises the following operations:

[0007] (I)硬件连接:将计算机与显示设备、鼠标、键盘、通用力反馈手柄连接,其中,所述计算机中装有手柄驱动程序,以及装有在操作系统支持下的由中央处理模块、数据处理模块、信息指令模块、图形界面模块构成的应用软件系统,在系统中至少包含浏览与编辑两种运行模式;所述手柄内包含有可被计算机修改的寄存器,所述寄存器通过电平控制马达转速实现力反馈;所述手柄的外表至少带有两个摇杆和14个按键,摇杆的功能和按键功能已由用户预先自定义; [0007] (I) hardware connection: a computer connected to a display device, a mouse, a keyboard, a general force feedback handle, wherein the handle driver installed on the computer, and with the support of the operating system by the central processing module data processing module, module instruction information, graphical software application modules in the system for viewing and editing included in at least two modes of operation; within the handle may be modified with a computer a register level by implement force feedback motor speed control; the outer handle with at least two defined by the user in advance from the joystick and buttons 14, function buttons and joystick functions;

[0008] (2)打开计算机,运行软件系统,由系统的信息指令模块检测手柄的连接状态,若手柄连接状态良好,则打开与手柄的数据通信接口,并不断维护该接口;若手柄连接异常则向中央处理模块发出程序挂起指令,提示用户正确连接手柄,直到连接良好;[0009] (3)用户设置初始显示比例与显示位置信息; [0008] (2) Turn on the computer, running the software system, the connection state information command module detects handle system, if the handle is attached in good condition, is opened with the data communication interface of the handle, and constant maintenance of the interface; if the handle connection abnormality is issued to the central processing module program suspend command, prompts the user properly connecting the handle until the connection is good; [0009] (3) the user setting initial display ratio display position information;

[0010] (4)中央处理模块接收用户打开影像数据或控制点数据的指令,将其发送至数据处理模块,由数据处理模块载入数据;当数据中包含已有控制点时,数据处理模块根据用户选定的几何模型关系进行参数解算,并计算每个控制点在选定函数关系下的残差; [0010] (4) a central processing module receives the user image data or instructions to open the control point data, and transmits it to the data processing module, data loaded by the data processing module; when the data is included in the existing control point, the data processing module solver parameters selected by the user according to the geometric relationship model, and calculates a residual at each control point of a selected function;

[0011] (5)中央处理模块将附加显示比例与显示位置信息的指令发送至图形界面模块,图形界面模块从数据处理模块中获取图像数据块以及该区域内包含的控制点,控制显示设备将其显示出来;同时图形界面模块从数据处理模块中获取控制点数据,并将其在数据列表中显示; [0011] (5) an additional central processing module transmits display scale display position information of the instruction to the graphic interface module, graphical interface module acquires the image data blocks, and a control region comprising a point from the data processing module controls the display device which is displayed; the same graphical interface control point module obtaining data from the data processing module, and displays the data list;

[0012] (6)手柄进入工作状态后,信息指令模块实时检测手柄的连接状态,手柄寄存器内实时更新按键和摇杆所处的状态,该状态随时被计算机通过硬件接口获取;信息异常时,寄存器通过电平控制马达转速实现力反馈; [0013] (7)当数据载入后,信息指令模块开始以一定频率检测手柄按键与摇杆的操作状态,并将其存入模块内,参照预定义的按键功能分配表,通过比对时间片之间的手柄状态,判定手柄上特定的按键是否完成了双击或单击操作,或者是否处于持续按下的状态,并将该信息转换为对应的功能指令,发送给中央处理模块; [0012] (6) grip into the working state, the connection state information of real-time detection instruction module handle, the handle status register is updated in real time in which the buttons and joystick, in this state ready to be acquired by the computer interface hardware; when abnormality information, force feedback control registers implemented by the motor speed level; [0013] (7) when the data is loaded, the instruction information detecting module starts at a frequency controller buttons and the operation state of the joystick, and store it in the module, with reference to pre button assignments table definition, by comparing the state between the time slice of the handle, the handle is determined whether or not the particular key click or double-click operation, or continuously pressed is in a state, and converts the information corresponding to function instruction, sent to the central processing module;

[0014] (8)中央处理模块在接受指令后判定指令内容,若为数据修改信息,则将其传递给数据处理模块,由数据处理模块进行响应;若指令包含图形显示变更信息,则更新中央处理模块内部的视图信息,并将其传递至图形界面模块;若指令被判定为操作异常时,处理模块则不转发该指令,而根据预定义的操作异常的类别向信息指令模块发出对应强度的力反馈指令,由信息指令模块控制手柄产生震动以提示用户; [0014] (8) a central processing module determines the instruction content after receiving the instruction, if the modification information data, it is passed to a data processing module, by the data processing module to respond; If the instruction includes a graphics display changing information, then updates the central internal view information processing module, and passes it to the graphic interface module; if the operation instruction is determined to be abnormal, the processing module does not forward the instruction, and the class information sent to the command module corresponding to the intensity abnormality according to a predefined operation a force feedback command, the control command module handles the information to prompt the user to vibrate;

[0015] (9)当中央处理模块接收到当前控制点切换指令时,则将当前显示位置调整至更新后的当前控制点处,通知图形界面模块更新显示;同时从数据处理模块中获取该控制点残差信息,若判定控制点残差超限,则根据残差的超限程度对信息指令模块发出相应强度力反馈指令,由信息指令模块控制手柄产生震动以提示用户; [0015] (9) When the central processing module receives the active control switching instruction, the current display at the current position of the control point was adjusted to the update, the update notification module graphical display; also acquires the control data from the processing module residual information point, if it is determined the residual gauge control point, the intensity of the force feedback to issue the corresponding command module instruction information from the residual degree of overrun, the control command module handles the information to prompt the user to vibrate;

[0016] (10)数据处理模块收到控制点编辑指令时执行指令,并通过中央处理模块通知图形界面模块更新控制点数据显示; Executing instructions [0016] (10) a data processing module receives the control point editing instruction, and notifies the control point graphical user interface module updates the data displayed by the central processing module;

[0017] (11)当编辑工作完成时,由用户发出数据关闭指令,中央处理模块则向数据处理模块发出消息,由数据处理模块将计算机内存的控制点数据保存至外存储设备中;同时向图形界面模块发出指令,使其清空图像显示与控制点列表,并进入挂起状态停止刷新显示。 [0017] (11) when the editing work is completed, issues a data closing command by the user, the central processing module sending a message to the data processing module will be saved by the data processing module computer memory control point data to the external storage device; and simultaneously to GUI module gives an instruction so that image display and clear the list of control points, and enters the suspend state to refresh the display is stopped.

[0018] 所述浏览模式是指浏览查看影像数据,并可进行控制点的添加与删除;所述编辑模式是指对图像控制点进行编辑修改。 [0018] The browsing mode that a browser to view the video data, and can be added and deleted control point; refers to the image editing mode to edit or modify the control points.

[0019] 所述手柄上左、右两摇杆的作用在浏览模式与编辑模式下都设置为左、右影像的移动。 [0019] The handle acting on left and right rocker Browse mode and editing mode are set to move the left and right images.

[0020] 所述通用鼠标键盘也通过硬件接口与计算机连接,在手柄出现故障时,由鼠标键 [0020] The general mouse and keyboard is also connected via a hardware interface with the computer, when the handle fails, a mouse button

盘代替工作。 Disk instead of work.

[0021] 一种实现所述影像控制点交互编辑方法的交互编辑系统,它包括通用PC计算机、显示设备、鼠标、键盘,其特征在于:还包括与计算机连接的力反馈手柄、在计算机操作系统支持下的软件处理模块,所述软件处理模块包括中央处理模块、数据处理模块、信息指令模块、图形界面模块;所述中央处理模块和数据处理模块相连进行数据指令互递,和信息指令模块相连进行输入信息指令互递,和图形界面模块相连进行图像数据显示指令传递;所述信息指令模块与计算机操作系统和手柄相连,得到计算机操作系统的支持,将手柄接口信息进行转化;所述图形界面模块与显示设备相连,进行图像输出;所述力反馈手柄通过硬件接口与所述信息指令模块相连,手柄内包含有可被计算机修改的寄存器,所述寄存器通过电平控制马达转速实现力反馈;所述手柄 [0021] The interactive editing system for realizing the interactive image editing method of the control point, which includes a general purpose computer PC, a display device, a mouse, a keyboard, characterized by: further comprising a force feedback handle connected to the computer, a computer operating system With the support of software processing module, the processing module includes a central processing software module, a data processing module, information instruction module, graphical interface module; said central processing module and a data processing module for mutual data delivery instruction, and instruction information module is connected instruction input mutual information delivery, and the graphical interface display module is connected to the image data transfer instruction; the instruction information module connected to the computer operating system and a handle, the support computer operating system will handle the interface conversion information; the graphical interface module is connected with the display device, an image output; the handle is connected to a force feedback interface hardware module with the instruction information, the handle may be modified with a computer register, said register control motor speed to achieve the level of force feedback; said handle 外表至少带有两个摇杆和14个按键,摇杆的功能和按键功能由用户预先自定义。 And having at least two outer rocker buttons 14, function buttons and joystick functions previously defined by the user.

[0022] 所述力反馈手柄与计算机通过1394接口、USB接口、COM接口、打印机接口或蓝牙接口连接。 [0022] The force feedback handle and computer, USB interfaces, COM interface, a Bluetooth interface or printer interface 1394 connected through an interface.

[0023] 所述力反馈手柄的两个摇杆分别控制两个影像的移动。 [0023] The two force feedback joystick control handle, respectively the movement of two images.

[0024] 所述图形界面模块显示浏览模式和编辑模式两种界面。 The [0024] interface module graphical display mode and the edit mode browsing both interfaces.

[0025] 所述鼠标键盘也通过硬件接口与计算机连接。 [0025] The mouse and keyboard are also connected with the computer through the hardware interface. [0026] 本发明由于采取以上技术方案,其具有以下优点:1、本发明的交互编辑方法,能够对影像控制点同时进行浏览、编辑和数据查看,可以在编辑与查看状态间不停切换,较以前的方法大有改进。 [0026] As a result of the present invention, the above technical solution, which has the following advantages: 1, interactive editing method according to the present invention, the video control points can be viewed, edited, and view data at the same time, can continuously switch between editing and viewing the status, a significant improvement over previous methods. 2、本发明使用的通用力反馈手柄硬件,市场价小于100元人民币,而专用硬件设备由于为特种设备,量产规模小,价格在数千元人民币;同时,其在图像控制点编辑时能同时移动缩放待处理影像和参考数据;同时它还能接受应用软件发出的指令做自身响应,降低了编辑中出现人为失误的机会。 2, handle general force feedback hardware used in the present invention, the market price is less than 100 yuan, and a dedicated hardware device due to special equipment, small-scale production, the price of several thousand yuan; the same time, it can control the image editing points At the same time move the zoom image and reference data to be processed; and it can accept commands issued by the application software to make their own response, reducing the chance of human errors occur editor.

附图说明 BRIEF DESCRIPTION

[0027]图I是发明交互编辑系统的结构图,箭头指向为指令与数据传输方向; [0027] Figure I is a block diagram of the interactive editing system of the invention, with the arrow pointing to the instruction data transmission direction;

[0028] 图2是图像界面布局图,A是左影像浏览窗口,B是右影像浏览窗口,C是控制点数据列表,D是当前位置十字标准线; [0028] FIG 2 is a layout view of the graphical interface, A is the left image browser window, B is a right image browsing window, C is a list of the control point data, D is a standard line current position of the cross;

[0029] 图3是通用力反馈游戏手柄的按键布局图; [0029] FIG. 3 is a general force feedback joystick button layout view;

[0030] 图4是本发明交互编辑方法的运行流程图。 [0030] FIG. 4 is a flowchart of the operation of the interactive editing method of the present invention.

具体实施方式 detailed description

[0031] 下面结合附图和实施例对本发明进行详细的描述。 Drawings and embodiments of the present invention will be described in detail [0031] below in conjunction.

[0032] 为实现以上目的,本发明应配备如下硬件: [0032] To achieve the above object, the present invention should be equipped with the following hardware:

[0033] I、计算机主机,通用显示设备(包括兼容的显示器或投影仪等),通用鼠标(包括兼容的鼠标、数位绘图板、触摸板等),以及系统兼容的键盘; [0033] I, the host computer, universal display device (monitor or projector comprising compatible like), general mouse (including compatible mouse, digital drawing board, touch pad, etc.), as well as compatible keyboard;

[0034] 2、与计算机硬件接口(如1394、USB、C0M、打印机接口或蓝牙等无线接口)相连的的通用力反馈手柄:作为输入设备用于控制点编辑操作。 General force feedback handle [0034] 2, with computer hardware interface (e.g. 1394, USB, C0M, printer interface, or a Bluetooth wireless interface, etc.) connected to: an input device for controlling the editing point.

[0035] 在计算机操作系统的支持下还应包括如下软件处理系统: [0035] The software also comprises a processing system with the support of computer operating systems:

[0036] I、中央处理模块,用于协调各个模块之间的数据传输以及功能调度; [0036] I, the central processing module, data transfer, and for coordinating scheduling between various functional modules;

[0037] 2、数据处理模块,用于管理影像数据与控制点数据,并负责主要算法的实现; [0037] 2, a data processing module, for managing the image data and control point data, and is responsible for implementing the main algorithm;

[0038] 3、信息指令模块,与上述游戏手柄配伍工作,用于获取硬件状态参数,转换为用户指令,使软硬件协同工作; [0038] 3, command module information, work with the above-described game controller compatibility, for obtaining hardware status parameter, is converted to a user instruction, so that the hardware and software to work together;

[0039] 4、图形界面模块,用于查看影像数据、控制点数据以及监控用户操作响应。 [0039] 4, graphical interface module, the image data for viewing, monitoring, and control point data in response to a user operation.

[0040] 上述结构以及数据或指令传输方向如图I所示。 [0040] The instructions or data structures and transmission direction as shown in Figure I. [0041] 为了配合与硬件工作,本发明所涉及的软件模块应分别包含以下功能: [0041] In order to work with the hardware and software modules according to the present invention should contain the following functions respectively:

[0042] (I)中央处理模块维护实时的用户操作状态信息,并负责其他软件模块之间的指令数据的格式转换与转发。 [0042] (I) a central processing module maintains a real-time status information of the user operation, and for forwarding the command data format conversion between the other software modules. 同时,该模块在用户操作异常(如移动、缩放指令越界)或检测到当前图像控制点包含异常(如控制点残差超限)时,对信息指令模块发出指令,使手柄产生力反馈响应。 Meanwhile, in the abnormal module user operation (such as moving, scaling instruction bounds) or the detection of a current image containing the abnormal control points (control points residual gauge), the instruction information instructs the module, the handle a force feedback response.

·[0043] (2)当该装置处于工作状态时,数据处理模块维护影像数据及已有的控制点数据信息,可接受编辑指令并相应对控制点编辑,包括添加、删除以及修改等。 * [0043] (2) when the device is in operation, the data processing module maintains the existing image data and control point data, and pharmaceutically editing instruction corresponding to the control point editing, including adding, deleting and modifying the like. 同时该模块包含几何函数模型以及解算功能,可以通过已有控制点估计选定几何模型的模型参数,并给出每个控制点的残差值。 Meanwhile, the module comprises a model function of the geometry and function solver, the model parameters can be estimated selected geometric model, and the residual values ​​of each control point is given by the existing control point.

[0044] (3)信息指令模块按照一定频率获取游戏手柄的摇杆以及按键的当前状态,并通过分析,以及比对其上个时间片的手柄状态,将其转换为中央处理模块可直接识别的指令消息,并将其发往中央处理模块。 [0044] (3) obtaining module instruction information according to a certain frequency of the game controller and the current state of the rocker button, and by analyzing and comparing its handle state time sheet to convert it to the central processing module may directly identify instruction message, and sent to the central processing module. 同时它也从操作系统中得到鼠标或键盘等通用输入设备的指令,转为统一指令格式发送给中央处理模块。 It also instructed universal input device such as a mouse or keyboard from the operating system, to a central processing module into a unified instruction format. 同时,该模块亦可从中央处理模块中获取力反馈指令,将其发送至手柄摇杆。 Meanwhile, the unit may also acquire a force feedback command from the central processing module, send it to the rocker lever.

[0045] (4)图形界面模块维护显示状态数据(包括当前的显示区域,缩放比例),模块以一定的刷新率对计算机显示设备发送显示指令,使显示设备按照其维护的显示状态显示图像数据以及控制点标记。 [0045] (4) a graphical interface module maintains a display state data (including the current display area, scaling), a certain refresh rate module computer display apparatus transmitting a display instruction to cause the display device to display image data according to the display state of maintenance and a control point marker. 该模块从中央处理模块获取指令,改变其显示状态信息,界面布局如图2所示,图中,A区是左边影像的显示窗口,B区是右影像的显示窗口,C区是控制点数据列表,D是当前位置十字标准线。 The module acquisition instruction from the central processing module, change its display status information, as shown in FIG interface layout, figure, A is the area of ​​the image on the left display window 2, B is a window area of ​​the right image, C is the control point data region list, D is the current position of the cross line standards.

[0046] 软件模块中配套的运行模式应至少包含浏览模式与编辑模式,在显示设备中显示出浏览界面与编辑界面两种工作状态,浏览模式用于浏览查看影像数据,并可进行控制点的添加与删除;编辑模式用于对图像控制点进行编辑修改。 [0046] software modules supporting the operating mode should contain at least browse mode and edit mode, showing two operating states and editing screen browser interface in a display device, browse mode to view the image data for browsing, and a control point Add and delete; editing mode control points for image editing changes.

[0047] 带有硬件接口的通用力反馈手柄,是一种常见的游戏手柄,手柄内包含有可被计算机修改的寄存器,手柄通过该寄存器内电平,控制马达转速以实现力反馈功能。 [0047] Universal a handle with a force feedback interface hardware, is a common game handle, the handle comprising a computer registers may be modified, within the handle by a register level, the control motor speed to achieve a force feedback. 手柄的外表至少带有两个摇杆和14个按键。 An outer handle with at least two buttons 14 and rocker. 手柄上左、右两摇杆的功能在浏览模式与编辑模式下都设置为左、右影像移动;14个按键的功能可由用户自定义,其默认按键功能在两种模式下的功能如下表所示,按键编排顺序如图3所示。 The handle left and right rocker function Browse mode and editing mode are set to the left and right movement of the image; 14 function keys can be user-defined, the default function key functions in two modes in the following table shown, the button arrangement order shown in FIG.

[0048] 按键功能表: [0048] Key Functions:

[0049]按键序号_浏览模式_编辑模式_ [0049] The browse mode button number _ _ _ edit mode

切换下个控制点为当前查看控I _ ... See the next control point switching control current I _ ...

1 ^ 切换下个控制点为当則编辑控制点制点 ^ 1 under control switching point when the edit point the control point system

2 缩小左影像 同时缩小左右影像 2 reduced left image while reducing the left and right images

切换下个控制点为当前查看控^ ^ . Switching the control points for the current control See ^ ^.

3 切换下个控制点为当則编f耳控制点制点 3 switches the control point when the control point system ear knitting point f

4 缩小右影像 同时放大左右影像 4 an enlarged while narrowing the right image around the image

5 持续按下等待确认删除控制点 微调左影像向厶移动 5 Press and hold to wait to confirm the deletion of control points to fine-tune the image to the left to move Si

6 持续按下等待确认添加控制点 微调左影像向左移动 6 Keep pressed wait for confirmation add control points to fine-tune the left image moves to the left

双击删除当前查看的图像控制, Double-click to delete currently viewed image control,

7 ^ ^ 微调右影像向右移动点(6键按下时) ^ 7 ^ trimming right image point moves to the right (by pressing the key 6)

双击添加当前位置为图像控制, Double-click Add current image position control,

8 ^^ I 微调右影像向左移动点(5键按下时) 8 ^^ I moved to the left and right images trimming point (5 key is pressed)

9 切换到编辑模式 浏览编辑模式 9 switch to edit mode browser edit mode

10 撤销前次编辑操作(需耍双击)撤销前次编辑操作 10 undo previous editing operation (double click playing required) undo a previous editing operation

11 放大左影像 微调左影像向上移动 Amplifying the left image 11 is moved upward left image trimming

12 缩小左影像 微调左影像向下移动 12 narrow left to fine-tune the image moves down the left image

13 放大右影像 微调右影像向上移动 13 an enlarged right image trimming the right image is moved upward

14 缩小右影像_微调右影像向下移动_ 14 _ right image reduction trimming the right image is moved downward _

[0050] [0050]

[0051] 影像控制点交互编辑的方法流程如图4所示,主要包含硬件连接、系统初始化、数据载入、数据显示刷新、输入状态检测、指令转换与传递、数据修改等步骤。 [0051] The method of controlling an image point interactive editing process shown in Figure 4, mainly includes hardware connection, system initialization, data load, data display refresh, input state detection, conversion and transmission of instructions, data modification and other steps.

[0052] (I)计算机主机与显示设备、鼠标、键盘、通用力反馈手柄连接;在计算机操作系统内预先或现时安装手柄厂商提供的驱动程序; [0052] (I) and the host computer display device, a mouse, a keyboard, a universal handle connecting force feedback; pre-install the driver handle or current supplied by the manufacturer in the computer operating system;

[0053] (2)在操作系统上运行配套软件程序,由系统的信息指令模块检测手柄的连接状态,若手柄连接状态良好,则打开与手柄的数据通信接口,并不断维护该接口;若在初始(包括程序运行中)手柄连接异常则向中央处理模块发出程序挂起指令,提示用户正确连接手柄,直到连接良好; [0053] (2) Run supporting software program on the operating system, the connection state information command module detects handle system, if the handle is attached in good condition, is opened with the data communication interface of the handle, and constant maintenance of the interface; if initial (including program run) is issued to the handle connecting abnormal program pending instruction central processing module, connected to prompt the user to properly handle until the connection is good;

[0054] (3)用户设置初始显示比例与显示位置信息; [0054] (3) the user setting initial display ratio display position information;

[0055] (4)中央处理模块接收用户打开影像数据或控制点数据的指令,将其发送至数据处理模块,由数据处理模块载入数据;当数据中包含已有控制点时,数据处理模块根据用户选定的几何模型关系进行参数解算,并计算每个控制点在选定函数关系下的残差; [0055] (4) a central processing module receives the user image data or instructions to open the control point data, and transmits it to the data processing module, data loaded by the data processing module; when the data is included in the existing control point, the data processing module solver parameters selected by the user according to the geometric relationship model, and calculates a residual at each control point of a selected function;

[0056] (5)中央处理模块将附加显示比例与显示位置信息(初始信息可由用户设置)的指令发送至图形界面模块,图形界面模块从数据处理模块中获取图像数据块以及该区域内包含的控制点,控制显示设备将其显示出来;同时图形界面模块从数据处理模块中获取控制点数据,并将其在数据列表中显示;[0057] (6)手柄进入工作状态后,信息指令模块实时检测手柄的连接状态,手柄寄存器内实时更新按键和摇杆所处的状态,该状态可随时被计算机通过硬件接口获取;同时,手柄内寄存器可被计算机系统修改,手柄可通过该寄存器内电平控制马达转速以实现力反馈功倉泛; [0056] (5) an additional central processing module transmits display scale and display position information (initial information provided by the user) a command to the graphic interface module, graphical interface module acquires the image data from the block and the region included in the data processing module control point, controls the display device to display it; the same graphical interface control point module obtaining data from the data processing module, and displays the data list; after [0057] (6) grip into operation, real-time information command module detecting the connection state of the handle, the handle status register is updated in real time in which the buttons and joystick, in this state ready to be acquired by the computer interface hardware; Meanwhile, the register may be modified within the handle computer system can handle within the register level controlling a force feedback motor speed to achieve a pan-power cartridge;

[0058] (7)当数据载入后,信息指令模块开始以一定频率检测手柄按键与摇杆的操作状态,并将其存入模块内,参照预定义的按键功能分配表,通过比对时间片之间的手柄状态,判定手柄上特定的按键是否完成了双击或单击操作,或者是否处于持续按下的状态,并将该信息转换为对应的功能指令,发送给中央处理模块; [0058] (7) When the data is loaded, the instruction information detecting module starts at a frequency controller buttons and the operation state of the joystick, and stores it in the module, with reference to a predefined function key allocation table, by aligning time state between the sheets of the handle, the handle is determined whether or not the particular key click or double-click operation, or continuously pressed is in a state, and converts the information corresponding to the function command, sent to the central processing module;

[0059] (8)中央处理模块在接受指令后判定指令内容,若为数据修改信息,则将其传递给数据处理模块,由数据处理模块进行响应;若指令包含图形显示变更信息,则更新中央处理模块内部的视图信息,并将其传递至图形界面模块;若指令被判定为操作异常时,处理模块则不转发该指令,而根据预定义的操作异常的类别向信息指令模块发出对应强度的力反馈指令,由信息指令模块控制手柄产生震动以提示用户; [0060] (9)当中央处理模块接收到当前控制点切换指令时,则将当前显示位置调整至更新后的当前控制点处,通知图形界面模块更新显示;同时从数据处理模块中获取该控制点残差信息,若判定控制点残差超限,则根据残差的超限程度对信息指令模块发出相应强度力反馈指令,由信息指令模块控制手柄产生震动以提示用户; [0059] (8) a central processing module determines the instruction content after receiving the instruction, if the modification information data, it is passed to a data processing module, by the data processing module to respond; If the instruction includes a graphics display changing information, then updates the central internal view information processing module, and passes it to the graphic interface module; if the operation instruction is determined to be abnormal, the processing module does not forward the instruction, and the class information sent to the command module corresponding to the intensity abnormality according to a predefined operation a force feedback command, the control handle vibrates to prompt the user information by the instruction module; [0060] (9) when the central processing module receives the current switching command control point, then the current is adjusted to the position of the control point at the current updated, update notification graphical interface display module; simultaneously obtaining residual information from the control point data processing module, when it is determined the residual gauge control point, the intensity of the force feedback to issue the corresponding command module instruction information from the residual degree of overrun by a control command module handle information to prompt the user to vibrate;

[0061] (10)数据处理模块收到控制点编辑指令时执行指令,并通过中央处理模块通知图形界面模块更新控制点数据显示; Executing instructions [0061] (10) a data processing module receives the control point editing instruction, and notifies the control point graphical user interface module updates the data displayed by the central processing module;

[0062] (11)当编辑工作完成时,由用户发出数据关闭指令,中央处理模块则向数据处理模块发出消息,由数据处理模块将计算机内存的控制点数据保存至外存储设备中;同时向图形界面模块发出指令,使其清空图像显示与控制点列表,并进入挂起状态停止刷新显示。 [0062] (11) when the editing work is completed, issues a data closing command by the user, the central processing module sending a message to the data processing module will be saved to an external storage device by the data processing module computer memory control point data; simultaneously GUI module gives an instruction so that image display and clear the list of control points, and enters the suspend state to refresh the display is stopped.

[0063] 下面以Microsoft Windows 7 32位操作系统构建的系统与软件接口为例解释本发明具体实施方式: [0063] In the following Microsoft Windows 7 32-bit operating system and a software interface system constructed to explain an example embodiment of the present invention DETAILED DESCRIPTION:

[0064] (I)选用USB接口的通用力反馈游戏手柄,按键布局如图3所示,将其连接到计算机对应硬件接口,并在计算机上安装手柄厂商提供的驱动程序; [0064] (I) selected generic USB interface force feedback game pad, the key layout shown in Figure 3, connect it to the corresponding hardware interface to the computer, and install the driver handle vendors on the computer;

[0065] (2)在软件接口中通过操作系统扩展功能提供的DirectInput初始化游戏手柄设备; [0065] (2) via the software interface provided by the operating system extension DirectInput game controller device initialization;

[0066] (3)在软件接口中设置计时器,以固定时间频率(每20毫秒一次)向DirectInput发出请求,获取当前游戏手柄的按键与摇杆操控状态; [0066] (3) a timer provided in the software interface, at fixed time frequency (every 20 milliseconds) to DirectInput request, obtain the current game pad buttons and joystick control state;

[0067] (4)将获取的手柄状态通过软件接口中的解释器进行解释,把按键指令转换为消息指令(如按键单击,按键双击,按键长按等); [0067] (4) the state of the acquired handle explained by interpreter software interface, the switch button command instruction message (e.g., key click, double-click buttons, press buttons, etc.);

[0068] (5)将消息指令发送给上层编辑软件指令接口,由上层编辑软件指令接口响应用户指令,并反应在图形界面上; [0068] (5) A message command to the upper layer editing software command interface, by the upper layer editing software command interface response to user commands, and the reaction on the graphical interface;

[0069] (6)编辑软件检测到用户操作出现错误,或当前查看图像控制点出现异常时发出反馈指令,由DirectInput控制手柄根据固定模式产生一组力反馈响应; [0069] (6) editing software user error is detected, or the current control point to see the image abnormal feedback command issued, the control handle to generate a set of DirectInput force feedback response according to a fixed pattern;

[0070] 步骤(5)中的编辑软件指令接口为通用接口,可兼容响应通用键盘鼠标的操作和手柄的操作,在手柄接口出现故障或功能缺陷时,由键盘鼠标完成工作。 [0070] Step editing software instructions (5) of the interface is a generic interface, in response to operation of the operation and compatible with the universal handle keyboard and mouse, when failure or dysfunction in the handle interface, to complete the work by the keyboard and mouse.

[0071] 上述实施例仅用于说明本发明,其中局部的结构、连接方式、操作步骤等都是可以有所变化的,凡是在本发明技术方案的基础上进行的等同变换或改进,均不应排除在本发明的保护范围之外。 [0071] The above-described embodiments are merely illustrative of the invention, wherein the local configuration, connection, etc. are the steps may be varied, and all equivalents transformation performed on the basis of the technical solution of the present invention or improvements, not should be excluded from the scope of the present invention.

Claims (9)

  1. 1. 一种影像控制点交互编辑的方法,其特征在于,主要包含如下操作步骤: (1)硬件连接:将计算机与显示设备、鼠标、键盘、通用力反馈手柄连接,其中,所述计算机中装有手柄驱动程序,以及装有在操作系统支持下的由中央处理模块、数据处理模块、信息指令模块、图形界面模块构成的应用软件系统,在系统中至少包含浏览与编辑两种运行模式;所述手柄内包含有可被计算机修改的寄存器,所述寄存器通过电平控制马达转速实现力反馈;所述手柄的外表至少带有两个摇杆和14个按键,摇杆的功能和按键功能已由用户预先自定义; (2)打开计算机,运行软件系统,由系统的信息指令模块检测手柄的连接状态,若手柄连接状态良好,则打开与手柄的数据通信接口,并不断维护该接口;若手柄连接异常则向中央处理模块发出程序挂起指令,提示用户正确 An image editing method for interactive control points, characterized in that, mainly comprises the following steps: (1) hardware connection: a computer connected to a display device, a mouse, a keyboard, a handle general force feedback, wherein said computer with a handle driver, and a module by the central processing module, a data processing module, command information, application software module configuration of a graphical interface with the support of the operating system, the system comprising at least two modes of operation for viewing and editing; within the handle comprising a computer registers may be modified, to realize the force feedback motor speed control register via the level; appearance of the handle and having at least two rocker buttons 14, function buttons and joystick functions defined by the user in advance from; (2) Turn on the computer, operating system software, the connection status detection module handle command system, if the connection is good handle, the handle opening and the data communication interface, and constant maintenance of the interface; If the handle is connected to a program exception is issued pending instruction central processing module, the correct user is prompted 连接手柄,直到连接良好; (3)用户设置初始显示比例与显示位置信息; (4)中央处理模块接收用户打开影像数据或控制点数据的指令,将其发送至数据处理模块,由数据处理模块载入数据;当数据中包含已有控制点时,数据处理模块根据用户选定的几何模型关系进行参数解算,并计算每个控制点在选定函数关系下的残差; (5)中央处理模块将附加显示比例与显示位置信息的指令发送至图形界面模块,图形界面模块从数据处理模块中获取图像数据块以及该区域内包含的控制点,控制显示设备将其显示出来;同时图形界面模块从数据处理模块中获取控制点数据,并将其在数据列表中显示; (6)手柄进入工作状态后,信息指令模块实时检测手柄的连接状态,手柄寄存器内实时更新按键和摇杆所处的状态,该状态随时被计算机通过硬件接口获取;信息异常时, Connecting the handle until the connection is good; (3) the user setting initial display ratio display position information; (4) a central processing module receives the user opens the video data or instruction from the control point data, and transmits it to the data processing module, by the data processing module Loading data; when the data is included in the existing control point, the data processing module solver parameters selected by the user according to the geometric relationship model, and calculates the residuals for each control point as a function of a selected; (5) central the command processing module and an additional display scale display position information is transmitted to the graphic interface module, graphical interface module acquires the image data blocks, and a control region comprising a point from the data processing module controls the display device to display it; the same graphical interface control point module obtaining data from the data processing module, and displays the data list; (6) grip into the working state, the connection state information of real-time detection instruction module handle, the handle and the rocker key register updated in real time in which state, the state is always obtained by the interface hardware of the computer; abnormal information, 寄存器通过电平控制马达转速实现力反馈; (7)当数据载入后,信息指令模块开始以一定频率检测手柄按键与摇杆的操作状态,并将其存入模块内,参照预定义的按键功能分配表,通过比对时间片之间的手柄状态,判定手柄上特定的按键是否完成了双击或单击操作,或者是否处于持续按下的状态,并将该信息转换为对应的功能指令,发送给中央处理模块; (8)中央处理模块在接受指令后判定指令内容,若为数据修改信息,则将其传递给数据处理模块,由数据处理模块进行响应;若指令包含图形显示变更信息,则更新中央处理模块内部的视图信息,并将其传递至图形界面模块;若指令被判定为操作异常时,处理模块则不转发该指令,而根据预定义的操作异常的类别向信息指令模块发出对应强度的力反馈指令,由信息指令模块控制手柄产生震动以提示用 Force feedback control registers implemented by the motor speed level; (7) When the data is loaded, the instruction information detecting module starts at a frequency controller buttons and the operation state of the joystick, and store it in the module, with reference to a predefined key function allocation table, by comparing the state between the time slice of the handle, the handle is determined whether or not the particular key click or double-click operation, or continuously pressed is in a state, and converts the information into a corresponding function instructions, sent to the central processing module; (8) a central processing module determines the instruction content after receiving the instruction, if the modification information data, it is passed to a data processing module, by the data processing module to respond; If the instruction includes a graphics display changing information, update the view inside the central information processing module, and passes it to the graphic interface module; if the operation instruction is judged to be abnormal, the instruction does not forward processing module, and an abnormal categories according to a predefined operating information to the instruction module corresponding to the intensity of a force feedback command, the control command module information by the handle to vibrate presentation ; (9)当中央处理模块接收到当前控制点切换指令时,则将当前显示位置调整至更新后的当前控制点处,通知图形界面模块更新显示;同时从数据处理模块中获取该控制点残差信息,若判定控制点残差超限,则根据残差的超限程度对信息指令模块发出相应强度力反馈指令,由信息指令模块控制手柄产生震动以提示用户; (10)数据处理模块收到控制点编辑指令时执行指令,并通过中央处理模块通知图形界面模块更新控制点数据显示; (11)当编辑工作完成时,由用户发出数据关闭指令,中央处理模块则向数据处理模块发出消息,由数据处理模块将计算机内存的控制点数据保存至外存储设备中;同时向图形界面模块发出指令,使其清空图像显示与控制点列表,并进入挂起状态停止刷新显示。 ; (9) when the central processing module receives the active control switching instruction, the current display at the current position of the control point was adjusted to the update, the update notification module graphical display; residues simultaneously obtaining the control point data from the processing module difference information, if it is determined the residual gauge control point, issuing from the residual gauge the degree of intensity of the force corresponding to the command module information feedback command, the control command module handles the information to prompt the user to vibrate; (10) receiving the data processing module perform a control point editing instruction, and notifies the GUI module updates the control point data by the central processing module; (11) when the editing work is completed, sent by the user data closing command, central processing module sending a message to the data processing module by computer data processing module will be saved to the memory of the control point data of the external storage device; simultaneously issue commands to the graphical user interface module, so that the clear image display control point list, and enter the suspend state to refresh the display is stopped.
  2. 2.如权利要求I所述的影像控制点交互编辑的方法,其特征在于,所述浏览模式是指浏览查看影像数据,并可进行控制点的添加与删除;所述编辑模式是指对图像控制点进行编辑修改。 2. The image editing method of interactive control points according to claim I, wherein the browsing mode that a browser to view the video data, and can be added and deleted control point; refers to the image editing mode control point edit it.
  3. 3.如权利要求I所述的影像控制点交互编辑的方法,其特征在于,所述手柄上左、右两摇杆的作用在浏览模式与编辑模式下都设置为左、右影像的移动。 The method of controlling an image point of the interactive editing of I as claimed in claim 3, wherein the handle on the left and right rocker role in the browse mode and the edit mode are set to move the left and right images.
  4. 4.如权利要求I所述的影像控制点交互编辑的方法,其特征在于,所述通用鼠标键盘也通过硬件接口与计算机连接,在手柄出现故障时,由鼠标键盘代替工作。 4. The method of controlling an image point interactive editing of claim I, wherein the mouse and keyboard is also connected via universal hardware interface with the computer, the handle fails at the work place of the mouse and keyboard.
  5. 5. 一种实现所述影像控制点交互编辑方法的交互编辑系统,它包括通用PC计算机、显示设备、鼠标、键盘,其特征在于:还包括与计算机连接的力反馈手柄、在计算机操作系统支持下的软件处理模块,所述软件处理模块包括中央处理模块、数据处理模块、信息指令模块、图形界面模块; 所述中央处理模块和数据处理模块相连进行数据指令互递,和信息指令模块相连进行输入信息指令互递,和图形界面模块相连进行图像数据显示指令传递;所述信息指令模块与计算机操作系统和手柄相连,得到计算机操作系统的支持,将手柄接口信息进行转化; 所述图形界面模块与显示设备相连,进行图像输出; 所述力反馈手柄通过硬件接口与所述信息指令模块相连,手柄内包含有可被计算机修改的寄存器,所述寄存器通过电平控制马达转速实现力反馈;所述手柄 A control point implementing the interactive image editing method of interactive editing system, which includes a general purpose computer PC, a display device, a mouse, a keyboard, characterized by: further comprising a force feedback handle connected to the computer, the computer operating system support software processing modules in a software processing module includes a central processing module, a data processing module, information instruction module, graphical interface module; said central processing module and a data processing module for mutual data delivery instruction, and the instruction module is connected for information mutual handover instruction input information, graphical interface module and connected to the image data transfer instruction; the instruction information module connected to the computer operating system and a handle, the support computer operating system will handle the interface conversion information; the graphical interface module connected with the display device, an image output; the handle is connected to a force feedback interface hardware module with the instruction information, the handle comprising a computer can be modified to a register control motor speed feedback force level achieved; the said handle 外表至少带有两个摇杆和14个按键,摇杆的功能和按键功能由用户预先自定义。 And having at least two outer rocker buttons 14, function buttons and joystick functions previously defined by the user.
  6. 6.如权利要求5所述的影像控制点交互编辑系统,其特征在于:所述力反馈手柄与计算机通过1394接口、USB接口、COM接口、打印机接口或蓝牙接口连接。 Interactive image editing system control point as claimed in claim 5, characterized in that: the handle and the force feedback computer through the interface 1394, USB interfaces, COM interfaces, a printer interface or a Bluetooth interface.
  7. 7.如权利要求5或6所述的影像控制点交互编辑系统,其特征在于:所述力反馈手柄的两个摇杆分别控制两个影像的移动。 7. The control point interactive video editing system of claim 5 or claim 6, wherein: the two force feedback joystick control handle, respectively the movement of two images.
  8. 8.如权利要求5所述的影像控制点交互编辑系统,其特征在于:所述图形界面模块显示浏览模式和编辑模式两种界面。 8. The interactive video editing system control point as claimed in claim 5, wherein: the graphical display interface module browsing mode and editing mode both interfaces.
  9. 9.如权利要求5所述的影像控制点交互编辑系统,其特征在于:所述鼠标键盘也通过硬件接口与计算机连接。 Video interactive control point editing system according to claim 9, wherein: the mouse and keyboard is also connected with the computer through the hardware interface.
CN 201210185496 2012-06-07 2012-06-07 Method and system for interactive editing of image control points CN102722250A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201210185496 CN102722250A (en) 2012-06-07 2012-06-07 Method and system for interactive editing of image control points

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201210185496 CN102722250A (en) 2012-06-07 2012-06-07 Method and system for interactive editing of image control points

Publications (1)

Publication Number Publication Date
CN102722250A true true CN102722250A (en) 2012-10-10

Family

ID=46948045

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201210185496 CN102722250A (en) 2012-06-07 2012-06-07 Method and system for interactive editing of image control points

Country Status (1)

Country Link
CN (1) CN102722250A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104424073A (en) * 2013-08-21 2015-03-18 联想(北京)有限公司 Information processing method and electronic equipment

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1166220A (en) * 1995-10-09 1997-11-26 任天堂株式会社 Stereo image processing system
CN101101674A (en) * 2007-07-23 2008-01-09 武汉大学 RPC model forward transform method
CN101750606A (en) * 2009-11-24 2010-06-23 中国科学院对地观测与数字地球科学中心 Automatic and moderate orthographic projection correction method of satellite remote sensing image
CN101879375A (en) * 2009-05-06 2010-11-10 鼎亿数码科技(上海)有限公司;鼎亿公司 Mobile-phone game handle based on Bluetooth transmission and realization method thereof
WO2011069120A1 (en) * 2009-12-03 2011-06-09 Cedars-Sinai Medical Center Method and system for plaque characterization

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1166220A (en) * 1995-10-09 1997-11-26 任天堂株式会社 Stereo image processing system
CN101101674A (en) * 2007-07-23 2008-01-09 武汉大学 RPC model forward transform method
CN101879375A (en) * 2009-05-06 2010-11-10 鼎亿数码科技(上海)有限公司;鼎亿公司 Mobile-phone game handle based on Bluetooth transmission and realization method thereof
CN101750606A (en) * 2009-11-24 2010-06-23 中国科学院对地观测与数字地球科学中心 Automatic and moderate orthographic projection correction method of satellite remote sensing image
WO2011069120A1 (en) * 2009-12-03 2011-06-09 Cedars-Sinai Medical Center Method and system for plaque characterization

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104424073A (en) * 2013-08-21 2015-03-18 联想(北京)有限公司 Information processing method and electronic equipment

Similar Documents

Publication Publication Date Title
US5448263A (en) Interactive display system
US6141000A (en) Projection display system with touch sensing on screen, computer assisted alignment correction and network conferencing
US20100283747A1 (en) Methods for use with multi-touch displays for determining when a touch is processed as a mouse event
CN201294037Y (en) Controlled equipment, control terminal and remote-control system
US20100188352A1 (en) Information processing apparatus, information processing method, and program
US20060103508A1 (en) Remote-control system, remote-control apparatus, apparatus to be controlled, remote-control method, computer program, and storage medium
US8358327B2 (en) CODEC-driven touch screen video conferencing control system
CN101753878A (en) Remote control method for touch screen remote controller
CN102346647A (en) Control method and system of projector
CN102184014A (en) Intelligent appliance interaction control method and device based on mobile equipment orientation
JPH09116985A (en) Remote controller, remote control method and device
CN102404641A (en) Method and system for remotely controlling television by using smart phone
CN101840299A (en) Touch operation method, device and mobile terminal
CN1630246A (en) A method for realizing remote desktop data acquisition
CN102819398A (en) Method for slidingly controlling camera via touch screen device
CN102665094A (en) Test method of set-top box and test system thereof
CN103226454A (en) Method and system for achieving multiscreen display
CN201278211Y (en) Remote controller with touch screen and camera
KR100980741B1 (en) A remote controller and a method for remote contrlling a display
US20120146884A1 (en) Control transfer apparatus, control transfer system and method thereof
JPH1021036A (en) Interactive video input and output system
CN102215426A (en) Smart television set-top box controlled by tablet personal computer or smart phone
CN101324804A (en) Large-screen interactive electronic white board and interactive method thereof
CN202907114U (en) A TV set system based on a touch remote control device
CN102611858A (en) Remote control method of multi-mode remote controller, remote controller, user terminal and system

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
ASS Succession or assignment of patent right

Free format text: FORMER OWNER: LIU LIU

Effective date: 20130410

Owner name: WUHAN TIANMU GINWAVE CO., LTD.

Free format text: FORMER OWNER: HE XIAO

Effective date: 20130410

C41 Transfer of patent application or patent right or utility model
C02 Deemed withdrawal of patent application after publication (patent law 2001)