JP2010287169A - Apparatus and method for converting event - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the problem of user inconvenience with an operation with a pointing device of content described on the premise of remote control operation. <P>SOLUTION: A pointer movement part 413 into which information on an operation with a pointing device 411 has been input via an I/O driver 412 controls a pointer movement on a screen of content premised on remote control operation which has been obtained via a content management part 401. A pointer movement direction determination part 414 analyzes information on a pointer movement locus stored in a memory 415 by a pointer coordinate management part 416 to convert it into information on a key event, and generates the converted key event via a key event generation part 431. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to an event conversion apparatus and an event conversion method for converting an event related to an operation by a pointing device.

  In recent years, various devices and services aiming at fusion of broadcasting and communication have become widespread. For example, a television receiver that displays content provided from the Internet, provided with a communication unit that acquires content provided via the Internet, a Web browser that displays the acquired content, and the like is provided by digital broadcasting. For example, a service that provides data broadcasting content via the Internet in a form that can be handled by a program executed by a personal computer.

  By the way, data broadcasting contents in digital television broadcasting are described in BML (Broadcast Markup Language; hereinafter referred to as BML). “Data broadcasting encoding and transmission methods in digital broadcasting” issued by the Japan Radio Industry Association Defined in ARIB STD-B24 5.2 edition. BML is a description language based on HTML and Java (registered trademark) Script as well as contents provided from the Internet.

  Since data broadcasting is assumed to be displayed on a television receiver, BML used for data broadcasting content description is controlled by a remote control generally used for operating the television receiver. It is assumed.

  That is, in BML, an event based on pressing of an up / down / left / right key provided in a remote control is defined, but an event based on an operation by a pointing device such as a mouse is not defined.

Therefore, a technique is expected that enables the operation of content described in BML to be operated by a pointing device.
For example, according to Patent Document 1, a time interval of occurrence of a cursor movement event corresponding to an operation of a pointing device is measured, and when the occurrence of an event does not occur for a certain time or longer, based on the current cursor position coordinates. A method for extracting a moving direction and converting it into a direction key event by remote control operation based on the extracted moving direction is disclosed.

Japanese Patent Laid-Open No. 10-011222 (paragraph 0022-0025 in FIG. 1)

  However, in Patent Document 1, there is a possibility that direction key event conversion cannot be performed in a state where a cursor movement event occurs within a predetermined time interval, that is, in a state where the cursor continues to move without stopping. In other words, the direction key event conversion cannot be appropriately executed while continuously moving the pointing device. For example, when a direction key event corresponding to the up direction key of the remote controller is generated a plurality of times continuously, it is necessary to repeatedly move and stop the pointing device a plurality of times, and the operation is complicated.

  In addition, when it is detected that the cursor has stopped after moving in an unintentional direction due to an erroneous operation of the pointing device, the direction key event conversion in this unintentional direction is executed. There is a possibility that the key event will be converted in an unintended direction.

  Accordingly, in order to solve the above-described problems, the present invention has an object to provide an event conversion apparatus and an event conversion method that are convenient for a user and that can execute a key event operation by operating a pointing device. And

  In order to solve the above-described problems, the present invention provides pointer moving means for moving a pointer on a screen in response to an operation by a pointing device, and the pointer moving means on a command-type operation screen controlled by an operation by a remote controller. The trajectory information storage means for storing the trajectory information pointed to by the pointer to be moved in association with the time series of the movement of the pointer, and the command corresponding to the direction key of the remote controller based on the trajectory information stored by the trajectory information storage means Information conversion means generated by converting the information into an information conversion means, and operation execution means for executing an operation corresponding to the command converted by the information conversion means.

  Further, in order to solve the above-described problems, the present invention provides a pointer moving means for moving a pointer on the screen in accordance with an operation by a pointing device, and a pointer to be moved on a command type operation screen controlled by an operation by a remote controller. Is stored in association with the time series when the pointer is moved, and is converted into a command corresponding to a direction key of a remote controller based on the stored track information, and the converted command is A corresponding operation is executed.

  According to the present invention, it is convenient for a user, and a key event operation can be executed by operating a pointing device.

The block diagram which shows the structure of the personal computer which is an event issuing apparatus which concerns on embodiment of this invention. The figure which shows an example of the screen of the data broadcast content which the personal computer which concerns on this embodiment displays. FIG. 5 is a diagram showing an example of a focus movement table according to the present embodiment. The figure which shows the structure of the program which enables the data broadcasting content described on the assumption of operation with a remote control to be operated with a pointing device. The flowchart of the process which operates the data broadcast content which concerns on this embodiment with a mouse | mouth. The detailed flowchart of an event conversion process. The graph for visually comparing the difference between the actual coordinate value of the pointer trajectory information and the coordinate value of the approximate straight line. The figure which shows a response | compatibility with the inclination of an approximate linear type | formula, and the direction of key event information. The detailed flowchart of the process which identifies and registers a button area | region. FIG. 5 is a diagram showing an example of a focus movement table according to the present embodiment. 11 is a flowchart of a key event issuing process using the focus movement table shown in FIG.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a configuration of a personal computer that is an event conversion apparatus according to an embodiment of the present invention. In this embodiment, an example in which the event issuing device is applied to a personal computer is shown. However, an HDD recorder, a DVD recorder, a television receiver, a portable mobile terminal, or the like having the same configuration as in this embodiment may be used.

  The personal computer 10 includes a CPU 20, a north bridge 30, a main memory 31, a graphics controller 32, a display 33, a south bridge 40, a BIOS-ROM 41, a hard disk drive (Hard Disk Drive; hereinafter referred to as HDD) 42, an optical disk drive (Optical). Disk Drive (hereinafter referred to as ODD) 43, a controller unit 44, a tuner unit 45, a communication unit 46, a USB_IF unit 47, an operation unit 48, and the like.

  The CPU 20 is a processor that controls the operation of the personal computer 10 and executes an operating system (hereinafter referred to as OS) and various application programs loaded from the HDD 42 to the main memory 31. The CPU 20 also executes a BIOS (Basic Input Output System; hereinafter referred to as BIOS) program stored in the BIOS-ROM 41.

  The north bridge 30 is a bridge device that is connected to the CPU 20 via a bus such as an FSB (Front Side Bus; hereinafter referred to as FSB) and further connected to the south bridge 40. The north bridge 30 communicates with the graphics controller 32 via an AGP (Accelerated Graphics Port; hereinafter referred to as AGP) bus, and is also connected to the main memory 31.

  The main memory 31 stores the OS and various application programs that are loaded from the HDD 42 and executed by the CPU 20. That is, the work memory of the CPU 20.

  The graphics controller 32 is a display controller that controls the display device 33 included in the personal computer 10, performs predetermined processing on the data of the video signal input from the north bridge 30, and outputs the processed data to the display device 33.

  The display device 33 is a display module that displays a video signal input via the graphics controller 32, and is a thin display such as an LCD (Liquid Crystal Display; hereinafter referred to as LCD). In the present embodiment, a video signal that can be operated with a mouse is displayed with respect to a video signal that is assumed to be operated with a remote controller, such as data broadcasting content in digital broadcasting. The display device 33 may be provided outside the personal computer 10.

  The south bridge 40 is a bridge device that controls various I / O devices. A tuner unit 45 is connected to the south bridge 40 via a communication bus such as PCI Express. The south bridge 40 is connected to the BIOS-ROM 41, the HDD 42, the ODD 43, the controller unit 44, the communication unit 46, and the USB_IF unit 47 via various buses.

The BIOS-ROM 41 stores a BIOS program.
The HDD 42 stores an OS and various application programs to be loaded into the main memory 31, and is also used as a work memory when the CPU 20 executes various programs. In the present embodiment, the HDD 42 stores a program for processing for converting operation information from the mouse into event information by key operation, and is also used as a work memory when executing this program.

The ODD 43 reads data from the mounted optical disk. Also, data is recorded on a recordable optical disc.
The controller unit 44 is a one-chip microcomputer in which a keyboard controller and a mouse controller for controlling the operation unit 48 are integrated. In the present embodiment, the controller unit 44 controls a mouse that is a pointing device.

  The tuner unit 45 performs channel selection and demodulation / decoding processing on a specific channel with respect to the digital broadcast wave received by the antenna AT, and outputs data including caption data in addition to the video / audio data to the south bridge 40. . In the present embodiment, the data broadcast data of the terrestrial digital broadcast wave is subjected to channel selection and demodulation / decoding processing and output.

  The communication unit 46 exchanges data with an external device connected to an information providing site connected to the Internet or a home network via a LAN or the like. In this embodiment, content data provided from the Internet and described on the assumption that it is operated by a remote controller is acquired.

  The USB_IF unit 47 communicates with the connected USB device UD based on the USB standard to exchange data. The USB_IF unit 47 according to the present embodiment exchanges data with a connected terrestrial digital broadcast receiving device or a pointing device such as a mouse.

  The operation unit 48 is a pointing device such as a keyboard and a mouse, and hereinafter, an embodiment in which a mouse is applied will be described, but a touch pad, a pen tablet, or the like can also be applied.

  With such a configuration, the personal computer 10 according to the present embodiment uses a screen that enables operation with a pointing device for video content described on the premise of operation with a remote controller such as data broadcast content, It is possible to execute processing for converting an operation with a pointing device such as a mouse into an operation with a remote controller.

First, the data broadcast content screen 210 displayed by the personal computer 10 according to the present embodiment will be described with reference to FIG.
FIG. 2 is a diagram showing an example of a data broadcast content screen displayed by the personal computer 10 according to the present embodiment.
The data broadcast content screen 210 is a graphic image that is displayed in a partial area of the graphic screen 200 displayed on the display device 33 of the personal computer 10 and is generated by an application program executed by the CPU 20.

  The data broadcasting content screen 210 includes a video display area 211, a “weather forecast” button 212, a “news” button 213, a “program guide” button 214, a “notice” button 215, a “photo list” button 216, and a “help” button. 217, an information presentation area 218, a pointer 220, and the like.

The video display area 211 is an area for displaying video of a digital broadcast program acquired via the tuner unit 45, the communication unit 46, the USB_IF unit 47, and the like.
The “weather forecast” button 212, “news” button 213, “program guide” button 214, “notification” button 215, “photo list” button 216, and “help” button 217 are for presenting the corresponding information. This button is displayed so that it can be focused or selected. Then, the focused or selected button is focused or selected by highlighting by the thickness of the border line that displays the surrounding border line thickly, or by highlighting by a color that is displayed in a different color from the surrounding area. Indicates the state. Specifically, in the data broadcast content screen 210 shown in FIG. 2, the “weather forecast” button 212 is in a state of being focused or selected by highlighting with the thickness of the frame line.

  The information presentation area 218 is an area for presenting information corresponding to a button selected from the “weather forecast” button 212 to the “help” button 217. The presented information is acquired via the tuner unit 45, the communication unit 46, the USB_IF unit 47, and the like.

  The pointer 220 is a point indicating component that moves in accordance with an operation of a pointing device such as a mouse connected via the controller unit 44, the USB_IF unit 47, or the like, and points to a specific position. Specifically, the position indicated by the tip of the arrow is specified. In this embodiment, on the data broadcast content screen 210 shown in FIG. 2, the position of the pointer 220 moves not only by the operation of the pointing device but also by a program that converts the operation by the pointing device into the operation by the remote control. To do.

  In the data broadcast content screen 210 shown in FIG. 2, the “weather forecast” button 212 to the “help” button 217 are described in BML so as to be selected by an operation with the remote controller. Then, under the condition of operating with the up / down / left / right direction keys of the remote controller, the movement of the focus or selected button is defined as a focus movement table shown in FIG.

Next, FIG. 3 will be used to explain the definition of the focus movement direction of the button on the data broadcast content screen 210 shown in FIG.
Specifically, in a state where the “weather forecast” button 212 that is the region 1 is the current focus region, the focused button moves to the “notification” button 215 that is the region 4 when the up direction key is pressed. In addition, the “News” button 213 in the area 2 is pressed when the down key is pressed, the “Help” button 217 in the area 6 is pressed when the left key is pressed, and the “Photo” in the area 5 is pressed when the right key is pressed. Move to the “List” button 216.

  Also, the buttons in the areas 2 to 6 other than the “weather forecast” button 212, that is, the “news” button 213, the “program guide” button 214, the “notice” button 215, the “photo list” button 216, and the “help” button Even in the state where each of the focus areas 217 is the current focus area, the focus moves to the corresponding button in response to pressing of the up / down / left / right direction keys as in the table shown in FIG.

  However, as shown in the block diagram of FIG. 1, the personal computer 10 according to the present embodiment does not include a block for acquiring operation input information from the remote controller. The operation of the button is executed by converting the operation of the mouse connected to the controller unit 44, the USB_IF unit 47, etc. into the operation of the remote controller.

  Next, with reference to FIG. 4, for the data broadcast content described by the operation by the remote controller executed by the personal computer 10 according to the present embodiment, the operation by the pointing device is converted into the operation by the remote controller, The structure of a program for displaying a data broadcast content screen that can be operated by a pointing device will be described.

  FIG. 4 is a diagram showing the structure of a program that enables a data broadcasting content described on the premise of an operation by a remote controller to be operated by a pointing device.

  This program includes a content management unit 401, a UI engine 402, a frame buffer management unit 403, an I / O driver 412, a pointer movement unit 413, a pointer movement direction determination unit 414, a pointer coordinate management unit 416, a frame difference detection unit 421, a force. It includes a movement area management unit 422, a key event generation unit 431, an interval timer 441, and the like. Further, the main memory 31 or the HDD 42 includes memories 404, 415, 423, and the like.

  The interval timer 441 performs timer measurement based on a clock signal having a predetermined frequency input to the CPU 20 or the like, and performs a predetermined period for the frame difference detection unit 421, the pointer coordinate management unit 416, the pointer movement direction determination unit 414, and the like. An interrupt signal for executing the process is output.

  The content management unit 401 analyzes data broadcast content data acquired from the tuner unit 45, the communication unit 46, the USB_IF unit 47, and the like, and information on coordinate values and colors of GUI parts such as buttons on the screen of the content. Are extracted and output to the UI engine 402.

  The UI engine 402 outputs to the frame buffer management unit 403 display screen information for displaying a screen laid out in units of image frames based on information such as coordinate values and colors of GUI parts input from the content management unit 401. . Also, the UI engine 402 superimposes pointer display information for displaying the pointer 220 input from the pointer moving unit 413 on the display screen information.

  The frame buffer management unit 403 manages display screen information input from the UI engine 402 in units of frames and stores the information in the memory 404. The display screen information stored in the memory 404 is read at a predetermined timing and output to the display device 33.

  The memory 404 is a frame buffer that stores display screen information and displays an image of data broadcast content acquired by the content management unit 401. Furthermore, the memory 404 also stores difference area information indicating information related to different areas in the plurality of display screen information. The memory 404 is provided in the main memory 31 or the HDD 42.

  The I / O driver 412 is a program for controlling a pointing device 411 such as a mouse connected to the controller unit 44, the USB_IF unit 47, and the like. The I / O driver 412 controls the pointer 220 according to operation information input from the pointing device 411. A pointer control signal for controlling movement is output to the pointer moving unit 413.

  The pointer moving unit 413 outputs pointer display information to the UI engine 402 based on pointer control information input from the I / O driver. In addition, pointer display information based on the pointer control information input from the pointer movement direction determination unit 414 is also output to the UI engine 402.

  The pointer coordinate management unit 416 displays pointer trajectory information indicating the movement trajectory of the pointer 220 displayed on a part of the screen displayed on the display device 33 at predetermined intervals (at predetermined intervals based on an interrupt signal from the interval timer 441). Time) and store it in the memory 415 in time series. That is, the pointer trajectory information is point trajectory information for each predetermined time based on the coordinate value of the image display area of the display device 33, which is point information regarding the point indicated by the pointer 220.

  The memory 415 stores time-series pointer trajectory information acquired by the pointer coordinate management unit 416. The memory 415 is provided in the main memory 31 or the HDD 42.

  The pointer movement direction determination unit 414 reads and analyzes the pointer trajectory information stored in the memory 415 at predetermined time intervals based on the interrupt signal from the interval timer 441. Then, based on the moving direction of the pointer determined by this analysis, it is converted into key event information corresponding to information emitted from a remote controller or the like and output to the key event generating unit 431. The key event information is information for performing a screen operation in response to pressing of a direction key or a determination key provided in a remote controller or the like. Furthermore, the pointer movement direction determination unit 414 outputs pointer control information corresponding to the key event information to the pointer movement unit 413. The key event information and the pointer control information are also output to the focus movement area management unit 422.

  The key event generation unit 431 outputs key event information based on pressing of a key provided in a remote controller or the like to various functional blocks that execute screen operations. Furthermore, the key event generation unit 431 similarly outputs the key event information input from the pointer movement direction determination unit 414 to various functional blocks.

The frame difference detection unit 421 stores difference area information of a plurality of display screen information in the display screen information stored in the memory 404 in the memory 404.
When the key event information and the pointer control information are input from the pointer movement direction determination unit 414, the focus movement area management unit 422 receives display image information regarding a specific image stored in the memory 404 and the frame difference detection unit 421. Request output of difference area information. Based on the display image information and the difference area information input from the frame difference detection unit 421, button area information specified as a button on the screen is extracted and stored in the memory 423.

The memory 423 stores the button area information extracted by the focus movement area management unit 422. The memory 415 is provided in the main memory 31 or the HDD 42.
That is, according to the program structure described above, processing for operating data broadcast content described on the premise of operation by a remote controller with a mouse as a pointing device is executed.

Next, with reference to FIG. 5, a description will be given of processing for operating data broadcast content described on the premise of operation by a remote controller using a mouse.
FIG. 5 is a flowchart of processing for operating the data broadcast content according to the present embodiment with the mouse.
First, when the pointer 220 is moved and displayed on the data broadcasting content screen displayed in a partial area of the screen displayed on the display device 33, the pointer moving unit 413 moves the pointer 220 on the screen. Hide (S501).

  Next, the pointer moving unit 413 moves the pointer 220 to the center of the screen of the data broadcasting content (S502), and the interval timer 441 starts timer measurement based on the input clock signal (S503). Further, the pointer coordinate management unit 416 clears the pointer trajectory information stored in the memory 415, and the frame difference detection unit 421 clears the difference area information stored in the memory 404 (S504).

  Based on the interrupt signal from the interval timer 441, it is determined whether a predetermined time has elapsed (S505). If it has not elapsed (N in S505), the pointer coordinate management unit 416 determines the current pointer coordinate value. The current time information is acquired and the pointer trajectory information is stored in the memory 415 (S506). Then, it is determined whether the pointer control mode has been changed (S507). If the pointer control mode has been changed (Y in S507), the pointer control mode is set to the normal mode (S508), and the process is terminated.

  Note that at least two pointer control modes are defined: a normal mode and a conversion mode. The normal mode is a mode in which the pointer 220 moves in conjunction with only the operation with the mouse, that is, a general pointer control mode. The conversion mode is a mode for converting a mouse operation into a key event such as a remote control operation. When the pointer 220 moves on the data broadcasting content screen in this embodiment, the conversion mode is automatically switched to.

  On the other hand, when the pointer control mode is not changed (N in S507), the frame difference detection unit 421 acquires the display image information of the current and previous image frames stored in the memory 404, and acquires the acquired 2 The difference area information of one image frame is detected and specified, and stored in the memory 404 as difference area information ΔFB1 (S509). Then, since the process for determining whether or not the predetermined time has elapsed (S505) is executed, if the predetermined time has not elapsed and the pointer control mode is not changed, the process of storing the pointer trajectory information ( S506) and the process of storing the difference area information (S509) are repeatedly executed.

  It is determined whether a predetermined time has elapsed based on the interrupt signal from the interval timer 441 (S505), and when it has elapsed (Y in S505), the pointer movement direction determination unit 414 determines the key event based on the pointer trajectory information. The information is converted into information (S510), and the key event information is output to the key event generating unit 431. Then, the key event generation unit 431 issues key event information input from the pointer movement direction determination unit 414 (S511), and the focus of the button on the screen moves. Further, the focus movement area management unit 422 extracts button area information specified as a button area on the screen based on the display image information and the difference area information of the image frame detected by the frame difference detection unit 421 and extracts the memory 423. (S512). Then, the process again moves to the process of moving the pointer 220 to the center of the screen (S502), and the plurality of processes described above are executed.

That is, according to the flowchart described above, the operation by the mouse is converted into the key event operation by using the pointer on the screen of the data broadcasting content.
Next, with reference to FIG. 6, an event conversion process performed by the pointer movement direction determination unit 414 for converting into key event information based on the pointer trajectory information will be described in detail.

FIG. 6 is a detailed flowchart of the event conversion process.
First, the pointer movement direction determination unit 414 acquires time-series pointer trajectory information stored in the memory 415 (S601). The pointer trajectory information is two-dimensional coordinate information made up of an x coordinate value and a y coordinate value on a graphic screen displayed on the display 33 for each time information such as a time stamp at a predetermined time interval. Then, the pointer movement direction determination unit 414 performs at least two relationships with respect to each of the three relationships of the relationship between the x coordinate value and the y coordinate value, the relationship between the time information and the x coordinate value, and the relationship between the time information and the y coordinate value. An approximate linear equation is calculated by multiplication or the like (S602).

  Furthermore, regarding the coordinate value of the pointer trajectory information acquired from the memory 415 and the coordinate value on each approximate linear equation calculated from these coordinate values, the difference between the y coordinate value and the specific x coordinate value is smaller than a predetermined value. Is determined (S603).

  If it is determined that the difference is not small (large) (N in S603), the process ends. However, if it is determined that the difference is small (Y in S603), it is converted into key event information according to the slope value of the approximate linear equation (S604).

  In other words, the event conversion process is a process of calculating an approximate linear equation based on the acquired pointer trajectory information and converting it into a key event according to the difference between the pointer trajectory information and the approximate linear equation.

Next, specifically, a conceptual diagram obtained by graphing the relationship derived from the time information and the coordinate information as the pointer trajectory information and the approximate straight line of these relationships will be described with reference to FIG.
FIG. 7 is a graph for visually comparing the difference between the actual coordinate value of the pointer trajectory information and the coordinate value of the approximate line.
Graphs (Aa), (Ab), and (Ac) are graphs based on arbitrary pointer trajectory information A, and graphs (Ba), (Bb), and (Bc) are graphs based on arbitrary pointer trajectory information B. is there.

  The graph (Aa) is a graph in which the relationship between the x coordinate value and the y coordinate value of the arbitrary pointer trajectory information A and the approximate straight line equation calculated from these coordinate values are collectively displayed. The graph (Ab) is a graph in which the relationship between the time information of the pointer trajectory information A and the x coordinate value and the approximate linear expression calculated from these coordinate values are collectively displayed. The graph (Ac) It is the graph which displayed collectively the relationship between the time information of pointer locus | trajectory information A, and y coordinate value, and the approximate linear type | formula calculated from these coordinate values.

  The graphs (Ba), (Bb), and (Bc) have the same contents as the graphs (Aa), (Ab), and (Ac) based on arbitrary pointer trajectory information B different from the pointer trajectory information A. Is a flag that displays.

  The graphs (Aa), (Ab), (Ac), and the graph (Bb) are a coordinate value graph and an approximate linear graph, and there is almost no difference in the y coordinate value with respect to a specific x coordinate value ( Is smaller than a predetermined value). On the other hand, the graphs (Ba) and (Bc) are a coordinate value graph and an approximate linear graph, and it is determined that the difference between the y coordinate value and the specific x coordinate value is large (greater than or equal to a predetermined value).

  That is, when the pointer movement direction determination unit 414 acquires the pointer locus information A, the pointer movement direction determination unit 414 determines that there is no difference between the actual data and the approximate linear equation, and does not convert the information related to the mouse operation into the key event. When the information B is acquired, it is determined that there is a difference between the actual data and the approximate linear equation, and information related to the mouse operation is converted into a key event.

Next, with reference to FIG. 8, a description will be given of a determination criterion in the process of converting into key event information in accordance with the inclination of the approximate linear equation.
FIG. 8 is a diagram illustrating the correspondence between the slope of the approximate linear equation and the direction of the key event information.
Note that the x-coordinate value and y-coordinate value of the pointer trajectory information are plotted on the determination reference graph composed of the xy coordinates shown in FIG. 8, and the graphs (Aa) and (Ba) shown in FIG. ) And the same coordinate system.

  The area of the criterion graph includes an upward area 801 that is an area to be converted to a key event for the up key, a left area 802 that is an area to be converted to a key event for the left key, and a downward direction. The area is divided into a downward area 803, which is an area converted into a key event of the key, and an upward area 804, an area converted into a key event of the right arrow key. Note that these four regions have two straight lines of a relational expression of y = x and a relational expression of y = −x as boundary lines.

  Specifically, when an approximate linear expression calculated from the x coordinate value and the y coordinate value of the pointer trajectory information exists in the upward area 801, the pointer trajectory information is converted into a key event of the upward key. Is done.

That is, the pointer trajectory information is converted into a predetermined key event in accordance with the inclination of the approximate linear equation calculated based on the pointer trajectory information.
Next, a process for specifying and registering a button area, which is executed by the focus movement area management unit 422, will be described in detail with reference to FIG.
FIG. 9 is a detailed flowchart of a process for specifying and registering a button area.
First, when the key event information converted by the event conversion process is issued, the frame difference detection unit 421 acquires display image information of the current and previous image frames stored in the memory 404, and this The frame difference area information of the two acquired image frames is detected and specified, and stored as difference area information ΔFB2 in the memory 404 (S901). Further, the frame difference detection unit 421 reads the difference area information ΔFB1 and the difference area information ΔFB2 stored in the memory 404, and specifies and extracts the difference area between the difference area information ΔFB1 and the difference area information ΔFB2 (S902). ). Then, the focus movement area management unit 422 identifies the difference area extracted by the frame difference detection unit 421 as a button area and registers it as button area information in the memory 404 (S903).

  The button area information is registered in the form of the focus movement table shown in FIG. 3, and is registered in association with the corresponding data broadcast content. Also, coordinate value information on the screen of each button area is also registered.

(Application examples)
Next, an example of a focus movement table registered by deleting button area information in which the direction specified by the approximate straight line expression based on the pointer trajectory information and the movement direction by the key event are reversed will be described.

  In general, the button movement of data broadcasting content is often defined to move cyclically between specific buttons by a key operation in a specific direction so that the number of times the operation key is pressed is reduced. Specifically, in the focus movement table shown in FIG. 3, the pointer 220 moves upward and is converted into an upward key event in a state where the “weather forecast” button that is area 1 is the current focus area. Then, the focus moves to the “notification” button, which is the area 4 located below the area 1 on the screen.

  However, in order to avoid a contradiction that the operation direction and the button movement direction on the screen are opposite directions, it is effective to use the focus movement table shown in FIG. Specifically, in a state where the “weather forecast” button, which is the area 1, is the current focus area, the area 1 on the screen is positioned at the top of the plurality of buttons, and thus is based on the pointer movement direction. The movement area when converted to an upward key event is not defined.

That is, it is possible to determine whether or not to issue the key event converted by the event conversion process, using the focus movement table shown in FIG.
Next, a process for issuing a key event using the focus movement table shown in FIG. 10 will be described with reference to FIG.
FIG. 11 is a flowchart of a key event issuing process using the focus movement table shown in FIG.
First, when an event conversion process based on the pointer trajectory information is executed by the pointer movement direction determination unit 414 (S1101), the focus movement region management unit 422 displays the button region information regarding the button specified from the current focus region, and the operation The focus movement table associated with the set content is acquired (S1102). If these pieces of information are not acquired (N in S1103), the process ends. If the information is acquired (Y in S1103), the acquired button area information is compared with the focus movement table (S1104).

  As a result of the collation, when the focus movement direction with respect to the current focus area is not defined by the key event converted by the event conversion process (N in S1105), the process ends and is defined (in S1105). Y) calculates the movement distance from the current focus area to the destination focus area based on the coordinate value information registered together with the focus movement table (S1106). Further, the calculated moving distance is compared with the distance that the pointer 220 calculated from the pointer trajectory information has moved on the screen, and if the difference between these distances is not within a predetermined value (N in S1107), the process is performed. finish. On the other hand, if the difference between these distances is within a predetermined value (Y in S1107), a key event that moves in a predetermined direction is issued based on the key event converted by the event conversion process (S1108).

That is, by using the focus movement table shown in FIG. 10, it is possible to avoid the contradiction that the operation direction and the button movement direction on the screen are opposite directions.
Although the embodiments so far have been described with respect to the operation of digital broadcast data broadcast content described in BML, the scope of the present invention is not limited to BML or digital broadcast data broadcast content. The present invention can also be applied to a case where a graphic screen operated using a remote control such as a MENU screen or an operation screen of an optical disc playback program is operated using a pointing device such as a mouse.

  Moreover, although the example which issues the event equivalent to an up / down / left / right direction key based on the movement of the pointer on a screen was shown, the form which combines the wheel button with which the mouse | mouth was equipped, for example is also considered easily.

  In addition, the buttons provided on the remote control that are not explicitly displayed on the content screen, such as “return”, “decision”, “play”, “stop”, etc., are used by using the right click button provided on the mouse. A form in which a pop-up is displayed near the currently focused area to enable selection may be used.

  As described above, according to the present embodiment, information related to the movement trajectory of the pointer on the screen according to an operation by a pointing device such as a mouse is stored, and the stored information is analyzed to generate a key event corresponding to a direction key. Therefore, it is convenient for the user, and the key event operation can be executed by operating the pointing device.

  The present invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the scope of the present invention.

  DESCRIPTION OF SYMBOLS 10 ... Personal computer, 20 ... CPU, 30 ... North bridge, 31 ... Main memory, 32 ... Graphics controller, 33 ... Display, 40 ... South bridge, 41 ... BIOS-ROM, 42 ... HDD, 43 ... ODD, 44 ... Controller section, 45 ... Tuner section, 46 ... Communication section, 47 ... USB_IF section, 48 ... Operation section, 210 ... Data broadcast content screen, 211 ... Video display area, 212 ... "Weather forecast" button, 213 ... "News ”Button 214,“ program guide ”button 215,“ notice ”button, 216,“ photo list ”button, 217,“ help ”button, 218, information presentation area, 220, pointer, 401, content management section, 402 ... UI engine, 403 ... frame buffer management unit, 412 ... I / O driver, 41 ... Pointer moving unit, 414 ... Pointer moving direction determining unit, 416 ... Pointer coordinate managing unit, 421 ... Frame difference detecting unit, 422 ... Force moving area managing unit, 431 ... Key event generating unit, 441 ... Interval timer, 404, 415 423 memory.

Claims (7)

Pointer moving means for moving the pointer on the screen according to the operation by the pointing device;
Trajectory information storage means for storing the trajectory information pointed to by the pointer moved by the pointer moving means on the operation screen in the command format controlled by the operation by the remote controller in association with the time series in which the pointer has moved;
Information conversion means that is generated based on the trajectory information stored in the trajectory information storage means and converted into a command corresponding to a direction key of a remote control;
An operation execution means for executing an operation corresponding to the command converted by the information conversion means;
An event conversion apparatus comprising:   2. The event conversion apparatus according to claim 1, wherein the point indicating component moving means moves the point indicating component to a central portion of the operation screen after the operation executing means executes an operation.   The point pointing component moving means moves the point pointing component to the center of the operation screen when moving the point pointing component from the outside of the operation screen onto the operation screen. Event converter. Image capturing means for capturing the currently displayed screen as an image;
The operation screen displays information related to the area specified based on the image captured by the image capturing unit before the operation executing unit performs the operation and the image captured after the operation executing unit performs the operation. Region registration means for registering as button region information regarding the button for operating
The event conversion apparatus according to claim 2, further comprising:   The area registration means registers the button area information related to a plurality of buttons in association with button movement information related to a destination button that is moved by the operation execution means for each of the plurality of buttons. The event conversion apparatus according to claim 4.   If the movement direction determined by the information conversion means is different from the movement direction of the button on the operation screen by the operation executed by the operation execution means, the area registration means starts registering the corresponding button movement information. 6. The event converter according to claim 5, wherein the event converter is excluded. Move the pointer on the screen according to the operation with the pointing device,
The trajectory information pointed to by the pointer to be moved on the operation screen in the command format controlled by the operation with the remote controller is stored in association with the time series in which the pointer has moved,
Based on the stored locus information, it is generated by converting into a command corresponding to a direction key of a remote control,
Performing an operation corresponding to the converted command;
An event conversion method characterized by that.

Images