JP2006079160A - Digital apparatus, copy method, copy program, and storage medium storing it - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To optionally copy data displayed on a digital apparatus for use. <P>SOLUTION: This digital apparatus is provided with a function for making a user select original data, a function for displaying an image composed by laying out raster data of respective elements in the selected original data in a position defined by the original data, a function for making the user designate an area for showing a copy object on the displayed image, a function for determining an element as a copy object if the whole of the raster data for the element can be included in the designated area and determining a part of an element corresponding to a part of the raster data included in the designated area as a copy object if a part of the raster for the element is included in the designated area, a function for making the user designate data formats for the respective elements of the copy object and parts of the respective elements, a function for storing the respective elements of the copy object and the parts of the respective elements in the designated data formats, and a function for making the user separately retrieve the stored respective elements and their parts for use. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a technique for arbitrarily copying and using data displayed on a display included in a digital device in a digital device such as a mobile phone, a portable terminal (PDA), and a digital home appliance.

  Currently, as a computer OS or middleware, an API for selecting an arbitrary closed region and performing clipping processing is implemented. As an example, a GUI operation is performed on a pit map display, that is, a raster image, or on a display postscript, that is, a vector image. The environment has already been realized.

  Furthermore, raster operations, clipping, and block transfer are realized as APIs, and a window system is implemented on top of this, and copy and paste operations between windows, and graphic processing is performed on the developed bitmap display and window system. In applications for computers, some of the elements that make up a vector image or a raster image are specified in an arbitrary combination to be edited. Some applications for office work can be edited in the same way.

  On the other hand, in a digital device such as a mobile phone, a portable terminal (PDA), or a digital home appliance, an editing function for copying and pasting partial data with an arbitrary designation is realized only for a character string. This is because a window system that is middleware has not been required, and even if it is desired to be mounted, there are restrictions on the amount of memory mounted, the processing capacity of the CPU, and the size of the display area of the display.

  The present invention has been made in view of such background art, and an object of the present invention is to arbitrarily copy and use data displayed on a digital device.

In order to achieve the above-mentioned problem in the present invention, first, in the invention of claim 1, a function for allowing a user to select original data;
A function of displaying raster images of each element of the selected original data at a position determined from the selected original data and combining them;
A function that allows the user to specify an area to be copied on the displayed image;
If the element contains the entire raster data in the specified area, this element is the copy target. On the other hand, if the element contains a part of the raster data in the specified area, it corresponds to the raster data part of the element entering the area. A function to copy the element part,
A function that allows the user to specify the data format for each element to be copied and each element part,
A function to save each element to be copied and each element part in the specified data format,
The digital device is characterized in that it has a function of allowing a user to individually retrieve and use each saved element and a portion of each element.

The invention according to claim 2 is characterized in that, in the displayed image, the function for causing the user to designate an area indicating a copy target is to cause the user to designate one or a plurality of areas. The digital device according to Item 1 is provided.

The invention of claim 3 is a method executed by a digital device,
Allowing the user to select the original data;
Displaying rasterized data of each element of the selected original data at a position determined from the selected original data and displaying a combined image;
A step of allowing the user to specify an area indicating a copy target on the displayed image;
If the element contains the entire raster data in the specified area, this element is the copy target. On the other hand, if the element contains a part of the raster data in the specified area, it corresponds to the raster data part of the element entering the area. A process for copying the element part, and
For each element to be copied and the part of each element, the process of allowing the user to specify the respective data format,
Saving each element to be copied and the part of each element in a specified data format;
The copying method is characterized by including a step of allowing the user to individually take out and use each saved element and a portion of each element.

  According to a fourth aspect of the present invention, the step of causing the user to designate an area indicating a copy target on the displayed image is to cause the user to designate one or a plurality of areas. The copying method according to item 3 is used.

In the invention of claim 5, the digital device includes
Allowing the user to select the original data;
Displaying rasterized data of each element of the selected original data at a position determined from the selected original data and displaying a combined image;
A step of allowing the user to specify an area indicating a copy target on the displayed image;
If the element contains the entire raster data in the specified area, this element is the copy target. On the other hand, if the element contains a part of the raster data in the specified area, it corresponds to the raster data part of the element entering the area. A process for copying the element part, and
For each element to be copied and the part of each element, the process of allowing the user to specify the respective data format,
Saving each element to be copied and the part of each element in a specified data format;
A copy program is characterized in that the stored elements and the parts of the elements are individually extracted and used.

  In the invention of claim 6, the step of causing the user to designate an area indicating a copy target on the displayed image causes the user to designate one or a plurality of areas. The copy program according to item 5 is used.

  The invention according to claim 7 is a recording medium on which the copy program according to claim 5 or 6 is recorded.

  The invention of claim 7, which refers to claims 1, 3, 5 and 5, is a digital device which arbitrarily selects original data, displays an image of the original data, and displays the original data including the entire raster data. In the case of an element, this element is set as a copy target. On the other hand, in the case of an element containing a part of raster data, an area in which the element part of the original data corresponding to this raster data part is to be copied is displayed. This can be arbitrarily specified on the image of the original data, and there is an effect that each element to be copied and a part of each element can be saved in a specified data format and individually extracted and used.

  In the invention of claim 8, which refers to claims 2, 4, 6, and 6, in the case of an element of original data in which the entire raster data is entered in a digital device, this element is set as a copy target, and on the other hand, In the case of an element including a part, there is an effect that one or a plurality of areas to be copied can be designated for the element part of the original data corresponding to the raster data part.

  As described above, the present invention has an effect that data to be displayed on a digital device can be arbitrarily copied and used.

  The best embodiment of the present invention will be described below.

  In the present embodiment, the digital device includes a CPU, a memory, a display, an input device, and the like, and executes a browser. The browser is a program for browsing the display image of the original data. The original data includes data representing each element such as text and image and information for determining the position of raster data of each element. The display image is an image obtained by laying out the raster data of each element of the original data at a position determined from the original data. The original data is also called source data, a source file, or simply a source, and may be described in a markup language such as HTML or XML, for example.

  Hereinafter, a digital device that is executing a browser will be described.

  FIG. 1 shows an example of the appearance of a digital device when a browser is executed. As shown in FIG. 1, the digital device includes a display and a button as an input device. The button is a pointing device that can be pressed, moved freely 360 degrees up, down, left, and right, and tilted up, down, left, and right. By moving the button, you can move the cursor displayed on the display screen. The digital device includes a key (not shown) as an input device in addition to the buttons. As shown in FIG. 1, the digital device divides the display screen into a menu area, a display area, and a message area. The menu area is an area for displaying a browser menu. The display area is an area for displaying a display image of the original data. The message area is an area for displaying a message from the digital device to the user.

  When the user selects the original data, the digital device creates a display image from the original data, and displays the display image within the display area.

  As shown in FIG. 2, by tilting the button up, down, left, and right, the display area can be moved up, down, left, and right on the display image accordingly. With this movement, the range of the display image displayed in the display area changes.

  In the menu area, when the user points to a partial area to be copied and hits a predetermined key, the user indicates a copy target on the display image displayed in the display area. An area can be specified. Here, an area indicating a copy target is referred to as a copy area. The user may designate a plurality of copy areas. If the element contains the entire raster data in the copy area, this element is the target of copying, while if the element contains a portion of the raster data in the copy area, the element corresponding to the raster data part of the element entering the copy area This part is the target of copying.

The digital device allows the user to specify the data format of each element to be copied and each element part, and copies each element to be copied and each element part in the data format specified by the user. Save it to the clipboard. The clipboard is an area of memory that is shared and used by a plurality of applications. In the digital device, the user can individually extract and use each element stored in the clipboard and each element part.

  When the user points to a partial area corresponding to the end of the menu area with a cursor and hits a predetermined key, the digital device ends the execution of the browser.

  In this embodiment, the user designates a copy area by selecting a plurality of points one by one on the display image displayed in the display area by the user operating a button. . Of the multiple points, the first point selected by the user is called the start point, the last point selected is called the end point, and when more than two points are selected, the point that is neither the start point nor the end point is called the intermediate point. To.

  When the user selects only two points, the start point and the end point, the digital device displays the copy area diagonally on the display image displayed in the display area as shown in FIG. The area surrounded by the rectangle is taken as the copy area.

  When the user selects three or more points and the number of selected points is n (n ≧ 3), the digital device displays i (1 ≦ i <n) on the display image displayed in the display area. An area surrounded by a polygon having sides of a straight line drawn from the first selected point to the (i + 1) th selected point and a straight line drawn from the end point to the start point is set as a copy area. FIG. 4 shows an example of a copy area when three points are selected.

  As shown in FIG. 5A, when the cursor is displayed, when the user single-clicks the button, the digital device displays the point indicated by the cursor on the display image displayed in the display area. As the starting point, the coordinates of the point are acquired, and as shown in FIG. 5B, the cursor is erased, and a mark indicating that the point is the point selected by the user is displayed at the point where the cursor is pointing. indicate.

  When the user presses the button after selecting the start point, the digital device displays a blinking mark on the start point. Then, when the user moves the button while pressing it, the digital device moves the blinking mark on the display image displayed in the display area in accordance with this movement, as shown in FIG. Let

  Similarly, when the user presses a button after selecting an intermediate point, the digital device displays a blinking mark on the intermediate point. When the user moves the button while pressing it, the digital device moves the blinking mark on the display image displayed in the display area in accordance with the movement.

  When the flashing mark is displayed, if the user single-clicks the button, the digital device uses the point indicated by the flashing mark as the intermediate point on the display image displayed in the display area. The coordinates are acquired, the blinking mark is deleted, and a mark indicating that the point is selected by the user is displayed at the position of the point that the blinking mark points to.

  If the user double-clicks the button while the flashing mark is displayed, the digital device will display the coordinates of that point with the point indicated by the flashing mark as the end point on the display image displayed in the display area. , The blinking mark is erased, a mark indicating that the user has selected the point is displayed at the position of the point where the blinking mark was pointing, and a cursor is displayed beside this point. When double-clicking, the user can specify another copy area in succession.

  When the flashing mark is displayed, when the user triple-clicks the button, the digital device displays the coordinates of the point on the display image displayed in the display area, with the point indicated by the flashing mark as the end point. , The blinking mark is erased, and a mark indicating that the point has been selected by the user is displayed at the position of the point where the blinking mark was pointing. When triple clicking is performed, this means that the copy area has been designated, and the user cannot subsequently designate another copy area.

  In the following, an example of the flow of processing for creating a display image from original data will be described with reference to the flowchart of FIG.

S (STEP) 1;
The user selects the original data on the digital device.

S (STEP) 2;
The digital device checks whether the original data selected by the user can be interpreted normally, can be decomposed into elements, and can be rasterized.
If both are possible, go to STEP 3
On the other hand, if either is not possible, go to END.

S (STEP) 3;
The digital device enumerates the elements of the original data selected by the user and stores the number and type of each element.

  Each element is numbered according to a predetermined rule. For example, the number may be assigned in order from the first element. The element type is a type as data of the element, and includes, for example, an image and text.

S (STEP) 4;
The digital device uses the first element as the element.

S (STEP) 5;
The digital device creates raster data of the element.

S (STEP) 6;
The digital device creates a display image in which the raster data of the element is laid out at a position determined from the original data, and stores the peripheral information and the number of the element.

  Here, the outer periphery information of the element is information for specifying the outer periphery of the raster data of the element on the display image, and when the outer periphery is a rectangle, the outer periphery information is, for example, the width and height in units of pixels, And it consists of the coordinates of the lower left end and the upper right end on the display image (see FIG. 8).

S (STEP) 7;
The digital device checks whether this element is the last element,
If it is the last element, go to END,
If it is not the last element, go to STEP8.

S (STEP) 8;
The digital device newly sets the element next to the element as the element.

S (STEP) 9;
The digital device creates raster data of the element.

S (STEP) 10;
The raster data of the element is laid out at a position determined from the original data, and the image synthesized with the display image is newly set as the display image, and the outer periphery information and the number of the element are stored. Then, return to STEP7.

  In this processing example, every time raster data of an element is created, it is added to the display image, so that it is not necessary to temporarily store the raster data of all elements, and the display image It is possible to reduce the memory capacity required to create the.

  If there is enough memory capacity to temporarily store the raster data for all elements, after creating the raster data for all elements, the raster data for each element is laid out at the position determined from the original data. Then, they may be combined to create a display image.

  Hereinafter, an example of the flow of main processing performed when displaying a display image will be described with reference to the flowchart of FIG.

S (STEP) 1;
The digital device checks whether the user has tilted the button,
If the user tilts the button, go to STEP2,
If the user does not tilt the button, proceed to STEP 12.

S (STEP) 2;
The digital device checks if the user tilts the button to the right,
If you tilt it to the right, go to STEP 3,
If not, go to STEP4.

S (STEP) 3;
The digital device moves the display area to the right on the display image, and then proceeds to STEP10.

S (STEP) 4;
The digital device checks if the user tilts the button to the left,
If you tilt to the left, go to STEP5,
If not, go to STEP6.

S (STEP) 5;
The digital device moves the display area to the left on the display image, and then proceeds to STEP10.

S (STEP) 6;
The digital device checks to see if the user has tilted the button
If tilted up, go to STEP7,
If not, go to STEP8.

S (STEP) 7;
The digital device moves the display area up on the display image, and then proceeds to STEP 10.

S (STEP) 8;
The digital device checks if the user tilts the button down,
If tilted down, go to STEP 9
If not, go to STEP12.

S (STEP) 9;
The digital device moves the display area down on the display image, and then proceeds to STEP 10.

S (STEP) 10;
The digital device checks whether the display area has reached the edge of the displayed image,
If so, go to STEP 11
If not, return to STEP1.

S (STEP) 11;
The digital device displays a message that the end of the display image has been reached in the message area. Then, it returns to STEP1.

S (STEP) 12;
The digital device confirms whether or not the user points at the partial area to be copied in the menu area with the cursor and hits a predetermined key.
If the user points to the partial area to be copied in the menu area with a cursor and hits a predetermined key, the process proceeds to STEP13.
In the menu area, if the user points to the partial area where the copy process is performed with the cursor and is not hitting a predetermined key, the process proceeds to STEP 15.

S (STEP) 13;
The digital device performs processing for allowing the user to specify a copy area indicating a copy target.

S (STEP) 14;
The digital device performs a process of copying each element to be copied and a part of each element. Then, it returns to STEP1.

S (STEP) 15;
The digital device checks whether or not the user points at the partial area corresponding to the end of the menu area with the cursor and hits a predetermined key.
If the user points to a partial area corresponding to the end of the menu area with a cursor and hits a predetermined key, the execution of the browser is ended, and the process proceeds to END.
If the user points to the partial area corresponding to the end of the menu area with the cursor and does not hit a predetermined key, the process returns to STEP1.

  Below, an example of the flow of the process for specifying the copy area indicating the copy target (STEP 13 of the main process) will be described with reference to the flowchart of FIG.

S (STEP) 1;
The digital device sets the variable “number of clicks” to zero.

S (STEP) 2;
The digital device checks to see if the user clicks the button,
If you click, go to STEP3,
If not clicked, proceed to STEP5.

S (STEP) 3;
The digital device increases the variable “number of clicks” by one.

S (STEP) 4;
The digital device waits for a predetermined short time. Thereafter, the process returns to STEP2.

S (STEP) 5;
The digital device checks to see if the variable “Number of clicks” is 1,
If it is 1, then the user has made a single click and proceeds to STEP 6,
If not 1, it is determined that the user has not performed a single click, and the process proceeds to STEP8.

S (STEP) 6;
The digital device acquires the coordinates of the point with the point indicated by the cursor (or blinking mark) as the start point (or intermediate point).

S (STEP) 7;
The digital device erases the cursor (or blinking mark) and displays a mark indicating that the point is selected by the user at the position of the start point (or intermediate point). Then, it returns to STEP1.

S (STEP) 8;
The digital device checks to see if the variable “clicks” is 2,
2. If the user double-clicked, proceed to STEP 9,
If it is not 2, the process proceeds to STEP 12 assuming that the user has not double-clicked.

S (STEP) 9;
The digital device uses the point indicated by the blinking mark as the end point, and acquires the coordinates of that point.

S (STEP) 10;
The digital device erases the blinking mark and displays a mark indicating that the point is selected by the user at the end point position.

S (STEP) 11;
The digital device displays a cursor near the end point. Then, it returns to STEP1.

S (STEP) 12;
The digital device checks whether the variable “Clicks” is 3,
If it is 3, then the user has made a triple click and proceeds to STEP13.
Otherwise, it is determined that the user has not performed a triple click, and the process proceeds to STEP18.

S (STEP) 13;
The digital device uses the point indicated by the blinking mark as the end point, and acquires the coordinates of that point.

S (STEP) 14;
The digital device erases the blinking mark and displays a mark indicating that the point is selected by the user at the end point position.

S (STEP) 15;
The digital device checks whether the number of points acquired as the starting point matches the number of points acquired as the end point.
If it matches, go to STEP 16,
If not, go to STEP17.

S (STEP) 16;
For each copy area, the digital device stores a coordinate sequence in which the coordinates of the points defining each copy area are arranged in the order of selection, and then proceeds to END.

S (STEP) 17;
The digital device does not match the number of points acquired as the start point and the number of points acquired as the end point, so an error message prompting re-designation of the copy area is displayed in the message area. Erase coordinates. Then, it returns to STEP1.

S (STEP) 18;
The digital device checks whether the user keeps pressing the button,
If the button is held down, proceed to STEP 19,
If not, continue to END.

S (STEP) 19;
The digital device displays a blinking mark at the position of the start point (or intermediate point) selected immediately before by the user.

S (STEP) 20;
The digital device checks to see if the user is moving the button,
If so, proceed to STEP 21
If not, return to STEP1.

S (STEP) 21;
The digital device moves the blinking mark in the moving direction by the moving amount that the user has moved the button. Then, it returns to STEP1.

  Hereinafter, an example of the flow of the process of copying each element to be copied and each element part (STEP 14 of the main process) will be described with reference to the flowchart of FIG.

S (STEP) 1;
The digital device uses the first element as the element.

S (STEP) 2;
The digital device compares, for each copy area, the coordinate data in which the coordinates of the points that define each copy area are arranged in the order of selection and the peripheral information of the element, so that the raster data of the element Check if it ’s in the area,
If the raster data portion of the element enters any copy area, proceed to STEP 3;
If the entire raster data of the element is in any copy area, proceed to STEP5.
If neither the raster data part nor the whole of the element enters any copy area, the process proceeds to STEP 6.

S (STEP) 3;
The digital device extracts from the element a portion corresponding to the raster data portion of the element that enters the copy area.

  In this extraction, the portion of the element corresponding to the raster data portion of the element that protrudes from the copy area is scraped little by little. While confirming, the process may be repeated until the raster data of the part of the element remaining after cutting enters the copy area.

S (STEP) 4;
The digital device stores the number of the element, information that the part of the element is a copy target, and peripheral information of the extracted part, and if the element is text, also stores the character string that forms this part To do. Then, it progresses to STEP6.

  Here, the outer periphery information of the element part is information that specifies the outer periphery of the raster data of the element part on the display image, similar to the outer periphery information of the element, and when the outer periphery is a rectangle, the outer periphery information is: For example, the pixel unit is a width and a height, and the coordinates of the lower left corner and the upper right corner on the display image.

S (STEP) 5;
The digital device stores the number of the element, information that the entire element is a copy target, and peripheral information of the element. If the element is text, the digital device also stores a character string that forms the element.

S (STEP) 6;
The digital device checks whether this element is the last element,
If it is the last element, go to STEP8,
If it is not the last element, go to STEP7.

S (STEP) 7;
The digital device newly sets the element next to the element as the element. Thereafter, the process returns to STEP2.

S (STEP) 8;
In the digital device, the user designates a data format for each element to be copied and a part of each element. The digital device stores the data format designated by the user for each copy target.

  In this processing example, only when the type to be copied is text, the data format can be specified as either raster or text. When the type to be copied is other than text, such as an image, only the raster can be specified as the data format. It is.

S (STEP) 9;
The digital device targets the first copy target.

S (STEP) 10;
The digital device confirms the data format specified by the user for the target,
If the specified data format is raster, go to STEP11,
If the specified data format is text, proceed to STEP 15.

S (STEP) 11;
The digital device checks whether the object is the whole element or part of the element,
If so, go to STEP14.
If it is a part, go to STEP12.

S (STEP) 12;
The digital device creates raster data of elements including the target as a part.

S (STEP) 13;
The digital device refers to the outer periphery information of the part of the element that is the target, extracts the part corresponding to the part of the element that is the target from the raster data of the element that includes the target as a part, Save to clipboard. Then, it progresses to STEP16.

S (STEP) 14;
The digital device creates raster data of the target element and saves it as copy data on the clipboard. Then, it progresses to STEP16.

S (STEP) 15;
The digital device copies the target character string stored and saves it on the clipboard.

S (STEP) 16;
The digital device checks whether the target is the last copy target,
If it is the last copy target, go to END,
If it is not the last copy target, go to STEP17.

S (STEP) 17;
The digital device newly sets the next copy target of the target as the target. Then, it returns to STEP10.

The figure which shows the example of the external appearance of a digital device. The figure explaining the movement of the display area on the image for a display. The figure which shows the example of a copy area when only 2 points | pieces are selected. The figure which shows the example of a copy area when 3 points | pieces are selected. The figure explaining selection of a starting point. The figure explaining selection of the next point of a starting point. The flowchart which shows the example of the flow of a process which produces the image for a display from original data. The figure which shows the example of the raster data of the element on the image for a display. The flowchart which shows the example of the flow of the main process performed when displaying a display image. The flowchart which shows the example of the flow of a process which makes a user designate a copy area. The flowchart which shows the example of the flow of a process which copies each element of a copy object, and the part of each element.

Claims (7)

A function that allows the user to select the original data,
A function of displaying raster images of each element of the selected original data at a position determined from the selected original data and combining them;
A function that allows the user to specify an area to be copied on the displayed image;
If the element contains the entire raster data in the specified area, this element is the copy target. On the other hand, if the element contains a part of the raster data in the specified area, it corresponds to the raster data part of the element entering the area. A function to copy the element part,
A function that allows the user to specify the data format for each element to be copied and each element part,
A function to save each element to be copied and each element part in the specified data format,
A digital apparatus having a function of allowing a user to individually retrieve and use each stored element and a portion of each element.   The digital apparatus according to claim 1, wherein the function for causing the user to designate an area indicating a copy target on the displayed image is to cause the user to designate one or a plurality of areas. A method performed by a digital device,
Allowing the user to select the original data;
Displaying rasterized data of each element of the selected original data at a position determined from the selected original data and displaying a combined image;
A step of allowing the user to specify an area indicating a copy target on the displayed image;
If the element contains the entire raster data in the specified area, this element is the copy target. On the other hand, if the element contains a part of the raster data in the specified area, it corresponds to the raster data part of the element entering the area. A process for copying the element part, and
For each element to be copied and the part of each element, the process of allowing the user to specify the respective data format,
Saving each element to be copied and the part of each element in a specified data format;
And a step of allowing a user to individually take out and use each saved element and a portion of each element.   4. The copying method according to claim 3, wherein the step of causing the user to designate an area indicating a copy target on the displayed image is to cause the user to designate one or a plurality of areas. In digital equipment,
Allowing the user to select the original data;
Displaying rasterized data of each element of the selected original data at a position determined from the selected original data and displaying a combined image;
A step of allowing the user to specify an area indicating a copy target on the displayed image;
If the element contains the entire raster data in the specified area, this element is the copy target. On the other hand, if the element contains a part of the raster data in the specified area, it corresponds to the raster data part of the element entering the area. A process for copying the element part, and
For each element to be copied and the part of each element, the process of allowing the user to specify the respective data format
Saving each element to be copied and the part of each element in a specified data format;
A copy program for causing a user to individually retrieve and use each element stored and a portion of each element.   6. The copy program according to claim 5, wherein the step of causing the user to designate an area indicating a copy target on the displayed image is to cause the user to designate one or a plurality of areas.   A recording medium on which the copy program according to claim 5 is recorded.

Images