JP6021460B2 - Drawing method, program, and apparatus - Google Patents

Description

  The present invention relates to a drawing method, a program, and an apparatus.

  In recent years, user interfaces using multipointing devices have been used in portable terminals such as tablet computers and smartphones. The operations using the multipointing device correspond to operations such as moving the cursor and selecting on the display.

  A typical multi-pointing device includes a device (for example, a multi-touch screen) in which a touch panel is installed on the surface of a display and a plurality of locations can be pointed at the same time using a finger directly on the touch panel.

  Using this multipointing device, the operator can give various input instructions to the computer. Examples are given below. For example, “tap” corresponds to a click performed with the mouse by touching the screen and releasing it immediately. “Double tap” corresponds to a double click performed with a mouse by tapping twice continuously in a short time. “Drag” is an operation of moving a finger while touching the screen, and corresponds to dragging the mouse. “Flick” means an operation of moving a finger simultaneously with a tap, and there is no corresponding operation with a mouse. “Swipe” is an operation that sweeps the screen, and is an operation corresponding to the middle of dragging and flicking. This “swipe” is used, for example, when scrolling is continued even after a finger to be operated is released. “Pinch-in” and “pinch-out” correspond to operations to move two fingers closer and away from each other. “Touch and hold” means an operation of keeping the touch screen touched with a single finger for a certain period of time.

  In this way, the multipointing device can give various instructions to the machine. However, it is often difficult to create an image intended by an operator with a multipointing device in a short time. Therefore, further development of a technique for providing an environment in which an intended image can be created in a short time by a simpler method using a multipointing device is desired.

  Conventionally, a control point direction line segment generation unit that uses a line segment that passes through each point coordinate data and has the same inclination as the line segment connecting the point coordinate data before and after each point coordinate data as the control point direction before and after each point coordinate And the control point direction line segment, which is the output of the control point direction line segment generator, is used as an input to determine the positions of control points before and after each point coordinate data on the control point direction line segment of each point coordinate data A point data generation unit is provided, and in addition to the point sequence coordinate data that is the output of the point sequence coordinate data input unit, the control point data that is the output of the control point data generation unit is used as an input to generate a Bezier curve. There is a technique for obtaining a Bezier curve passing through an input point by providing a portion (see Patent Document 1).

  Further, in a coordinate input method for generating coordinate data according to the designated coordinate position, a step of detecting the designated coordinate position and outputting the coordinate data, a step of storing the coordinate data, and the stored There is a technique having a calculation step of obtaining an approximate curve including a point represented by the coordinate data based on the coordinate data, and a step of outputting a feature point of the obtained approximate curve (see Patent Document 2).

JP-A-6-103356 JP-A-9-106321

  In one aspect, an object of the present invention is to provide a method, a program, and an apparatus that can easily perform drawing.

  According to an embodiment, the drawing software is a step of accepting a drawing type, and a step of accepting a plurality of coordinates corresponding to each of the plurality of points when a plurality of points are designated at the same time. And a step of drawing an image based on the received plurality of coordinates and the type of drawing is provided.

  According to the embodiment, drawing can be performed easily.

It is a figure which shows the outline | summary of one Example. It is a figure which shows the processing flow of one Example. It is a functional block diagram of one Example. It is a figure which shows the specific example of the process of one Example. It is a figure which shows the example of a deformation | transformation, edit, etc. of the image of one Example. It is a figure which shows the other example of a deformation | transformation or edit of the image of one Example. It is a figure which shows the other example of the edit of the image of one Example. It is a figure which shows the timing of acquisition of the data of one Example. It is a figure which shows the hardware constitutions of one Example.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. It should be noted that the following examples are for the purpose of understanding the invention and are not intended to limit the scope of the present invention. Also, the following embodiments are not mutually exclusive. Therefore, it should be noted that the elements of the embodiments are also intended to be combined unless a contradiction arises. Further, in the invention according to the method and the program described in the claims, the order of the processes may be changed as long as there is no contradiction, or a plurality of processes may be performed simultaneously. It goes without saying that these embodiments are also included in the technical scope of the invention described in the claims.

  Also, the present invention is not limited to the use of multipointing devices. For example, various pointing devices that can specify a position by contact or non-contact can be used. Further, the position that can be designated is not limited to the two-dimensional coordinate position, but includes designation of a three-dimensional coordinate position in a three-dimensional space. Further, the present invention is not limited to a two-dimensional image, and it goes without saying that the present invention can be applied to, for example, a two-dimensional projection image of a three-dimensional object and a stereoscopic image display. Therefore, the present invention can also be used for generating a three-dimensional object in a virtual space and its deformation.

  FIG. 1 is a diagram showing an outline of an embodiment according to the present invention.

  In FIG. 1A, a tablet 100 is a machine on which a program according to an embodiment of the present invention operates. In the embodiment of the present invention, some or all of the components may be implemented by a program. The tablet 100 has a display 120 including a touch sensor. The touch sensor mainly detects a plurality of touches (contacts) with a finger. By detecting the finger contact, the coordinates of the contact position, the movement, the pressing force of the finger, and the like are detected.

  The display 120 displays a drawing canvas, and an image 150 is displayed. For example, the menu 110 may be arranged so that a figure to be drawn can be selected. As shown in the figure, the operator has selected the triangle 112 in the menu 110. The middle finger 131, index finger 132, and thumb 133 of the operator's hand 130 are in contact with the display 120. On the display, a triangle 150 having the vertex of the contact point of these three fingers is drawn.

  FIG. 1B shows a state where the operator has released each finger (131, 132, 133) of the hand 130. A drawn triangle 150 is displayed on the display 120. In this way, the operator selects a figure to be drawn, and then touches a plurality of fingers at the same time on a display including a multipointing device, so that the selected image can be easily adjusted to a desired size, position, and angle. Can be drawn. The method of selecting the drawing type is not limited to the menu method as shown in the figure. For example, the drawing type may be specified by tracing a finger on the screen. Alternatively, an image created by the user by drawing may be registered in the menu. The image is not limited to a two-dimensional image. A three-dimensional model in a virtual space may be targeted. Details of these modified examples will be described in another embodiment described later.

  FIG. 2 shows a processing flow in one embodiment.

  In step 210 of FIG. 2A, the drawing type is accepted based on an instruction from the operator. If the drawing type is accepted once, the subsequent drawing of the same drawing type may be performed a plurality of times. As the drawing type, for example, a quadrangle, a triangle, an ellipse, or the like may be selected by the operator as shown in FIG. Alternatively, an already drawn image may be registered in the menu. In addition, an image stored in a copy buffer (not shown) by a range selection and copy function from an already drawn image may be adopted as a drawing type.

  In step 220, a change in drawing type may be accepted. If you want to change an already drawn image (for example, a triangle) to a circular image, select the triangle image as the editing target, and then select the circle as the drawing type so that the image changes from a triangle to a circle. It may be. The selection of the image and the change of the drawing type will be described later.

  In step 222, as illustrated in FIG. 1A, the coordinates of the designated points are accepted at the same time.

  In step 230, an image is drawn based on the designated drawing type. For drawing an image, for example, in a multipointing device, the coordinates of the contact point of each finger when a plurality of fingers are simultaneously in contact may be used. Alternatively, a plurality of points pointing to the multipointing device in time series may be used. A single point may be used. For example, in a triangle, the coordinate positions of the three vertices of the triangle may be adopted as the coordinates of the acquired finger contact point. In this case, if only two points are specified, the positions of the two predetermined points of the triangle vertices are determined for the two points, and triangles similar to the default shape triangle are drawn for the other points. May be. When the third point is specified after the two points are specified, the image may be deformed and redrawn based on the coordinates of the third point. For example, when only one point is specified in drawing a triangle, for example, a predetermined vertex is aligned with that point, and the other two points are triangles having a default size, shape, and orientation from the predetermined point. May be drawn. Thereafter, when the coordinates of the other two points are designated, the image may be deformed and redrawn based on the designated coordinates of the two points.

  In the above description, a triangle is taken as an example, but those skilled in the art can appropriately implement other drawing types by analogizing the above example. Also, those skilled in the art can find various methods for how to draw when there are few indications of points.

  In step 232, for example, when each of the designated positions of the vertices of the triangle is moved by the movement of the finger, the image may be deformed according to the change of the position, and the drawing may be performed again.

  In step 233, when the drawing type change is instructed after the drawing is once completed, a process of redrawing may be performed. Note that the number of points to be specified may differ depending on the type of drawing. In this case, for example, the coordinates of the obtained points are assigned to each point of a predetermined drawing type, and the points that are not designated may be drawn using the default triangle as described above. Good. Alternatively, the operator may be notified that there is a missing point, and the operator may be prompted to specify the point.

In step 236, for example, when all the fingers are separated from the multi-pointing device, an image drawn before the fingers are released may be held. The plurality of fingers are sequentially separated from the multipointing device. Therefore, there is a case where an image at the time when the finger is sequentially separated from the multi-pointing device is held as the image most faithful to the instruction of the operator. In this case, the rendered image may be stored with the point at which the finger was touching at the reference time as a valid point, with the time a predetermined time before the last finger is removed as the reference time. . Further, an image when the most points are designated from the reference time until the last finger is released may be stored. The details of this processing will be described later with reference to FIG.

  In step 238, the created image is edited. This editing operation will be described in detail in the description of FIG.

  Drawing is performed by the above processing. The drawing result is temporarily stored in a memory, and can be displayed on a display or output to a printer based on the stored information.

  FIG. 2B shows a flow of an embodiment relating to image editing.

  In step 250, the mode for drawing an image is shifted to an image editing mode. As an opportunity to shift to the image editing mode, for example, there is a case where a button for image editing is pressed. Alternatively, the user may simply select a part of the drawn image to select the image and shift to a mode in which the image can be edited. The transition to the image editing mode is not limited to the above example. By shifting to the image editing mode, an instruction for image editing can be accepted.

  In step 252, an image editing instruction is accepted. Examples of image editing instructions include image enlargement, reduction, deformation, and movement. In step 252, the process proceeds to the image editing step 238 and appropriate image editing is performed. A specific example of image editing will be further described in detail with reference to FIGS.

  FIG. 3 shows a functional block diagram of the apparatus of one embodiment. The apparatus includes a drawing type receiving unit 310, a point coordinate receiving unit 322, a drawing unit 330, an editing mode transition unit 350, and an editing instruction receiving unit 352.

  The drawing type receiving unit 310 receives a drawing type to be drawn according to an instruction from the operator. The drawing type receiving unit 310 may include a drawing type change receiving unit 320. The drawing type change accepting unit 320 may accept an instruction from an operator when changing the drawing type of a drawn image.

  The point coordinate receiving unit 322 receives a plurality of coordinates corresponding to each of a plurality of points when a plurality of points are designated at the same time in the multipointing device.

  A drawing type from the drawing type receiving unit 310 and a plurality of coordinates corresponding to each of a plurality of points from the point coordinate receiving unit 322 may be input to the drawing unit 330.

  The drawing unit 330 may include an image deformation unit 332, a drawing change unit 333, an image holding unit 336, and an image editing unit 338.

  The image deforming unit 332 applies the change in coordinates to the image when a plurality of received coordinates are changed, and deforms the drawn image.

  The drawing changing unit 333 performs drawing again based on the drawing type when the drawing type is changed.

  For example, the image holding unit 336 displays a predetermined image drawn between a time that is a predetermined time before the time when the designation of the last point of the plurality of points is canceled and the time when the designation is canceled. It is desirable to hold for display.

  The image editing unit 338 edits an image based on an operator instruction in the image editing mode.

  The edit mode transition unit 350 performs processing for transition to the edit mode. For example, the editing mode may be entered when the editing mode is designated. Alternatively, when an image is selected, the edit mode may be entered.

  The editing instruction receiving unit 352 receives an image editing instruction in accordance with an operator instruction. Then, the editing instruction is given to the image editing unit 338, and the image is edited.

  The result drawn by the drawing unit 330 may be displayed on the display. Alternatively, it may be output to a printer (380).

  FIG. 4 shows a specific example of the processing of one embodiment.

  FIG. 4A shows that three points of a point 401, a point 402, and a point 403 are given by the multipointing device. These three points are obtained by simultaneously pointing the multipointing device using, for example, the thumb, the index finger, and the middle finger. Then, coordinate information of three points is acquired.

  FIG. 4B shows an image 400 drawn when a triangle is selected as the drawing type. The vertices of each triangle coincide with the acquired coordinates of the three points. Note that when only two points are given by the multipointing device, for example, the two points are set as a point 401 and a point 402, and the position of the point 403 is determined based on the default triangular shape. Also good. Further, when only one point is given by the multipointing device, for example, one point may be placed at the point 401 and a triangle having a default size and shape may be drawn in the default orientation.

  FIG. 4C shows an image drawn when a circle is selected as the drawing type. In this case, for example, a circle passing through three given points may be drawn. When two points are instructed, for example, drawing may be performed by placing the two points at a point where a circle and a line of the diameter intersect. When one point is given, a circle of a default size in which an arbitrary point of the circle becomes one given point may be displayed.

  FIG. 4D shows an image drawn when a curve is selected as the drawing type. The type of curve may be a Bezier curve, for example. Alternatively, it may be a polygonal line.

  A person skilled in the art can determine in advance how to set the drawing type and the default drawing as described above. Accordingly, the above example is not intended to limit the present invention as claimed.

  A case where the drawing type is changed will be described with reference to FIGS. For example, it is assumed that the initially drawn image is a triangle 400 as shown in FIG. When the image type is changed to a circle after drawing the triangle, the image may be changed to a circle image shown in FIG. Needless to say, the image type may be changed in the edit mode.

  FIG. 5 shows an example of image deformation and editing according to an embodiment.

  FIGS. 5A and 5B apply to both the deformation of the image during drawing of the image and the editing of the image after drawing the image.

  In FIG. 5A, it is assumed that a triangle having points 401, 402, and 403 as vertices is drawn first. When the point 403 moves to the point 503 during the drawing, the triangle 400 disappears and the triangle is transformed into a triangle 510 as shown in FIG. The same editing can be performed in the image editing mode after the drawing of the triangle having the points 401, 402, and 403 as vertices is completed. That is, when the mode is changed to, for example, the point 403 is moved to the point 503, a triangle 510 is similarly drawn and the image is edited as shown in FIG.

  FIG. 5C shows another embodiment of image editing. It is assumed that the point 425 on one side of the triangle 400 is pointed and moved to the point 525 in the edit mode. In this case, the triangle 400 may be redrawn to the triangle 520, for example.

  FIG. 5D shows a case where the point 435 inside the triangle 400 is pointed and moved to the point 535. In this case, the triangle 400 may be moved to 530, for example.

  As described above, the image can be deformed or edited. In addition, said example does not limit this invention.

  FIG. 6 shows another example of the deformation of the image of the embodiment.

  As shown in FIG. 6A, an example in which an object 600 is placed on a virtual space is shown. When the operator points the point 601, the point 602, the point 603, and the point 604 at the same time with the multipoint device, the object 600 is placed on the virtual space. Then, a two-dimensional image obtained by viewing the object 600 from a specific viewpoint is drawn. Then, it is assumed that the point 601 has moved to the point 611.

  FIG. 6B shows an object 650 in which the right hand of the object has moved to a point 601 by the above-described movement of the point. Then, a two-dimensional image obtained by viewing the object 650 from a specific viewpoint is redrawn.

  The example of FIGS. 6A and 6B is the same when the image is edited when the point 601 is moved to the point 611 in the edit mode.

  FIG. 7 is a diagram illustrating another example of image editing according to an embodiment.

  In FIG. 7A, first, the operator uses the index finger and the thumb to point the two points 701 and 702 at the same time (in the overlapping time) and designates the rotation axis 750 in order to rotate the object 600. To do. Thereafter, the operator moves the finger from the point 710 to the point 720 to instruct rotation of the object. In this case, the rotation shaft 750 may be designated at the same time or overlapping times by the thumb and index finger of the operator, for example. It should be noted that an appropriate timing described with reference to FIG.

  FIG. 7B shows a state where the object 700 has finished rotating around the rotation axis 750. Then, a two-dimensional image obtained by viewing the object 700 from a specific viewpoint is drawn.

  As described above, the embodiment of the present invention can be used not only for drawing a two-dimensional image but also for drawing a three-dimensional object arrangement, deformation, movement, etc. in a virtual space on a two-dimensional plane.

  FIG. 8 shows the data acquisition timing of one embodiment. As shown in the figure, a case where an operator operates the multipointing device using three fingers, that is, a thumb, an index finger, and a middle finger is shown. A line 801 indicates a period during which the thumb is touching the multipointing device. That is, the thumb touches the multipointing device at time t3 and is away from the multipointing device at time t6. Similarly, the index finger touches the multipointing device at time t1 and is away from the multipointing device at time t4. The middle finger touches the multi-pointing device at time t2, and is away from the multi-pointing device at time t5. In this case, it can be seen that the finger touching the multi-pointing device varies depending on the time. For example, a time tm that is a predetermined time Ta before the time t6 when all fingers are released is calculated. Then, during the period of Ta from time tm to t6, an image drawn at the time (for example, tm or t4) when the most positions are pointed may be held as an image. By doing so, it is possible to reduce the instability of image drawing due to a subtle shift in the designated time of the position of each finger.

  Alternatively, the position of the point at which each finger is released may be stored, an image drawn, and the image held (not shown). Alternatively, the position where the finger touches the multi-pointing device is memorized, and when the finger touches the same position again and is separated, the position is stored by (toggle) operation that erases the memory of the position. You may memorize | store, perform drawing based on the memorize | stored position, and hold | maintain the drawn image (not shown).

  FIG. 9 shows a configuration example of hardware (computer) according to the embodiment of the present invention. The hardware can include a CPU 910, a memory 920, an input device 930, a display device 940, a printer 980, and a portable recording medium interface 960. Each device may be connected by a bus 970. The portable recording medium interface 960 can read and write the portable recording medium 961.

  Note that all or part of the present embodiment can be implemented by a program. This program can be stored in the portable recording medium 961. Examples of the portable recording medium 961 include a magnetic recording medium, an optical disk, a magneto-optical recording medium, and a nonvolatile memory. Magnetic recording media include HDDs, flexible disks (FD), magnetic tapes (MT) and the like. Optical disks include DVD (Digital Versatile Disc), DVD-RAM, CD-ROM (Compact Disc-Read Only Memory), CD-R (Recordable) / RW (ReWritable), and the like. Magneto-optical recording media include MO (Magneto-Optical disk). Non-volatile memory includes USB memory and SD memory. A program stored in the portable storage medium 961 is read and executed by the CPU, whereby all or part of the embodiment of the present invention can be implemented.

310 Drawing Type Accepting Unit 320 Drawing Type Change Accepting Unit 322 Point Coordinate Accepting Unit 330 Drawing Unit 332 Image Deforming Unit 333 Drawing Changing Unit 336 Image Holding Unit 338 Image Editing Unit 350 Editing Mode Transition Unit 352 Editing Instruction Accepting Unit

Claims (7)

A method of drawing by a computer,
Accepting the type of drawing,
Accepting a plurality of coordinates corresponding to each of the plurality of points when a plurality of points are specified simultaneously;
Rendering an image based on the received plurality of coordinates and the type of rendering;
I have a,
The step of drawing the image includes
A time that is a predetermined time before the time when the transition is made from the state where at least one point of the plurality of points is designated to the state where the designation of all the points is canceled, and the time when the transition is made Holding the received plurality of coordinates and the type of drawing for display at a time between which the most plurality of points have been designated . The step of drawing the image includes
Applying the change in coordinates to the image when the received plurality of coordinates changes, and transforming the rendered image;
The method of claim 1 comprising: Accepting the drawing type comprises:
Accepting a change in the type of drawing, drawing the image comprises:
Changing the drawing type of the image based on the changed drawing type;
The method according to claim 1 or 2 . When the image is selected in accordance with an instruction from an operator, the process proceeds to a mode for editing the image;
A mode for editing the image, and when one or more points are designated, accepting an editing instruction according to the coordinates of the one or more points and / or changes in the coordinates of the points;
Further comprising
The step of drawing the image includes
Editing the image based on an editing instruction by a change in coordinates of the one or more points and / or coordinates of the points,
4. A method according to any one of claims 1 to 3 . The coordinates are two-dimensional coordinates or three-dimensional coordinates.
5. A method according to any one of claims 1 to 4 . The program which makes a computer perform the method of any one of Claims 1 thru | or 5 . A device for drawing,
A drawing type accepting unit that accepts a drawing type;
A point coordinate receiving unit that receives a plurality of coordinates corresponding to each of the plurality of points when a plurality of points are specified at the same time;
A drawing unit that draws an image based on the received plurality of coordinates and the drawing type , wherein all points are deselected from a state in which at least one of the plurality of points is designated A plurality of received coordinates at a time when the most plurality of points are designated between a time that is a predetermined time before the time when the state has been changed and the time when the transfer has been made, and A drawing unit for holding the type of drawing for display ;
Having a device.

Images