JP6192793B2 - Object display method, program, and apparatus - Google Patents

Description

  The present invention relates to a method, a program, and an apparatus for displaying an object.

  In recent years, with the spread of tablet terminals and smartphones using multi-touch devices, and the spread of game machines using non-contact sensors, new input control methods using these sensing devices have been studied. Yes.

  For example, a specific gesture caused by finger movement is associated with a specific command to enable interactive device operation.

  A typical multi-touch device includes a device (for example, a multi-touch screen) in which a touch panel is installed on the surface of a display and a plurality of locations can be pointed at the same time using a finger directly on the touch panel.

  Using this multi-touch device, the operator can give various input instructions to the computer. Examples are given below. For example, “tap” corresponds to a click performed with the mouse by touching the screen and releasing it immediately. “Double tap” corresponds to a double click performed with a mouse by tapping twice continuously in a short time. “Drag” is an operation of moving a finger while touching the screen, and corresponds to dragging the mouse. “Flick” means an operation of moving a finger simultaneously with a tap, and there is no corresponding operation with a mouse. “Swipe” is an operation that sweeps the screen, and is an operation corresponding to the middle of dragging and flicking. This “swipe” is used, for example, when scrolling is continued even after a finger to be operated is released. “Pinch-in” and “pinch-out” correspond to operations to move two fingers closer and away from each other. “Touch and hold” means an operation of keeping the touch screen touched with a single finger for a certain period of time.

  In this way, the multi-touch device can give various instructions to the machine. However, it is still often difficult for the operator to perform an operation intended by the multi-touch device. Therefore, further development of a technique that provides an environment in which an intended image can be created or changed in a short time by a simpler method using a multi-touch device is desired.

  Conventionally, there is a technique for identifying a user's gesture for a multi-touch device and executing a predetermined operation in accordance with the gesture (see Patent Document 1).

  In addition, when a second icon is superimposed on a first icon at a specific position using a multi-touch device, a technique for displaying the second icon at a specific position instead of the first icon (See Patent Document 2).

Special table 2008-508601 gazette Special table 2010-538394 gazette

  An embodiment aims to make it possible to change or display an object more simply or intuitively using a sensing device.

In one aspect, the present invention is a method for displaying an object by a computer comprising:
Receiving a gesture event made to a sensing device from an operator; identifying a plurality of attributes of an object selected by the received gesture event; and based on a predetermined rule, the received A step of converting a gesture event or a newly received gesture event into a command, and a replacement object that is a candidate for replacement of the selected object, the replacement having a predetermined attribute that matches the selected object Retrieving an object from an object storage unit, modifying the selected object based on the command and a plurality of attributes of the selected object, the modifying step comprising: The selection The object, comprising the step of replacing by the alternative object to provide a method.

  In the embodiment, an object can be changed or displayed more easily using a sensing device.

It is a figure which shows the structure of one Example. It is a figure which shows the example of operation of one Example. It is a figure which shows operation of one Example. It is a figure which shows another Example with the function of a snapshot. It is the figure which showed the change of the object when the instruction | indication of fixation of an attribute is performed. It is a figure which shows a snapshot function. It is a figure which shows a history function. It is a figure which shows the processing flow of one Example. It is a figure which shows the structural example of the hardware (computer) of the Example of this invention. It is a functional block diagram of one Example.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. It should be noted that the following examples are for the purpose of understanding the invention and are not intended to limit the scope of the present invention. Also, the following embodiments are not mutually exclusive. Therefore, it should be noted that the elements of the embodiments are also intended to be combined unless a contradiction arises. Further, in the invention according to the method and the program described in the claims, the order of the processes may be changed as long as there is no contradiction, or a plurality of processes may be performed simultaneously. It goes without saying that these embodiments are also included in the technical scope of the invention described in the claims.

  Also, the present invention is not limited to the use of multi-touch devices. For example, various sensing devices that can specify a position in contact or non-contact can be used. Further, the position that can be designated is not limited to the two-dimensional coordinate position, but includes designation of a three-dimensional coordinate position in a three-dimensional space. Further, the present invention is not limited to a two-dimensional image, and it goes without saying that the present invention can be applied to, for example, a two-dimensional projection image of a three-dimensional object and a stereoscopic image display. Therefore, the present invention can be used to change or modify a three-dimensional object in the virtual space.

  In addition, the present invention can be used in various fields. For example, it can be used for drawing software for creating and editing two-dimensional images, presentation material creation software, plan book creation software, and the like. In addition, game software, 3D modeling software, plug-in software such as a web browser, software related to virtual reality (virtual reality), software related to social networking service (SNS), thinking tools such as mind maps, Needless to say, it can also be used for business software such as spreadsheet software.

  Other examples of the objects in this specification include changing the character equipment in the game software, changing and correcting the character itself, changing the costume of the avatar (the character that will be his own character) and changing the hair style, Examples include changes in the color, texture, and gloss of 3D material, changes in fonts and balloons, and changes in fonts in balloons. Further, the operations (tap, touch, swipe, double tap, drag and drop, etc.) in each of the embodiments described below are exemplary. Therefore, it goes without saying that any operation may be assigned to any instruction.

  FIG. 1 shows an embodiment of the present invention. A screen 110 is installed on the tablet terminal 100. The screen 110 may also serve as a multi-touch device. The finger 151 of the operator's hand 150 is in contact with the screen 110. On the screen, only one finger of the finger 151 touches the screen 110, but a plurality of fingers may touch it. For example, the finger 151 may touch the screen and move the finger along the arrow 131 while touching the screen. This operation corresponds to “flick” or “swipe”. The finger 151 may trace the screen along the trajectory 132. There is no specific name for this operation.

  FIG. 2 shows an example of the operation of one embodiment of the present invention. In FIG. 2A, the character 200 is displayed on the screen 110. Of the plurality of objects constituting the character 200, a skirt 210 that is a lower-body clothes is displayed. The skirt 210 is one of the objects. The operator can put the skirt 210 in a selected state by touching or tapping the skirt 210 with the finger 151, for example. Thereafter, the finger 151 may be swiped in the direction of the arrow 250 that is substantially horizontal. Note that, between the touch operation and the swipe operation described above, the finger 151 may be once released from the screen, or two operations may be continuously performed without leaving the screen.

  FIG. 2B shows a state after the finger 151 is swiped in the direction of the arrow 250. The clothing of the lower body of the character 200 is displayed with the skirt 210 deleted and changed to trousers 220. In this case, as shown in FIG. 2D, the skirt 210 has attributes “clothing”, “lower body”, and “for women”. The trousers 220 also have “clothing”, “lower body”, and “for women” as attributes. Therefore, both have some of the same attributes. Then, the displayed pants 220 may be selected. Furthermore, when the finger 151 is swiped in the direction of the arrow 250, another object having an attribute in which some of the plurality of attributes of the pants 220 are the same may be displayed (not shown). Note that the display order may be predetermined or random.

  FIG. 2C shows a state where the finger 151 has been swiped in the direction of the arrow 251 in the horizontal direction from the state of FIG. In this case, the skirt 210, which is the object immediately before the trousers 220 are displayed, may be displayed. In this way, when the finger is swiped substantially horizontally, another object having a part of the plurality of attributes of the object may be displayed. In this case, a history saving function, which will be described later, may be used to execute an operation in which the selected object returns to the previous one.

  In addition, a plurality of objects may be sequentially displayed in the middle of one horizontal swipe.

  FIG. 2D shows a table listing some of the attributes of each object. “ID” is an identifier for identifying each object. For example, the attribute may have items of “use”, “position”, “sex”, “color”, and “season”. The item for the attribute is not limited to the above example. The object of ID 210 has “clothing”, “lower body”, “woman”, “gray”, and “spring / autumn” in the order of the above items as attributes. It should be noted that it may be determined in advance for each ID whether an object with which attribute item matches among the plurality of attribute items is selected as a candidate. Alternatively, for example, when an object is selected, the attribute item may be displayed and the user may be prompted to select so that the attribute item to be matched can be selected.

  FIG. 3 illustrates the operation of one embodiment. FIG. 3A assumes a case where character 200 is wearing trousers 220 and trousers 220 are selected. A state immediately before the finger 151 swipes in the direction of the arrow 350 is shown.

  FIG. 3B shows a state where the finger 151 has finished swiping in the direction of the arrow 350. As shown, the lower garment has been modified from light gray trousers 220 to dark gray trousers 221. In this case, the corrected pants 221 may be added to the table showing the attributes shown in FIG. By saving, the trousers 221 may be used again.

  FIG. 3C shows a state in which the finger 151 has been swiped along the arrow 351. As shown, the lower garment has returned to light gray trousers 220. Thus, for example, the attribute of “color” may be corrected by an operation of swiping substantially vertically. It should be noted that which attribute can be modified may be determined in advance for each object. Or the candidate of the attribute which can be corrected may be displayed and a user may be prompted to select an attribute. Further, the attribute of “color” may be continuously changed during the swipe. Alternatively, when the swipe direction changes from the vertically swipe state to the left and right or oblique directions, changes in hue, saturation, brightness, etc. may be changed according to the direction.

  FIG. 4 shows another embodiment having a snapshot function. FIG. 4A shows a case where the character 200 is selected by double tapping. An example in which the finger 151 is swiped in the direction of the arrow 450 is shown. As illustrated, a snapshot 460 in which the entire character 200 is reduced is displayed. The snapshot 460 holds the state of the character 200 at the time of double tapping. Thereafter, for example, the character 200 may be restored to the state stored in the snapshot 460 by double-tapping the snapshot (not shown). Alternatively, when the character 200 is not selected and the snapshot 460 is double-tapped, a new character having the snapshot 460 state may be displayed (not shown).

  FIG. 4B shows a state after the object trousers 221 are double-tapped and then swipe by the finger 151 in the arrow 452 direction. In this case, a snapshot 461 of only the pants 221 may be generated. Thereafter, for example, when the lower-body clothes are selected and the snapshot 461 is double-tapped, the lower-body clothes may be in the snapshot 461 state (not shown). Alternatively, by dragging and dropping the snapshot 461 onto the lower body clothes, the lower body clothes may be brought into the state of the snapshot 461 (described in FIG. 6).

  FIG. 5 shows an example of changing an object when an instruction for fixing an attribute is given. For example, the operator may be instructed to fix the attribute “color”. As shown in FIG. 5A, it is assumed that the operator fixes the attribute “color” in advance. A state immediately before swiping the finger 151 in the direction of the arrow 550 is shown. The color of the trousers 221 is dark gray. FIG. 5B shows a state in which the finger 151 has been swiped along the arrow 550. As shown, the lower garment is a dark gray miniskirt 520. In this case, among the objects stored in the table of FIG. 2D, only those having the same “color” attribute (dark gray) may be retrieved and displayed. Alternatively, an object having another “color” attribute may be searched, the attribute may be changed (to dark gray), and the object may be displayed. Note that attributes that can be instructed to be fixed may be limited to those limited in attributes (for example, color, brightness, hue, etc.). For example, when an object is selected, an attribute that can be fixed may be displayed to prompt an operator to fix the attribute. Note that a displayed object having a new attribute may be registered in addition to the table shown in FIG.

  FIG. 6 shows an example of snapshot restoration. As shown in FIG. 6A, it is assumed that the snapshot 461 is dragged and dropped on the miniskirt 520 in the direction of the arrow 650. As shown in FIG. 6B, the lower body clothes of the character 200 are changed to trousers 220. Thus, by saving the snapshot 461, the state of the snapshot 461 can be easily restored in a later state.

  FIG. 7 shows an embodiment of the history function. As shown in FIG. 7A, the trousers 220 are first selected by tapping, and then a circle 702 is drawn with the finger 151. In this case, drawing a circle 702 may be associated with a command that activates the history function. As shown in FIG. The display history (781 to 787) of the clothing of the lower body may be displayed below the character 200. Then, when the finger 151 drags and drops the history display 781 onto the clothing of the lower body of the character 200, the clothing of the lower body is changed to a dress 720. The history display (781 to 787) may be horizontally scrolled to the left and right to further display the past history. The side scrolling instruction may be performed by, for example, swiping with the finger 151.

  FIG. 8 shows a processing flow of one embodiment.

  In step 810, the attributes of the selected object are identified.

  In step 820, the operator's gesture is received as an event.

  In step 830, the gesture event is converted to a command. In this case, the correspondence between the gesture and the command may be determined in advance. Further, based on an instruction from the user, the correspondence between the gesture and the command may be newly added or changed.

  In step 840, based on some attributes of the plurality of attributes of the selected object, an object with a part or all of the attributes matching is searched from the storage unit. When searching, which attribute is to be searched for as a key may be specified for each selected object. Or the attribute for searching may be memorize | stored and a search may be implemented regarding the attribute. Alternatively, the operator may be prompted so that the operator can specify the attribute to be searched.

  In step 850, the object is corrected from the attribute and command of the object. Depending on the command, object replacement 852, object attribute change 854, and snapshot display 856 may be performed. The corrected object and the displayed object may be selected.

  In step 860, the history of the displayed object is stored. In the history storage, only the object IDs shown in FIG. 2D may be stored in a stack type. When a specific object is designated by the history, the attribute may be acquired and displayed from the object ID with reference to the table of FIG. Note that graphical information such as the shape of the object may be stored separately using the object ID as a key. In saving the history, all of a plurality of objects or a set of objects may be saved.

  In step 870, for example, when the attribute is changed, a new entry may be added to the table shown in FIG. Alternatively, the attributes that can be changed may be stored for each object ID in a table different from the table in FIG. Both tables may be linked by an object ID.

  In step 880, it is determined whether an instruction to save a snapshot has been issued. If this determination is “Yes”, the process proceeds to Step 885. If “no”, the process may be terminated. If the selected state continues, the process may return to step 820 (not shown).

  In step 885, the snapshot is saved. In this storage, all the states of the object or the set of objects are stored. As already described, when the character 200 is selected, the states of all objects associated with the character 200 may be saved.

  Other application examples in which the above-described various embodiments of the present invention are applied to specific application software are disclosed below (not shown).

(1) Draw Software Draw software is a type of graphic software that creates figures and illustrations using functions such as filling points, curves, and areas. The created diagrams and illustrations are often saved in vector format data, but may be saved in raster format.

  For example, the line type of the line drawn with the draw software may be changed (for example, changed from a solid line to a broken line) by using the above-described embodiment. You may change the thickness of the line. The color of the filled area may be changed. As described above, the embodiment of the present invention can be used to change or modify a diagram or an illustration drawn with draw software.

(2) Presentation software The above-described embodiment can be used in presentation software, planning document creation software, spreadsheet software, and the like.

  For example, when the created pie chart is changed to another form of graph (bar graph or the like), the above-described embodiment can be used. The operator can easily change to a bar graph by swiping the pie graph.

  Or you may utilize for changing the template prepared for the presentation.

  Or you may use a present Example regarding changing the font of the character described in the balloon etc. For example, the present embodiment may be used to change a document written in one font into another font by swiping the balloon.

(3) Game software When changing game software, social networking service (SNS) characters and avatar clothes, equipment, hairstyle, etc., the above-described embodiments may be used.

  For example, the above-described embodiment may be used so that the operator changes the character's hairstyle from long to short by swiping the character's head with a finger.

(4) 3D software The above-described embodiment may be applied to a three-dimensional object such as 3D software.

  For example, the above-described embodiment may be used such that the operator changes the color of the three-dimensional object by swiping the three-dimensional object with a finger. Or you may apply the above-mentioned Example so that the texture, glossiness, etc. of a three-dimensional object may be changed.

  The above application examples are examples and do not limit the present invention.

  FIG. 9 shows a configuration example of hardware (computer) according to the embodiment of the present invention. The hardware can include a CPU 910, a memory 920, an input device 930, a display device 940, a printer 980, and a portable recording medium interface 960. Each device may be connected by a bus 970. The portable recording medium interface 960 can read and write the portable recording medium 961.

  Note that all or part of the present embodiment can be implemented by a program. This program can be stored in the portable recording medium 961. Examples of the portable recording medium 961 include a magnetic recording medium, an optical disk, a magneto-optical recording medium, and a nonvolatile memory. Magnetic recording media include HDDs, flexible disks (FD), magnetic tapes (MT) and the like. Optical disks include DVD (Digital Versatile Disc), DVD-RAM, CD-ROM (Compact Disc-Read Only Memory), CD-R (Recordable) / RW (ReWritable), and the like. Magneto-optical recording media include MO (Magneto-Optical disk). Non-volatile memory includes USB memory and SD memory. All or part of the embodiments of the present invention can be implemented by reading a program stored in the portable recording medium 961 and executing it by the CPU.

  FIG. 10 is a functional block diagram of an embodiment.

  The gesture event receiving unit 1012 may receive the gesture 1010 of the operator and pass the gesture event information to the command conversion unit 1014.

  The command conversion unit 1014 converts the gesture event into a command based on a predetermined rule. Then, the command may be transmitted to the object attribute specifying unit 1018, the correction unit 1030, and the snapshot object storage unit 1016.

  The object attribute specifying unit 1018 specifies the attribute of the selected object in response to the object selection command. The identified attribute may be transmitted to the correction unit 1030 and the alternative object search unit 1020.

  The substitute object search unit 1020 searches the object storage unit 1050 in accordance with, for example, a search item having an attribute defined for each object. The retrieved set of replaceable objects may be passed to the replacement unit 1032 in the modification unit 1030.

  In response to the replacement command from the command conversion unit 1014, the replacement unit 1032 may replace the currently selected object with one of a set of replaceable objects.

  The attribute change unit 1034 in the correction unit 1030 may change the attribute of the selected object in response to the attribute change command from the command conversion unit 1014.

  The snapshot object storage unit 1016 may store a snapshot of the selected object in response to a snapshot storage command from the command conversion unit 1014.

  In response to the snapshot display command, the snapshot object display control unit 1036 in the correction unit 1030 may take out the specified snapshot from the snapshot object storage unit 1016 and control the display of the snapshot. .

  The history storage unit 1040 stores the correction history of the object in the correction unit 1030. Further, history information may be provided in response to a request from the replacement unit 1032 that operates in response to a history display instruction command.

  The display unit 1060 may perform display based on the object correction information in the correction unit 1030.

1012 Gesture event receiving unit 1014 Command conversion unit 1016 Snapshot object storage unit 1018 Object attribute specifying unit 1020 Alternative object search unit 1030 Modification unit 1032 Replacement unit 1034 Attribute change unit 1036 Snapshot object display control unit 1040 History storage unit 1050 Object storage unit 1060 display unit

Claims (7)

A method of displaying an object by a computer,
Receiving a gesture event performed on a sensing device from an operator;
Converting received gesture events into commands based on predetermined rules;
Selecting an object in response to a command for selecting the object;
Identifying a plurality of attributes which the selected object has,
In response to commands according to the replacement of an object, said a placeholder object which is a substitute candidate selected object, an alternative object with attributes that match the predetermined attribute by the selected object, Retrieving from the object storage unit;
Modifying the selected object;
Have
The modifying step comprises replacing the selected object with the substitute object;
Including the method. The modifying step includes:
Changing at least one of the plurality of attributes;
The method of claim 1 comprising: Storing information including the history of correction as history information;
Further comprising
The method according to claim 1, wherein the command includes a command for returning the modification to a designated past state based on the history information. Saving the indicated object or collection of objects as a snapshot object based on a command specifying a snapshot;
Further comprising
The modifying step includes replacing the selected object with the snapshot object or displaying the snapshot object newly.
4. A method according to any one of claims 1 to 3.   The method according to any one of claims 1 to 4, further comprising the step of storing the object in which at least one of a plurality of attributes is modified in an object storage unit.   The program which makes a computer perform the method of any one of Claims 1 thru | or 5. A device for displaying objects,
A gesture event receiving unit that receives a gesture event performed on a sensing device from an operator;
A command conversion unit that converts, based on a predetermined rule, the accepted taken gesture events to command,
In response to a command related to the selection of an object , an object attribute specifying unit that selects an object and specifies a plurality of attributes of the selected object;
In response to commands according to the replacement of an object, said a placeholder object which is a substitute candidate selected object, an alternative object with attributes that match the predetermined attribute by the selected object, An alternative object search unit that searches from the object storage unit,
A correction unit for correcting the selected object;
Have
The correction unit is
A replacement unit that replaces the selected object with the substitute object;
Including the device.

Images