JP2011254175A - Information processor and operation method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve such a problem of prior art that it is difficult to read annotation information when the display direction of annotation information of an object is different from the display direction of the object, and it is difficult to input the annotation information when the display direction of the annotation information of an object is matched to the display direction of the object.SOLUTION: The information processor detects the display direction of an object displayed on a screen and the display direction of annotation information of the object, acquires information indicating whether the object is associated with the annotation information or not, and displays the annotation information while matching the display direction of annotation information to the display direction of the object when the object is associated with the annotation information.

Description

  The present invention relates to a technique for controlling an image displayed on a screen.

  In recent years, systems capable of displaying electronic data and writing to the electronic data to be displayed have become widespread.

  This makes it possible to provide effective presentations using various electronic data such as figures and images, or by directly writing electronic data depending on the situation.

  However, there are various issues to properly adjust the data display direction and data writing position when the operator who switches data and writes data and the standing position of the person browsing the data are different. There is.

  In order to solve this problem, there are methods of automatically adjusting the number of data display and the display position, and automatically adjusting the display position of written data.

  For example, Patent Document 1 proposes an invention in which document data is stored, and difference data from the previously stored document data and its coordinates are acquired. Also, if one or more difference data can be placed in the margin, and the difference data overlaps, a technique for shifting the position according to the priority, and if the difference data does not enter the margin even if the position is shifted A technique for reducing and arranging the difference data is also described.

JP 2009-147435 A

  However, since the technique described in Patent Document 1 is intended to arrange the differential data to be written, the writing direction of the differential data to be written is not considered. Therefore, if the original data display direction is different from the data writing direction, it is difficult to read if the writer writes in the direction that is easy to write, or the writer who writes when the writer tries to write in the original data display direction. There is a problem that is difficult to write.

  SUMMARY OF THE INVENTION An object of the present invention is to solve such problems and to display data inputted from a position where it is easy to write so that it can be easily viewed by a person who is looking from a different position.

  An information processing apparatus according to the present invention for solving the above-described problems includes a detection unit that detects a display direction of an object displayed on a screen and a display direction of annotation information of the object, and the object and the annotation information. When the acquisition means for acquiring information indicating whether or not the object and the annotation information are associated with each other, the display direction of the annotation information is matched with the display direction of the object, and the annotation information is Display control means for displaying.

  According to the present invention, data input from a position where it is easy to write can be displayed so that it can be easily viewed by a person who is looking from a different position.

It is a figure which shows the function structure of the information processing apparatus which concerns on this invention. It is a flowchart which shows the flow of the process which aligns the direction of an object. It is a figure which shows typically the flow of the process which arranges the direction of an object. It is a figure which shows the function structure of the information processing apparatus which concerns on this invention. It is a flowchart which shows the flow of the process which determines whether an object is rotated, and the process which determines a rotation angle.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1A is a diagram showing a configuration of a data display apparatus (information processing apparatus) 101 to which the present invention can be applied.

  The data display device 101 includes a speech bubble input unit 102 that inputs a speech symbol, a speech content input unit 103 that inputs speech content input by the speech bubble input unit, and a display direction acquisition unit 104 that acquires a display direction of a speech bubble. It is characterized by providing.

  Further, a speech content rotation unit 105 that rotates the content of the speech bubble input by the speech content input unit 103 is provided. Moreover, the display part 106 which displays data is provided.

  The data display device 101 includes at least a CPU 107, a program memory 109 that stores a processing program executed by the CPU 107, and a memory 108 that provides a work area during processing by the CPU 107 and temporarily stores various data.

  The functions of the above-described units and the processing of the flowcharts shown below are realized by the CPU 107 based on this processing program.

  FIG. 2 is a flowchart showing an operation example when converting the display direction of the input speech bubble when the speech bubble is input from the user to the data being displayed by the speech bubble input unit 102.

  When arbitrary data (object) is designated by the speech bubble input unit 102 as a speech bubble start target, the speech bubble input data (data newly displayed among the data currently displayed on the data display device 101 in step S201). Annotation information) is acquired.

  That is, the process of step S201 corresponds to a process of associating arbitrary data (object) with speech input data (annotation information).

  In step S202, the input target data that is the starting point of the written speech bubble and is the target of writing is acquired.

  Next, in step S203, the display direction acquisition unit 104 acquires the display direction (for example, vertical direction, horizontal direction, etc.) of the input target data acquired in step S202.

  Actually, the display direction is acquired from the display direction of the screen to be input target data, the display direction of the image displayed on the screen, or the display angle designation of the character font of the text.

  After that, in step S204, the balloon content is rotated and displayed in the display direction acquired in step S203 by the balloon content rotating unit 105, and the process ends.

  That is, in the process of step S204, when arbitrary data (object) and speech input data (annotation information) are associated with each other, the display direction of the speech input data is matched with the display direction of the arbitrary data and the speech input is performed. This corresponds to display control for displaying data.

  By the way, as a speech bubble input method, for example, a ruled line and an ellipse are designated, and a character string with a ruled line drawn is designated as a speech target by connecting both with a line.

  Further, the speech bubble contents enclosed by an ellipse are to be converted to rotation as newly written data.

  FIG. 3 shows a speech input method and a screen example in which display contents are converted by speech input.

  FIG. 3A shows an example of a screen displaying original image data (object). In this figure, the display direction (display angle) of the image data (object) is 0 degree.

  FIG. 3B shows an example of a screen in which a speech balloon target is designated by a ruled line 301.

  FIG. 3C shows an example of a screen in which a drawing data character string 302 “reconsideration” is newly written from the opposite direction to the display after drawing a leader line from the ruled line 301. In this figure, the display direction (display angle) of the speech balloon content (data serving as annotation information) is 180 degrees.

  FIG. 3D shows an example of a screen in which the write data character string 302 is surrounded by an ellipse 303, and the data character string 302, which is the speech content, is to be converted by the speech content rotating unit 105.

  FIG. 3E shows an example of a screen in which the write data character string 302 written in the reverse direction is converted and displayed in the same direction as the speech-out target data. That is, in this figure, the display direction (display angle) of the speech balloon content (data serving as annotation information) is 0 degrees.

  In this example, the contents of the speech bubble are reversed from top to bottom because they are written from the opposite side. However, if the speech content is written from the side, it may be arranged in the same way.

  It is preferable to automatically determine which direction and how much the speech bubble should be rotated from the shape of the speech bubble and the stroke order of the speech bubble.

  For example, if you start writing from a unique direction, such as the ellipse in Fig. 3, the frame corresponding to the part where you want to write the contents of the speech bubble, you can easily determine the speech balloon direction. It becomes.

  That is, first, the content of the speech bubble is specified as the speech bubble input data (annotation information) by an operation surrounding the content (data) of the speech bubble displayed on the screen.

  Furthermore, the display direction of the balloon input data (annotation information) is determined based on the end points of the operation (for example, writing start and writing end points) and the locus.

  Although an example of a character string is shown here as a conversion target, a character string including a symbol or a symbol, a single character thereof, a picture that is not a character, or the like may be used as long as it has a direction.

  By the way, when the balloon content is rotated and displayed by the balloon content rotation unit 105 in step S204, it is determined whether or not the newly written data is difficult to see due to an obstacle to displaying other data being displayed. May be.

  Based on this determination result, not only the display direction but also the display position can be converted. The configuration of the data display device in this case is shown in FIG. In the data display device 401, since 402 to 409 are the same as the data display device 101, description thereof is omitted. In addition, a display position control unit 410 is provided to determine whether display data overlap.

  After the process of step S205 is completed, the display position control unit 410 determines whether the display position of the input data overlaps with other data being displayed, thereby preventing display of other data. When the display overlap is determined, the display position control unit 410 moves the display position of the input data to the margin part. If there is no display overlap, the process is terminated without changing the display position.

  However, even if they overlap, when the user intentionally overlaps and writes, this processing may not be performed and the position written by the user may not be changed.

  As described above, according to the present embodiment, it is possible to display data input from a position where it is easy to write so that it can be easily viewed by a person viewing from a different position.

(Second Embodiment)
Next, as the second embodiment, an example will be described in which, in the first embodiment, it is determined whether or not to change the display direction of the written content based on the input shape of the speech.

  This makes it possible to treat the written content as a user's memo by not performing conversion even if the speech content and the display direction of the speech target are different, so that convenience is improved.

  The configuration of the data display device of the second embodiment is shown in FIG. In the data display device 501, 502 to 509 are the same as the data display device 101, and thus the description thereof is omitted. In addition, the data display device 501 includes a determination unit 510 that determines whether to change the display direction of the speech bubble depending on the situation. .

  FIG. 5A illustrates an operation example when determining whether or not to convert the balloon and the display direction of the content according to the balloon shape input by the user when the balloon is input from the user by the balloon input unit 102. It is a flowchart to show.

  In step S601, the balloon and the balloon contents are acquired as newly written data among the data displayed on the data display device 501.

  In step S602, the determination unit 510 determines whether the speech data acquired in step S601 should be converted.

  The determination unit 510 makes a determination based on the shape type of the locus that specifies the range of the speech balloon content and whether or not the range is specified.

  As a result of the determination in step S602, if it is determined that the data is to be converted, the process proceeds to step S603, and if it is determined that the data is not to be converted, the process is terminated.

  In step S603, the processing after the processing of step S202 shown in FIG. 2, that is, the display direction conversion processing from the acquisition of the written speech target data to the rotation display processing of the speech content input in step S204 is performed. Exit.

  Here, as the shape of the speech bubble, for example, conversion is performed when enclosed by an ellipse as shown in the first embodiment, and conversion is performed when not surrounded by an ellipse or enclosed by a rectangle without being enclosed by an ellipse. Setting such as not to be considered.

  As described above, according to the present embodiment, a character input from a position where it is easy to write can be displayed and converted by a designation method so that it can be easily viewed by a person viewing from a different position. You can decide whether to keep it legible.

(Third embodiment)
Next, a third embodiment will be described. In this embodiment, in the first embodiment, the rotation angle is determined by acquiring the direction of the input content.

  Accordingly, the angle to be rotated can be determined more accurately without limiting the shape and writing method of the speech bubble input by the speech bubble input unit, so that convenience is improved.

  The configuration of the data display device of the third embodiment is shown in FIG. In the data display device 701, descriptions of 702 to 709 are omitted because they are the same as the data display device 101, but in addition, a speech content direction acquisition unit 710 is provided to acquire the direction from the content of the written speech bubble.

  FIG. 5B is a flowchart illustrating an operation example when the rotation angle is determined by acquiring the display direction of the input content.

  Steps S801 to S803 are the same as the operations described in the first embodiment, and a description thereof will be omitted.

  In step S804, the speech content direction acquisition unit 710 detects the direction of the input content written in the speech bubble.

  Next, in step S805, the difference between the display direction of the speech input target data acquired in step S803 and the direction of the speech content acquired in step S804 is calculated.

  In step S806, it is determined from the calculation result in step S805 whether there is a difference between the input target of the speech bubble and the direction of the input speech bubble content.

  If YES in step S806, the process proceeds to step S807, where the balloon content rotating unit 105 rotates the balloon content, converts the display direction, and displays again, and the process ends.

  On the other hand, when the speech balloon input is performed in accordance with the data being displayed, the result is No in step S806, so that the process is terminated without performing any particular conversion.

  Here, the direction detection means for the input speech bubble content may be any means as long as the direction of the input data can be detected. For example, if the written data is a character, the direction may be determined by a handwritten character recognition technique such as optical character recognition (OCR) in addition to the determination at the writing start position and the end position.

  In addition, since a direction is known if a symbol or a picture has a general shape even if it is not a character, a recognition means such as recognizing the content using a dictionary registered in advance may be used.

  Alternatively, the direction may be determined by a recognition technique for recognizing a plurality of input trajectory coordinate data rotated at a plurality of angles by the input trajectory coordinate rotation means for each character and the coordinate rotation means.

  Alternatively, by providing a recognition unit that recognizes the position of the input person such as the user's head and body or the writing position, the speech content direction acquisition unit 710 can determine the direction based on the position of the input person. Become.

  More specifically, a method is conceivable in which a sensor capable of detecting the position of the input person is connected to a data display device, and determination is made by recognizing an input direction based on an input signal from the sensor.

  In addition to the method of detecting the position in advance, any method may be used as long as the position of the input person can be detected, such as a method of detecting a change based on information such as an image and temperature / depth.

  As described above, according to the present embodiment, it is possible to easily match the content input from a position easy for the user to write with the display direction of the input target by determining the direction from the content.

  Further, according to the present invention, the direction of data input in an easy-to-write direction can be converted and displayed so that it can be easily viewed by a person who is looking from a different position.

  Moreover, it is possible not to convert depending on the input shape. In addition, it is possible to determine how to convert from the content of the input data and the input direction.

(Other embodiments)
The present invention can also be realized by executing the following processing. That is, software (program) that realizes the functions of the above-described embodiments is supplied to a system or apparatus via a network or various storage media, and a computer (or CPU, MPU, or the like) of the system or apparatus reads the program. It is a process to be executed.

Claims (4)

Detecting means for detecting the display direction of the object displayed on the screen and the display direction of the annotation information of the object;
Obtaining means for obtaining information indicating whether the object and the annotation information are associated;
An information processing apparatus comprising: a display control unit configured to display the annotation information by matching a display direction of the annotation information with a display direction of the object when the object and the annotation information are associated with each other. And a specifying means for specifying the data as the annotation information by an operation surrounding the data displayed on the screen.
The information processing apparatus according to claim 1, further comprising a determining unit that determines a display direction of the annotation information based on an end point and a trajectory of the operation. An operation method of an information processing apparatus for controlling an image displayed on a screen,
A detection step of detecting a display direction of the object displayed on the screen and a display direction of the annotation information of the object;
An acquisition step of acquiring information indicating whether the object and the annotation information are associated;
And a display control step of displaying the annotation information by matching a display direction of the annotation information with a display direction of the object when the object and the annotation information are associated with each other.   A program for causing a computer to execute the operation method according to claim 3.

Images