TWI426464B - Method and device of displaying four-dimension information - Google Patents

Description

Four-dimensional information display method and device

The present invention refers to a four-dimensional information display method, and more particularly to a four-dimensional image display method for displaying a three-dimensional object that changes with time.

The four-dimensional computer-aided engineering software (4D CAD) is used to add time information to the three-dimensional model, which is applied to the engineering, which is the engineering construction sequence scheduling. The four-dimensional computer-aided engineering software can help the entire engineering life cycle from design and construction. Towards more consistent operation management, and 4D software has been recognized in recent years for academic research or industry use. 4D software has the advantages of improving team communication skills, preventing space and time conflicts, and increasing productivity.

However, today's 4D computer-aided engineering software has a high demand for the system. Generally, it is necessary to use a desktop computer to perform smoothly. However, in the construction stage, if you want to manage it on the spot, you must rely on a portable computer or smart type. With the help of mobile phones, but because of the large amount of 4D software memory usage, 4D computer-aided engineering software does not work smoothly on portable computers and smart phones.

Moreover, when the 4D software is to be displayed and used on site, due to the complexity of the worksite environment and the large change of the work place, a hand-held device such as a PDA that is light and convenient to carry is generally used as a vehicle for the site site 4D software, but The use of 4D software on handheld devices must overcome two challenges, one is the processing efficiency of the handheld device and the limitation of the memory size, and the other is that the handheld device generally uses the button and the stylus as the operation interface, such an operation interface. It's not designed to navigate the virtual space, it's not appropriate to use it to manipulate the visual model.

For the sake of the job, the applicant has been able to overcome the above shortcomings by carefully testing and researching, and through a spirit of perseverance, to conceive the "four-dimensional information display method and device" of the case. A brief description of the case.

In view of the defects of the prior art, the present invention achieves the effect of four-dimensional model browsing by reading a two-dimensional image, and reduces the limitation of the use of the four-dimensional software memory, that is, the present invention proposes a method for rendering a four-dimensional image by using a two-dimensional image. Display function, this method utilizes the three-dimensional model generated by the existing three-dimensional software, adds the model to different time stages according to the order of time, and cooperates with the camera function in the three-dimensional software to make the camera take the building model as the spherical center. The spherical surface is distributed, or the camera is placed at the center of the spherical surface. Different cameras are arranged according to different angles of view. Cameras are used to capture different images at different stages and at different positions, and a series of image files are generated, which are read through data reading. The effect of the four-dimensional model.

In order to improve the defect that the above-mentioned handheld device operation interface is not suitable for browsing virtual space, the present invention further establishes a set capable of being applied to a handheld device, and combines multi-touch gestures and motion detection in 4D model browsing. The operating interface prototype. And through the user test to verify the multi-touch gesture combined with the motion detection operation, it is more convenient than the traditional stylus operation mode.

Therefore, according to a first concept of the present invention, a four-dimensional information display method is provided, comprising the steps of constructing a spherical mesh having a plurality of grid points to surround a three-dimensional object; and at least from the plurality of mesh points at different times One observes the three-dimensional object; and records the observed three-dimensional object as a one-stage image.

Preferably, the four-dimensional information display method provided by the present invention further includes the step of accessing and displaying the desired image of the stage through an instruction.

Preferably, the four-dimensional information display method provided by the present invention further comprises the steps of: integrating the plurality of stages of the image into a four-dimensional image; and controlling the four-dimensional image by using an instruction.

Preferably, the four-dimensional information display method provided by the present invention, wherein the three-dimensional object system changes over time.

Preferably, the four-dimensional information display method provided by the present invention, wherein the three-dimensional object is a physical object or a virtual object.

Preferably, the four-dimensional information display method provided by the present invention, wherein the grid points are spatially identical or different from each other.

Preferably, the four-dimensional information display method provided by the present invention, wherein the time intervals are the same or different from each other in time.

Preferably, the four-dimensional information display method provided by the present invention includes a touch command and an action command, and the touch command is received via a touch input device, and the action command is via a motion sensing device. And receive.

Preferably, the four-dimensional information display method provided by the present invention, wherein the touch input device is a personal computer with a touch input function, a desktop computer, a notebook computer, a server, a mobile communication device, A handheld mobile phone, a PDA.

Preferably, the four-dimensional information display method provided by the present invention, wherein the touch command comprises a rotation command, a zoom command, a pan command, a forward command, a back command, a forward play command, and a backward play command. The action instruction includes an open command, a lock command, and a reply command.

Preferably, the four-dimensional information display method provided by the present invention, wherein the rotation command is to slide on the touch input device with a finger.

Preferably, the four-dimensional information display method provided by the present invention, wherein the zoom instruction is to slide on the touch input device with two fingers.

Preferably, the four-dimensional information display method provided by the present invention, wherein the panning command is to slide on the touch input device with three fingers.

Preferably, the four-dimensional information display method provided by the present invention, wherein the forward instruction is a side of the touch input device with one finger.

Preferably, the four-dimensional information display method provided by the present invention, wherein the back instruction is to click on the other side of the touch input device with one finger.

Preferably, the four-dimensional information display method provided by the present invention, wherein the forward play command is to double-click a side of the touch input device with one finger.

Preferably, the four-dimensional information display method provided by the present invention, wherein the backward playback command is to double-click the other side of the touch input device with one finger.

Preferably, the four-dimensional information display method provided by the present invention, wherein the opening command is to raise the arm.

Preferably, the four-dimensional information display method provided by the present invention, wherein the locking instruction is a hanging arm.

Preferably, the four-dimensional information display method provided by the present invention, wherein the reply command is a shaking arm.

Therefore, according to the second concept of the present invention, a four-dimensional information display method is provided for displaying a change of a three-dimensional object over time, comprising the steps of observing the three-dimensional object from at least one perspective at a plurality of different times; The observed three-dimensional objects are recorded as one-stage images.

Preferably, the four-dimensional information display method provided by the present invention further includes accessing and displaying the desired image of the stage through an instruction.

Preferably, the four-dimensional information display method provided by the present invention further comprises integrating the plurality of stages of the image into a four-dimensional image; and controlling the four-dimensional image by using an instruction.

Preferably, the four-dimensional information display method provided by the present invention, wherein the instruction comprises a touch command and an action command.

Therefore, in accordance with a third aspect of the present invention, a computer program product for implementing the four-dimensional information display method as described is provided, which is embodied on a computer readable medium and can be executed on a computer.

Therefore, according to the fourth concept of the present invention, an electronic computing device implementing the four-dimensional information display method as described is proposed.

Preferably, the electronic computing device provided by the present invention is a personal computer, a desktop computer, a notebook computer, a server, a workstation, a handheld device, a mobile phone, a digital phone, a PDA. , a handheld device or a mobile communication device.

The present invention will be fully understood by the following examples, so that those skilled in the art can do so. However, the implementation of the present invention may not be limited by the following embodiments.

The object of the four-dimensional information display method of the present invention is preferably a physical object or a virtual object, which changes its appearance over time, so it is first necessary to establish the target at different times. In the model, the physical object can be a mobile phone, an antenna, a satellite, a building, a car, a landscape, a computer, or everything else having a three-dimensional volume, and the virtual object is a corresponding object simulated by a computer or may be completely absent. A pure virtual object corresponding to the physical object.

The implementation of this method must first establish a three-dimensional model of the building. If you want to simulate the effect of four-dimensional display, you must establish individual models of the three-dimensional model at various stages. If you only want to simulate three-dimensional display, you only need to establish three-dimensional. The model is OK. The following is an example of a building that is actually under construction, and is made into a corresponding virtual object to illustrate the implementation of the four-dimensional information display method of the present invention.

The observation of the building includes the following combinations: viewing the building at a fixed angle of view at different times, observing the building at different angles at different times, and observing the building at different angles at the same time. .

Please refer to the first figures (a)-(g), which are diagrams showing the changes of the building from different angles of view at different times; the first figures (a)-(g) simultaneously reveal the first embodiment of the invention. For example, it is used to illustrate the case where the building is observed at a fixed angle of view at different times; for a building under construction, its appearance certainly changes with the passage of time or evolution, and the observer certainly hopes to The appearance change of the building 10 over time is observed; therefore, the first figures (a)-(g) respectively reveal the structural changes of the building 10 at various times, as the construction process changes, It is in the stage of constructing the beam; the pictures in the first picture (a)-(g) correspond to different times t0~t6, and the time t0~t6 evolves with time; each time t0~t6 The intervals in time may be the same or different from each other, that is, the same time difference or different time differences.

The first figure (a) shows the state of the building 10a at time t0, when the building 10a has just completed the construction of the pillar; the first figure (b) shows the building 10b at time t1. State, at this time, the building 10b has just built a beam; the first figure (c) shows the state of the building 10c at time t2, when the building 10c has just built the second beam; and so on. The first figures (d)-(g) respectively show the state of the building 10d~10g at time t3~t6; in the first embodiment disclosed in the first figures (a)-(g), Observing the building 10 with a fixed viewing angle is equivalent to erecting a camera at a fixed viewing point to record changes in the building 10 over time; the contents of the first figures (a)-(g) are separately recorded as multiple stage image backups. .

Please refer to the second figure (a)-(g), which is a schematic diagram of the change of the building from different perspectives at different times; the second figures (a)-(g) respectively reveal the differentities of the building 10 In the time step, as the structure of the building changes, especially in the stage of building the beam, the pictures correspond to different time steps s0~s6, and the time evolves along the time step s0~s6. . The second figures (a)-(g) simultaneously disclose a second embodiment of the present invention, which is used to illustrate the case of using different viewing angles to observe buildings at different times, which is equivalent to erecting multiple sets at different observation points. The camera records the change of the building 10 over time, and selects to display the image of the building 10 taken by different cameras at different times; the contents of the second picture (a)-(g) are recorded as multiple stages respectively. Image backup.

In order to facilitate the observation of the appearance of the building at different angles of view, a three-dimensional spherical grid surrounding the building can be constructed centered on the building, the center of the grid coincides with the center of the building, and along the axial direction. Forming a uniform or non-uniform mesh on the spherical surface in a manner of equal or unequal spacing from the transverse; a three-dimensional spherical mesh having a uniform mesh is disclosed in the third figure; thus the three-dimensional spherical surface can be The grid is applied to the first and second embodiments described above, so that the observer can more conveniently observe the building 10 from different perspectives. It should be noted, however, that the implementation of the present invention does not necessarily require the construction of a three-dimensional spherical mesh that encases the building. The implementation of the first and second embodiments may also eliminate the use of a three-dimensional spherical mesh.

Please refer to the fourth figure (a)-(d), which is a schematic diagram of the change of the building from different angles of view at a fixed time; the fourth figure (a)-(d) simultaneously reveals the third embodiment of the present invention. For example, it is used to illustrate the case of viewing a building at different angles of view at a fixed time; for a building under construction, its appearance certainly changes over time, but at a particular moment. On the other hand, the appearance may appear in a variety of appearances, so at the same moment, the observer may wish to observe the appearance of the building 10 from different perspectives; therefore, the fourth figures (a)-(d) respectively reveal At the same time, the appearance of the building 10 observed from different perspectives, especially at the stage of the completion of the construction of a group of pillars; in the fourth figure (a)-(d) The contents are recorded as multiple stage image backups.

It is worth noting that in the case where a three-dimensional spherical grid surrounds the building 10, the observer can also record all the images of the building 10 observed from the perspective of each grid point in all the different stages. Then, according to the situation as needed, the images to be displayed are selected therefrom, thereby being combined into the states described in the first to third embodiments.

In addition, the aforementioned three-dimensional spherical mesh having a uniform mesh density or a non-uniform mesh density may be applied to any one of the foregoing first to third embodiments, but the foregoing first to third embodiments are not necessarily It is necessary to use a spherical mesh. If the mesh is not used, you can directly select any point to observe the building. The higher the mesh density, the smoother and finer the simulated 4D display will be.

Therefore, in summary, the four-dimensional information display method described in the present invention is mainly used to display the state change of the three-dimensional object changed with time evolution, and the implementation flow is as shown in the fifth figure. The disclosure mainly includes a step 501: constructing a spherical mesh having a plurality of mesh points to surround the three-dimensional target; step 502 observing the three-dimensional target from at least one of the mesh points at different times; and step 503 The observed three-dimensional objects are recorded as phase images separately.

In the absence of a three-dimensional spherical mesh, the four-dimensional information display method of the present invention is mainly used to display the change of the three-dimensional target changed over time, and the implementation process is as disclosed in the sixth figure. Mainly includes step 601: viewing the three-dimensional object from at least one perspective at different times; and step 602 recording the observed three-dimensional object as a phase image.

Then, each stage image is named according to different positions and time stages or given appropriate labels, and then the stage image to be displayed is called by the instruction and displayed on the screen to achieve the effect of simulating the four-dimensional display, or multiple pictures may be The stage images are integrated into a single four-dimensional digital image. The above four-dimensional digital image is preferably a lightweight and portable handheld device such as a PDA, iPhone or other smart phone as a 4D software capable of playing 4D digital images, or other personal computer with a central processing unit. , a desktop computer, a laptop, a server, a mobile communication device, or a handheld mobile phone.

In combination with a touch input device, such as a touch panel, the user can generate the aforementioned command through different multi-touch gestures to call the stage image to be displayed and display it on the screen, or generate the aforementioned instructions. Control the four-dimensional digital image; take the following at least 10 gestures as an example to illustrate the way to operate the 4D model with multi-touch gestures. For the definition of various touch gestures, please refer to the seventh diagram (a)~(j ).

The gesture of the seventh diagram (a) defines the gesture of the rotation model: through the single-finger touch drag screen, we can rotate the model, and the rotation of the finger from right to left is the clockwise direction of the model. Rotating (overlooking the angle of view), the rotation of the finger from right to left is the rotation of the model in a counterclockwise direction (overlooking view). Slide your finger from bottom to top to bring the camera position up to the bottom of the model, and slide your finger from top to bottom to bring the camera position over the model.

The gesture in Figure 7(b) defines the zoom model: by sliding the screen with two fingers, we can zoom in and out, and its function is equivalent to Zoom's function. Using two fingers, the fingers are separated from the middle to enlarge the model, and the fingers are closed from the sides of the screen to the middle to narrow the model.

The gesture in Figure 7(c) defines the translation model: by dragging the screen through the touch of three fingers, we can make the translation of the model, which moves in the same way as the Pan. Using three fingers, the three fingers slide to the right at the same time, the model moves to the right, the three fingers slide to the left at the same time, the model moves to the left, the three fingers slide up at the same time, the model moves to the top, and the three fingers slide down at the same time, the model moves to the lower .

The gestures of the seventh (d) to (g) respectively define various controls for the time axis: by clicking the screen with a single finger, we can make the forward and backward of the timeline; as shown in the seventh figure (d), click The right side of the screen advances the timeline; as in the seventh diagram (e), click the time on the left side of the screen to retreat; as in the seventh diagram (f), quickly click on the right screen twice, and the model time is played in the axial direction; as shown in the seventh figure ( g), quickly click on the left screen twice, the model time is played in the axial direction.

The gestures of the seventh (h) and (i) respectively define the opening/locking model: as in the seventh figure (h), when the user raises the arm, the machine is turned on, as shown in the seventh figure (i), when the user hangs down The arm locks the machine; therefore, when the user is walking, the machine is naturally locked, that is, when the person is detected to walk, the posture of the arm naturally hangs, that is, the screen is locked, and the power loss is reduced, when the user raises the arm, You can immediately turn on the screen and start the operation. You don't need to take one more action from the pocket. You only need to put your hand down after use, which helps the user to use it more conveniently.

The gesture of the seventh figure (j) defines the return to the model preset perspective: the design consideration of this function is convenient for the user to return to the preset perspective position when accidentally lost in the 3D space while browsing the model. Help the user to regain the orientation in the virtual space, and in order to reduce the operation on the hand, by shaking the arm of the machine, the angle of view can be returned to the preset angle of view.

The above-mentioned embodiment uses the iPhone SDK 2.2 opened by Apple Computer Inc. as a software development tool, and uses Objective-C as a software development language, and then actually works on the iPod touch, but The implementation of the present invention is not limited to the use of iPhone SDK 2.2, Objective-C or iPod touch.

The present invention is a rare and incomprehensible invention, and the above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto. That is to say, the equivalent changes and modifications made by the applicant in accordance with the scope of the patent application of the present invention should still fall within the scope of the patent of the present invention. I would like to ask your review committee to give a clear explanation and pray for it.

10. . . building

T0~t5. . . time

501. . . Construct a spherical mesh with multiple grid points to surround the 3D target

502. . . Observing the three-dimensional object from at least one of the grid points at different times

503. . . Record the observed 3D targets as stage images

601. . . Observing three-dimensional objects from at least one perspective at different times

602. . . Record the observed 3D targets as stage images

The first figures (a) to (g) are schematic views of the building of the present invention viewed from a fixed viewing angle at different times;

The second figures (a) to (g) are schematic views of the buildings of the present invention viewed from different perspectives at different times;

The third figure is a schematic diagram of the three-dimensional spherical grid of the present invention;

The fourth figures (a)-(d) are respectively schematic views of the building of the present invention viewed from different angles of view at a fixed time;

The fifth figure is an implementation flow chart of a four-dimensional information display method using a three-dimensional spherical grid;

The sixth figure is an implementation flow chart of the four-dimensional information display method in which the three-dimensional spherical grid is not applied;

The seventh diagrams (a) to (j) are respectively schematic diagrams of the touch gestures of the present invention.

10. . . building

T0~t5. . . time

Claims (23)

A four-dimensional information display method includes the steps of: constructing a spherical mesh having a plurality of mesh points, wherein the spatial distances between the mesh points are the same or different, and the spherical mesh surrounds a three-dimensional Optionally, the three-dimensional object is a physical object or a virtual object changes with time; the three-dimensional object is observed from at least one of the grid points at different times, and the time intervals between the moments are It is the same or different; and the observed three-dimensional objects are recorded as one-stage images. The method for displaying a four-dimensional information as described in claim 1 of the patent application further includes the step of: accessing and displaying the desired image of the stage through an instruction. The method for displaying a four-dimensional information as described in claim 1 further includes the steps of: integrating the plurality of images of the stage into a four-dimensional image; and controlling the four-dimensional image by using an instruction. The control method of claim 2, wherein the command comprises a touch command and an action command, the touch command being received via a touch input device, the action command being sensed via a motion Received by the device. The control method of claim 4, wherein the touch input device is a personal computer having a touch input function, a desktop computer, a notebook computer, a server, a mobile communication device, and a Handheld mobile phone, a PDA. The four-dimensional information display method of claim 4, wherein the touch command comprises a rotation command, a zoom command, a pan command, a forward command, a back command, a forward play command, and a backward play command. The action instruction includes an open command, a lock command, and a reply command. The four-dimensional information display method of claim 6, wherein the rotation command is to slide on the touch input device with a finger. The four-dimensional information display method of claim 6, wherein the zoom instruction is to slide on the touch input device with two fingers. The four-dimensional information display method of claim 6, wherein the panning command is to slide on the touch input device with three fingers. The four-dimensional information display method according to claim 6, wherein the forward instruction is to click on a side of the touch input device with one finger. The four-dimensional information display method according to claim 10, wherein the back instruction is to click on the other side of the touch input device with one finger. The four-dimensional information display method according to claim 6, wherein the forward play command is to double-click a side of the touch input device with one finger. The four-dimensional information display method according to claim 12, wherein the backward play command is to double-click a other side of the touch input device with one finger. For example, the four-dimensional information display method described in claim 6 is that the opening command is to raise the arm. The four-dimensional information display method described in claim 6 is wherein the locking command is a hanging arm. For example, the four-dimensional information display method described in claim 6 is that the reply command is a shaking arm. A four-dimensional image display method for displaying a three-dimensional object over time, comprising the steps of: viewing the three-dimensional object from at least one perspective at a plurality of different times, wherein the moments are temporally related to each other The intervals are the same or different and the three-dimensional object is changed as a physical object or a virtual object changes over time; and the observed three-dimensional objects are separately recorded as one-stage images. For example, the four-dimensional information display method described in claim 17 of the patent application includes: accessing and displaying the desired image of the stage through an instruction. The four-dimensional information display method described in claim 17 further includes: integrating the plurality of stages of the image into a four-dimensional image; and controlling the four-dimensional image through an instruction. The method of displaying a four-dimensional information according to claim 18 or 19, wherein the instruction comprises a touch command and an action command. A computer program product for implementing the four-dimensional information display method as described in claim 17 of the patent application, which is embodied on a computer readable medium and executable on a computer. An electronic computing device implementing the four-dimensional information display method as described in claim 17 of the patent application. The electronic computing device according to claim 22 is a personal computer having a central processing unit, a desktop computer, a notebook computer, a server, a mobile communication device, a handheld mobile phone, and a PDA.