JP6275809B1 - Display control method and program for causing a computer to execute the display control method - Google Patents

Abstract

A display control method for facilitating grasping of a space in a virtual space is provided.
A display control method in a system including an HMD, wherein virtual space 200 data including a virtual camera 300 and target objects FC and SC is generated, and the HMD is based on a visual field CV and virtual space data of the virtual camera. The visual field image is displayed, the virtual camera is moved based on the movement of the HMD, and the visual field image is updated. Furthermore, based on the input operation, the specific processing object TP composed of a figure having an opening on the side far from the virtual camera is displayed. It is determined whether or not at least a part of the target object exists on the virtual camera side relative to the specific processing object in the field of view, and it is determined that at least a part exists on the virtual camera side by moving the specific processing object At least a part of the target object is transparently processed.
[Selection] Figure 10

Description

  The present disclosure relates to a display control method and a program for causing a computer to execute the display control method.

In recent years, games (hereinafter sometimes referred to as VR games) in which a head-mounted device (HMD: Head-Mounted Device) can be attached and immersed in a virtual reality (VR) space are known.
Patent Document 1 can identify an object arranged on a reference line of sight in a virtual space, and can move the identified object according to a head tilting operation in a predetermined direction of the HMD in accordance with the identification of the object. It is disclosed.

Japanese Patent Laid-Open No. 2006-173698 JP, 2006-52396, A

  In Patent Document 1, when a plurality of objects overlap with the line-of-sight direction of the HMD, the object that can be visually recognized and can be selected is the object on the near side in principle. And difficult to choose.

  An object of the present disclosure is to provide a display control method for facilitating space grasp in a VR space. Moreover, this indication aims at providing the program for making a computer perform the said display control method.

According to one aspect of the present disclosure, a display control method in a system including a head mounted device,
The display control method is
(A) generating virtual space data defining a virtual space including the virtual camera and the target object;
(B) displaying a visual field image on the head mounted device based on the visual field of the virtual camera and the virtual space data;
(C) updating the visual field image by moving the virtual camera based on the movement of the head mounted device;
(D) displaying a specific processing object formed of a graphic having an opening on the side far from the virtual camera in the virtual space based on a predetermined input operation;
(E) determining whether at least a part of the target object is present on the virtual camera side with respect to the specific processing object in the visual field;
(F) By moving the specific processing object, the at least a part of the target object determined to be present at least at the virtual camera side from the specific processing object in the step (e) is transparently processed. Steps,
including.

  According to the present disclosure, it is possible to provide a display control method for facilitating space grasp in the VR space.

1 is a schematic diagram illustrating a head mounted device (HMD) system according to an embodiment. It is a figure which shows the head of the user with which HMD was mounted | worn. It is a figure which shows the hardware constitutions of a control apparatus. It is a flowchart which shows the process which displays a visual field image on HMD. It is xyz space figure which shows an example of virtual space. (A) is a yx plan view of the virtual space shown in FIG. 5, and (b) is a zx plan view of the virtual space shown in FIG. 5. It is a flowchart for demonstrating the display control method which concerns on this embodiment. (A) is a schematic diagram of the virtual space prescribed | regulated with the display control method which concerns on this embodiment, (b) is a visual field image produced | generated based on the said virtual space. (A) is a schematic diagram of the virtual space prescribed | regulated with the display control method which concerns on this embodiment, (b) is a visual field image produced | generated based on the said virtual space. (A) is a schematic diagram of the virtual space prescribed | regulated with the display control method which concerns on this embodiment, (b) is a visual field image produced | generated based on the said virtual space. (A) is a schematic diagram of the virtual space prescribed | regulated with the display control method which concerns on this embodiment, (b) is a visual field image produced | generated based on the said virtual space. It is a schematic diagram regarding the control method of a transparent process object. It is a visual field image regarding the control method of a transparent processing object. (A), (b) is a figure which shows the modification of a transparent process object. 10 is a schematic diagram of a virtual space defined by a display control method according to Modification 1. (A) is a schematic diagram of the virtual space prescribed | regulated by the display control method which concerns on the modification 1, (b) is a visual field image produced | generated based on the said virtual space. (A) is a schematic diagram of the virtual space prescribed | regulated by the display control method which concerns on the modification 2, (b) is a visual field image produced | generated based on the said virtual space.

[Description of Embodiments Presented by the Present Disclosure]
An overview of an embodiment indicated by the present disclosure will be described.
(1) A display control method in a system including a head mounted device,
The display control method is
(A) generating virtual space data defining a virtual space including the virtual camera and the target object;
(B) displaying a visual field image on the head mounted device based on the visual field of the virtual camera and the virtual space data;
(C) updating the visual field image by moving the virtual camera based on the movement of the head mounted device;
(D) displaying a specific processing object formed of a graphic having an opening on the side far from the virtual camera in the virtual space based on a predetermined input operation;
(E) determining whether at least a part of the target object is present on the virtual camera side with respect to the specific processing object in the visual field;
(F) By moving the specific processing object, the at least a part of the target object determined to be present at least at the virtual camera side from the specific processing object in the step (e) is transparently processed. Steps,
including.

  According to the above method, it is possible to easily grasp the space in the VR space.

  (2) In the step (f), by changing the position and inclination of the two-dimensional figure forming the opening in the three-dimensional orthogonal coordinate system, the two-dimensional area to be transparently processed in the virtual space is changed. The position and inclination in the three-dimensional orthogonal coordinate system may be changed.

  According to the above method, since the perceived visual field image can be viewed by freely moving the specific processing object to an arbitrary position and orientation in the virtual space that is a three-dimensional space, it is possible to provide a rich virtual space experience. it can.

  (3) In the step (f), the size of the opening of the specific processing object may be changeable.

  According to the above method, a richer virtual space experience can be provided.

(4) The system further includes a position sensor configured to detect a position of the head mounted device and a position of a body part other than the user's head,
The virtual space further includes an operation object operable according to the movement of the part of the user's body,
In the step (f), the specific processing object may be movable based on the movement of the operation object.

  According to the above method, for example, the specific processing object can be arbitrarily moved by moving the virtual hand object (hand device) displayed in the visual field image.

(5) The system further includes a position sensor configured to detect a position of the head mounted device and a position of a body part other than the user's head,
The virtual space further includes an operation object operable according to the movement of the part of the user's body,
In the step (f), the size of the opening may be changeable based on the shape of the operation object.

  According to the above method, for example, the size of the opening of the specific processing object can be arbitrarily changed according to the shape of the finger of the virtual hand object.

  (6) In the step (f), only the target object closest to the virtual camera is transparently processed among the plurality of target objects determined to be at least partially present on the virtual camera side from the specific processing object. Also good.

  According to the above-described method, it is possible to prevent a transparent target object from being subjected to a transparent process among a plurality of target objects.

  (7) A program for causing a computer to execute the display control method according to any one of (1) to (6) above.

  According to this configuration, it is possible to provide a program that facilitates space grasp in the VR space.

[Details of Embodiments Presented by the Present Disclosure]
Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In addition, about the member which has the same reference number as the member already demonstrated in description of this embodiment, the description is not repeated for convenience of explanation.

  FIG. 1 is a schematic diagram illustrating a head mounted device (hereinafter simply referred to as an HMD) system 1 that implements an information processing method according to an embodiment (hereinafter simply referred to as the present embodiment) described in the present disclosure. As shown in FIG. 1, the HMD system 1 includes an HMD 110 mounted on the head of the user U, a position sensor 130, a control device 120, and an external controller 320.

  The HMD 110 includes a display unit 112, an HMD sensor 114, and headphones 116 (an example of an audio output unit).

  The display unit 112 includes a non-transmissive display device configured to cover the field of view (field of view) of the user U wearing the HMD 110. The HMD 110 may include a transmissive display device, and may be temporarily configured as a non-transmissive display device by adjusting the transmittance of the transmissive display device. Thereby, the user U can immerse in the virtual space by viewing only the visual field image displayed on the display unit 112. Note that the display unit 112 may include a display unit for the left eye that is projected onto the left eye of the user U and a display unit for the right eye that is projected onto the right eye of the user U.

  The HMD sensor 114 is mounted in the vicinity of the display unit 112 of the HMD 110. The HMD sensor 114 includes at least one of a geomagnetic sensor, an acceleration sensor, and a tilt sensor (such as an angular velocity sensor and a gyro sensor), and can detect various movements of the HMD 110 mounted on the head of the user U.

  The headphones 116 are attached to the left and right ears of the user U, respectively. The headphones 116 are configured to receive audio data (electrical signals) from the control device 120 and output audio based on the received audio data. The sound output to the right ear speaker of the headphone 116 may be different from the sound output to the left ear speaker of the headphone 116. For example, the control device 120 acquires audio data input to the right ear speaker and audio data input to the left ear speaker based on the head-related transfer function, and uses the two different audio data to the headphones 116. May be output to each of the left ear speaker and the right ear speaker. In addition, you may provide a speaker (for example, two stationary speakers) and an earphone independent of HMD110, without providing headphones 116 in HMD110.

  The position sensor 130 is composed of, for example, a position tracking camera, and is configured to detect the position of the HMD 110. The position sensor 130 is communicably connected to the control device 120 by wireless or wired communication, and is configured to detect information on the position, inclination, or light emission intensity of a plurality of detection points (not shown) provided in the HMD 110. . The position sensor 130 may include an infrared sensor and a plurality of optical cameras.

  The control device 120 acquires the position information of the HMD 110 based on the information acquired from the position sensor 130, and wears the position of the virtual camera in the virtual space and the HMD 110 in the real space based on the acquired position information. Thus, the position of the user U can be accurately associated.

  Next, with reference to FIG. 2, a method for acquiring information related to the position and inclination of the HMD 110 will be described. FIG. 2 is a diagram illustrating the head of the user U wearing the HMD 110. Information regarding the position and inclination of the HMD 110 that is linked to the movement of the head of the user U wearing the HMD 110 can be detected by the position sensor 130 and / or the HMD sensor 114 mounted on the HMD 110. As shown in FIG. 2, three-dimensional coordinates (uvw coordinates) are defined centering on the head of the user U wearing the HMD 110. The vertical direction in which the user U stands upright is defined as the v axis, the direction orthogonal to the v axis and connecting the center of the display unit 112 and the user U is defined as the w axis, and the direction perpendicular to the v axis and the w axis is the u axis. It prescribes as The position sensor 130 and / or the HMD sensor 114 is an angle around each uvw axis (that is, a yaw angle indicating rotation about the v axis, a pitch angle indicating rotation about the u axis, and a center about the w axis). The inclination determined by the roll angle indicating rotation) is detected. The control device 120 determines angle information for controlling the visual axis of the virtual camera that defines the visual field information based on the detected angle change around each uvw axis.

  Next, the hardware configuration of the control device 120 will be described with reference to FIG. As shown in FIG. 3, the control device 120 includes a control unit 121, a storage unit 123, an I / O (input / output) interface 124, a communication interface 125, and a bus 126. The control unit 121, the storage unit 123, the I / O interface 124, and the communication interface 125 are connected to each other via a bus 126 so as to communicate with each other.

  The control device 120 may be configured as a personal computer, a tablet, or a wearable device separately from the HMD 110, or may be mounted inside the HMD 110. In addition, some functions of the control device 120 may be mounted on the HMD 110, and the remaining functions of the control device 120 may be mounted on another device separate from the HMD 110.

  The control unit 121 includes a memory and a processor. The memory includes, for example, a ROM (Read Only Memory) in which various programs are stored, a RAM (Random Access Memory) having a plurality of work areas in which various programs executed by the processor are stored, and the like. The processor is, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and / or a GPU (Graphics Processing Unit), and a program specified from various programs incorporated in the ROM is expanded on the RAM. It is comprised so that various processes may be performed in cooperation with.

  In particular, the processor 121 develops an information processing program (to be described later) for causing a computer to execute the information processing method according to the present embodiment on the RAM, and executes the program in cooperation with the RAM. May control various operations of the control device 120. The control unit 121 provides a virtual space (view image) to the display unit 112 of the HMD 110 by executing a predetermined application (game program) stored in the memory or the storage unit 123. Thereby, the user U can be immersed in the virtual space provided on the display unit 112.

  The storage unit (storage) 123 is a storage device such as an HDD (Hard Disk Drive), an SSD (Solid State Drive), or a USB flash memory, and is configured to store programs and various data. The storage unit 123 may incorporate an information processing program. In addition, a user authentication program, a game program including data on various images and objects, and the like may be stored. Furthermore, a database including tables for managing various data may be constructed in the storage unit 123.

  The I / O interface 124 is configured to connect the position sensor 130, the HMD 110, the headphones 116, and the external controller 320 to the control device 120 so that they can communicate with each other. For example, the I / O interface 124 is a USB (Universal Serial Bus). A terminal, a DVI (Digital Visual Interface) terminal, a HDMI (registered trademark) (High-Definition Multimedia Interface) terminal, and the like. The control device 120 may be wirelessly connected to each of the position sensor 130, the HMD 110, the headphones 116, and the external controller 320.

  The communication interface 125 is configured to connect the control device 120 to a communication network 3 such as a LAN (Local Area Network), a WAN (Wide Area Network), or the Internet. The communication interface 125 includes various wired connection terminals for communicating with an external device via the communication network 3 and various processing circuits for wireless connection. The communication interface 125 conforms to a communication standard for communicating via the communication network 3. Configured to fit.

  Next, processing for displaying a field-of-view image on the HMD 110 will be described with reference to FIGS. 4 to 6. FIG. 4 is a flowchart showing a process for displaying the visual field image on the HMD 110. FIG. 5 shows an xyz space diagram showing an example of the virtual space 200. The state (a) in FIG. 6 is a yx plan view of the virtual space 200 shown in FIG. 5, and the state (b) in FIG. 6 is a zx plan view of the virtual space 200 shown in FIG.

As shown in FIG. 4, in step S <b> 1, the control unit 121 (see FIG. 3) generates virtual space data that defines the virtual space 200 including the virtual camera 300. As shown in FIGS. 5 and 6, the virtual space 200 is defined as a celestial sphere centered on the center position 21 (only the upper half celestial sphere is shown in FIGS. 5 and 6). In the virtual space 200, an xyz coordinate system with the center position 21 as the origin is set. In the initial state of the HMD system 1, the virtual camera 300 is disposed at the center position 21 of the virtual space 200.
The uvw coordinate system that defines the visual field of the virtual camera 300 is determined so as to be linked to the uvw coordinate system that is defined around the head of the user U in the real space. Further, the virtual camera 300 may be moved in the virtual space 200 in conjunction with the movement of the user U wearing the HMD 110 in the real space.

  Next, in step S2, the control unit 121 specifies the field of view CV (see FIG. 6) of the virtual camera 300. Specifically, the control unit 121 acquires information on the position and inclination of the HMD 110 based on data indicating the state of the HMD 110 transmitted from the position sensor 130 and / or the HMD sensor 114. Next, the control unit 121 determines the position and orientation of the virtual camera 300 in the virtual space 200 based on information regarding the position and inclination of the HMD 110. Next, the control unit 121 determines a reference line of sight L corresponding to the visual axis of the virtual camera 300 from the position and orientation of the virtual camera 300, and specifies the field of view CV of the virtual camera 300 from the determined reference line of sight L. Here, the visual field CV of the virtual camera 300 coincides with a partial region of the virtual space 200 that is visible to the user U wearing the HMD 110. In other words, the visual field CV coincides with a partial area of the virtual space 200 displayed on the HMD 110. Further, the visual field CV includes a first region CVa set as an angular range of the polar angle θα centered on the reference line of sight L in the xy plane shown in the state (a) of FIG. 6, and a state (b) of FIG. The xz plane shown has a second region CVb set as an angular range of the azimuth angle θβ with the reference line of sight L as the center.

  As described above, the control unit 121 can specify the visual field CV of the virtual camera 300 based on the data from the position sensor 130 and / or the HMD sensor 114. Here, when the user U wearing the HMD 110 moves, the control unit 121 specifies the visual field CV of the virtual camera 300 based on the data indicating the movement of the HMD 110 transmitted from the position sensor 130 and / or the HMD sensor 114. be able to. That is, the control unit 121 can move the visual field CV according to the movement of the HMD 110.

  Next, in step S <b> 3, the control unit 121 generates visual field image data indicating the visual field image displayed on the display unit 112 of the HMD 110. Specifically, the control unit 121 generates visual field image data based on virtual space data defining the virtual space 200 and the visual field CV of the virtual camera 300. In other words, the visual field CV of the virtual camera 300 determines the range to be drawn as visual field image data in the virtual space data.

  Next, in step S <b> 4, the control unit 121 displays a field image on the display unit 112 of the HMD 110 based on the field image data. As described above, the visual field CV of the virtual camera 300 is changed according to the movement of the user U wearing the HMD 110, and the visual field image V displayed on the HMD 110 is changed, so that the user U is immersed in the virtual space 200. be able to.

  Next, the display control method according to the present embodiment will be described with reference to FIGS. FIG. 7 is a flowchart for explaining the display control method according to the present embodiment. 8 to 11 are a schematic diagram of a virtual space defined by the display control method according to the present embodiment, and a visual field image generated based on the virtual space.

  First, as shown in the state (a) of FIG. 8, the virtual space 200 includes a virtual camera 300, a first target object FC, and a second target object SC. The control unit 121 generates virtual space data that defines the virtual space 200 including these objects.

  The virtual camera 300 is associated with the HMD system 1 operated by the user U. That is, the position and orientation of the virtual camera 300 (that is, the visual field CV of the virtual camera 300) are changed according to the movement of the HMD 110 worn by the user U. 8 and the like, the virtual camera 300 is disposed at a position away from the center of the virtual space 200, but the virtual camera 300 may be disposed at the center of the virtual space 200.

  In the virtual space 200, a plurality of target objects can be arranged according to the progress of the game program. However, for ease of explanation, only the first target object FC and the second target object SC are illustrated in this example. Show. The first target object FC is an object arranged closer to the virtual camera 300 than the second target object SC. In the present embodiment, the first target object FC is, for example, a tree object, and the second target object SC is, for example, an enemy character that can be controlled by another user or the control unit.

  As described above, when the first target object FC larger than the second target object SC is arranged in front of the second target object SC, the display of the HMD 110 is displayed as shown in the state (b) of FIG. In the visual field image V displayed on the part 112, the second target object SC on the back side is hidden by the first target object FC and cannot be viewed by the user.

  Therefore, in the present embodiment, a transparent processing object TP (an example of a specific processing object) for facilitating the understanding of the space in the virtual space can be arranged in the virtual space 200 based on the input operation of the user U (view image V Can be displayed inside). A display control method related to the transparent processing object TP will be described below with reference to FIG.

  First, the control unit 121 determines whether or not the user U has selected a predetermined mode (for example, a view mode) (step S10 in FIG. 7). This view mode can be selected by the user U operating the external controller 320 from a menu screen (not shown) displayed in the visual field image V, for example. Alternatively, an eye tracking sensor (gaze sensor) that detects the user's U gaze direction may be provided, and it may be determined that the view mode has been selected by the control unit 121 based on detection by the eye tracking sensor.

  When it is determined that the view mode is selected by the input operation of the user U (Yes in step S10), the control unit 121, as illustrated in the state (a) of FIG. Then, the transparent processing object TP is arranged (step S12). Specifically, it is preferable to arrange the transparent processing object TP in the visual field CV of the virtual camera 300 in the virtual space 200. As a result, the transparent processed object TP is displayed at a predetermined position in the field-of-view image V as shown in the state (b) of FIG. The transparent processing object TP is configured as a two-dimensional figure having an opening on the side far from the virtual camera 300, for example, a V-shaped figure object having a vertex on the virtual camera 300 side and an opening on the side far from the virtual camera 300. Has been. The position and inclination of the transparent processing object TP in the three-dimensional orthogonal coordinate system constituting the virtual space 200 can be changed by an input operation of the user U.

  Next, the control unit 121 determines whether at least a part of the target object (for example, the first target object FC or the second target object SC) exists closer to the virtual camera 300 than the transparent processing object TP in the field of view CV. It is determined whether or not (step S14). Here, “at least a part of the target object exists closer to the virtual camera 300 than the transparent processing object TP” means that the transparent processing object TP, which is a two-dimensional V-shaped object, is applied to the target object. It means that it is placed at a position that overlaps the target object.

  When it is determined that at least a part of the first target object FC or the second target object SC does not exist on the virtual camera 300 side with respect to the transparent processing object TP (No in step S14), the control unit 121 It is determined whether or not an input operation of the user U with respect to the transparent processing object TP has been received (step S16). The input operation includes not only the movement of the transparent processing object TP but also the change of inclination (orientation) and the adjustment of the opening angle. For example, when the user U operates the external controller 320, an input operation signal for the transparent processing object TP is transmitted to the control unit 121.

  When it is determined that the input operation of the user U with respect to the transparent processing object TP is received (Yes in step S16), the control unit 121 controls the transparent processing object TP based on the input operation (step S18). For example, when an input operation related to the movement of the transparent processing object TP is received, the control unit 121 moves the transparent processing object TP in accordance with the input operation. For example, as shown in the state (a) of FIG. 10, the control unit 121 moves the transparent processing object TP to the right side from the initial position. As a result, as shown in the state (b) of FIG. Then, the control part 121 returns a process to step S14.

  If it is determined in step S14 that at least a part of the target object (first target object FC or second target object SC) is present on the virtual camera 300 side with respect to the transparent process object TP (Yes in step S14). ), The control unit 121 performs transparent processing on the target object (step S20). For example, as shown in the state (a) of FIG. 10, when the transparent processing object TP is moved to the right side of the initial position, at least a part of the first target object FC is more virtual than the transparent processing object TP. If it is present on the 300 side, the control unit 121 performs the transparency process (for example, completely transparentized) on the first target object FC (see the state (a) in FIG. 11). As a result, as shown in the state (b) of FIG. 11, the first target object FC is transparently processed in the view image V and exists behind the virtual camera 300 with respect to the first target object FC. The second target object SC is visible. Note that the transmission processing of the target object is not limited to complete transmission, and may be semi-transparent as long as the depth is visible.

  Thereafter, the control unit 121 returns the process to step S16. When the input operation of the user U is accepted, the control unit 121 controls the transparent process object TP based on the input operation (step S18), and A predetermined target object that overlaps is subjected to a transparent process (steps S14 and S20). That is, the control unit 121 performs transparency processing in the virtual space 200 by changing the position and inclination of the two-dimensional transparency processing object TP forming the opening in the three-dimensional orthogonal coordinate system based on a user input operation. The position and inclination of the two-dimensional region in the three-dimensional orthogonal coordinate system are changed. Thereby, since the visual field image subjected to the transmission processing can be viewed by freely moving the transmission processing object TP to an arbitrary position and orientation in the virtual space which is a three-dimensional space, a rich virtual space experience can be provided.

  Further, after step S20, the control unit 121 determines whether or not the user U has canceled the selection of the view mode (step S22). Deselection of the view mode can be determined, for example, by operation of the external controller 320 by the user U or detection by an eye tracking sensor. When it is determined that the user U has canceled the selection of the view mode (Yes in step S22), the control unit 121 hides the transparent processing object TP and has been transparently processed by the transparent processing object TP. The first target object FC is made opaque (step S24). Thereby, it returns to the state of the virtual space 200 shown in the state (a) of FIG. 8, and the user U can visually recognize the visual field image V shown in the state (b) of FIG. That is, the second target object SC is hidden again by the first target object FC. Then, the control part 121 returns a process to step S10.

  As described above, according to the present embodiment, the control unit 121 transmits the V-shaped transparent processing object TP having an opening on the side far from the virtual camera 300 in the virtual space 200 based on the input operation of the user U. Is displayed, and it is determined whether or not at least a part of the target objects FC and SC are present on the virtual camera 300 side with respect to the transparent processing object TP in the field of view CV, and the transparent processing object TP is moved to thereby perform the transparent processing. The target object (for example, the first target object FC) determined to be at least partially present on the virtual camera 300 side with respect to the object TP is subjected to a transparent process. As a result, the user U can visually recognize the second target object SC on the back side hidden by the first target object FC, and the space in the VR space can be easily grasped.

  In this example, the movement of the transparent processing object TP and various adjustments (such as adjustment of the opening angle and direction) are performed according to the input operation of the external controller 320, but the present invention is not limited to this example. For example, as shown in FIG. 12, a virtual hand object H (an example of an operation object) that can be operated by an input operation of the user U is arranged in the virtual space 200, and the transparent processing object TP is grasped by the virtual hand object H. It may be a mode of moving. Thereby, it is possible to control the transparent processing object TP more intuitively.

  Further, as shown in FIG. 13, the opening angle θ of the transparent processing object TP is made to correspond to the V shape formed by the virtual hand object H, for example, the thumb and the index finger, and the V shape formed by the finger of the virtual hand object H. The opening angle θ may be changed by changing the angle. Thereby, it is possible to control the transparent processing object TP more intuitively.

  In this example, as long as the transparent object TP is a two-dimensional figure having an opening on the side far from the virtual camera 300, the shape is not limited to that shown in FIG. For example, a transparent processing object TP1 having a curved shape (U-shape) as shown in the state (a) of FIG. 14 and a transparent processing object TP2 having a separated shape as shown in the state (b) of FIG. Also good.

(Modification 1)
FIG. 15 is a schematic diagram of a virtual space defined by the display control method according to the first modification. A state (a) in FIG. 16 is a schematic diagram of a virtual space defined by the display control method according to the first modification, and a state (b) in FIG. 16 is a visual field image generated based on the virtual space. is there.
As shown in FIG. 15, a part of both the first target object FC and the second target object SC that overlap in the virtual space 200 is located closer to the virtual camera 300 than the transparent processing object TP. In this case, the control unit 121 may perform the transparent process on both the first target object FC and the second target object SC. As shown in the state (a) of FIG. Only the object FC may be transparently processed and the second target object SC on the back side may not be transparently processed. In the latter case, as shown in the state (b) of FIG. 16, the second target object SC on the back side in the visual field image V is visible. In the present disclosure, when a small target object (for example, the second target object SC) on the back side is hidden by a large target object (for example, the first target object FC) on the near side in the virtual space 200, Since the target object on the side is made visible, only the first target object FC on the near side is transmitted instead of performing the transparent process on both the first and second target objects FC and SC. It is enough to process.

(Modification 2)
A state (a) in FIG. 17 is a schematic diagram of a virtual space defined by the display control method according to the modification 2. A state (b) in FIG. 17 is a visual field image generated based on the virtual space. is there.
In the above-described embodiment, when it is determined that at least a part of the first target object FC exists on the virtual camera 300 side with respect to the transparent processing object TP, the control unit 121 performs the first target object FC. However, the present invention is not limited to this example. For example, when the transparent processing object TP is applied to the first target object FC arranged in the virtual space 200, the control unit 121 sets the first target object FC as shown in the state (a) of FIG. Only the part existing in front of the transparent processing object TP of the object FC may be transparently processed. Thereby, as shown in the state (b) of FIG. 17, a part of the first target object FC on the near side in the visual field image V is transmitted and a part of the second target object SC on the far side is visually recognized. It becomes possible, and the user U can easily grasp the space as in the above embodiment.

  As mentioned above, although embodiment of this indication was described, the technical scope of this invention should not be limitedly interpreted by description of this embodiment. This embodiment is an example, and it is understood by those skilled in the art that various modifications can be made within the scope of the invention described in the claims. The technical scope of the present invention should be determined based on the scope of the invention described in the claims and the equivalents thereof.

  An information processing program for causing a computer (processor) to execute the information processing method according to the present embodiment is incorporated in advance in the storage unit 123 or the ROM in order to implement various processes executed by the control unit 121 by software. Also good. Alternatively, the information processing program includes a magnetic disk (HDD, floppy disk), an optical disk (CD-ROM, DVD-ROM, Blu-ray disk, etc.), a magneto-optical disk (MO, etc.), flash memory (SD card, USB memory, It may be stored in a computer-readable storage medium such as SSD. In this case, the program stored in the storage medium is incorporated into the storage unit 123 by connecting the storage medium to the control device 120. The control unit 121 executes the information processing method according to the present embodiment by loading the information processing program incorporated in the storage unit 123 onto the RAM and executing the program loaded by the processor.

  Further, the information processing program may be downloaded from a computer on the communication network 3 via the communication interface 125. Similarly in this case, the downloaded program is incorporated in the storage unit 123.

1: HMD system 3: Communication network 21: Center position 110: Head mounted device (HMD)
112: Display unit 114: HMD sensor 116: Headphone 120: Control device 121: Control unit 123: Storage unit 124: I / O interface 125: Communication interface 126: Bus 130: Position sensor 200: Virtual space 300: Virtual camera 400: Movement path CV: Field of view FC: First target object (an example of a target object)
SC: second target object (an example of a target object)
TP: Transparent processing object (an example of a specific processing object)
H: Virtual hand object (an example of an operation object)

Claims (10)

A display control method in a system including a head mounted device,
Generating a virtual space data defining a virtual space including a virtual camera and the target object,
A step of displaying the viewing image on the head mounted device based on the previous SL virtual camera view and the virtual space data,
And updating the view image by moving the virtual camera based on the motion of prior SL head-mounted device,
Based on a user input operation, displaying in the virtual space a specific processing object composed of a figure having an opening on the side far from the virtual camera;
Determining whether at least a portion is present in the target object in the virtual camera than the specific treatment object before Symbol the field of view,
By moving the pre Symbol specific processing object, comprising the steps of: transmitting processing said at least a portion of the target object is determined to at least a portion is present than before the SL specific treatment object in the virtual camera,
Including a display control method. In the step of performing transparent processing on the at least part of the target object , the transparent processing is performed in the virtual space by changing the position and inclination of the two-dimensional figure forming the opening in the three-dimensional orthogonal coordinate system. The display control method according to claim 1, wherein the position and inclination of the three-dimensional region in the three-dimensional orthogonal coordinate system are changed. The display control method according to claim 1, wherein the size of the opening of the specific processing object can be changed in the step of transparently processing the at least part of the target object . The system further comprises a position sensor configured to detect the position of the head mounted device and the position of a body part other than the user's head;
The virtual space further includes an operation object operable according to the movement of the part of the user's body,
4. The display control method according to claim 1, wherein in the step of transparently processing the at least part of the target object, the specific processing object can be moved based on a movement of the operation object. 5. The system further comprises a position sensor configured to detect the position of the head mounted device and the position of a body part other than the user's head;
The virtual space further includes an operation object operable according to the movement of the part of the user's body,
The display control method according to claim 3, wherein the size of the opening can be changed based on a shape of the operation object in the step of transparently processing the at least part of the target object . In the step of transparently processing at least a part of the target object, only a target object closest to the virtual camera among a plurality of target objects determined to have at least a part on the virtual camera side from the specific processing object. The display control method according to any one of claims 1 to 5, wherein a transparent process is performed. The display control method according to any one of claims 1 to 6, wherein the specific processing object is capable of moving a portion closer to the virtual camera than the opening based on an input operation of the user. The transparent processing of the at least part of the target object includes transparently processing the entire target object when it is determined that at least part of the target object is present on the virtual camera side from the specific processing object. 8. The display control method according to any one of items 1 to 7. A program for causing a computer to execute the display control method according to any one of claims 1 to 8 .   An apparatus comprising a processor and a memory for storing computer readable instructions,
  The apparatus for executing the display control method according to any one of claims 1 to 8, when the computer-readable instruction is executed by the processor.

Images