CN117270675A - User virtual image loading method based on mixed reality remote collaborative environment - Google Patents

Abstract

The embodiment of the disclosure discloses a user avatar loading method in a mixed reality-based remote collaborative environment. One embodiment of the method comprises the following steps: mapping the user position coordinates of the target user into a virtual space to obtain target point space coordinates; determining the space coordinates of the virtual objects to obtain a space coordinate set of the virtual objects; determining a heterogeneous space; mapping each virtual object to a heterogeneous space to obtain each coordinate of each virtual object in the heterogeneous space as a virtual object heterogeneous space coordinate set; generating heterogeneous space position information of the target point according to the space coordinates of the target point, the space coordinate set of the virtual object, the number of virtual objects included in the virtual space and the heterogeneous space coordinate set of the virtual object; and loading the avatar model corresponding to the target user in the heterogeneous space according to the heterogeneous space position information of the target point. The embodiment improves the convenience of interaction of users in heterogeneous space.

Description

User virtual image loading method based on mixed reality remote collaboration environment

Technical field

Embodiments of the present disclosure relate to the field of computer technology, and specifically relate to a user avatar loading method in a mixed reality-based remote collaboration environment.

Background technique

Mixed reality technology connects the physical and digital worlds by superimposing computer-generated virtual information onto real scenes. Common mixed reality devices include smartphones, smart glasses, mixed reality head-mounted displays, etc. Users can interact with other users in a heterogeneous space (a virtual space for the user to interact with other users) by using these devices to complete remote collaborative tasks. Currently, before users interact with other users in the heterogeneous space, they usually need to load the user's avatar (such as an avatar model) into the heterogeneous space. For example, the user's location in a heterogeneous space can be defined based on CollaboVR and the user's avatar can be loaded.

However, when loading user avatars using the above method, the following technical problems often occur:

First, based on CollaboVR defining the user's position in the heterogeneous space, it is impossible to load more than two user avatars into the heterogeneous space at the same time, causing inconvenience for users to interact in the heterogeneous space.

Second, the orientation of the user's avatar loaded in the above manner changes relative to the orientation of the user itself, resulting in low efficiency for each user to interact in a heterogeneous space.

Third, the user's position changes in the real scene are not taken into account, which further leads to inconvenience for users to interact in heterogeneous spaces.

Contents of the invention

This Summary is provided to introduce in simplified form concepts that are later described in detail in the Detailed Description. The content of this disclosure is not intended to identify key features or essential features of the claimed technical solutions, nor is it intended to be used to limit the scope of the claimed technical solutions.

Some embodiments of the present disclosure propose methods, devices, electronic devices and computer-readable media for loading user avatars in a mixed reality remote collaboration environment to solve one or more of the technical problems mentioned in the background art section above. .

In the first aspect, some embodiments of the present disclosure provide a method for loading a user avatar in a mixed reality remote collaboration environment. The method includes: mapping the user position coordinates of the target user into the virtual space to obtain the mapped coordinates. as the target point spatial coordinates; determine the virtual object space coordinates of each virtual object included in the above virtual space to obtain a set of virtual object spatial coordinates; determine the heterogeneous space corresponding to the above virtual space, where the above heterogeneous space corresponds to each virtual object to be interacted with The user's virtual space; map the above-mentioned virtual objects to the above-mentioned heterogeneous space, and obtain the respective coordinates of the above-mentioned virtual objects in the above-mentioned heterogeneous space as a virtual object heterogeneous space coordinate set; according to the above-mentioned target point space coordinates, the above-mentioned virtual objects The spatial coordinate set, the number of virtual objects included in the virtual space and the heterogeneous spatial coordinate set of the virtual objects generate target point heterogeneous spatial location information, where the target point heterogeneous spatial location information represents the target user's location in the heterogeneous space. The position in the space; according to the heterogeneous space position information of the above target point, load the avatar model corresponding to the above target user in the above heterogeneous space.

In the second aspect, some embodiments of the present disclosure provide a device for loading a user avatar in a mixed reality remote collaboration environment. The device includes: a first mapping unit configured to map the user position coordinates of the target user to the virtual space. In Configured to determine the heterogeneous space corresponding to the above-mentioned virtual space, wherein the above-mentioned heterogeneous space is a virtual space corresponding to each user to be interacted with; the second mapping unit is configured to map each of the above-mentioned virtual objects to the above-mentioned heterogeneous space, to obtain the above-mentioned Each coordinate of each virtual object in the above-mentioned heterogeneous space is used as a set of virtual object heterogeneous space coordinates; the generation unit is configured to determine the number of virtual objects included in the above-mentioned virtual space according to the above-mentioned target point spatial coordinates, the above-mentioned virtual object space coordinate set, and the above-mentioned virtual space. and the above-mentioned virtual object heterogeneous spatial coordinate set to generate target point heterogeneous spatial position information, wherein the above-mentioned target point heterogeneous spatial position information represents the position of the above-mentioned target user in the above-mentioned heterogeneous space; the loading unit is configured to according to the above-mentioned The heterogeneous space position information of the target point is used to load the avatar model corresponding to the above target user in the above heterogeneous space.

In a third aspect, some embodiments of the present disclosure provide an electronic device, including: one or more processors; a storage device on which one or more programs are stored. When one or more programs are processed by one or more The processor executes, causing one or more processors to implement the method described in any implementation manner of the first aspect.

In a fourth aspect, some embodiments of the present disclosure provide a computer-readable medium on which a computer program is stored, wherein when the program is executed by a processor, the method described in any implementation manner of the first aspect is implemented.

The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the user avatar loading method in a mixed reality remote collaboration environment based on some embodiments of the present disclosure, the convenience of user interaction in a heterogeneous space is improved. Specifically, the reason for the inconvenience for users to interact in heterogeneous spaces is that based on CollaboVR's definition of the user's position in the heterogeneous space, it is impossible to load more than two user avatars into the heterogeneous space at the same time. Based on this, some embodiments of the present disclosure provide a user avatar loading method in a mixed reality remote collaboration environment. First, the user position coordinates of the target user are mapped to the virtual space, and the mapped coordinates are obtained as the target point space coordinates. From this, the spatial coordinates of the target point that represent the position of the user (target point) in the virtual space can be obtained. Then, the virtual object space coordinates of each virtual object included in the virtual space are determined to obtain a set of virtual object space coordinates. From this, the virtual object space coordinates that represent the position of the virtual object in the virtual space can be obtained. Secondly, determine the heterogeneous space corresponding to the virtual space. As a result, a virtual space can be obtained for each user to be interacted with to jointly perform remote collaboration tasks through mixed reality technology. Then, each virtual object is mapped to the heterogeneous space, and the coordinates of each virtual object in the heterogeneous space are obtained as a virtual object heterogeneous space coordinate set. From this, a set of virtual object heterogeneous space coordinates representing the position of each virtual object in the heterogeneous space can be obtained. Secondly, the target point heterogeneous spatial position information is generated based on the target point spatial coordinates, the virtual object spatial coordinate set, the number of virtual objects included in the virtual space, and the virtual object heterogeneous spatial coordinate set. From this, the heterogeneous spatial location information of the target point that represents the target user's heterogeneous spatial location can be obtained. Finally, based on the heterogeneous space position information of the target point, the avatar model corresponding to the target user is loaded in the heterogeneous space. Thus, it is possible to display the avatar model of the above-mentioned target users in a heterogeneous space. Therefore, through the user avatar loading method in a mixed reality remote collaboration environment based on some embodiments of the present disclosure, the user avatar of any target user can be loaded into a heterogeneous space, so that multiple users can be loaded into a heterogeneous space. interact in the space, thereby improving the convenience for users to interact in heterogeneous spaces.

Description of the drawings

The above and other features, advantages, and aspects of various embodiments of the present disclosure will become more apparent with reference to the following detailed description taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It should be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.

Figure 1 is a flow chart of some embodiments of a user avatar loading method in a mixed reality remote collaboration environment according to the present disclosure;

Figure 2 is a schematic structural diagram of some embodiments of a user avatar loading device in a mixed reality remote collaboration environment according to the present disclosure;

3 is a schematic structural diagram of an electronic device suitable for implementing some embodiments of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure.

It should also be noted that, for convenience of description, only the parts related to the invention are shown in the drawings. The embodiments and features of the embodiments in the present disclosure may be combined with each other without conflict.

It should be noted that concepts such as “first” and “second” mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units. Or interdependence.

It should be noted that the modifications of "one" and "plurality" mentioned in this disclosure are illustrative and not restrictive. Those skilled in the art will understand that unless the context clearly indicates otherwise, it should be understood as "one or Multiple”.

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and are not used to limit the scope of these messages or information.

The present disclosure will be described in detail below in conjunction with embodiments with reference to the accompanying drawings.

Figure 1 shows a process 100 of some embodiments of a user avatar loading method in a mixed reality remote collaboration environment according to the present disclosure. The user virtual image loading method based on mixed reality remote collaboration environment includes the following steps:

Step 101: Map the user position coordinates of the target user into the virtual space, and obtain the mapped coordinates as the target point space coordinates.

In some embodiments, the execution subject (such as a computing device) of the user avatar loading method in a mixed reality remote collaboration environment can map the user position coordinates of the target user into the virtual space, and obtain the mapped coordinates as the target point space. coordinate. Among them, the above-mentioned target users may be users who perform remote collaboration tasks through mixed reality technology (MR, MixedReality). The above-mentioned remote collaboration tasks may be tasks performed through remote collaboration technology. For example, the above-mentioned remote collaboration task may be a medical surgical task. The above remote collaboration tasks can also be remote meetings. The above user location coordinates may be coordinates representing the user's real location. The above-mentioned user position coordinates may include the user position abscissa and the user position ordinate. For example, the above user location coordinates may be the horizontal and vertical coordinates of the user location in the national geodetic coordinate system. The above-mentioned virtual space may be a virtual space constructed through mixed reality technology. Here, the above-mentioned virtual space corresponds to the above-mentioned target user. In practice, the above execution subject can map the user position coordinates of the target user to the virtual space according to the predefined mapping relationship, and obtain the mapped coordinates as the target point space coordinates. From this, the spatial coordinates of the target point that represent the position of the user (target point) in the virtual space can be obtained.

It should be noted that the above computing device may be hardware or software. When the computing device is hardware, it can be implemented as a distributed cluster composed of multiple servers or terminal devices, or it can be implemented as a single server or a single terminal device. When the computing device is embodied as software, it can be installed in the hardware device listed above. It may be implemented, for example, as multiple software or software modules for providing distributed services, or as a single software or software module. There are no specific limitations here. It should be understood that there may be any number of computing devices depending on implementation needs.

Step 102: Determine the virtual object space coordinates of each virtual object included in the virtual space to obtain a set of virtual object space coordinates.

In some embodiments, the execution subject may determine the virtual object space coordinates of each virtual object included in the virtual space to obtain a set of virtual object space coordinates. Wherein, the above-mentioned virtual objects may be items in the above-mentioned virtual space. Here, there is no limitation on whether the above virtual object is a real object. For example, the above-mentioned virtual object may be a virtual object obtained by mapping items in the real environment to the virtual space. The above-mentioned virtual object may also be a virtual object defined in the virtual space. The above-mentioned virtual object space coordinates may be the horizontal and vertical coordinates of the virtual object in the virtual space. In practice, the above execution subject can determine the virtual object space coordinates of each virtual object included in the virtual space through various methods to obtain a set of virtual object space coordinates. As an example, for each virtual object, the execution subject can map the position of the virtual object in the real environment to the virtual space to obtain the spatial coordinates of the virtual object. For example, the position of the virtual object in the real environment can be the horizontal and vertical coordinates of the virtual object in the national geodetic coordinate system in the real environment. As another example, for each virtual object, the coordinates of the virtual object can be defined when the virtual object is defined in the virtual space to obtain the virtual object space coordinates. From this, the virtual object space coordinates that represent the position of the virtual object in the virtual space can be obtained.

Step 103: Determine the heterogeneous space corresponding to the virtual space.

In some embodiments, the execution subject may determine the heterogeneous space corresponding to the virtual space. Wherein, the above-mentioned heterogeneous space may be a virtual space corresponding to each user to be interacted with. The above-mentioned users to be interacted with can be various users who jointly perform remote collaboration tasks through mixed reality technology. The above-mentioned users to be interacted with may include the above-mentioned target users. In practice, mixed reality technology can be used to determine the heterogeneous spaces corresponding to each user to be interacted with. As a result, a virtual space can be obtained for each user to be interacted with to jointly perform remote collaboration tasks through mixed reality technology.

Optionally, before performing step 103, for each virtual object included in the above-mentioned virtual space, the following generation operation can be performed:

First, the execution subject can generate the subspace coordinates of the target point based on the virtual object space coordinates of the virtual object and the target point space coordinates. In practice, the subspace coordinates of the target point can be generated by the following formula:

p _k = (xx _k , yy _k ).

Among them, p _k represents the subspace coordinate of the target point corresponding to the kth virtual object. x represents the abscissa coordinate of the user's position included in the user's position coordinates. y represents the ordinate of the user's position included in the user's position coordinates. x _k represents the abscissa coordinate in the virtual object space coordinates of the k-th virtual object. y _k represents the ordinate in the virtual object space coordinates of the kth virtual object.

Then, the potential energy of the virtual object can be determined based on the potential energy constant of the virtual object and the distance between the virtual object spatial coordinates of the virtual object and the target point spatial coordinates. In practice, the potential energy of the virtual object can be determined according to the following formula:

Among them, E _k represents the virtual object potential energy of the kth virtual object. ξ _k represents the gravitational potential energy constant of the k-th virtual object. d represents the distance between the virtual object space coordinates of the virtual object and the target point space coordinates. Wherein, the above-mentioned gravitational potential energy constant may be the product of the gravitational constant, the mass of the k-th virtual object and the weight of the target user. The mass of the kth virtual object and the weight of the target user can be obtained from the associated terminal through a wired connection or a wireless connection.

Step 104: Map each virtual object to the heterogeneous space, and obtain the coordinates of each virtual object in the heterogeneous space as a virtual object heterogeneous space coordinate set.

In some embodiments, the execution subject may map the virtual objects to the heterogeneous space, and obtain the coordinates of the virtual objects in the heterogeneous space as a virtual object heterogeneous space coordinate set. In practice, the above execution subject can map each of the above virtual objects to the above heterogeneous space according to the above predefined mapping relationship. From this, a set of virtual object heterogeneous space coordinates representing the position of each virtual object in the heterogeneous space can be obtained.

Step 105: Generate target point heterogeneous spatial position information based on the target point spatial coordinates, the virtual object spatial coordinate set, the number of virtual objects included in the virtual space, and the virtual object heterogeneous spatial coordinate set.

In some embodiments, the execution subject may generate a target point heterogeneous spatial position based on the target point spatial coordinates, the virtual object spatial coordinate set, the number of virtual objects included in the virtual space, and the virtual object heterogeneous spatial coordinate set. information. Wherein, the heterogeneous space location information of the target point represents the location of the target user in the heterogeneous space. In practice, the above heterogeneous spatial position information of the target point can be generated in various ways. From this, the heterogeneous spatial location information of the target point that represents the target user's heterogeneous spatial location can be obtained.

In some optional implementations of some embodiments, for each virtual object included in the above-mentioned virtual space, the following determination operations may be performed:

First, the rotation angle of the virtual object can be determined based on the virtual object space coordinates of the virtual object and the heterogeneous space coordinates of the virtual object. In practice, the atan2 function can be used to determine the rotation angle of the virtual object based on the virtual object space coordinates of the virtual object and the heterogeneous space coordinates of the virtual object.

Then, the virtual object rotation inverse matrix can be determined based on the above virtual object rotation angle. In the first step, the rotation matrix of the virtual object can be determined according to the following formula:

Among them, C _k represents the virtual object rotation matrix corresponding to the k-th virtual object. θ _k represents the rotation angle of the virtual object corresponding to the k-th virtual object.

In the second step, the inverse matrix of the above virtual object rotation matrix can be determined as the virtual object rotation inverse matrix. This can provide data support for generating heterogeneous spatial location information of target points.

In some optional implementations of some embodiments, the execution subject may determine the number of virtual objects included in the virtual space, the potential energy of each virtual object generated, the subspace coordinates of each target point generated, and the determined virtual objects. The object rotation inverse matrix and the above virtual object heterogeneous spatial coordinate set generate heterogeneous spatial position information of the target point. In practice, first of all, the above execution subject can generate the heterogeneous spatial coordinates of the target point through the following formula:

Among them, p′ represents the heterogeneous spatial coordinates of the target point. m represents the number of virtual objects in the virtual space. E _k represents the virtual object potential energy of the kth virtual object. E _p represents the total potential energy of the target point space. p _k represents the subspace coordinates of the target point corresponding to the kth virtual object. o′ _k represents the virtual object heterogeneous space coordinates of the kth virtual object. C _k represents the virtual object rotation matrix of the kth virtual object. Represents the inverse matrix of the rotation matrix C _k , that is, the inverse matrix of the rotation of the virtual object. Among them, E _p can be obtained by summing the virtual object potential energy of each virtual object included in the virtual space.

Then, the above-mentioned heterogeneous spatial coordinates of the target point can be determined as the heterogeneous spatial position information of the target point. Thus, the target point heterogeneous space position information that represents the target user's position in the virtual space can be obtained.

Optionally, first, for each virtual object, the execution subject can obtain the target point direction vector according to the virtual object. Wherein, the above-mentioned target point direction vector can represent the direction of the target user relative to the above-mentioned virtual object. For example, the above-mentioned target point direction vector can represent that the direction of the target user relative to the above-mentioned virtual object is 45 degrees east-south. In practice, for each virtual object, the above-mentioned execution subject can obtain the direction of the target user relative to the above-mentioned virtual object from the acceleration sensor through a wired connection or a wireless connection, and convert the direction into a direction vector to obtain the target point direction vector. For example, the direction can be encoded into a vector using one-hot encoding to obtain the target point direction vector. Then, the target point orientation vector can be generated based on the number of virtual objects included in the virtual space, the total potential energy of the target point space, the generated potential energy of each virtual object, and the acquired direction vectors of each target point. In practice, the target point orientation vector can be generated by the following formula:

in, Represents the target point orientation vector. /> Represents the target point direction vector corresponding to the kth virtual object.

Finally, the method can be determined based on the number of virtual objects included in the virtual space, the potential energy of each virtual object generated, the total potential energy of the target point space, the subspace coordinates of each target point generated, the set of heterogeneous space coordinates of the virtual objects, and the determined The inverse rotation matrix of each virtual object and the above-mentioned target point orientation vector generate heterogeneous spatial position information of the target point. In practice, the first step can be based on the number of virtual objects included in the above-mentioned virtual space, the potential energy of each generated virtual object, the total potential energy of the above-mentioned target point space, the generated subspace coordinates of each target point, and the above-mentioned heterogeneous space coordinates of the virtual objects. Set and determine the rotation inverse matrix of each virtual object to generate heterogeneous spatial coordinates of the target point. In the second step, the heterogeneous spatial coordinates of the target point and the orientation vector of the target point can be determined as the heterogeneous spatial position information of the target point. From this, the heterogeneous space position information of the target point that represents the position and orientation of the target user in the heterogeneous space can be obtained.

As an inventive point of the embodiments of the present disclosure, the above content solves the second technical problem mentioned in the background art: "The orientation of the user avatar loaded in the above manner changes relative to the orientation of the user itself, resulting in each user being in a heterogeneous space. less efficient at interacting”. The factors that lead to low efficiency for each user to interact in heterogeneous spaces are as follows: The orientation of the user avatar loaded in the above manner changes relative to the orientation of the user itself, resulting in low efficiency for each user to interact in heterogeneous spaces. . If the above factors are solved or alleviated, the effect of improving the convenience of users' interaction in heterogeneous spaces can be achieved. In order to achieve this effect, the present disclosure generates the heterogeneous spatial coordinates of the target point and the orientation vector of the target point, and determines the heterogeneous spatial coordinates of the target point and the orientation vector of the target point as the heterogeneous spatial position information of the target point. Wherein, when generating the target point orientation vector, each virtual object is taken into consideration, and the target point orientation vector is generated based on the acquired target point direction vector and the virtual object potential energy of each virtual object. Therefore, according to the heterogeneous spatial position information of the target point, when the avatar model corresponding to the target user is loaded in the heterogeneous space, the orientation of the avatar model can be made to be the orientation represented by the target point orientation vector. Therefore, due to the limitations of virtual objects, the orientation of each user avatar (avatar model) is determined by the virtual object, so that the offset between the orientation of each user avatar and the user's own orientation is basically the same, as much as possible. It maintains the orientation relationship of each user in the interaction, thereby improving the efficiency of each user's interaction in a heterogeneous space.

Step 106: Load the avatar model corresponding to the target user in the heterogeneous space according to the heterogeneous space position information of the target point.

In some embodiments, the execution subject may load an avatar model corresponding to the target user in the heterogeneous space based on the heterogeneous space position information of the target point. Wherein, the above-mentioned avatar model may be a model representing the avatar of the target user. For example, the above-mentioned avatar model may be a two-dimensional character image. In practice, the execution subject may place the avatar model corresponding to the target user at the heterogeneous space coordinates of the target point represented by the heterogeneous space position information of the target point in the heterogeneous space. Thus, it is possible to display the avatar model of the above-mentioned target users in a heterogeneous space.

Optionally, first, the execution subject may determine the distance between the spatial coordinates of the target point and the spatial coordinates of each virtual object among the spatial coordinates of each virtual object, to obtain a distance set. Then, in response to the presence of a distance smaller than the preset distance threshold in the above distance set, the too close distance prompt information may be played. Wherein, the above-mentioned preset distance threshold may be a preset distance threshold. The above-mentioned too-close prompt information may be information that prompts the user that the distance between the virtual object and the virtual object is too close. For example, the above-mentioned too-close prompt information can be: "Please note that the distance to the object is too close!". In this way, the user can be prompted when the distance between the user and the virtual object is too close, so that the user can move slightly away from the virtual object.

Optionally, the execution subject may generate the global coordinates of the target point based on the number of virtual objects included in the virtual space, the generated potential energy of each virtual object, and the generated subspace coordinates of each target point. In practice, the global coordinates of the target point can be generated in various ways based on the number of virtual objects included in the virtual space, the potential energy of each generated virtual object, and the generated subspace coordinates of each target point. From this, the global coordinates of the target point that are restricted by each virtual object and represent the position of the target user in the virtual space can be obtained.

Optionally, first, the execution subject may generate the total potential energy of the target point space based on the number of virtual objects included in the virtual space and the generated potential energy of each virtual object. In practice, the total potential energy E _p of the target point space can be generated by the following formula:

Then, the global coordinates of the target point can be generated based on the number of virtual objects included in the virtual space, the total potential energy of the target point space, the generated potential energy of each virtual object, and the generated subspace coordinates of each target point. In practice, the global coordinate p of the target point can be generated by the following formula:

From this, the global coordinates of the target point that are restricted by each virtual object and represent the position of the target user in the virtual space can be further obtained.

Optionally, first, the execution subject may obtain user location change information in response to the user location coordinate update of the target user. Wherein, the above user location change information may include at least one user location change coordinate. The above user location change information may be information representing a change in the user's location. The above-mentioned user position change coordinates may be the coordinates experienced when the user position changes. In practice, in response to the above update of the user location coordinates of the target user, the user location can be located at a preset time interval through the positioning device, and at least one user location change coordinate is obtained as the user location change information. The above positioning device may be a device capable of locating the user's location. For example, the above positioning device may be a GPS locator. Secondly, the target point heterogeneous position change information can be generated based on the above user position change information. Wherein, the above-mentioned target point heterogeneous position change information may include at least one target point heterogeneous position change coordinate. In practice, each user position change coordinate in the above user position change information can be mapped to the virtual space respectively, and at least one target point heterogeneous position change coordinate is obtained as the target point heterogeneous position change information. Finally, the avatar model can be controlled to move according to the heterogeneous position change coordinates of each target point included in the target point heterogeneous position change information. In practice, the above-mentioned avatar model can be controlled to traverse the heterogeneous position change coordinates of each target point included in the above-mentioned target point heterogeneous position change information, so as to realize the movement of the above-mentioned avatar model.

The above content, as an inventive point of the embodiments of the present disclosure, solves the third technical problem mentioned in the background art: "the user's position changes in the real scene are not taken into account, further causing inconvenience for the user to interact in a heterogeneous space." Factors that further lead to inconvenience for users to interact in heterogeneous spaces are as follows: The user's position changes in the real scene are not taken into account, which further leads to inconvenience for users to interact in heterogeneous spaces. If the above factors are solved, the effect of improving the convenience of users' interaction in heterogeneous spaces can be achieved. In order to achieve this effect, the present disclosure controls the virtual image model to move based on the heterogeneous position change information of the target point. Therefore, when the user's position changes, the avatar model in the virtual space can move synchronously, thereby improving the convenience of user interaction in heterogeneous spaces.

The above-mentioned embodiments of the present disclosure have the following beneficial effects: through the user avatar loading method in a mixed reality remote collaboration environment based on some embodiments of the present disclosure, the convenience of user interaction in a heterogeneous space is improved. Specifically, the reason for the inconvenience for users to interact in heterogeneous spaces is that based on CollaboVR's definition of the user's position in the heterogeneous space, it is impossible to load more than two user avatars into the heterogeneous space at the same time. Based on this, some embodiments of the present disclosure provide a user avatar loading method in a mixed reality remote collaboration environment. First, the user position coordinates of the target user are mapped to the virtual space, and the mapped coordinates are obtained as the target point space coordinates. From this, the spatial coordinates of the target point that represent the position of the user (target point) in the virtual space can be obtained. Then, the virtual object space coordinates of each virtual object included in the virtual space are determined to obtain a set of virtual object space coordinates. From this, the virtual object space coordinates that represent the position of the virtual object in the virtual space can be obtained. Secondly, determine the heterogeneous space corresponding to the virtual space. As a result, a virtual space can be obtained for each user to be interacted with to jointly perform remote collaboration tasks through mixed reality technology. Then, each virtual object is mapped to the heterogeneous space, and the coordinates of each virtual object in the heterogeneous space are obtained as a virtual object heterogeneous space coordinate set. From this, a set of virtual object heterogeneous space coordinates representing the position of each virtual object in the heterogeneous space can be obtained. Secondly, the target point heterogeneous spatial position information is generated based on the target point spatial coordinates, the virtual object spatial coordinate set, the number of virtual objects included in the virtual space, and the virtual object heterogeneous spatial coordinate set. From this, the heterogeneous spatial location information of the target point that represents the target user's heterogeneous spatial location can be obtained. Finally, based on the heterogeneous space position information of the target point, the avatar model corresponding to the target user is loaded in the heterogeneous space. Thus, it is possible to display the avatar model of the above-mentioned target users in a heterogeneous space. Therefore, through the user avatar loading method in a mixed reality remote collaboration environment based on some embodiments of the present disclosure, the user avatar of any target user can be loaded into a heterogeneous space, so that multiple users can be loaded into a heterogeneous space. interact in the space, thereby improving the convenience for users to interact in heterogeneous spaces.

Continuing to refer to Figure 2, as an implementation of the methods shown in the above figures, the present disclosure provides some embodiments of a user avatar loading device based on a mixed reality remote collaboration environment. These device embodiments are the same as those shown in Figure 1 Corresponding to those method embodiments, the device can be applied in various electronic devices.

As shown in Figure 2, the user avatar loading device 200 in a mixed reality remote collaboration environment in some embodiments includes: a first mapping unit 201, a first determining unit 202, a second determining unit 203, a second mapping unit 204, Generating unit 205 and loading unit 206. Among them, the first mapping unit 201 is configured to map the user position coordinates of the target user into the virtual space, and obtain the mapped coordinates as the target point space coordinates; the first determining unit 202 is configured to determine each of the coordinates included in the virtual space. The virtual object space coordinates of the virtual object are used to obtain a set of virtual object space coordinates; the second determination unit 203 is configured to determine the heterogeneous space corresponding to the above-mentioned virtual space, where the above-mentioned heterogeneous space is a virtual space corresponding to each user to be interacted with; The second mapping unit 204 is configured to map each of the above-mentioned virtual objects to the above-mentioned heterogeneous space, and obtain the respective coordinates of each of the above-mentioned virtual objects in the above-mentioned heterogeneous space as a set of virtual object heterogeneous space coordinates; the generation unit 205 is configured to map the above-mentioned virtual objects to the above-mentioned heterogeneous space. The target point spatial coordinates, the above-mentioned virtual object spatial coordinate set, the number of virtual objects included in the above-mentioned virtual space and the above-mentioned virtual object heterogeneous spatial coordinate set generate target point heterogeneous spatial position information, wherein the above-mentioned target point heterogeneous spatial position information represents the position of the target user in the heterogeneous space; the loading unit 206 is configured to load an avatar model corresponding to the target user in the heterogeneous space based on the heterogeneous space position information of the target point.

It can be understood that the units recorded in the device 200 correspond to various steps in the method described with reference to FIG. 1 . Therefore, the operations, features and beneficial effects described above for the method are also applicable to the device 200 and the units included therein, and will not be described again here.

Referring now to FIG. 3 , a schematic structural diagram of an electronic device (eg, computing device) 300 suitable for implementing some embodiments of the present disclosure is shown. The electronic device shown in FIG. 3 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

As shown in FIG. 3 , the electronic device 300 may include a processing device (eg, central processing unit, graphics processor, etc.) 301 , which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 302 or loaded from a storage device 308 The program in the memory (RAM) 303 executes various appropriate actions and processes. In the RAM 303, various programs and data required for the operation of the electronic device 300 are also stored. The processing device 301, the ROM 302 and the RAM 303 are connected to each other via a bus 304. An input/output (I/O) interface 305 is also connected to bus 304.

Generally, the following devices may be connected to the I/O interface 305: input devices 306 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speakers, vibration An output device 307 such as a computer; a storage device 308 including a magnetic tape, a hard disk, etc.; and a communication device 309. The communication device 309 may allow the electronic device 300 to communicate wirelessly or wiredly with other devices to exchange data. Although FIG. 3 illustrates electronic device 300 with various means, it should be understood that implementation or availability of all illustrated means is not required. More or fewer means may alternatively be implemented or provided. Each block shown in Figure 3 may represent one device, or may represent multiple devices as needed.

In particular, according to some embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as a computer software program. For example, some embodiments of the present disclosure include a computer program product including a computer program carried on a computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In some such embodiments, the computer program may be downloaded and installed from the network via communication device 309, or from storage device 308, or from ROM 302. When the computer program is executed by the processing device 301, the above-described functions defined in the methods of some embodiments of the present disclosure are performed.

It should be noted that the computer-readable medium recorded in some embodiments of the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmed read-only memory (EPROM or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In some embodiments of the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. In some embodiments of the present disclosure, the computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.

In some embodiments, the client and server can communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium. (e.g., communications network) interconnection. Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or developed in the future network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: maps the user position coordinates of the target user into the virtual space to obtain the mapped coordinates. As the target point space coordinate; for the virtual object space coordinates of each virtual object included in the above-mentioned virtual space, the virtual object space coordinate with the shortest distance from the above-mentioned target point space coordinate among the above-mentioned virtual object space coordinates is determined as the target virtual object space Coordinates, where the spatial coordinates of the target virtual object represent the position of the target virtual object in the virtual space; determine the heterogeneous space corresponding to the virtual space, where the heterogeneous space is a virtual space corresponding to each user to be interacted; set the above target The virtual object is mapped to the above-mentioned heterogeneous space, and the coordinates of the above-mentioned target virtual object in the above-mentioned heterogeneous space are obtained as the heterogeneous space coordinates of the target virtual object; according to the above-mentioned target point spatial coordinates, the above-mentioned target virtual object spatial coordinates, the above-mentioned virtual space includes The number of virtual objects and the heterogeneous spatial coordinates of the target virtual object generate heterogeneous spatial position information of the target point, where the heterogeneous spatial position information of the target point represents the position of the target user in the heterogeneous space; according to the target point The heterogeneous space location information is used to load the avatar model corresponding to the above target user in the above heterogeneous space.

Computer program code for performing the operations of some embodiments of the present disclosure may be written in one or more programming languages, including object-oriented programming languages—such as Java, Smalltalk, C++, or a combination thereof, Also included are conventional procedural programming languages—such as the "C" language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In situations involving remote computers, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as an Internet service provider). connected via the Internet).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved. It will also be noted that each block of the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or operations. , or can be implemented using a combination of specialized hardware and computer instructions.

The units described in some embodiments of the present disclosure may be implemented in software or hardware. The described unit may also be provided in a processor. For example, it may be described as follows: a processor includes a first mapping unit, a first determining unit, a second determining unit, a second mapping unit, a generating unit and a loading unit. Among them, the names of these units do not constitute a limitation on the unit itself under certain circumstances. For example, the first mapping unit can also be described as “mapping the user position coordinates of the target user into the virtual space, and obtaining the mapped coordinates as the unit of spatial coordinates of the target point".

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chips (SOCs), Complex Programmable Logical device (CPLD) and so on.

The above description is only an illustration of some preferred embodiments of the present disclosure and the technical principles applied. Persons skilled in the art should understand that the scope of the invention involved in the embodiments of the present disclosure is not limited to technical solutions composed of specific combinations of the above technical features, and should also cover the above-mentioned technical solutions without departing from the above-mentioned inventive concept. Other technical solutions formed by any combination of technical features or their equivalent features. For example, a technical solution is formed by replacing the above features with technical features with similar functions disclosed in the embodiments of the present disclosure (but not limited to).

Claims (10)

1. A method for loading a user virtual image based on a mixed reality remote collaborative environment comprises the following steps:

mapping the user position coordinates of the target user into a virtual space to obtain mapped coordinates serving as target point space coordinates;

determining virtual object space coordinates of each virtual object included in the virtual space to obtain a virtual object space coordinate set;

determining a heterogeneous space corresponding to the virtual space, wherein the heterogeneous space is a virtual space corresponding to each user to be interacted;

mapping each virtual object to the heterogeneous space to obtain each coordinate of each virtual object in the heterogeneous space as a virtual object heterogeneous space coordinate set;

generating target point heterogeneous space position information according to the target point space coordinates, the virtual object space coordinate set, the number of virtual objects included in the virtual space and the virtual object heterogeneous space coordinate set, wherein the target point heterogeneous space position information represents the position of the target user in the heterogeneous space;

and loading an avatar model corresponding to the target user in the heterogeneous space according to the heterogeneous space position information of the target point.

2. The method of claim 1, wherein the method further comprises:

determining the distance between the space coordinate of the target point and each virtual object space coordinate in the space coordinates of each virtual object to obtain a distance set;

and playing the too-close distance prompt information in response to the fact that the distance smaller than the preset distance threshold exists in the distance set.

3. The method of claim 1, wherein prior to the determining the heterogeneous space to which the virtual space corresponds, the method further comprises:

for each virtual object included within the virtual space, performing the generating operation of:

generating target point subspace coordinates according to the virtual object space coordinates of the virtual object and the target point space coordinates;

and generating virtual object potential energy according to the potential energy constant of the virtual object and the distance between the virtual object space coordinates of the virtual object and the target point space coordinates.

4. The method of claim 3, wherein the generating target point heterogeneous spatial location information comprises:

for each virtual object included within the virtual space, performing the following determination operations:

determining a virtual object rotation angle according to the virtual object space coordinates of the virtual object and the virtual object heterogeneous space coordinates;

And determining a virtual object rotation inverse matrix according to the virtual object rotation angle.

5. The method of claim 4, wherein the generating target point heterogeneous spatial location information further comprises:

and generating target point heterogeneous space position information according to the number of virtual objects included in the virtual space, the generated potential energy of each virtual object, the generated subspace coordinates of each target point, the determined rotation inverse matrix of each virtual object and the virtual object heterogeneous space coordinate set.

6. The method of claim 5, wherein the method further comprises:

and generating global coordinates of the target point according to the number of virtual objects included in the virtual space, the generated potential energy of each virtual object and the generated subspace coordinates of each target point.

7. The method of claim 6, wherein the generating the target point global coordinates from the number of virtual objects included in the virtual space, the generated respective virtual object potential energies, and the generated respective target point subspace coordinates comprises:

generating total potential energy of a target point space according to the number of virtual objects included in the virtual space and the generated potential energy of each virtual object;

And generating target point global coordinates according to the number of virtual objects included in the virtual space, the total potential energy of the target point space, the generated potential energy of each virtual object and the generated subspace coordinates of each target point.

8. A user avatar loading device in a mixed reality-based remote collaborative environment, comprising:

the first mapping unit is configured to map the user position coordinates of the target user into the virtual space, and obtain mapped coordinates as target point space coordinates;

a first determining unit configured to determine virtual object space coordinates of each virtual object included in the virtual space, resulting in a virtual object space coordinate set;

the second determining unit is configured to determine a heterogeneous space corresponding to the virtual space, wherein the heterogeneous space is a virtual space corresponding to each user to be interacted;

a second mapping unit configured to map the respective virtual objects to the heterogeneous space, and obtain respective coordinates of the respective virtual objects in the heterogeneous space as a virtual object heterogeneous space coordinate set;

a generation unit configured to generate target point heterogeneous space position information according to the target point space coordinates, the virtual object space coordinate set, the number of virtual objects included in the virtual space, and the virtual object heterogeneous space coordinate set, wherein the target point heterogeneous space position information characterizes a position of the target user in the heterogeneous space;

And the loading unit is configured to load the avatar model corresponding to the target user in the heterogeneous space according to the heterogeneous space position information of the target point.

9. An electronic device, comprising:

one or more processors;

a storage device having one or more programs stored thereon;

when executed by the one or more processors, causes the one or more processors to implement the method of any of claims 1-7.

10. A computer readable medium having stored thereon a computer program, wherein the program when executed by a processor implements the method of any of claims 1-7.