KR101915065B1 - Live streaming system for virtual reality contents and operating method thereof - Google Patents

Abstract

A live streaming system for providing a live streaming service for broadcast VR content is provided. A live streaming system for VR content according to an exemplary embodiment of the present invention includes a streamer terminal for executing broadcast VR content and proceeding streaming broadcasting for the broadcast VR content according to a streamer input, And a broadcast management server for responding to the streaming request and streaming the 360-degree panorama image of the broadcast VR content to the viewer terminal using the pre-established Internet broadcast platform.

Description

Technical Field [0001] The present invention relates to a live streaming system for a VR content and a method of operating the system,

The present invention relates to a live streaming system for VR content and a method of operation of the system. And more particularly, to a streamer and a system for providing a live streaming service for broadcast VR content to a viewer and a method of operating the system.

Recently, a field of great interest from around the world is the field of virtual reality (hereinafter abbreviated as "VR"). Some believe that the 2020 VR content market will come in the wake of the hardware market.

VR refers to a specific environment or situation, or technology itself, that is similar to the reality created by artificial technology using computers, but not actual. At this time, the created virtual environment or situation stimulates the user's five senses and makes the user experience the spatial and temporal experiences similar to reality, thereby freely bringing the boundary between reality and imagination free. In addition to being immersed in virtual reality, users can also interact with things implemented in virtual reality, such as manipulating or commanding them using real devices. VR is distinguished from a one-sided simulation in that it can interact with users and create user experience.

On the other hand, as Internet broadcasting platforms such as Africa TV, Twot, and YouTube are established, streamers that broadcast personal internet over various contents are increasing day by day. In recent years, streamers have become more diverse, including advertising sponsors (such as banner ads from companies) and YouTube streaming revenues. As a result, not only personal hobby broadcasting but also streamers for personal internet broadcasting to be.

However, despite the fact that VR content is a big issue all over the world, it is difficult for VR contents to be transmitted to viewers through the pre-established Internet broadcasting platform. to be.

For example, assuming that a streamer wearing a VR device such as an HMD (head mounted device) is going to broadcast Internet for a VR game content through an established Internet broadcasting platform, a broadcasting client installed in the streamer terminal The game screen is captured and streamed to the viewer terminal as it is. In addition, since the viewing client installed on the viewer terminal displays the captured screen image on the viewer terminal as it is, even the viewer wearing the HMD can not experience the sense of realism and immersion of the original VR game content.

In addition, even if the viewer wearing the VR device turns the viewpoint by turning his or her head to the left or right, the viewpoint of the game image displayed on the viewer terminal is not changed, which also deteriorates the sense of reality and immersion of the VR content.

Thus, there is a need for a live streaming system designed to allow streamers and viewers to share experiences with VR content.

Korean Patent Laid-Open Publication No. 2017-0037338 (published April 4, 2014)

SUMMARY OF THE INVENTION It is an object of the present invention to provide a live streaming system designed to allow streamers and viewers to share experiences on VR content.

The technical objects of the present invention are not limited to the above-mentioned technical problems, and other technical subjects not mentioned can be clearly understood by those skilled in the art from the following description.

According to an aspect of the present invention, there is provided a live streaming system for VR content, comprising: a VR server for executing VR content for broadcasting and streaming broadcasting for the VR content for broadcasting according to input of a streamer And a broadcasting management server for broadcasting the 360-degree panoramic image of the VR content for broadcasting to the viewer terminal using the pre-built Internet broadcasting platform in response to the streaming request of the streamer terminal and the streamer terminal.

In one embodiment, the broadcast VR content is a first broadcast VR game content being executed in the streamer terminal, and the rendering server further includes a rendering server for rendering the 360-degree panorama image, A content synchronization module for synchronizing a second broadcast VR game content identical to the first broadcast VR game content and being executed in the rendering server with the first broadcast VR content in response to receipt of the game progress information, And a panorama image rendering module for rendering the 360-degree panorama image based on the game content.

The panorama image rendering module may render the 360-degree panoramic image using an image photographed by a virtual camera disposed adjacent to a virtual object in a virtual space constructed on the second broadcast VR content, The virtual object is a virtual object controlled according to input of the streamer, and the virtual camera can be moved together with the virtual object in the virtual space.

In one embodiment, the streamer terminal receives a selection input for at least one Internet broadcasting platform for streaming broadcasting for the broadcasting VR content among the pre-established Internet broadcasting platforms, And a plurality of broadcast client modules interfaced with the established Internet broadcast platform, wherein, based on the selection input, at least one of the plurality of broadcast client modules, which is associated with the at least one Internet broadcasting platform for streaming, The client module is selected, and the 360-degree panorama image can be streamed using the selected at least one broadcast client module.

According to another aspect of the present invention, there is provided a live streaming method for VR content for broadcasting performed by a live streaming system, comprising the steps of: Receiving a streaming request for the VR content for broadcasting from the streamer terminal, and generating a 360-degree panorama image for the VR content for broadcasting using the pre-built internet broadcasting platform in response to the streaming request, As shown in FIG.

According to the present invention, a 360-degree panorama image for broadcast VR content is rendered on a streamer terminal or a separate rendering server, and the rendered 360-degree panorama image is streamed to a viewer terminal. Therefore, the experience of the broadcast VR content can be shared between the viewer and the streamer watching the streaming broadcast.

In addition, when the streaming broadcast is performed for the VR game contents, the 360 degree panorama image is rendered using the virtual camera disposed near the virtual object controlled by the streamer. Thus, the viewer's immersion feeling on the streaming broadcast can be improved.

Also, as the 360-degree panoramic image is provided, the viewpoint of the viewer is not completely dependent on the viewpoint of the streamer, and the viewer's sense of reality and immersion of the VR content can be improved.

In addition, a streaming broadcasting service for VR contents can be provided using a pre-established Internet broadcasting platform, and the system construction cost can be greatly reduced.

In addition, since streaming broadcasting can be performed on a new topic called VR content, personal internet broadcasting is more active.

In addition, streaming broadcasting is permitted only for streamers purchased through a billing process, whereby a new profit structure can be formed for a provider of a live streaming system and / or an Internet broadcasting platform, and the effect of mass- have.

The effects of the present invention are not limited to the effects mentioned above, and other effects not mentioned can be clearly understood to those of ordinary skill in the art from the following description.

1 is a configuration diagram of a live streaming system for VR contents according to a first embodiment of the present invention.
FIGS. 2A to 3 are exemplary views of a screen that can be displayed by executing a game client module in a streamer terminal.
4 is a configuration diagram of a live streaming system for VR content according to the second embodiment of the present invention.
5 is a block diagram illustrating a relay server that is a component of a live streaming system according to an embodiment of the present invention.
6 is a block diagram illustrating a rendering server that is a component of a live streaming system according to an embodiment of the present invention.
7A and 7B are views for explaining a 360-degree panoramic image rendering method that can be referred to in some embodiments of the present invention.
8 is a block diagram illustrating a broadcast web server, which is a component of a live streaming system according to an embodiment of the present invention.
9 is a block diagram illustrating a broadcast management server, which is a component of a live streaming system according to an embodiment of the present invention.
10 is a flowchart of a live streaming method for VR content according to another embodiment of the present invention.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS The advantages and features of the present invention and the manner of achieving them will become apparent with reference to the embodiments described in detail below with reference to the accompanying drawings. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. To fully disclose the scope of the invention to those skilled in the art, and the invention is only defined by the scope of the claims. Like reference numerals refer to like elements throughout the specification.

Unless defined otherwise, all terms (including technical and scientific terms) used herein may be used in a sense commonly understood by one of ordinary skill in the art to which this invention belongs. Also, commonly used predefined terms are not ideally or excessively interpreted unless explicitly defined otherwise. The terminology used herein is for the purpose of illustrating embodiments and is not intended to be limiting of the present invention. In the present specification, the singular form includes plural forms unless otherwise specified in the specification.

It is noted that the terms "comprises" and / or "comprising" used in the specification are intended to be inclusive in a manner similar to the components, steps, operations, and / Or additions.

Prior to the description of the present specification, some terms used in this specification will be clarified.

In this specification, an Internet broadcasting platform means a platform for providing a streaming broadcasting service using the Internet. For example, the Internet broadcasting platform may be, but is not limited to, an African TV, a YouTube, a Twot, and a Cacao TV.

In this specification, a streamer means a person who performs Internet broadcasting through an Internet broadcasting platform. The streamer is named as BJ (broadcasting jockey) in African TV, PD (play director) in Cacao TV, streamer in twin TV and creator in YouTube, and various other terms such as broadcaster However, in the present specification, it is referred to as a streamer for convenience.

In this specification, virtual reality (VR) refers to a specific environment or situation, or technology itself, that is similar to the reality produced by an artificial technique using a computer or the like, but is not actual. VR can be used in various technical terms such as artificial reality, cyberspace, virtual worlds, virtual environment, synthetic environment, artificial environment, It should be noted that they may be used interchangeably but may refer to the same object.

Hereinafter, some embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a configuration diagram of a live streaming system for VR contents according to a first embodiment of the present invention.

1, a live streaming system according to a first embodiment of the present invention includes a streamer terminal 100, a rendering server 300, a broadcasting management server 500, at least one Internet broadcasting platform 700, And may include one viewer terminal 900. However, it should be understood that the present invention is not limited to the above-described embodiments, and that various changes and modifications may be made without departing from the scope of the present invention. It should be noted that each component of the live streaming system shown in FIG. 1 shows functional elements that are functionally distinct, and that at least one component may be implemented in a form that is integrated with one another in an actual physical environment. For example, the rendering server 300 and the broadcast management server 500 may be implemented as a single integrated server device. Hereinafter, the components of the live streaming system will be described.

In the live streaming system, the streamer terminal 100 is a computing device used by the streamer 1 to carry out live streaming broadcasting. Here, the computing device may be a notebook, a desktop, a laptop, a smart phone, and the like, but it is not limited thereto and may include any type of device having a computing function and a communication function can do.

The streamer terminal 100 may execute the broadcast VR content and proceed with the live broadcast for the broadcast VR content. In the following description, it is assumed that the type of the VR content for broadcasting is the VR game content. However, this is for convenience of understanding, and the scope of the present invention is not limited thereto.

In this embodiment, the streamer terminal 100 can execute the broadcast VR game content through the pre-installed game client module and proceed with live streaming broadcasting. Here, the game client module may be understood as a software module in which a broadcasting function is additionally implemented in the VR game contents.

For example, when the broadcast VR game content is a first-person shooter (FPS) game, when the game client module is executed, the broadcast VR game content can be executed as shown in FIG. 2A, (5) may be displayed. Also, if the visual field is changed to the right according to the input of the streamer 1, the broadcast interface 7 related to the live streaming broadcast can be displayed as shown in FIG. 2B. Alternatively, if the current time is changed to the third person time according to the input of the streamer 1 as shown in FIG. 2C, the broadcast interface 7 may be displayed. For reference, the button (e.g., YouTube) deactivated in FIG. 2B may refer to an Internet broadcasting platform that is currently unavailable for various reasons.

The broadcast interface 7 may include, for example, a selection interface for an Internet broadcast platform on which live broadcasting is to be performed, a broadcast start / end interface, and the like. Thus, the streamer 1 can conveniently begin live streaming broadcast through the broadcast interface 7 at any time during the play of the VR game content for broadcasting.

When the live broadcast starts, an indicator 9a indicating " broadcasting " can be displayed on the screen of the streamer terminal 1 as shown in Fig. If the broadcast is impossible due to a network problem or the like, an indicator 9b indicating " no broadcast " may be displayed.

Referring again to FIG. 1, the streamer 1 can play VR game contents for broadcasting by wearing a VR device such as an HMD (head mounted device), and the streamer 1 May be streamed to the viewer terminal 900. The viewer terminal 900 may be a video game terminal. More specifically, a 360 degree panorama image for the broadcast VR game content may be streamed to the viewer terminal 900 through at least one Internet broadcast platform 700 selected by the streamer 1. [

In one embodiment, the 360 degree panoramic image may be a rendered image based on broadcast VR game content running in streamer terminal 100. According to the present embodiment, there is no need to provide a separate rendering server 300, and there is an advantage that a live streaming system can be constructed more simply. However, since a high-performance computing capability is generally required to execute VR game contents, it is preferable that a separate rendering server 300 is installed to provide seamless live streaming service.

In some embodiments, it may be determined whether the 360 degree panorama image is rendered on the streamer terminal 100 based on the performance of the streamer terminal 100. [ For example, if the streamer terminal 100 is a high-performance computing device satisfying predetermined performance conditions, the 360-degree panoramic image can be performed in the streamer terminal 100. In the opposite case, the rendering server 300 may render the 360-degree panorama image. According to this embodiment, the computing ability of the rendering server 300 is limited to only some streamer terminals lacking the computing capability, so that when a plurality of streamers broadcast live streaming simultaneously, the burden of the rendering server 300 Can be alleviated.

In the live streaming system, the rendering server 300 renders a 360 degree panorama image 3 based on the VR game content for broadcasting.

According to the embodiment of the present invention, the rendering server 300 acquires the same broadcast VR game contents (hereinafter referred to as " first broadcast VR game content ") that is the same as the broadcast VR game content 2 broadcast VR game content "). The rendering server 300 synchronizes the second broadcast VR game content with the first broadcast VR game content using the game progress information received in real time from the streamer terminal 100 during the streaming broadcast, And the 360-degree panoramic image 3 is rendered based on the VR game content for broadcasting. In the present embodiment, the game progress information includes all information required for synchronization of two VR game contents. For example, the game progress information includes a virtual object controlled by the streamer 1, a state of the virtual object, , Which may vary depending on the VR game contents. A more detailed description of this embodiment will be given later with reference to Figs. 6 to 7B.

In the live streaming system, the broadcasting management server 500 transmits the 360-degree panorama image 3 rendered by the rendering server 300 to the Internet broadcasting platform 700 and streams the same to the viewer terminal 900.

According to an exemplary embodiment of the present invention, the broadcast management server 500 may include at least one broadcast client module operatively associated with the Internet broadcast platform 700. Here, the broadcast client module is a module for transmitting a streaming target image to a streaming server of an Internet broadcasting platform, for example, a software module provided by the Internet broadcasting platform. More specifically, for example, if the Internet broadcasting platform is an African TV, the broadcasting client module may be a software module installed in a terminal of the BJ which performs live streaming broadcasting through an African TV. A more detailed description of the broadcast management server 500 will be described later with reference to FIG.

In the live streaming system, the Internet broadcasting platform 700 means a platform for providing a live broadcasting streaming service over the Internet.

According to an embodiment of the present invention, the Internet broadcasting platform 700 may be an Internet broadcasting platform such as Africa TV, Twot, YouTube, and the like. That is, in the present embodiment, a separate streaming server is not constructed for real-time streaming of VR virtual contents, but an Internet broadcasting platform in which a plurality of viewers exist can be used as it is. Accordingly, the time and human cost required for constructing a separate system can be reduced.

In the live streaming system, the viewer terminal 900 refers to a terminal used by a viewer to view a live streaming song. The viewer terminal 900 may be, for example, a computing device equipped with a viewer client module linked to a pre-established Internet broadcasting platform 700. The computing device may be a notebook, a desktop, a laptop, , Smart phone (Smart phone), and HMD. The viewing client module may be, for example, a software module installed to use a live streaming broadcasting service provided by an Internet broadcasting platform.

In a live streaming system according to some embodiments of the present invention, each component can communicate over a network. Here, the network may be any kind of wired / wireless network such as a local area network (LAN), a wide area network (WAN), a mobile radio communication network, a wibro Can be implemented.

The live streaming system according to the first embodiment of the present invention has been described with reference to FIGS. 1 to 3. FIG. Next, a live streaming system for VR contents according to a second embodiment of the present invention will be described with reference to FIG.

4 is a configuration diagram of a live streaming system according to a second embodiment of the present invention.

Referring to FIG. 4, the live streaming system according to the second embodiment of the present invention may further include a relay server 200 and a broadcast web server 400. However, it should be understood that the present invention is not limited to the above-described embodiments, and that various changes and modifications may be made without departing from the scope of the present invention. It should also be noted that each component of the live streaming system shown in FIG. 4 represents functional elements that are functionally distinct, and that at least one component may be implemented in an integrated manner in an actual physical environment.

In the live streaming system, the relay server 200 generates a broadcast channel to provide an independent broadcast environment to the streamer 1, and transmits game progress information received in real time from the streamer terminal 100 during live streaming to a render server (300). For example, in response to a request from a plurality of streamer terminals (e.g., authenticated streamers, streamers that have purchased broadcasting rights) that are permitted to live streaming broadcasts, the relay server 200 broadcasts broadcasts for each of the plurality of streamers And provide them. For example, the broadcasting room may mean an online space shared by viewers watching live streaming broadcasting of each streamer and each streamer. A chat function, and other functions necessary for smooth broadcast progress can be provided for each broadcasting station. Since the broadcasting room is a well-known concept in the related art, a detailed description thereof will be omitted.

For reference, the relay server 200 may be implemented as a photon server or the like, but is not limited thereto. A more detailed description of the relay server 200 will be given later with reference to Fig.

In the live streaming system, the broadcast web server 400 provides a web page service. For example, the broadcasting web server 400 may provide a web page in response to a request from the streamer terminal 100 and provide the web page through a web page such as membership, login, member information management, broadcasting information management, It is possible to provide various functions that can be performed. A more detailed description of the broadcast web server 400 will be described later with reference to FIG.

The live streaming system according to the second embodiment of the present invention has been described with reference to FIG. Hereinafter, each component of the live streaming system will be described in detail with reference to FIG. 5 to FIG.

5 is a block diagram illustrating a relay server 200 that is a component of a live streaming system for VR content according to an embodiment of the present invention.

Referring to FIG. 5, the relay server 200 may include a content information receiving module 210, a content advance relay module 230, and a broadcast management module 250. 5, only the components related to the embodiment of the present invention are shown. Accordingly, those skilled in the art will recognize that other general-purpose components other than those shown in FIG. 5 may be further included.

The content information receiving module 210 receives information on the first broadcast VR game content from the streamer terminal 100 and the content information relay module 230 receives the information on the first broadcast VR game content To the rendering server (300).

For example, the content information receiving module 210 receives game progress information for the first broadcast VR game content in real time from the streamer terminal 100, and the content information relay module 230 receives the game progress information To the rendering server 300. Accordingly, the rendering server 300 can synchronize the second broadcast VR content that is being executed with the first broadcast VR content using the game progress information, and render the 360-degree panorama image.

The broadcast management module 250 generates a broadcast environment, which is an online space in which a streamer is broadcasted in response to a broadcast start request of the streamer terminal 100 to which the streaming broadcast is permitted. In addition, the broadcasting management module 250 may terminate the broadcasting in response to a broadcasting end request from the streamer terminal 100. [

According to the embodiment of the present invention, the streamer in which the streaming broadcasting is permitted may be a streamer that has been successfully authenticated and purchased a broadcasting right. Also, in this embodiment, a broadcast start request of a streamer for which the streaming is not permitted may be blocked.

6 is a block diagram illustrating a rendering server 300 that is a component of a live streaming system for VR content in accordance with an embodiment of the present invention.

The rendering server 300 may be configured to include a content execution module 310, a content synchronization module 330, a panorama image rendering module 350, an encoding module 370, and a panorama image transmission module 390. However, only the components related to the embodiment of the present invention are shown in Fig. Therefore, it will be understood by those skilled in the art that other general-purpose components other than those shown in FIG. 6 may be further included.

Referring to each component, the content execution module 310 executes the second broadcast VR game content. Specifically, the content execution module 310 executes the second broadcast VR game content that is the same as the first broadcast VR game content executed in the streamer terminal 100. [ For example, the content execution module 310 may receive the information on the first broadcast VR content from the streamer terminal 100 and execute the same second broadcast VR game content as the first broadcast VR game content .

The content synchronization module 330 synchronizes the second broadcast VR game content and the first broadcast VR game content using the content progress information of the first broadcast VR game content received from the streamer terminal 100 in real time.

The panorama image rendering module 350 renders a 360 degree panorama image streamed to the viewer terminal 900 based on the second broadcast VR game content. Hereinafter, a method of rendering the 360-degree panoramic image by the panoramic image rendering module 350 will be described in detail with reference to FIGS. 7A and 7B.

7A shows an exemplary virtual space constructed on the second broadcast VR game contents. In the case where the first virtual object 10 and the second virtual object 20 exist in the virtual space in FIG. 7A and the second virtual object 20 is a virtual object played by the streamer 1, . Hereinafter, a description will be given with reference to FIG.

According to an embodiment of the present invention, the panorama image rendering module 350 may use the game image captured by the virtual camera 30 disposed adjacent to the second virtual object 20 in the virtual space, Lt; / RTI > For example, as shown in FIG. 7B, the virtual camera 30 rotates 360 degrees around the second virtual object 20 to capture the game image 40, and the panorama image rendering module 350 generates a game image The panoramic panoramic image can be rendered using the panoramic panoramic image 40. However, the method of rendering the 360-degree panorama image by the panorama image rendering module 350 is not limited to this, and any method may be used.

In the above-described embodiment, when the second virtual object 20 is moved according to the input of the streamer 1, the virtual camera 30 can be moved together with the second virtual object 20. [ Accordingly, viewers watching the live streaming broadcast can enjoy the broadcast VR game contents as if they are playing the VR game contents for direct broadcasting, so that the immersion feeling for the live streaming broadcast can be maximized.

Further, according to the above-described embodiment, since the 360-degree panoramic image is provided, the viewing area of the viewer may not be completely dependent on the viewing area of the streamer 1. More specifically, if the view direction of the viewer is changed from the first viewpoint to the second viewpoint, an image corresponding to the second viewpoint among the 360 degree panorama images is displayed on the viewer terminal 900 regardless of the viewpoint of the streamer 1, Lt; / RTI > Therefore, the viewer's field of view is not completely dependent on the field of view of the streamer 1, and accordingly the viewer who watches the VR content for broadcasting experiences the same feeling of reality and immersion as the streamer 1 without installing the VR game content .

The encoding module 370 encodes the rendered 360 degree panorama image.

In one embodiment, the encoding module 370 may adaptively encode the network state between the Internet broadcast platform 700 and the viewer terminal 900. [ For example, if the network condition is unstable (e.g., if there is a wireless network section) and the available bandwidth is not sufficient, the encoding module 370 may encode the 360 degree panorama image with a lower quality image than the preset reference quality . In the opposite case, the 360-degree panoramic image can be encoded with a predetermined reference image quality or a higher image quality.

In one embodiment, the encoding module 370 may perform encoding taking into account the computing capabilities of the viewer terminal 900. [ For example, when the viewer terminal 900 is a mobile terminal lacking computing capability, the encoding module 370 can perform encoding with a picture quality lower than a predetermined reference picture quality.

In one embodiment, encoding module 370 may encode the 360 degree panorama image using scalable video coding (SVC) techniques to selectively select image quality. In such a case, it is possible to change and stream the image quality of the 360-degree panorama image based on at least one of the conditions of the computing capability and the network state of the viewer terminal 900, and the panorama image transmission module 390, 500 or the Internet broadcasting platform 700 may adjust the image quality of the 360 degree panorama image based on the condition.

The panorama image transmission module 390 transmits the encoded 360 degree panorama image to the broadcasting management server 500. [

8 is a block diagram illustrating a broadcast web server 400 that is a component of a live streaming system for VR content in accordance with an embodiment of the present invention.

Referring to FIG. 8, the broadcast web server 400 may include a member information management module 410, an authentication module 430, a broadcast information management module 450, and a billing module 470. However, only the components related to the embodiment of the present invention are shown in Fig. Therefore, it will be understood by those skilled in the art that other general-purpose components other than the components shown in FIG. 8 may be further included.

Referring to the respective components, the membership information management module 410 manages information about streamer members. For example, the member information management module 410 may manage the streamer member information by DB. Here, the information about the streamer member may include authentication information such as a member ID and a password.

The authentication module 430 performs authentication for the streamer member. The authentication may be performed, for example, on an ID / password basis, but may be performed in any other manner.

The broadcast information management module 450 manages broadcast information about a streamer member. The broadcast information management module 450 can organize the broadcast information into a DB. Here, the broadcast information may include, for example, setting information for an Internet broadcasting platform, information on VR content for broadcasting, information on broadcasting rights, and the like.

The billing processing module 470 performs a billing process in accordance with the purchase of the broadcast rights in response to the streaming member purchase request of the streamer member. The method of performing the billing process may be performed by any method such as point, account transfer, card settlement, and the like.

According to the embodiment of the present invention, a live broadcast request of a streamer that has not purchased a broadcast right can be blocked. According to the present embodiment, streaming broadcasting is allowed only for a streamer purchased through a billing process, whereby a new profit structure can be formed for a provider of a live streaming system and / or an Internet broadcasting platform, and a high- There is a mass production effect.

FIG. 9 is a block diagram illustrating a broadcast management server 500, which is a component of a live streaming system for VR content according to an embodiment of the present invention.

Referring to FIG. 9, the broadcast management server 500 may include a panorama image receiving module 510 and a broadcast client managing module 530. In addition, the broadcast client management module 530 may be configured to include at least one broadcast client module 531 - 535. However, only components that are related to the embodiment of the present invention are shown in Fig. Therefore, it will be understood by those skilled in the art that other general-purpose components other than the components shown in FIG. 9 may be further included.

Referring to the respective components, the panorama image receiving module 510 receives the 360-degree panorama image rendered by the rendering server 300. Here, the 360-degree panorama image may be a properly-encoded 360-degree panorama image.

The broadcast client management module 530 manages at least one broadcast client module 531 through 535 linked to the pre-established internet broadcast platform 700.

According to an embodiment of the present invention, the broadcast client management module 530 may be configured to broadcast the broadcast client information to the corresponding broadcast client based on broadcast information of the stored streamer member and / or selection information of the Internet broadcast platform selected by the streamer member through the broadcast interface, You can run the module. In addition, the broadcast client management module 530 may stream the 360-degree panorama image to the viewer terminal 900 through the broadcast client module.

5, FIG. 6, FIG. 8, and FIG. 9 described above refer to software or a hardware such as an FPGA (Field Programmable Gate Array) or an ASIC (Application-Specific Integrated Circuit) . However, the components are not limited to software or hardware, and may be configured to be addressable storage media, and configured to execute one or more processors. The functions provided in the components may be implemented by a more detailed component, or may be implemented by a single component that performs a specific function by combining a plurality of components.

Up to now, the components of the live streaming system for VR content according to the embodiment of the present invention have been described with reference to FIG. 5 to FIG. Next, a live streaming method for VR content according to another embodiment of the present invention will be described in detail with reference to FIG.

Hereinafter, each step of the live streaming method according to the embodiment of the present invention can be performed by a system composed of a single computing device and / or a plurality of computing devices. For example, the system may be a live streaming system according to some embodiments of the present invention. However, for the sake of convenience of description, description of the operation subject of each step included in the live streaming method may be omitted. In addition, each step of the live streaming method may be implemented as an operation of a computer program executed by a processor.

10 is a flowchart of a live streaming method for VR content according to an embodiment of the present invention. However, it should be understood that the present invention is not limited thereto and that some steps may be added or deleted as needed. In FIG. 10, the rendering server 300 and the broadcasting management server 500 are implemented as a single server device.

Referring to FIG. 10, a game client module is executed in the streamer terminal 100 as a first step for performing live broadcasting on broadcast VR game contents (S10). The game client module includes the first VR game content for broadcasting, and the first VR game content for the broadcasting is also executed in step S10.

Next, an authentication procedure between the streamer terminal 100 and the broadcast web server 400 may be performed (S20). That is, a request to start a live broadcasting can be allowed only for a streamer registered as a streamer member.

Next, broadcast information about the streamer authenticated by the broadcast web server 400 is searched (S30), and the broadcast client module is executed in the broadcast management server 500 based on the searched broadcast information (S50) . Or, according to an embodiment, a broadcast client module may be executed that is linked to an Internet broadcast platform selected by the streamer through the streamer terminal 100. For reference, in step S50, a plurality of broadcast client modules may be executed. That is, the streamer may perform live streaming broadcasting through a plurality of Internet broadcasting platforms 700.

When the broadcast client module is executed, a broadcast generation request is transmitted to the relay server 200, and in response to the broadcast generation request, the relay server 200 generates a broadcast for the streamer in operation S70. In addition, the relay server 200 may connect the broadcasting client module and the game client module to the broadcasting room so that the game progress information may be relayed between the two modules (S80, S90).

Next, when the streamer terminal 100 plays the first broadcast VR game content by the streamer, the game progress information is delivered to the rendering server 300 through the relay server 200 in real time (S100 , S119, S120).

In response to the game progress information being received in real time, the rendering server 300 synchronizes the second broadcast VR game content with the first broadcast VR game content (S130), and based on the second broadcast VR game content, The panoramic image is also generated (S140).

Finally, the generated 360 degree panorama image is streamed to the viewer terminal 900 through the internet broadcasting platform 700 (S150, S160).

With reference to FIG. 10, a live broadcasting method for VR content according to an embodiment of the present invention has been described. According to the above-described method, the 360-degree panorama image for the broadcast VR game content is rendered in the rendering server 300, and the rendered 360-degree panorama image is streamed to the viewer terminal 900. Therefore, the experience of the broadcast VR game contents can be shared between the viewer and the streamer watching the streaming broadcast.

The concepts of the invention described above with reference to Figures 1 to 10 can be implemented in computer readable code on a computer readable medium. The computer readable recording medium may be, for example, a removable recording medium (CD, DVD, Blu-ray disk, USB storage device, removable hard disk) . The computer program recorded on the computer-readable recording medium may be transmitted to another computing device via a network such as the Internet and installed in the other computing device, thereby being used in the other computing device.

Although the operations are shown in the specific order in the figures, it should be understood that the operations need not necessarily be performed in the particular order shown or in a sequential order, or that all of the illustrated operations must be performed to achieve the desired result. In certain situations, multitasking and parallel processing may be advantageous. Moreover, the separation of the various configurations in the above-described embodiments should not be understood as such a separation being necessary, and the described program components and systems may generally be integrated together into a single software product or packaged into multiple software products .

While the present invention has been described in connection with what is presently considered to be practical exemplary embodiments, it is to be understood that the invention is not limited to the disclosed embodiments, but, on the contrary, I can understand that. It is therefore to be understood that the above-described embodiments are illustrative in all aspects and not restrictive.

Claims (16)

A streamer terminal for executing a VR (Virtual Reality) content and for streaming broadcasting for the VR content for broadcasting according to an input of a streamer;
A broadcast management server for responding to the streaming request of the streamer terminal to stream the 360-degree panorama image of the broadcast VR content to the viewer terminal using the established Internet broadcast platform; And
And a rendering server for rendering the 360-degree panoramic image,
Wherein the broadcast VR content is a first broadcast VR game content being executed by the streamer terminal,
The rendering server,
A content synchronization module for synchronizing a second broadcast VR game content identical to the first broadcast VR game content and being executed in the rendering server with the first broadcast VR game content in response to receiving game progress information from the streamer terminal, ; And
And a panorama image rendering module for rendering the 360-degree panorama image based on the second broadcast VR game content,
Wherein the panorama image rendering module renders the 360 degree panorama image using an image photographed by a virtual camera disposed adjacent to a virtual object in a virtual space constructed on the second broadcast VR content,
The virtual object is a virtual object controlled according to an input of the streamer,
Wherein the virtual camera is moved with the virtual object in the virtual space. The method according to claim 1,
The 360-
Wherein the streamer terminal is a video rendered by the streamer terminal based on the broadcast VR content being executed in the streamer terminal.
Live streaming system for VR content. delete delete The method according to claim 1,
Further comprising a broadcast web server for providing a web page service to the streamer,
The broadcast web server includes:
A member information management module for managing information on streamer members, and
And an authentication module for performing authentication on the streamer using information on the streamer member.
Live streaming system for VR content. 6. The method of claim 5,
The broadcast web server includes:
Further comprising a billing module for performing a billing process in response to the request for purchase of a rights ticket in response to a request for purchase of a rights ticket of the streamer terminal,
And the streaming request of the streamer terminal that has not purchased the broadcasting right is blocked.
Live streaming system for VR content. The method according to claim 1,
The streamer terminal,
Receiving a selection input for at least one streaming Internet broadcasting platform for streaming broadcasting for the broadcasting VR content among the established Internet broadcasting platforms,
The broadcast management server includes:
And a plurality of broadcast client modules linked with the pre-established Internet broadcast platform,
Selecting at least one broadcast client module operable with the at least one internet broadcasting platform for streaming among the plurality of broadcast client modules based on the selection input,
And the 360 degree panorama image is streamed using the selected at least one broadcast client module.
Live streaming system for VR content. The method according to claim 1,
And a relay server for generating and managing a broadcast channel for the streamer in response to the streaming request of the streamer terminal.
Live streaming system for VR content. A live streaming method for broadcast VR content performed by a live streaming system,
Receiving a streaming request for the broadcast VR content from a streamer terminal for streaming broadcast VR content; And
Streaming a 360 degree panorama image of the broadcast VR content to a viewer terminal using the pre-built Internet broadcast platform in response to the streaming request,
Wherein the broadcast VR content is a first broadcast VR game content being executed by the streamer terminal,
Wherein the step of streaming the 360 degree panorama image to a viewer terminal comprises:
Receiving game progress information from the streamer terminal;
Synchronizing a second broadcast VR game content with the first broadcast VR game content based on the game progress information in response to receiving the game progress information;
Rendering the 360 degree panorama image based on the second broadcast VR game content; And
And streaming the rendered 360 degree panorama image,
The rendering of the 360 degree panorama image may include rendering the 360 degree panorama image using an image photographed by a virtual camera disposed adjacent to a virtual object in a virtual space built on the second broadcast VR game content Comprising:
The virtual object is a virtual object controlled according to an input of the streamer,
Wherein the virtual camera is moved with the virtual object in the virtual space.
A method for live streaming to VR content. 10. The method of claim 9,
The 360-
Wherein the streamer terminal is a video rendered by the streamer terminal based on the broadcast VR content being executed in the streamer terminal.
A method for live streaming to VR content. delete delete 10. The method of claim 9,
Receiving an authentication request from the streamer terminal; And
Further comprising the step of authenticating the streamer based on the information about the registered streamer member,
And if the authentication fails, the streaming request is blocked.
A method for live streaming to VR content. 14. The method of claim 13,
Further comprising the step of performing billing processing in response to the request for purchase of a broadcast right in response to a request for purchase of a broadcast right of the streamer terminal,
And the streaming request of the streamer terminal that has not purchased the broadcasting right is blocked.
A method for live streaming to VR content. 10. The method of claim 9,
Further comprising the step of receiving, from the streamer terminal, a selection input for at least one internet broadcasting platform for streaming to be streamed for the broadcast VR content among the established Internet broadcasting platforms,
Wherein the step of streaming the 360 degree panorama image to a viewer terminal comprises:
Selecting at least one broadcast client module associated with the at least one Internet broadcasting platform for streaming among the plurality of broadcast client modules based on the received selection input; And
And streaming the 360-degree panoramic image using the selected at least one broadcast client module.
A method for live streaming to VR content. 10. The method of claim 9,
Further comprising generating a broadcast for the streamer in response to the streaming request of the streamer terminal.
A method for live streaming to VR content.

Images